-- Logs begin at Wed 2022-07-27 19:22:43 UTC, end at Wed 2022-07-27 21:08:05 UTC. -- Jul 27 19:59:25.800224 dv-cinder-799871-44-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 27 19:59:25.809918 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 27 19:59:25.811920 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 19:59:25 2022] *** Jul 27 19:59:25.811920 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 19:59:25.811920 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 19:59:25.811920 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: nodename: dv-cinder-799871-44-iscsi Jul 27 19:59:25.811920 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: machine: x86_64 Jul 27 19:59:25.811920 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: clock source: unix Jul 27 19:59:25.811920 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: pcre jit disabled Jul 27 19:59:25.811920 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: detected number of CPU cores: 4 Jul 27 19:59:25.811920 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: current working directory: / Jul 27 19:59:25.811920 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: detected binary path: /usr/bin/uwsgi-core Jul 27 19:59:25.812495 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: your processes number limit is 47680 Jul 27 19:59:25.812495 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: your memory page size is 4096 bytes Jul 27 19:59:25.812495 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: detected max file descriptor number: 2048 Jul 27 19:59:25.812495 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: lock engine: pthread robust mutexes Jul 27 19:59:25.812495 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: thunder lock: enabled Jul 27 19:59:25.812495 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 27 19:59:25.812495 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 19:59:25.852332 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: Python main interpreter initialized at 0x557762a9a9c0 Jul 27 19:59:25.852332 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: python threads support enabled Jul 27 19:59:25.852332 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: your server socket listen backlog is limited to 100 connections Jul 27 19:59:25.852332 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: your mercy for graceful operations on workers is 90 seconds Jul 27 19:59:25.852677 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 19:59:25.852741 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: *** Operational MODE: preforking *** Jul 27 19:59:25.853013 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: *** uWSGI is running in multiple interpreter mode *** Jul 27 19:59:25.853013 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: spawned uWSGI master process (pid: 103341) Jul 27 19:59:25.853206 dv-cinder-799871-44-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 27 19:59:25.853747 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: spawned uWSGI worker 1 (pid: 103342, cores: 1) Jul 27 19:59:25.854082 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: spawned uWSGI worker 2 (pid: 103343, cores: 1) Jul 27 19:59:25.854248 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 19:59:26.514305 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 19:59:26.528925 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 19:59:27.592131 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 19:59:27.592131 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: from cryptography.utils import int_from_bytes Jul 27 19:59:27.592836 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 19:59:27.592836 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: from cryptography.utils import int_from_bytes Jul 27 19:59:27.617973 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 19:59:27.617973 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: from cryptography.utils import int_from_bytes Jul 27 19:59:27.618443 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 19:59:27.618443 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: from cryptography.utils import int_from_bytes Jul 27 19:59:30.071728 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 19:59:30.072315 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 19:59:30.072474 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 19:59:30.072832 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 19:59:30.073112 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 19:59:30.073497 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.073816 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.074131 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.074469 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.074756 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.075061 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.075378 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.075694 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.076018 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.076117 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 19:59:30.076474 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.076557 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 19:59:30.076649 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.076859 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 19:59:30.076991 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-44-iscsi {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.077207 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.077300 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 19:59:30.077485 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 19:59:30.077579 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.077807 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.077907 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.078122 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.078224 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.078422 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.078601 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.078742 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.078884 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.079020 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.079165 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.079391 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.079525 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.079712 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.079922 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.080077 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.080214 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.080367 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.080511 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.080647 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.080836 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.080942 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.081173 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.081263 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-44-iscsi {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.081478 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.081566 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.081793 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.081896 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.082095 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.082182 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.082414 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.082507 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.082715 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.082809 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.083036 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.083123 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-44-iscsi {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.083341 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.083436 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.083704 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.083846 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.084012 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.084184 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.084419 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.084515 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.084726 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.084812 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.085055 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.085157 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.085877 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.085970 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.086209 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.086496 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.086630 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.086822 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.086949 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.087138 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.087279 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.087455 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.087578 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.087771 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.087885 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.088070 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.088220 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-44-iscsi {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.088372 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.088538 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.088677 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.088853 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.089078 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.089204 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.089387 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.089597 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.089742 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.089908 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.090043 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.090206 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.090332 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.090524 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.090651 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.090840 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.090967 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.091148 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.091272 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.091396 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.091520 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.091651 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.091775 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.091923 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.092086 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.092238 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.092405 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.092533 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.092703 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.092840 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.093029 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.093139 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.093344 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.093432 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.093665 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.093752 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.093972 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.094062 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.094289 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.094414 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.094539 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.094704 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.094838 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.094967 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.095153 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.095299 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.095476 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.095613 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.095780 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.095925 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.096068 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.096196 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.096340 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.096482 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.096616 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.096768 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.096910 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.097092 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.097224 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.097357 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.097499 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.097632 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.097774 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.097908 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.098058 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.098223 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.098436 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.098578 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.098712 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.098826 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.098924 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.099126 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.099222 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.099427 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.099521 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.099740 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.099827 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.100073 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.100176 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.100376 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.100469 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.100621 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.100709 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.100917 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.101730 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.101823 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.102095 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.102181 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.102404 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.102597 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.102686 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.102949 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.103043 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.103272 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.103361 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.103571 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.103667 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.103869 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.103955 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.104168 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.104257 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.104471 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.104569 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.104768 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.104862 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.105092 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.105183 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.105396 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.105487 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.105695 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.105784 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.105995 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.106091 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.106279 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.106365 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.106581 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.106674 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.106889 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.106984 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.107186 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.107278 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.107486 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.107586 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.107787 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.107887 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.108089 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.108174 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.108388 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.108480 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.108687 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.108786 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.109006 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.109104 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.109314 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.109402 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.109615 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.109714 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.109916 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.110003 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.110218 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.110302 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.110517 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.110613 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.110818 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.110902 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.111112 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.111205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.111411 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.111499 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.111721 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.111808 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.112021 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.112117 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.112320 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.112407 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.112614 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.112698 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.112910 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.113029 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.113237 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.113410 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.113536 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.113624 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.113831 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.113918 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.114127 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.114222 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.114420 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.114521 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.114729 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.114825 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.115035 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.115122 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.115338 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.115429 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.115637 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.115730 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.115937 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.116025 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.116235 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.116320 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.116539 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.116652 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.116984 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.117118 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.117554 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.117642 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.117928 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.118023 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.118243 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.118336 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.118554 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.118648 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.118863 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.118973 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.119173 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.119268 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.119481 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.119568 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.119788 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.119887 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.120091 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.120185 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.120409 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.120503 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.120714 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.120801 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.121049 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.121137 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.121359 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.121445 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.121666 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.121754 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.121980 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.122065 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 19:59:30.122294 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.122380 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.122608 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.122703 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.122915 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.123002 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.123231 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.123334 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.123556 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.123646 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.123873 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.123960 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.124179 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.124322 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.124504 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.124591 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.124819 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.124923 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.125166 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.125254 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.125474 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.125562 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.125784 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.125872 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.126087 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.126182 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.126395 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.126483 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.126700 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.126787 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.127015 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.127110 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.127330 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.127416 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.127637 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.127731 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.127951 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.128049 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.128256 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.128343 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.128564 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.128651 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.128869 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.128984 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.129203 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.129306 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.129511 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.129605 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.129843 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.129931 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.130154 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.130241 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.130465 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.130551 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.130773 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.130860 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.131084 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.131170 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.131392 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.131479 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.131700 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.131786 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.132002 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.132098 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.132363 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.132458 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.132695 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.132934 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.133075 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.133280 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.133366 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.133605 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.133700 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.133920 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.134005 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.134239 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.134365 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.134541 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.134636 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.134858 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.134979 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.135162 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.135257 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.135469 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.135578 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.135776 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.135873 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.136081 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.136168 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.136385 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.136473 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.136691 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.136777 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.137019 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.137130 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.137327 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.137415 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.137635 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.137721 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.137942 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.138036 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.138242 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.138328 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.138544 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.138635 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.138851 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.138950 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.139152 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.139244 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.139461 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.139547 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.139771 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.139866 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.140076 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.140162 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.140383 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.140475 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.140691 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.140780 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.141020 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.141109 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.141334 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.141422 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.141641 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.141735 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.141948 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.142034 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.142259 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.142346 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.142568 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.142655 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.142872 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.142958 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.143196 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.143289 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.143507 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.143594 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.143808 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.143895 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.144117 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.144217 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.144418 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.144514 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.144719 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.144812 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.145046 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.145163 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.145350 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.145438 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.145650 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.145736 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.145951 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.146050 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.146252 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.146339 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.146552 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.146639 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.146853 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.146949 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.147163 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.147249 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.147466 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.147553 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.147766 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.148351 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.148603 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.148729 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.148905 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.149273 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.149450 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.149580 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.149668 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.149912 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.149997 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.150222 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.150318 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.150537 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.150623 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.150844 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.150929 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.151151 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.151244 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.151455 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.151541 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.151760 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.151845 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.152061 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.152154 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.152365 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.152451 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.152668 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.152754 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.152986 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.153077 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.153299 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.153387 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.153618 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.153704 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.153924 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.154020 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.154227 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.154313 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.154534 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.154620 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.154839 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.154927 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.155139 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.155234 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.155450 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.155537 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.155788 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.155884 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.156119 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.156209 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.156433 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.156528 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.156750 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.156837 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.157083 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.157193 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.157393 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.157488 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.157698 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.157792 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.158004 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.158090 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.158310 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.158405 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.158618 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.158704 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.158930 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.159014 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.159240 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.159333 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.159554 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.159641 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.159859 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.159945 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.160178 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.160266 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.160483 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.160568 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.160797 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.160881 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.161118 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.161205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.161431 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.161516 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.161755 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.161851 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.162088 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.162177 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.162395 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.162481 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.162702 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.162791 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.163008 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.163095 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.163313 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.163405 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.164165 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.164279 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.164479 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.164781 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.164891 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.165102 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.165203 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.165413 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.165511 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.165724 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.165819 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.166034 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.166121 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.166343 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.166431 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.166647 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.166734 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.166960 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.167061 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.167267 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.167355 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.167567 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.167653 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.167868 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.167955 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.168176 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.168271 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.168496 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.168589 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.168803 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.168900 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.169145 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.169246 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.169461 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.169549 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.169760 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.169854 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.170060 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.170154 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.170375 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.170460 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.170679 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.170772 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.170980 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.171065 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.171277 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.171363 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.171577 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.171682 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.171889 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.171975 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.172199 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.172286 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.172497 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.172584 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.172802 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.172895 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.173138 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.173227 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.173443 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.173531 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.173746 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.173832 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.174048 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.174135 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.174354 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.174445 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.174672 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.174800 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.174985 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.175079 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.175288 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.175375 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.175597 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.175702 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.175902 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.175999 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.176205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.176292 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.176508 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.176595 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.176825 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.176920 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.177157 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.177246 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.177462 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.177548 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.177763 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.177861 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.178062 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.178155 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.178367 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.178460 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.178678 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.178850 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.178997 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.179377 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.179558 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.179716 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.179999 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.180095 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.180326 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.180413 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.180642 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.180729 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.180956 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.181071 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.181304 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.181392 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.181643 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.181732 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.181938 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.182027 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.182244 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.182340 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.182553 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.182646 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.182858 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.182953 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.183165 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.183259 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.183475 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.183569 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.183784 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.183884 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.184086 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.184171 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.184390 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.184476 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.184698 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.184796 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.185020 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.185111 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.185328 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.185418 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.185636 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.185894 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.185993 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.186234 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.186331 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.186532 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.186631 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.186842 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.186937 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.187146 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.187233 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.187467 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.187567 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.187774 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.187861 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.188076 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.188162 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.188377 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.188472 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.188679 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.188780 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.189045 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.189136 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.189349 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.189453 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.189654 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.189741 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.189966 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.190053 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.190275 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.190369 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.190582 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.190676 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.190888 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.190978 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.191451 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.191551 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.191755 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.191843 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.192056 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.192143 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.192357 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.192459 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.192661 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.192766 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.192985 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.193077 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.193291 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.193390 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.193599 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.193686 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.193903 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.193990 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.194210 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.194306 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.194515 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.194602 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.195331 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.195484 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.195714 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.195888 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.196009 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.196239 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.196337 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.196542 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.196647 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.196843 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.197547 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.197655 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.197761 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.197868 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.197868 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.198086 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.198190 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.198294 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.198397 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.198512 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.198693 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.198808 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.199006 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.199119 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.199309 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.199572 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.199887 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.200198 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.200513 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.200826 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.201159 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.201269 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.201474 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.201586 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.201802 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.201916 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.202123 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.202228 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.202441 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.202584 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.202775 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.202895 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.203095 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.203212 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.203409 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.203632 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.203737 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.203963 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.204083 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.204321 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.204410 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.204627 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.204722 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.204934 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.205161 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.205275 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.205391 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.205601 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.205713 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.205910 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.206022 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.206219 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.206408 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.206524 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.206722 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.206830 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.207045 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.207141 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.207356 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.207453 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.207666 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.207761 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.207974 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.208061 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.208270 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.208363 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.208572 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.208668 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.208875 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.208983 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.209221 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.209321 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.209528 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.209626 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.209831 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.209917 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.210130 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.210217 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.210488 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.210582 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.211422 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.211517 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.211790 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.211920 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.212172 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.212269 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.212481 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.212569 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.212797 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.212884 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.213147 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.213251 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.213461 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.213549 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.213776 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.213863 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.214082 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.214170 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.214383 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.214470 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.214696 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.214849 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.215000 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.215087 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.215305 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.215392 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.215606 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.215763 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.215926 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.216059 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.216215 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.216302 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.216521 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.216618 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.216829 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.216916 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.217166 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.217253 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.217473 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.217572 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.217776 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.217863 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.218085 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.218172 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.218395 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.218484 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.218705 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.218791 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.219012 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.219117 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.219321 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.219411 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.219630 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.219718 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.219942 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.220028 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.220252 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.220339 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.220562 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.220654 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.220864 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.220957 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.221207 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.221296 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.221513 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.221607 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.221823 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.221910 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.222129 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.222217 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.222431 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.222516 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.222753 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.222851 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.223058 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.223144 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.223360 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.223453 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.223673 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.223770 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.223976 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.224063 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.224284 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.224371 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.224587 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.224683 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.224907 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.225048 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.225246 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.225343 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.225558 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.225654 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.225871 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.225984 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.226314 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.226440 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.226761 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.226879 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.227077 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.227211 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.227390 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.227529 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.227694 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.227845 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.228111 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.228198 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.228421 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.228515 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.228732 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.228820 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.229064 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.229156 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.229369 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.229458 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.229671 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.229759 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.229978 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.230066 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.230281 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.230376 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.230588 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.230676 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.230889 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.230975 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.231186 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.231279 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.231493 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.231579 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.231792 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.231926 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.232110 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.232239 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.232520 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.232614 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.232829 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.232915 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.233163 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.233266 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.233476 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.233570 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.233791 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.233885 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.234107 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.234196 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.234412 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.234499 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.234770 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.234857 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.235094 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.235194 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.235396 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.235483 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.235708 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.235797 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.236014 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.236102 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.236316 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.236401 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.236627 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.236714 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.236933 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.237058 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.237270 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.237357 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.237570 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.237670 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.237873 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.237959 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.238196 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.238290 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.238498 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.238592 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.238816 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.238920 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.239228 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.239316 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.239535 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.239620 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.239839 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.239934 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.240156 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.240250 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.240476 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.240563 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.240777 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.240873 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.241104 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.241195 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.241413 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.241503 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.241748 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.241929 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.242029 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.242451 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.242546 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.242766 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.242867 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.243079 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.243167 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.243390 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.243477 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.243703 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.243800 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.244005 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.244093 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.244307 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.244402 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.244617 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.244712 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.244914 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.245031 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.245259 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.245347 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.245573 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.245737 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.245897 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.245991 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.246212 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.246298 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.246514 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.246625 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.246836 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.246930 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.247142 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.247239 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.247443 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.247539 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.247742 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.247837 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.248044 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.248131 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.248385 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.248481 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.248688 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.248775 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.249028 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.249119 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.249359 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.249449 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.249686 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.249780 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.249994 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.250094 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.250303 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.250389 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.250613 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.250702 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.250920 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.251020 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.251225 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.251311 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.251550 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.251636 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.251851 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.251946 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.252154 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.252242 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.252463 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.252549 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.252766 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.252861 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.253098 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.253190 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.253403 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.253490 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.253715 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.253803 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.254016 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.254105 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.254317 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.254403 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.254615 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.254703 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.254919 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.255004 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.255226 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.255319 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.255546 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.255635 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.255853 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.255940 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.256156 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.256253 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.256459 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.256547 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.256758 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.256853 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.257123 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.257758 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.258017 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.258264 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.258360 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.258634 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.258728 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.258961 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.259057 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.259284 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.259371 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.259590 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.259676 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.259900 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.259990 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.260211 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.260298 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.260518 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.260614 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.260825 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.260913 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.261158 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.261249 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.261470 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.261566 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.261775 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.261862 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.262080 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.262168 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.262385 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.262481 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.262700 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.262788 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.263003 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.263089 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.263313 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.263407 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.263623 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.263850 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.263937 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.264187 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.264274 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.264505 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.264594 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.264818 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.264913 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.265159 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.265305 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.265473 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.265561 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.265785 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.265874 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.266095 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.266195 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.266404 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.266491 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.266712 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.266799 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.267020 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.267120 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.267338 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.267425 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.267657 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.267751 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.267975 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.268071 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.268293 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.268388 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.268606 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.268693 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.268919 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.269064 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.269256 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.269343 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.269567 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.269653 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.269887 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.269985 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.270206 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.270296 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.270509 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.270608 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.270822 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.271046 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.271133 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.271377 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.271464 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.271698 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.271788 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.272014 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.272107 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.272321 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.272409 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.272630 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.272719 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.273004 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.273597 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.273813 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.274085 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.274186 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.274427 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.274669 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.274765 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.275149 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.275247 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.275472 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.275560 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.275795 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.275880 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.276108 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.276271 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.276413 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.276498 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.276767 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.276927 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.277126 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.277268 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.277447 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.277602 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.277765 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.277927 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.278085 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.278250 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.278445 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.278565 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.278764 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.278864 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.279075 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.279191 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.279392 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.279480 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.279711 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.279812 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.280029 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.280118 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.280341 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.280436 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.280654 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.280750 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.280987 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.281123 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.281295 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.281383 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.281596 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.281697 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.281908 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.281995 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.282211 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.282298 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.282525 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.282738 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.282849 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.283082 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.283190 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.283397 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.283515 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.283721 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.283831 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.284048 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.284135 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.284362 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.284459 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.284666 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.284982 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.285073 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.285300 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.285399 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.285601 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.285691 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.285913 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.286001 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.286218 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.286315 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.286522 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.286610 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.286821 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.286909 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.287129 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.287226 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.287432 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.287520 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.287731 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.287827 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.288037 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.288140 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.288337 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.288425 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.288726 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.288814 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.289185 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.289329 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.289628 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.289918 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.290039 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.290230 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.290326 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.290533 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.290620 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.290836 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.290923 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.291139 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.291381 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.291476 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.291730 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.291826 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.292027 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.292113 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.292330 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.292420 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.292632 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.292719 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.292940 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.293078 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.293264 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.293351 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.293569 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.293656 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.293907 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.294004 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.294217 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.294352 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.294515 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.294601 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.294816 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.294913 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.295124 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.295217 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.295425 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.295513 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.295732 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.295831 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.296036 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.296122 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.296338 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.296424 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.296649 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.296738 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.296953 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.297054 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.297303 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.297515 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.297612 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.297846 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.297940 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.298163 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.298251 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.298489 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.298591 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.298797 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.298885 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.299100 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.299186 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.299400 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.299495 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.299698 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.299785 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.300006 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.300092 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.300307 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.300402 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.300609 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.300704 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.300909 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.301016 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.301244 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.301333 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.301547 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.301633 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.301851 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.301938 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.302153 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.302241 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.302456 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.302545 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.302758 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.302846 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.303062 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.303151 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.303368 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.303456 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.303671 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.303767 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.303980 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.304095 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.304377 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.304505 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.304725 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.304943 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.305098 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.305368 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.305456 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.305693 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.305780 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.306005 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.306231 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.306319 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.306570 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.306714 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.306893 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.307033 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.307197 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.307284 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.307504 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.307634 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.307817 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.307906 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.308131 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.308217 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.308437 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.308525 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.308735 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.308823 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.309079 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.309170 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.309391 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.309478 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.309702 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.309798 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.310013 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.310108 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.310324 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.310420 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.310633 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.310721 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.310942 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.311037 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.311251 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.311347 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.311559 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.311646 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.311860 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.311954 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.312166 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.312265 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.312474 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.312562 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.312783 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.312878 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.313114 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.313205 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.313432 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.313534 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.313730 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.313825 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.314037 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.314126 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.314344 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.314438 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.314659 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.314748 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.314963 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.315052 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.315262 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.315351 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.315560 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.315657 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.315865 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.315953 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.316420 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.316513 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.316717 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.316817 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.317038 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.317140 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.317340 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.317428 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.317642 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.317738 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.317939 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.318060 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.318237 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.318373 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.318534 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.318693 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.318832 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.319024 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.319151 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.319326 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.319422 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.319649 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.320276 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.320560 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.320717 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.320861 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.321244 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.321336 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.321578 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.321665 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.321923 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.322025 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.322209 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.322308 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.322541 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.322629 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.322851 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.322947 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.323170 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.323258 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.323477 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.323573 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.323783 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.323877 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.324083 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.324170 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.324392 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.324478 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.324711 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.324811 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.325040 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.325130 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.325348 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.325436 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.325653 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.325752 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.325965 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.326054 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.326267 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.326356 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.326567 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.326661 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.326870 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.326958 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.327171 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.327258 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.327472 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.327561 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.327772 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.327857 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.328077 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.328164 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.328381 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.328470 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.328683 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.328771 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.329007 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.329113 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.329315 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.329410 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.329623 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.329710 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.329927 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.330022 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.330228 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.330315 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.330531 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.330618 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.330836 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.330932 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.331137 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.331232 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.331442 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.331530 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.331747 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.331843 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.332059 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.332146 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.332366 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.332459 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.332672 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.332761 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.333006 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.333107 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.333319 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.333406 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.333637 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.333725 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.333955 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.334042 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.334259 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.334344 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.334564 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.334651 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.334894 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.334980 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.335206 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.335408 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.336089 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.336185 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.336432 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.336695 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.336784 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.337049 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.337144 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.337371 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.337461 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.337678 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.337763 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.337918 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 19:59:30.338008 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.338316 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.338625 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.338952 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.339272 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.339594 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.339912 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.340225 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.340556 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.340866 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.341203 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.341517 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.341830 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.342141 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.342459 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.342769 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.343079 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.343395 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.343711 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.344039 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.344370 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.344682 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.345032 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.345362 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.345712 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.346030 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.347195 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.347195 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.347195 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.347429 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.347601 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 19:59:30.347843 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 19:59:30.492269 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO dbcounter [None req-7637a368-284b-4ef8-9095-e326891f99f3 None None] Registered counter for database nova_api Jul 27 19:59:30.506988 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO dbcounter [None req-62a168c6-d53b-433f-b7f1-6c4dbd6a4219 None None] Registered counter for database nova_api Jul 27 19:59:30.514918 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG oslo_db.sqlalchemy.engines [None req-7637a368-284b-4ef8-9095-e326891f99f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 19:59:30.521326 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writer thread running {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 19:59:30.528300 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG oslo_db.sqlalchemy.engines [None req-62a168c6-d53b-433f-b7f1-6c4dbd6a4219 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 19:59:30.534694 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writer thread running {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 19:59:30.578321 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.context [None req-7637a368-284b-4ef8-9095-e326891f99f3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9601e96c-4523-4233-9a0d-7b0bfdd5753a(cell1) {{(pid=103342) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 19:59:30.582220 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-7637a368-284b-4ef8-9095-e326891f99f3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 19:59:30.583767 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-7637a368-284b-4ef8-9095-e326891f99f3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 19:59:30.584560 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-7637a368-284b-4ef8-9095-e326891f99f3 None None] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 19:59:30.586699 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-7637a368-284b-4ef8-9095-e326891f99f3 None None] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 19:59:30.588647 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO dbcounter [None req-7637a368-284b-4ef8-9095-e326891f99f3 None None] Registered counter for database nova_cell0 Jul 27 19:59:30.591862 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.context [None req-62a168c6-d53b-433f-b7f1-6c4dbd6a4219 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9601e96c-4523-4233-9a0d-7b0bfdd5753a(cell1) {{(pid=103343) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 19:59:30.594020 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO dbcounter [None req-7637a368-284b-4ef8-9095-e326891f99f3 None None] Registered counter for database nova_cell1 Jul 27 19:59:30.596021 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-62a168c6-d53b-433f-b7f1-6c4dbd6a4219 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 19:59:30.597613 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-62a168c6-d53b-433f-b7f1-6c4dbd6a4219 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 19:59:30.598412 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-62a168c6-d53b-433f-b7f1-6c4dbd6a4219 None None] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 19:59:30.600406 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-62a168c6-d53b-433f-b7f1-6c4dbd6a4219 None None] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 19:59:30.601100 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG oslo_db.sqlalchemy.engines [None req-7637a368-284b-4ef8-9095-e326891f99f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 19:59:30.602865 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO dbcounter [None req-62a168c6-d53b-433f-b7f1-6c4dbd6a4219 None None] Registered counter for database nova_cell0 Jul 27 19:59:30.603259 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG oslo_db.sqlalchemy.engines [None req-7637a368-284b-4ef8-9095-e326891f99f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 19:59:30.608164 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writer thread running {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 19:59:30.608451 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO dbcounter [None req-62a168c6-d53b-433f-b7f1-6c4dbd6a4219 None None] Registered counter for database nova_cell1 Jul 27 19:59:30.610906 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writer thread running {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 19:59:30.615316 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG oslo_db.sqlalchemy.engines [None req-62a168c6-d53b-433f-b7f1-6c4dbd6a4219 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 19:59:30.617142 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG oslo_db.sqlalchemy.engines [None req-62a168c6-d53b-433f-b7f1-6c4dbd6a4219 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 19:59:30.623805 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writer thread running {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 19:59:30.626038 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writer thread running {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 19:59:30.752743 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO dbcounter [None req-7637a368-284b-4ef8-9095-e326891f99f3 None None] Registered counter for database nova_cell0 Jul 27 19:59:30.760384 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG oslo_db.sqlalchemy.engines [None req-7637a368-284b-4ef8-9095-e326891f99f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 19:59:30.764641 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writer thread running {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 19:59:30.772204 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO dbcounter [None req-62a168c6-d53b-433f-b7f1-6c4dbd6a4219 None None] Registered counter for database nova_cell0 Jul 27 19:59:30.779483 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG oslo_db.sqlalchemy.engines [None req-62a168c6-d53b-433f-b7f1-6c4dbd6a4219 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 19:59:30.783745 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writer thread running {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 19:59:31.104083 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: WARNING keystonemiddleware.auth_token [None req-7637a368-284b-4ef8-9095-e326891f99f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 19:59:31.108154 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: WARNING keystonemiddleware.auth_token [None req-62a168c6-d53b-433f-b7f1-6c4dbd6a4219 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 19:59:31.111454 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: WARNING keystonemiddleware.auth_token [None req-7637a368-284b-4ef8-9095-e326891f99f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 19:59:31.115362 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: WARNING keystonemiddleware.auth_token [None req-62a168c6-d53b-433f-b7f1-6c4dbd6a4219 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 19:59:31.459289 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: WARNING keystonemiddleware.auth_token [None req-7637a368-284b-4ef8-9095-e326891f99f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 19:59:31.464131 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: WARNING keystonemiddleware.auth_token [None req-62a168c6-d53b-433f-b7f1-6c4dbd6a4219 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 19:59:31.465899 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: WARNING keystonemiddleware.auth_token [None req-7637a368-284b-4ef8-9095-e326891f99f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 19:59:31.470080 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: WARNING keystonemiddleware.auth_token [None req-62a168c6-d53b-433f-b7f1-6c4dbd6a4219 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 19:59:31.471176 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557762a9a9c0 pid: 103342 (default app) Jul 27 19:59:31.473302 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-7637a368-284b-4ef8-9095-e326891f99f3 None None] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 19:59:31.474489 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-7637a368-284b-4ef8-9095-e326891f99f3 None None] 10.222.0.65 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001782 Jul 27 19:59:31.474901 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 788 bytes} [Wed Jul 27 19:59:31 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 19:59:31.475369 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557762a9a9c0 pid: 103343 (default app) Jul 27 20:00:47.072259 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-7637a368-284b-4ef8-9095-e326891f99f3 None None] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:00:47.073910 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-7637a368-284b-4ef8-9095-e326891f99f3 None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002079 Jul 27 20:00:47.077913 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 2/2] 10.222.0.65 () {54 vars in 930 bytes} [Wed Jul 27 20:00:47 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:00:47.087042 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_api:SELECT=3 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:00:47.088686 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_cell0:SELECT=3 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:00:47.089748 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_cell1:SELECT=3 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:00:47.091038 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_cell0:SELECT=3 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:00:47.952955 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-bb395a0e-bd08-4126-91c1-e57c8494d590 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:00:47.984797 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-bb395a0e-bd08-4126-91c1-e57c8494d590 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.903517 Jul 27 20:00:47.985558 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 1/3] 10.222.0.65 () {60 vars in 1291 bytes} [Wed Jul 27 20:00:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:00:50.235546 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-7637a368-284b-4ef8-9095-e326891f99f3 None None] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:00:50.238826 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-7637a368-284b-4ef8-9095-e326891f99f3 None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003149 Jul 27 20:00:50.239506 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 3/4] 10.222.0.65 () {54 vars in 930 bytes} [Wed Jul 27 20:00:50 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:00:50.695523 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-797da353-982a-4f2f-87d0-50f2f2930a07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "id": "c1", "ram": 256, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:00:50.717786 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:00:50.717786 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: warnings.warn(msg) Jul 27 20:00:50.748798 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-797da353-982a-4f2f-87d0-50f2f2930a07 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.503263 Jul 27 20:00:50.750781 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 2/5] 10.222.0.65 () {64 vars in 1282 bytes} [Wed Jul 27 20:00:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:00:50.764497 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_api:SELECT=3 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:00:50.765837 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_cell1:SELECT=3 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:00:50.767001 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_cell0:SELECT=3 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:00:50.767755 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:00:50.978402 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-8c72cb2d-015f-42a9-ba7c-a7eee6989ae2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:00:50.982709 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:00:50.982709 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: warnings.warn(msg) Jul 27 20:00:51.048439 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-8c72cb2d-015f-42a9-ba7c-a7eee6989ae2 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289106 Jul 27 20:00:51.049290 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 4/6] 10.222.0.65 () {64 vars in 1335 bytes} [Wed Jul 27 20:00:50 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:00:53.272863 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-797da353-982a-4f2f-87d0-50f2f2930a07 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:00:53.273920 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-797da353-982a-4f2f-87d0-50f2f2930a07 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Jul 27 20:00:53.274495 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 3/7] 10.222.0.65 () {54 vars in 930 bytes} [Wed Jul 27 20:00:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:00:53.935987 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-4ae0a81a-738f-4c30-85d9-3ada312dc3f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "swap": 0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "ram": 512}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:00:53.956365 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:00:53.956365 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: warnings.warn(msg) Jul 27 20:00:53.977640 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-4ae0a81a-738f-4c30-85d9-3ada312dc3f1 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.695612 Jul 27 20:00:53.985031 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 5/8] 10.222.0.65 () {64 vars in 1282 bytes} [Wed Jul 27 20:00:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:00:53.993398 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-78113f90-b5c4-4373-a733-e1712222c260 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:00:53.996902 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:00:53.996902 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: warnings.warn(msg) Jul 27 20:00:54.031648 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-78113f90-b5c4-4373-a733-e1712222c260 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042270 Jul 27 20:00:54.032347 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 4/9] 10.222.0.65 () {64 vars in 1335 bytes} [Wed Jul 27 20:00:53 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:00:56.284158 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-4ae0a81a-738f-4c30-85d9-3ada312dc3f1 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:00:56.285656 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-4ae0a81a-738f-4c30-85d9-3ada312dc3f1 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001723 Jul 27 20:00:56.286586 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 6/10] 10.222.0.65 () {54 vars in 930 bytes} [Wed Jul 27 20:00:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:00:56.693302 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-c8371d17-121b-4399-a38b-c046f7150179 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d2", "os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1, "rxtx_factor": 1.0, "ram": 1024}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:00:56.711750 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-c8371d17-121b-4399-a38b-c046f7150179 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.419171 Jul 27 20:00:56.712348 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 5/11] 10.222.0.65 () {64 vars in 1282 bytes} [Wed Jul 27 20:00:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:00:56.724723 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-0036d4c1-9b1e-41af-9fb1-07eb0f34770a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:00:56.750204 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-0036d4c1-9b1e-41af-9fb1-07eb0f34770a admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029691 Jul 27 20:00:56.751368 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 7/12] 10.222.0.65 () {64 vars in 1335 bytes} [Wed Jul 27 20:00:56 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:00:58.959535 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-c8371d17-121b-4399-a38b-c046f7150179 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:00:58.960557 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-c8371d17-121b-4399-a38b-c046f7150179 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 27 20:00:58.960957 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 6/13] 10.222.0.65 () {54 vars in 930 bytes} [Wed Jul 27 20:00:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:00:59.409393 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-75f2e17b-a80f-4e30-a048-52e503db7761 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "id": "d3", "swap": 0, "vcpus": 2, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:00:59.445364 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-75f2e17b-a80f-4e30-a048-52e503db7761 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.477028 Jul 27 20:00:59.446251 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 8/14] 10.222.0.65 () {64 vars in 1282 bytes} [Wed Jul 27 20:00:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:00:59.460275 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-88afc56e-248c-41b7-a047-5860521d741d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:00:59.497473 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-88afc56e-248c-41b7-a047-5860521d741d admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042152 Jul 27 20:00:59.498760 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 7/15] 10.222.0.65 () {64 vars in 1335 bytes} [Wed Jul 27 20:00:59 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:01:01.722118 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-75f2e17b-a80f-4e30-a048-52e503db7761 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:01.727186 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-75f2e17b-a80f-4e30-a048-52e503db7761 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005476 Jul 27 20:01:01.727829 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 9/16] 10.222.0.65 () {54 vars in 930 bytes} [Wed Jul 27 20:01:01 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:01:02.174041 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-c426e98c-f7f4-4136-b6df-e70448623d05 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 20, "id": "d4", "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:01:02.194008 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-c426e98c-f7f4-4136-b6df-e70448623d05 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.459277 Jul 27 20:01:02.195365 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 8/17] 10.222.0.65 () {64 vars in 1282 bytes} [Wed Jul 27 20:01:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:01:02.207977 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-c63e62fd-5e7e-4f95-a4c4-8010b914af3f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:01:02.232732 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-c63e62fd-5e7e-4f95-a4c4-8010b914af3f admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029388 Jul 27 20:01:02.233351 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 10/18] 10.222.0.65 () {64 vars in 1335 bytes} [Wed Jul 27 20:01:02 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:01:04.507145 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-c426e98c-f7f4-4136-b6df-e70448623d05 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:04.508168 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-c426e98c-f7f4-4136-b6df-e70448623d05 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 27 20:01:04.508575 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 9/19] 10.222.0.65 () {54 vars in 930 bytes} [Wed Jul 27 20:01:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:01:04.989458 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-c191340b-f654-49c8-a660-e71407f7fc96 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:05.022434 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-c191340b-f654-49c8-a660-e71407f7fc96 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.507188 Jul 27 20:01:05.023269 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 11/20] 10.222.0.65 () {60 vars in 1291 bytes} [Wed Jul 27 20:01:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:01:07.294007 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-c426e98c-f7f4-4136-b6df-e70448623d05 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:07.295312 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-c426e98c-f7f4-4136-b6df-e70448623d05 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001930 Jul 27 20:01:07.295849 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 10/21] 10.222.0.65 () {54 vars in 930 bytes} [Wed Jul 27 20:01:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:01:07.741221 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-c5eafd9f-0ca5-4fc2-92fa-5ce726c32ee4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "id": "1", "rxtx_factor": 1.0}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:01:07.760225 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-c5eafd9f-0ca5-4fc2-92fa-5ce726c32ee4 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.457944 Jul 27 20:01:07.760791 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 12/22] 10.222.0.65 () {64 vars in 1282 bytes} [Wed Jul 27 20:01:07 2022] POST /compute/v2.1/flavors => generated 402 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:01:07.773931 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-8263d07e-2bde-40b4-a1fe-a2b91c554da0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:01:07.812547 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-8263d07e-2bde-40b4-a1fe-a2b91c554da0 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042858 Jul 27 20:01:07.813349 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 11/23] 10.222.0.65 () {64 vars in 1332 bytes} [Wed Jul 27 20:01:07 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:01:10.139518 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-c5eafd9f-0ca5-4fc2-92fa-5ce726c32ee4 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:10.140667 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-c5eafd9f-0ca5-4fc2-92fa-5ce726c32ee4 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001638 Jul 27 20:01:10.141195 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 13/24] 10.222.0.65 () {54 vars in 930 bytes} [Wed Jul 27 20:01:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:01:10.537391 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-a3fe1d6f-c832-47fe-a87e-be79ca65c4d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "m1.small", "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:01:10.556281 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-a3fe1d6f-c832-47fe-a87e-be79ca65c4d6 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.408591 Jul 27 20:01:10.556748 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 12/25] 10.222.0.65 () {64 vars in 1282 bytes} [Wed Jul 27 20:01:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:01:10.569503 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-18123e13-1072-41ac-bad8-804529fad3f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:01:10.593677 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-18123e13-1072-41ac-bad8-804529fad3f0 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028931 Jul 27 20:01:10.594251 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 14/26] 10.222.0.65 () {64 vars in 1332 bytes} [Wed Jul 27 20:01:10 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:01:12.793486 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-a3fe1d6f-c832-47fe-a87e-be79ca65c4d6 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:12.794495 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-a3fe1d6f-c832-47fe-a87e-be79ca65c4d6 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jul 27 20:01:12.794903 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 13/27] 10.222.0.65 () {54 vars in 930 bytes} [Wed Jul 27 20:01:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:01:13.176200 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-06a44551-a95d-4ffa-b3db-e24b6eea5098 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "ram": 4096, "id": "3", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:01:13.195778 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-06a44551-a95d-4ffa-b3db-e24b6eea5098 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.390280 Jul 27 20:01:13.196344 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 15/28] 10.222.0.65 () {64 vars in 1282 bytes} [Wed Jul 27 20:01:12 2022] POST /compute/v2.1/flavors => generated 406 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:01:13.208475 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-be3534be-91ca-49ed-8b9c-7aa9d7024adb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:01:13.232382 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-be3534be-91ca-49ed-8b9c-7aa9d7024adb admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027859 Jul 27 20:01:13.233200 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 14/29] 10.222.0.65 () {64 vars in 1332 bytes} [Wed Jul 27 20:01:13 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:01:15.458734 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-06a44551-a95d-4ffa-b3db-e24b6eea5098 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:15.460691 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-06a44551-a95d-4ffa-b3db-e24b6eea5098 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002390 Jul 27 20:01:15.461334 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 16/30] 10.222.0.65 () {54 vars in 930 bytes} [Wed Jul 27 20:01:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:01:15.903490 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-93bdb129-0b36-40d9-a4a0-dfb9fee6bd9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "os-flavor-access:is_public": true, "vcpus": 4, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "swap": 0, "rxtx_factor": 1.0, "id": "4"}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:01:15.923702 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-93bdb129-0b36-40d9-a4a0-dfb9fee6bd9d admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.456405 Jul 27 20:01:15.924252 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 15/31] 10.222.0.65 () {64 vars in 1282 bytes} [Wed Jul 27 20:01:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:01:15.936751 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-7f8f18fd-d66d-4de5-8ee8-6a0bdc773c86 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:01:15.964367 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-7f8f18fd-d66d-4de5-8ee8-6a0bdc773c86 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031182 Jul 27 20:01:15.964969 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 17/32] 10.222.0.65 () {64 vars in 1332 bytes} [Wed Jul 27 20:01:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:01:18.212982 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-93bdb129-0b36-40d9-a4a0-dfb9fee6bd9d admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:18.214007 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-93bdb129-0b36-40d9-a4a0-dfb9fee6bd9d admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 27 20:01:18.217175 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 16/33] 10.222.0.65 () {54 vars in 930 bytes} [Wed Jul 27 20:01:18 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:01:18.683646 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-784cf167-93e8-41e2-be68-efbbb742a0d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "disk": 160, "id": "5", "name": "m1.xlarge", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:01:18.704115 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-784cf167-93e8-41e2-be68-efbbb742a0d8 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.483949 Jul 27 20:01:18.704838 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 18/34] 10.222.0.65 () {64 vars in 1282 bytes} [Wed Jul 27 20:01:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:01:18.717907 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-38d2235d-3bad-4408-b3c0-f966a8f1fc9d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:01:18.724209 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:01:18.749349 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-38d2235d-3bad-4408-b3c0-f966a8f1fc9d admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035337 Jul 27 20:01:18.750575 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 17/35] 10.222.0.65 () {64 vars in 1332 bytes} [Wed Jul 27 20:01:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:01:38.842612 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-784cf167-93e8-41e2-be68-efbbb742a0d8 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:38.843610 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-784cf167-93e8-41e2-be68-efbbb742a0d8 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 27 20:01:38.844009 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 19/36] 10.222.0.65 () {54 vars in 930 bytes} [Wed Jul 27 20:01:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:01:38.854410 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:01:39.234797 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-b4ae2067-47b4-4ea0-a2fc-ca6e945b2537 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:39.253454 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-b4ae2067-47b4-4ea0-a2fc-ca6e945b2537 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403495 Jul 27 20:01:39.254102 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 18/37] 10.222.0.65 () {60 vars in 1291 bytes} [Wed Jul 27 20:01:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:01:40.323463 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-784cf167-93e8-41e2-be68-efbbb742a0d8 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:40.324478 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-784cf167-93e8-41e2-be68-efbbb742a0d8 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002546 Jul 27 20:01:40.324930 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 20/38] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Jul 27 20:01:40 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:01:40.863363 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-96d509da-9cc2-44d4-93a3-1e771ee066cf admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:40.868989 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.wsgi [None req-96d509da-9cc2-44d4-93a3-1e771ee066cf admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 27 20:01:40.872205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-96d509da-9cc2-44d4-93a3-1e771ee066cf admin admin] Request method failure captured: Jul 27 20:01:40.872205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 27 20:01:40.872205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: Accept: application/json Jul 27 20:01:40.872205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: Accept-Encoding: gzip, deflate Jul 27 20:01:40.872205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: Connection: keep-alive Jul 27 20:01:40.872205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: Content-Length: 0 Jul 27 20:01:40.872205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: Host: 10.222.0.65 Jul 27 20:01:40.872205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: Openstack-Api-Version: compute 2.90 Jul 27 20:01:40.872205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: Openstack-System-Scope: None Jul 27 20:01:40.872205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: User-Agent: python-novaclient Jul 27 20:01:40.872205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Auth-Token: gAAAAABi4Zmk0fsfWau64LWBvqfk1HFUEqTHZsEZY1BMej1zTGUDnrUHbvat36iX7gFJXbPTfk-egqAitKbDMAuribvFCvsIV3OewMD7wIdOuUSdzm8G_kSqHQWlnP2LpBtPJle1PhuhJYYrLl1C7S8U-70QLm8arvo1d6gT1EhWWslvZWR3g1U Jul 27 20:01:40.872205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Domain-Id: None Jul 27 20:01:40.872205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Domain-Name: None Jul 27 20:01:40.872205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Identity-Status: Confirmed Jul 27 20:01:40.872205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Is-Admin-Project: True Jul 27 20:01:40.872205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 20:01:40.872205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Project-Domain-Id: default Jul 27 20:01:40.872205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Project-Domain-Name: Default Jul 27 20:01:40.872205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Project-Id: 9e55cde5d6044829b509ee6bccad61b8 Jul 27 20:01:40.872205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Project-Name: admin Jul 27 20:01:40.872205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Role: admin,reader,member Jul 27 20:01:40.872205 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Roles: admin,reader,member Jul 27 20:01:40.873875 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9e55cde5d6044829b509ee6bccad61b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9e55cde5d6044829b509ee6bccad61b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9e55cde5d6044829b509ee6bccad61b8", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9e55cde5d6044829b509ee6bccad61b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:01:40.873875 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Tenant: admin Jul 27 20:01:40.873875 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Tenant-Id: 9e55cde5d6044829b509ee6bccad61b8 Jul 27 20:01:40.873875 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Tenant-Name: admin Jul 27 20:01:40.873875 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-User: admin Jul 27 20:01:40.873875 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-User-Domain-Id: default Jul 27 20:01:40.873875 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-User-Domain-Name: Default Jul 27 20:01:40.873875 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-User-Id: 8e99a25baa6a4ee4875a0277c6006aec Jul 27 20:01:40.873875 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-User-Name: admin Jul 27 20:01:40.873875 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: method: > Jul 27 20:01:40.873875 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: exception: Flavor 42 could not be found. Jul 27 20:01:40.873875 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: action_args: {'id': '42'} Jul 27 20:01:40.873875 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:01:40.873875 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:01:40.874948 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 20:01:40.874948 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 20:01:40.874948 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 20:01:40.874948 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 20:01:40.874948 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 20:01:40.874948 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 20:01:40.874948 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 20:01:40.874948 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 20:01:40.874948 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 20:01:40.874948 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:01:40.874948 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 20:01:40.874948 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 20:01:40.874948 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 27 20:01:40.874948 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 27 20:01:40.874948 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:01:40.874948 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 27 20:01:40.874948 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:01:40.874948 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:01:40.874948 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:01:40.876313 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:01:40.876313 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:01:40.876313 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:01:40.876313 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:01:40.876313 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 20:01:40.876313 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:01:40.876313 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 27 20:01:40.876313 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 27 20:01:40.876313 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:01:40.876313 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 27 20:01:40.876313 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:01:40.876313 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:01:40.876313 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:01:40.876313 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:01:40.876313 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:01:40.876313 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 27 20:01:40.876313 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 27 20:01:40.876313 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-96d509da-9cc2-44d4-93a3-1e771ee066cf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:01:40.877627 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-96d509da-9cc2-44d4-93a3-1e771ee066cf admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393375 Jul 27 20:01:40.877627 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 19/39] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Jul 27 20:01:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 20:01:40.883861 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-7f3ad251-03bf-41d1-a442-5fdbc4cfa5d3 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:40.887984 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:01:40.907864 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-7f3ad251-03bf-41d1-a442-5fdbc4cfa5d3 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027713 Jul 27 20:01:40.908406 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 21/40] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Jul 27 20:01:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:01:40.918320 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-2ffa400c-7029-4a46-b592-52318d6d8587 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:40.942939 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-2ffa400c-7029-4a46-b592-52318d6d8587 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028116 Jul 27 20:01:40.943477 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 20/41] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Jul 27 20:01:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:01:40.952707 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-f73c355c-55d5-48f2-ac89-ca332f9a1918 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:40.959488 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.wsgi [None req-f73c355c-55d5-48f2-ac89-ca332f9a1918 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 27 20:01:40.962746 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-f73c355c-55d5-48f2-ac89-ca332f9a1918 admin admin] Request method failure captured: Jul 27 20:01:40.962746 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 27 20:01:40.962746 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: Accept: application/json Jul 27 20:01:40.962746 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: Accept-Encoding: gzip, deflate Jul 27 20:01:40.962746 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: Connection: keep-alive Jul 27 20:01:40.962746 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: Content-Length: 0 Jul 27 20:01:40.962746 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: Host: 10.222.0.65 Jul 27 20:01:40.962746 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: Openstack-Api-Version: compute 2.90 Jul 27 20:01:40.962746 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: Openstack-System-Scope: None Jul 27 20:01:40.962746 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: User-Agent: python-novaclient Jul 27 20:01:40.962746 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Auth-Token: gAAAAABi4Zmk0fsfWau64LWBvqfk1HFUEqTHZsEZY1BMej1zTGUDnrUHbvat36iX7gFJXbPTfk-egqAitKbDMAuribvFCvsIV3OewMD7wIdOuUSdzm8G_kSqHQWlnP2LpBtPJle1PhuhJYYrLl1C7S8U-70QLm8arvo1d6gT1EhWWslvZWR3g1U Jul 27 20:01:40.962746 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Domain-Id: None Jul 27 20:01:40.962746 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Domain-Name: None Jul 27 20:01:40.962746 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Identity-Status: Confirmed Jul 27 20:01:40.962746 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Is-Admin-Project: True Jul 27 20:01:40.962746 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 20:01:40.962746 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Project-Domain-Id: default Jul 27 20:01:40.962746 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Project-Domain-Name: Default Jul 27 20:01:40.962746 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Project-Id: 9e55cde5d6044829b509ee6bccad61b8 Jul 27 20:01:40.962746 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Project-Name: admin Jul 27 20:01:40.962746 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Role: admin,reader,member Jul 27 20:01:40.962746 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Roles: admin,reader,member Jul 27 20:01:40.964293 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9e55cde5d6044829b509ee6bccad61b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9e55cde5d6044829b509ee6bccad61b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9e55cde5d6044829b509ee6bccad61b8", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9e55cde5d6044829b509ee6bccad61b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:01:40.964293 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Tenant: admin Jul 27 20:01:40.964293 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Tenant-Id: 9e55cde5d6044829b509ee6bccad61b8 Jul 27 20:01:40.964293 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Tenant-Name: admin Jul 27 20:01:40.964293 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-User: admin Jul 27 20:01:40.964293 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-User-Domain-Id: default Jul 27 20:01:40.964293 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-User-Domain-Name: Default Jul 27 20:01:40.964293 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-User-Id: 8e99a25baa6a4ee4875a0277c6006aec Jul 27 20:01:40.964293 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-User-Name: admin Jul 27 20:01:40.964293 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: method: > Jul 27 20:01:40.964293 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: exception: Flavor 42 could not be found. Jul 27 20:01:40.964293 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: action_args: {'id': '42'} Jul 27 20:01:40.964293 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:01:40.964293 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:01:40.965288 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 20:01:40.965288 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 20:01:40.965288 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 20:01:40.965288 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 20:01:40.965288 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 20:01:40.965288 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 20:01:40.965288 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 20:01:40.965288 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 20:01:40.965288 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 20:01:40.965288 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:01:40.965288 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 20:01:40.965288 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 20:01:40.965288 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 27 20:01:40.965288 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jul 27 20:01:40.965288 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:01:40.965288 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jul 27 20:01:40.965288 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:01:40.965288 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:01:40.965288 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:01:40.966633 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:01:40.966633 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:01:40.966633 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:01:40.966633 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:01:40.966633 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 20:01:40.966633 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:01:40.966633 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 27 20:01:40.966633 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jul 27 20:01:40.966633 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:01:40.966633 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jul 27 20:01:40.966633 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:01:40.966633 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:01:40.966633 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:01:40.966633 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:01:40.966633 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:01:40.966633 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 27 20:01:40.966633 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jul 27 20:01:40.966633 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-f73c355c-55d5-48f2-ac89-ca332f9a1918 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:01:40.967843 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-f73c355c-55d5-48f2-ac89-ca332f9a1918 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014977 Jul 27 20:01:40.967843 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 22/42] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Jul 27 20:01:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 27 20:01:41.927793 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-2ffa400c-7029-4a46-b592-52318d6d8587 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:41.928782 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-2ffa400c-7029-4a46-b592-52318d6d8587 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jul 27 20:01:41.929230 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 21/43] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Jul 27 20:01:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:01:42.456604 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-3e2767b4-8891-4751-bc6b-208175cc4655 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:42.462843 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.wsgi [None req-3e2767b4-8891-4751-bc6b-208175cc4655 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 27 20:01:42.464338 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-3e2767b4-8891-4751-bc6b-208175cc4655 admin admin] Request method failure captured: Jul 27 20:01:42.464338 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 27 20:01:42.464338 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: Accept: application/json Jul 27 20:01:42.464338 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: Accept-Encoding: gzip, deflate Jul 27 20:01:42.464338 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: Connection: keep-alive Jul 27 20:01:42.464338 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: Content-Length: 0 Jul 27 20:01:42.464338 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: Host: 10.222.0.65 Jul 27 20:01:42.464338 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: Openstack-Api-Version: compute 2.90 Jul 27 20:01:42.464338 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: Openstack-System-Scope: None Jul 27 20:01:42.464338 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: User-Agent: python-novaclient Jul 27 20:01:42.464338 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Auth-Token: gAAAAABi4ZmlEKOkSUGxM1pUmmiRvC60R7mDFox6725Gdr18rwjdBm2xfT5B42bCbyqMD-X_fI0kx6qPrqH2U2Uqk4sLgWUqbXdObcaKUv5wwo_0hsg3EusY6oTzrZgZCgzVtnGEx3Pb1XkCSJZqFalnsYhjqDfvj3J4MdJ7gCRAwszAEm7ZG_k Jul 27 20:01:42.464338 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Domain-Id: None Jul 27 20:01:42.464338 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Domain-Name: None Jul 27 20:01:42.464338 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Identity-Status: Confirmed Jul 27 20:01:42.464338 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Is-Admin-Project: True Jul 27 20:01:42.464338 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 20:01:42.464338 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Project-Domain-Id: default Jul 27 20:01:42.464338 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Project-Domain-Name: Default Jul 27 20:01:42.464338 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Project-Id: 9e55cde5d6044829b509ee6bccad61b8 Jul 27 20:01:42.464338 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Project-Name: admin Jul 27 20:01:42.464338 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Role: admin,reader,member Jul 27 20:01:42.464338 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Roles: admin,reader,member Jul 27 20:01:42.465879 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9e55cde5d6044829b509ee6bccad61b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9e55cde5d6044829b509ee6bccad61b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9e55cde5d6044829b509ee6bccad61b8", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9e55cde5d6044829b509ee6bccad61b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:01:42.465879 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Tenant: admin Jul 27 20:01:42.465879 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Tenant-Id: 9e55cde5d6044829b509ee6bccad61b8 Jul 27 20:01:42.465879 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Tenant-Name: admin Jul 27 20:01:42.465879 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-User: admin Jul 27 20:01:42.465879 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-User-Domain-Id: default Jul 27 20:01:42.465879 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-User-Domain-Name: Default Jul 27 20:01:42.465879 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-User-Id: 8e99a25baa6a4ee4875a0277c6006aec Jul 27 20:01:42.465879 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-User-Name: admin Jul 27 20:01:42.465879 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: method: > Jul 27 20:01:42.465879 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: exception: Flavor 84 could not be found. Jul 27 20:01:42.465879 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: action_args: {'id': '84'} Jul 27 20:01:42.465879 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:01:42.465879 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:01:42.466917 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 20:01:42.466917 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 20:01:42.466917 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 20:01:42.466917 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 20:01:42.466917 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 20:01:42.466917 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 20:01:42.466917 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 20:01:42.466917 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 20:01:42.466917 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 20:01:42.466917 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:01:42.466917 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 20:01:42.466917 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 20:01:42.466917 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 27 20:01:42.466917 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jul 27 20:01:42.466917 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:01:42.466917 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jul 27 20:01:42.466917 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:01:42.466917 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:01:42.466917 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:01:42.468223 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:01:42.468223 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:01:42.468223 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:01:42.468223 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:01:42.468223 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 20:01:42.468223 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:01:42.468223 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 27 20:01:42.468223 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jul 27 20:01:42.468223 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:01:42.468223 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jul 27 20:01:42.468223 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:01:42.468223 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:01:42.468223 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:01:42.468223 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:01:42.468223 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:01:42.468223 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 27 20:01:42.468223 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jul 27 20:01:42.468223 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-3e2767b4-8891-4751-bc6b-208175cc4655 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:01:42.469474 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-3e2767b4-8891-4751-bc6b-208175cc4655 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.397456 Jul 27 20:01:42.469474 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 23/44] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Jul 27 20:01:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 20:01:42.475488 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-ae0e6321-d69c-4bd7-87b3-a46c72ff75cb admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:42.490295 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-ae0e6321-d69c-4bd7-87b3-a46c72ff75cb admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018554 Jul 27 20:01:42.490816 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 22/45] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Jul 27 20:01:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:01:42.499805 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-8cb9c2eb-59cd-48d7-813e-035e51428305 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:42.515603 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-8cb9c2eb-59cd-48d7-813e-035e51428305 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019177 Jul 27 20:01:42.516140 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 24/46] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Jul 27 20:01:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:01:42.526071 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-866714b9-e7b8-46c9-b002-ac7f11dafa2c admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:42.531338 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.wsgi [None req-866714b9-e7b8-46c9-b002-ac7f11dafa2c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 27 20:01:42.532812 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-866714b9-e7b8-46c9-b002-ac7f11dafa2c admin admin] Request method failure captured: Jul 27 20:01:42.532812 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 27 20:01:42.532812 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: Accept: application/json Jul 27 20:01:42.532812 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: Accept-Encoding: gzip, deflate Jul 27 20:01:42.532812 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: Connection: keep-alive Jul 27 20:01:42.532812 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: Content-Length: 0 Jul 27 20:01:42.532812 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: Host: 10.222.0.65 Jul 27 20:01:42.532812 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: Openstack-Api-Version: compute 2.90 Jul 27 20:01:42.532812 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: Openstack-System-Scope: None Jul 27 20:01:42.532812 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: User-Agent: python-novaclient Jul 27 20:01:42.532812 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Auth-Token: gAAAAABi4ZmlEKOkSUGxM1pUmmiRvC60R7mDFox6725Gdr18rwjdBm2xfT5B42bCbyqMD-X_fI0kx6qPrqH2U2Uqk4sLgWUqbXdObcaKUv5wwo_0hsg3EusY6oTzrZgZCgzVtnGEx3Pb1XkCSJZqFalnsYhjqDfvj3J4MdJ7gCRAwszAEm7ZG_k Jul 27 20:01:42.532812 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Domain-Id: None Jul 27 20:01:42.532812 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Domain-Name: None Jul 27 20:01:42.532812 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Identity-Status: Confirmed Jul 27 20:01:42.532812 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Is-Admin-Project: True Jul 27 20:01:42.532812 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 20:01:42.532812 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Project-Domain-Id: default Jul 27 20:01:42.532812 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Project-Domain-Name: Default Jul 27 20:01:42.532812 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Project-Id: 9e55cde5d6044829b509ee6bccad61b8 Jul 27 20:01:42.532812 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Project-Name: admin Jul 27 20:01:42.532812 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Role: admin,reader,member Jul 27 20:01:42.532812 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Roles: admin,reader,member Jul 27 20:01:42.534317 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9e55cde5d6044829b509ee6bccad61b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9e55cde5d6044829b509ee6bccad61b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9e55cde5d6044829b509ee6bccad61b8", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9e55cde5d6044829b509ee6bccad61b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:01:42.534317 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Tenant: admin Jul 27 20:01:42.534317 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Tenant-Id: 9e55cde5d6044829b509ee6bccad61b8 Jul 27 20:01:42.534317 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Tenant-Name: admin Jul 27 20:01:42.534317 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-User: admin Jul 27 20:01:42.534317 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-User-Domain-Id: default Jul 27 20:01:42.534317 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-User-Domain-Name: Default Jul 27 20:01:42.534317 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-User-Id: 8e99a25baa6a4ee4875a0277c6006aec Jul 27 20:01:42.534317 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-User-Name: admin Jul 27 20:01:42.534317 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: method: > Jul 27 20:01:42.534317 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: exception: Flavor 84 could not be found. Jul 27 20:01:42.534317 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: action_args: {'id': '84'} Jul 27 20:01:42.534317 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:01:42.534317 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:01:42.535158 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 20:01:42.535158 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 20:01:42.535158 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 20:01:42.535158 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 20:01:42.535158 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 20:01:42.535158 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 20:01:42.535158 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 20:01:42.535158 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 20:01:42.535158 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 20:01:42.535158 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:01:42.535158 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 20:01:42.535158 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 20:01:42.535158 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 27 20:01:42.535158 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 27 20:01:42.535158 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:01:42.535158 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 27 20:01:42.535158 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:01:42.535158 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:01:42.535158 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:01:42.536281 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:01:42.536281 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:01:42.536281 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:01:42.536281 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:01:42.536281 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 20:01:42.536281 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:01:42.536281 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 27 20:01:42.536281 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 27 20:01:42.536281 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:01:42.536281 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 27 20:01:42.536281 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:01:42.536281 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:01:42.536281 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:01:42.536281 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:01:42.536281 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:01:42.536281 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 27 20:01:42.536281 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 27 20:01:42.536281 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-866714b9-e7b8-46c9-b002-ac7f11dafa2c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:01:42.537276 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-866714b9-e7b8-46c9-b002-ac7f11dafa2c admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011632 Jul 27 20:01:42.537276 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 23/47] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Jul 27 20:01:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 27 20:01:43.503498 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-8cb9c2eb-59cd-48d7-813e-035e51428305 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:43.505170 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-8cb9c2eb-59cd-48d7-813e-035e51428305 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002052 Jul 27 20:01:43.505560 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 25/48] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Jul 27 20:01:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:01:44.020524 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-bf5251b2-9e31-4c6d-984e-3093732a2175 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:44.026600 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.wsgi [None req-bf5251b2-9e31-4c6d-984e-3093732a2175 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 27 20:01:44.028091 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-bf5251b2-9e31-4c6d-984e-3093732a2175 admin admin] Request method failure captured: Jul 27 20:01:44.028091 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 27 20:01:44.028091 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: Accept: application/json Jul 27 20:01:44.028091 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: Accept-Encoding: gzip, deflate Jul 27 20:01:44.028091 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: Connection: keep-alive Jul 27 20:01:44.028091 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: Content-Length: 0 Jul 27 20:01:44.028091 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: Host: 10.222.0.65 Jul 27 20:01:44.028091 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: Openstack-Api-Version: compute 2.90 Jul 27 20:01:44.028091 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: Openstack-System-Scope: None Jul 27 20:01:44.028091 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: User-Agent: python-novaclient Jul 27 20:01:44.028091 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Auth-Token: gAAAAABi4ZmnbN0qZ1yuGl_VxbIUsI-BGqg7vC-QR-Wswd_IH1WwfKj_HNSu8bovjWyLWr19UDoeyC728cPFrVIOfCHr7XRNzRqX70UpQZwEyJ7ptC_wwFWxi5XAzrIuv1t_Cn77XnsRW4ovXWlYJH_u4UoEi-fh33o6cpKML7V3zpl28SWwBHE Jul 27 20:01:44.028091 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Domain-Id: None Jul 27 20:01:44.028091 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Domain-Name: None Jul 27 20:01:44.028091 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Identity-Status: Confirmed Jul 27 20:01:44.028091 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Is-Admin-Project: True Jul 27 20:01:44.028091 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 20:01:44.028091 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Project-Domain-Id: default Jul 27 20:01:44.028091 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Project-Domain-Name: Default Jul 27 20:01:44.028091 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Project-Id: 9e55cde5d6044829b509ee6bccad61b8 Jul 27 20:01:44.028091 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Project-Name: admin Jul 27 20:01:44.028091 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Role: admin,reader,member Jul 27 20:01:44.028091 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Roles: admin,reader,member Jul 27 20:01:44.029630 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9e55cde5d6044829b509ee6bccad61b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9e55cde5d6044829b509ee6bccad61b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9e55cde5d6044829b509ee6bccad61b8", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9e55cde5d6044829b509ee6bccad61b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:01:44.029630 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Tenant: admin Jul 27 20:01:44.029630 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Tenant-Id: 9e55cde5d6044829b509ee6bccad61b8 Jul 27 20:01:44.029630 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-Tenant-Name: admin Jul 27 20:01:44.029630 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-User: admin Jul 27 20:01:44.029630 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-User-Domain-Id: default Jul 27 20:01:44.029630 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-User-Domain-Name: Default Jul 27 20:01:44.029630 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-User-Id: 8e99a25baa6a4ee4875a0277c6006aec Jul 27 20:01:44.029630 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: X-User-Name: admin Jul 27 20:01:44.029630 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: method: > Jul 27 20:01:44.029630 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: exception: Flavor 451 could not be found. Jul 27 20:01:44.029630 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: action_args: {'id': '451'} Jul 27 20:01:44.029630 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:01:44.029630 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:01:44.030669 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 20:01:44.030669 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 20:01:44.030669 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 20:01:44.030669 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 20:01:44.030669 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 20:01:44.030669 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 20:01:44.030669 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 20:01:44.030669 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 20:01:44.030669 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 20:01:44.030669 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:01:44.030669 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 20:01:44.030669 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 20:01:44.030669 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 27 20:01:44.030669 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 27 20:01:44.030669 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:01:44.030669 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 27 20:01:44.030669 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:01:44.030669 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:01:44.030669 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:01:44.031920 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:01:44.031920 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:01:44.031920 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:01:44.031920 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:01:44.031920 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 20:01:44.031920 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:01:44.031920 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 27 20:01:44.031920 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 27 20:01:44.031920 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:01:44.031920 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 27 20:01:44.031920 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:01:44.031920 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:01:44.031920 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:01:44.031920 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:01:44.031920 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:01:44.031920 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 27 20:01:44.031920 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 27 20:01:44.031920 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-bf5251b2-9e31-4c6d-984e-3093732a2175 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:01:44.033197 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-bf5251b2-9e31-4c6d-984e-3093732a2175 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.387501 Jul 27 20:01:44.033197 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 24/49] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Jul 27 20:01:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 27 20:01:44.039598 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-61bc7b05-8d27-4952-9979-a25324cdc7a1 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:44.054939 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-61bc7b05-8d27-4952-9979-a25324cdc7a1 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019419 Jul 27 20:01:44.055466 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 26/50] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Jul 27 20:01:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:01:44.064738 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-a6cbb72d-acc3-4744-bcc7-193ab15dccb9 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:44.079823 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-a6cbb72d-acc3-4744-bcc7-193ab15dccb9 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018554 Jul 27 20:01:44.080367 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 25/51] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Jul 27 20:01:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:01:44.090373 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-1f35d1ca-d50b-45ab-98ed-308406e45221 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:44.095802 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.wsgi [None req-1f35d1ca-d50b-45ab-98ed-308406e45221 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 27 20:01:44.097329 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-1f35d1ca-d50b-45ab-98ed-308406e45221 admin admin] Request method failure captured: Jul 27 20:01:44.097329 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 27 20:01:44.097329 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: Accept: application/json Jul 27 20:01:44.097329 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: Accept-Encoding: gzip, deflate Jul 27 20:01:44.097329 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: Connection: keep-alive Jul 27 20:01:44.097329 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: Content-Length: 0 Jul 27 20:01:44.097329 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: Host: 10.222.0.65 Jul 27 20:01:44.097329 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: Openstack-Api-Version: compute 2.90 Jul 27 20:01:44.097329 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: Openstack-System-Scope: None Jul 27 20:01:44.097329 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: User-Agent: python-novaclient Jul 27 20:01:44.097329 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Auth-Token: gAAAAABi4ZmnbN0qZ1yuGl_VxbIUsI-BGqg7vC-QR-Wswd_IH1WwfKj_HNSu8bovjWyLWr19UDoeyC728cPFrVIOfCHr7XRNzRqX70UpQZwEyJ7ptC_wwFWxi5XAzrIuv1t_Cn77XnsRW4ovXWlYJH_u4UoEi-fh33o6cpKML7V3zpl28SWwBHE Jul 27 20:01:44.097329 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Domain-Id: None Jul 27 20:01:44.097329 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Domain-Name: None Jul 27 20:01:44.097329 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Identity-Status: Confirmed Jul 27 20:01:44.097329 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Is-Admin-Project: True Jul 27 20:01:44.097329 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Openstack-Nova-Api-Version: 2.90 Jul 27 20:01:44.097329 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Project-Domain-Id: default Jul 27 20:01:44.097329 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Project-Domain-Name: Default Jul 27 20:01:44.097329 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Project-Id: 9e55cde5d6044829b509ee6bccad61b8 Jul 27 20:01:44.097329 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Project-Name: admin Jul 27 20:01:44.097329 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Role: admin,reader,member Jul 27 20:01:44.097329 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Roles: admin,reader,member Jul 27 20:01:44.100018 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9e55cde5d6044829b509ee6bccad61b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9e55cde5d6044829b509ee6bccad61b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9e55cde5d6044829b509ee6bccad61b8", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9e55cde5d6044829b509ee6bccad61b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:01:44.100018 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Tenant: admin Jul 27 20:01:44.100018 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Tenant-Id: 9e55cde5d6044829b509ee6bccad61b8 Jul 27 20:01:44.100018 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-Tenant-Name: admin Jul 27 20:01:44.100018 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-User: admin Jul 27 20:01:44.100018 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-User-Domain-Id: default Jul 27 20:01:44.100018 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-User-Domain-Name: Default Jul 27 20:01:44.100018 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-User-Id: 8e99a25baa6a4ee4875a0277c6006aec Jul 27 20:01:44.100018 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: X-User-Name: admin Jul 27 20:01:44.100018 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: method: > Jul 27 20:01:44.100018 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: exception: Flavor 451 could not be found. Jul 27 20:01:44.100018 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: action_args: {'id': '451'} Jul 27 20:01:44.100018 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:01:44.100018 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:01:44.101157 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 27 20:01:44.101157 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 27 20:01:44.101157 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 27 20:01:44.101157 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 27 20:01:44.101157 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 27 20:01:44.101157 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 27 20:01:44.101157 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 27 20:01:44.101157 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 27 20:01:44.101157 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 27 20:01:44.101157 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:01:44.101157 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 27 20:01:44.101157 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 27 20:01:44.101157 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 27 20:01:44.101157 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jul 27 20:01:44.101157 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:01:44.101157 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jul 27 20:01:44.101157 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:01:44.101157 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:01:44.101157 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:01:44.102456 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:01:44.102456 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:01:44.102456 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:01:44.102456 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:01:44.102456 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 27 20:01:44.102456 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:01:44.102456 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 27 20:01:44.102456 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jul 27 20:01:44.102456 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:01:44.102456 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jul 27 20:01:44.102456 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:01:44.102456 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:01:44.102456 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:01:44.102456 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:01:44.102456 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:01:44.102456 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 27 20:01:44.102456 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: ERROR nova.api.openstack.wsgi Jul 27 20:01:44.102456 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-1f35d1ca-d50b-45ab-98ed-308406e45221 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:01:44.103689 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-1f35d1ca-d50b-45ab-98ed-308406e45221 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012519 Jul 27 20:01:44.103689 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 27/52] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Jul 27 20:01:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 27 20:01:45.071647 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-a6cbb72d-acc3-4744-bcc7-193ab15dccb9 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:45.072655 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-a6cbb72d-acc3-4744-bcc7-193ab15dccb9 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 27 20:01:45.073073 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 26/53] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Jul 27 20:01:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:01:45.595892 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-c5d0ac6c-b6d3-497a-91bd-d54ebce14cd6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:01:45.615100 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-c5d0ac6c-b6d3-497a-91bd-d54ebce14cd6 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.404989 Jul 27 20:01:45.615644 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 28/54] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Jul 27 20:01:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:01:46.585906 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-a6cbb72d-acc3-4744-bcc7-193ab15dccb9 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:46.586937 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-a6cbb72d-acc3-4744-bcc7-193ab15dccb9 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 27 20:01:46.587338 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 27/55] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Jul 27 20:01:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:01:47.108680 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-a3d51371-c90c-440a-ba60-ca27f3327121 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:01:47.126976 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-a3d51371-c90c-440a-ba60-ca27f3327121 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.405202 Jul 27 20:01:47.127522 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 29/56] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Jul 27 20:01:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:01:48.099840 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-a6cbb72d-acc3-4744-bcc7-193ab15dccb9 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:48.100844 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-a6cbb72d-acc3-4744-bcc7-193ab15dccb9 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jul 27 20:01:48.101289 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 28/57] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Jul 27 20:01:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:01:48.631099 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-352e7180-c158-4aae-978b-ed26f42c4dd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:01:48.649349 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-352e7180-c158-4aae-978b-ed26f42c4dd8 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.404635 Jul 27 20:01:48.649892 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 30/58] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Jul 27 20:01:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:01:49.613087 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-a6cbb72d-acc3-4744-bcc7-193ab15dccb9 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:49.614292 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-a6cbb72d-acc3-4744-bcc7-193ab15dccb9 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001666 Jul 27 20:01:49.614798 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 29/59] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Jul 27 20:01:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:01:50.144998 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-5f1b4c31-b722-4ac6-84ed-f3ae54e4630b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:01:50.163815 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-5f1b4c31-b722-4ac6-84ed-f3ae54e4630b admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.409105 Jul 27 20:01:50.164358 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 31/60] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Jul 27 20:01:49 2022] POST /compute/v2.1/flavors => generated 409 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:01:51.140305 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-a6cbb72d-acc3-4744-bcc7-193ab15dccb9 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:51.141355 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-a6cbb72d-acc3-4744-bcc7-193ab15dccb9 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 27 20:01:51.141757 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 30/61] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Jul 27 20:01:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:01:51.660910 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-9f2e1ef4-d1d1-4db7-8278-a54a107f3bce admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:01:51.680905 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-9f2e1ef4-d1d1-4db7-8278-a54a107f3bce admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.401031 Jul 27 20:01:51.681460 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 32/62] 10.222.0.65 () {60 vars in 1202 bytes} [Wed Jul 27 20:01:51 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:02:43.391580 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-a6cbb72d-acc3-4744-bcc7-193ab15dccb9 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:02:43.392572 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-a6cbb72d-acc3-4744-bcc7-193ab15dccb9 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jul 27 20:02:43.392987 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 31/63] 10.222.0.65 () {54 vars in 930 bytes} [Wed Jul 27 20:02:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:02:43.404028 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:02:43.781530 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-64682b4a-24a2-4a04-a5ee-47a056854332 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:02:43.801660 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-64682b4a-24a2-4a04-a5ee-47a056854332 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402085 Jul 27 20:02:43.802197 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 33/64] 10.222.0.65 () {60 vars in 1291 bytes} [Wed Jul 27 20:02:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:02:43.825715 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-84e43c95-918a-4d12-93be-f46fd18c7fd2 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:02:43.829277 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_api:SELECT=14 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:02:43.837194 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-84e43c95-918a-4d12-93be-f46fd18c7fd2 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014763 Jul 27 20:02:43.837905 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 32/65] 10.222.0.65 () {60 vars in 1282 bytes} [Wed Jul 27 20:02:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:02:43.852280 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-e179ca76-59ea-493b-bf98-518f105e6e99 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:02:43.859974 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-e179ca76-59ea-493b-bf98-518f105e6e99 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011459 Jul 27 20:02:43.860486 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 34/66] 10.222.0.65 () {60 vars in 1285 bytes} [Wed Jul 27 20:02:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:02:43.871765 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-f6ed0f24-9613-4bbf-85b1-0c351149ba80 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:02:43.879775 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-f6ed0f24-9613-4bbf-85b1-0c351149ba80 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011570 Jul 27 20:02:43.880284 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 33/67] 10.222.0.65 () {60 vars in 1285 bytes} [Wed Jul 27 20:02:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:02:43.892114 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-8c73ccbc-4fce-4da5-948b-d55eeaa9f5f2 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:02:43.900266 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-8c73ccbc-4fce-4da5-948b-d55eeaa9f5f2 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011578 Jul 27 20:02:43.900777 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 35/68] 10.222.0.65 () {60 vars in 1282 bytes} [Wed Jul 27 20:02:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:06:06.947444 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-f6ed0f24-9613-4bbf-85b1-0c351149ba80 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:06.948463 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-f6ed0f24-9613-4bbf-85b1-0c351149ba80 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 27 20:06:06.948864 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 34/69] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Jul 27 20:06:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:06:07.090844 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_api:SELECT=6 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:06:07.248225 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-5b5bfce9-4fd8-4bc5-8b2a-c159076ef3e4 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:07.250561 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:06:07.250561 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: warnings.warn(msg) Jul 27 20:06:07.251773 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-5b5bfce9-4fd8-4bc5-8b2a-c159076ef3e4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:06:07.252216 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-5b5bfce9-4fd8-4bc5-8b2a-c159076ef3e4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:06:07.253027 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-5b5bfce9-4fd8-4bc5-8b2a-c159076ef3e4 admin admin] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:06:07.253465 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-5b5bfce9-4fd8-4bc5-8b2a-c159076ef3e4 admin admin] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:06:07.287758 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-5b5bfce9-4fd8-4bc5-8b2a-c159076ef3e4 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.198249 Jul 27 20:06:07.288314 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 36/70] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Jul 27 20:06:07 2022] GET /compute/v2.1/os-services => generated 794 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:06:08.113033 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-f6ed0f24-9613-4bbf-85b1-0c351149ba80 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:08.114072 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-f6ed0f24-9613-4bbf-85b1-0c351149ba80 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 27 20:06:08.114464 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 35/71] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Jul 27 20:06:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:06:08.304483 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-b95584e0-5546-4065-abc1-9d80a882579a admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:08.306871 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:06:08.306871 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: warnings.warn(msg) Jul 27 20:06:08.308054 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-b95584e0-5546-4065-abc1-9d80a882579a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:06:08.308488 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-b95584e0-5546-4065-abc1-9d80a882579a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:06:08.309297 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-b95584e0-5546-4065-abc1-9d80a882579a admin admin] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:06:08.309718 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-b95584e0-5546-4065-abc1-9d80a882579a admin admin] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:06:08.329663 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-b95584e0-5546-4065-abc1-9d80a882579a admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076946 Jul 27 20:06:08.330173 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 37/72] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Jul 27 20:06:08 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:06:19.580955 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-f6ed0f24-9613-4bbf-85b1-0c351149ba80 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:19.582016 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-f6ed0f24-9613-4bbf-85b1-0c351149ba80 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jul 27 20:06:19.582414 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 36/73] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Jul 27 20:06:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:06:19.723896 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_cell0:SELECT=4 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:06:19.725367 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_cell1:SELECT=4 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:06:19.726073 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG dbcounter [-] [103342] Writing DB stats nova_api:SELECT=8 {{(pid=103342) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:06:19.777663 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-9ce50a87-66b5-4dee-830d-f5dcd4603964 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:19.780416 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:06:19.780416 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: warnings.warn(msg) Jul 27 20:06:19.781659 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-9ce50a87-66b5-4dee-830d-f5dcd4603964 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:06:19.782106 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-9ce50a87-66b5-4dee-830d-f5dcd4603964 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:06:19.782904 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-9ce50a87-66b5-4dee-830d-f5dcd4603964 admin admin] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:06:19.783333 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-9ce50a87-66b5-4dee-830d-f5dcd4603964 admin admin] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:06:19.811662 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-9ce50a87-66b5-4dee-830d-f5dcd4603964 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.092112 Jul 27 20:06:19.812209 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 38/74] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Jul 27 20:06:19 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:06:20.644385 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-f6ed0f24-9613-4bbf-85b1-0c351149ba80 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:20.645446 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-f6ed0f24-9613-4bbf-85b1-0c351149ba80 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Jul 27 20:06:20.645849 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 37/75] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Jul 27 20:06:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:06:20.839664 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG nova.api.openstack.wsgi [None req-d3b79297-725a-42cf-824f-46f3ac969b56 admin admin] Calling method '>' {{(pid=103342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:06:20.842112 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 20:06:20.842112 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: warnings.warn(msg) Jul 27 20:06:20.843299 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-d3b79297-725a-42cf-824f-46f3ac969b56 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:06:20.843734 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-d3b79297-725a-42cf-824f-46f3ac969b56 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:06:20.844508 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-d3b79297-725a-42cf-824f-46f3ac969b56 admin admin] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:06:20.844929 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: DEBUG oslo_concurrency.lockutils [None req-d3b79297-725a-42cf-824f-46f3ac969b56 admin admin] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:06:20.866989 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: INFO nova.api.openstack.requestlog [None req-d3b79297-725a-42cf-824f-46f3ac969b56 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.078885 Jul 27 20:06:20.867507 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: [pid: 103342|app: 0|req: 39/76] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Jul 27 20:06:20 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:07:17.936679 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: Wed Jul 27 20:07:17 2022 - graceful shutdown triggered... Jul 27 20:07:17.936544 dv-cinder-799871-44-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 27 20:07:17.937635 dv-cinder-799871-44-iscsi devstack@n-api.service[103343]: Gracefully killing worker 2 (pid: 103343)... Jul 27 20:07:17.938001 dv-cinder-799871-44-iscsi devstack@n-api.service[103342]: Gracefully killing worker 1 (pid: 103342)... Jul 27 20:07:18.937562 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: worker 1 buried after 1 seconds Jul 27 20:07:18.938099 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: worker 2 buried after 1 seconds Jul 27 20:07:18.938099 dv-cinder-799871-44-iscsi devstack@n-api.service[103341]: goodbye to uWSGI. Jul 27 20:07:18.939337 dv-cinder-799871-44-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 27 20:07:18.939944 dv-cinder-799871-44-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 27 20:07:18.942943 dv-cinder-799871-44-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 27 20:07:18.953150 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 27 20:07:18.955714 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 20:07:18 2022] *** Jul 27 20:07:18.955853 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 20:07:18.955965 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 20:07:18.956065 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: nodename: dv-cinder-799871-44-iscsi Jul 27 20:07:18.956162 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: machine: x86_64 Jul 27 20:07:18.956293 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: clock source: unix Jul 27 20:07:18.956431 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: pcre jit disabled Jul 27 20:07:18.956563 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: detected number of CPU cores: 4 Jul 27 20:07:18.956685 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: current working directory: / Jul 27 20:07:18.956813 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: detected binary path: /usr/bin/uwsgi-core Jul 27 20:07:18.956947 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: your processes number limit is 47680 Jul 27 20:07:18.957202 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: your memory page size is 4096 bytes Jul 27 20:07:18.957326 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: detected max file descriptor number: 2048 Jul 27 20:07:18.957446 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: lock engine: pthread robust mutexes Jul 27 20:07:18.957725 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: thunder lock: enabled Jul 27 20:07:18.958038 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 27 20:07:18.958167 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 20:07:18.997951 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: Python main interpreter initialized at 0x5615519639c0 Jul 27 20:07:18.997951 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: python threads support enabled Jul 27 20:07:18.997951 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: your server socket listen backlog is limited to 100 connections Jul 27 20:07:18.997951 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: your mercy for graceful operations on workers is 90 seconds Jul 27 20:07:18.998305 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 20:07:18.998305 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: *** Operational MODE: preforking *** Jul 27 20:07:18.998579 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: *** uWSGI is running in multiple interpreter mode *** Jul 27 20:07:18.998738 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: spawned uWSGI master process (pid: 117857) Jul 27 20:07:18.999047 dv-cinder-799871-44-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 27 20:07:18.999771 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: spawned uWSGI worker 1 (pid: 117876, cores: 1) Jul 27 20:07:19.000252 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: spawned uWSGI worker 2 (pid: 117877, cores: 1) Jul 27 20:07:19.000515 dv-cinder-799871-44-iscsi devstack@n-api.service[117857]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 20:07:19.678082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 20:07:19.679784 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 27 20:07:20.843844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 20:07:20.843844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: from cryptography.utils import int_from_bytes Jul 27 20:07:20.844495 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 20:07:20.844495 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: from cryptography.utils import int_from_bytes Jul 27 20:07:20.844495 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 20:07:20.844495 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: from cryptography.utils import int_from_bytes Jul 27 20:07:20.845050 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 20:07:20.845050 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: from cryptography.utils import int_from_bytes Jul 27 20:07:23.242467 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 20:07:23.243132 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 20:07:23.243231 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 20:07:23.243587 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 20:07:23.243682 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 20:07:23.243782 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 20:07:23.243880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 20:07:23.243970 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 20:07:23.244186 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 20:07:23.244285 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.244437 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 20:07:23.244542 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.244830 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.244933 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.245189 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.245295 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.245514 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.245619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.245837 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.245928 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.246171 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.246268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.246484 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.246581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.246816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.246922 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.247082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.247182 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.247402 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.247551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.247691 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.247826 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-44-iscsi {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.247994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.248131 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.248325 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-44-iscsi {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.248482 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.248655 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.248786 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.249123 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.249287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.249419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.249558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.249750 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.249897 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.250061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.250201 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.250392 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.250565 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.250735 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.250997 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.251193 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.251336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.251506 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.251625 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.251826 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.252010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.252194 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.252378 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.252574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.252766 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.253000 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.253207 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.253404 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.253819 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.254009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.254197 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.254386 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.254598 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.254792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.254982 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-44-iscsi {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.255178 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.255360 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.255561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-44-iscsi {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.255743 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.255931 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.256107 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.256298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.256513 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.256703 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.256857 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.257028 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.257202 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.257340 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.257488 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.257652 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.257789 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.257918 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.258062 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.258191 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.258358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.258488 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.258616 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.258750 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.258892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.259037 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.259198 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.259397 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.259530 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.259693 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.259829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.259972 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.260108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.260243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.260382 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.260529 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.260647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.260828 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.260950 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.261202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.261345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.261486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.261616 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.261756 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.261882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.262017 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.262129 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.262287 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.262802 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.263071 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.263188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.263468 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.263605 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.263727 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.263847 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.264638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.264773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.264901 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.265190 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.265319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.265440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.265550 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.265674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.265785 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.265902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.266020 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.266137 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.266254 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.266364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.266478 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.266725 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.266848 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.266957 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.267066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.267180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.267298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.267417 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.267535 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.267652 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.267771 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.267880 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.267989 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.268110 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.273085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.273247 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.273343 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.273420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.273502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.273588 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.273674 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.273757 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.273849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.273925 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.274029 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.274105 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.274176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.274246 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.274328 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.274410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.274495 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.274579 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.274658 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.274730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.274800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.274877 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.274961 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.275060 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.275140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.275222 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.275294 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.275375 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.275461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.275541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.275622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.275695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.275765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.275856 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.275936 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.276014 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.276085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.276162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.276238 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.276322 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.276411 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.276411 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.276540 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.276617 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.276696 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.276781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.276853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.276923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.277011 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.277085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.277168 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.277250 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.277322 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.277392 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.277469 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.277542 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.277618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.277702 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.277775 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.277852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.277930 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.278010 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.278090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.278168 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.278239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.278329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.278407 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.278478 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.278556 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.278634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.278718 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.278790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.278867 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.278951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.279035 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.279118 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.279200 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.279294 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.279386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.279475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.279557 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.279630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.279706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.279815 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.279891 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.279990 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.280072 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.280144 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.281452 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.281642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.281805 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.281954 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.282116 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.282264 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.282420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.282612 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.282772 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.282932 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.283079 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.283224 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.283376 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.283574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.283738 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.283898 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.284045 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.284199 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.284708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.284868 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.285061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.285225 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.285692 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.285849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.285997 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.287496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.287724 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.288420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.288573 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.288721 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.288902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.289084 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.289854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.290030 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.290188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.290343 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.290490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.290644 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.290810 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.291525 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.291695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.291890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.292038 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.292192 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 20:07:23.292427 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.292585 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.292743 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.292891 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.293063 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.293222 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.293378 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.293533 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.293679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.293871 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.294026 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.294186 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.294506 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.294677 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.294843 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.295029 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.295196 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.295357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.295514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.295660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.295858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.296013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.296158 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.296313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.296466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.296612 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.296757 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.296922 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.297106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.297271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.297430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.297576 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.297728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.297881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.298077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.298234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.298393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.298540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.298692 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.298857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.298857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.299191 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.299381 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.299670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.299844 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.300102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.300263 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.300424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.300572 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.300716 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.300862 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.301192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.301769 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.301936 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.302127 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.302282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.302431 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.302583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.302730 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.302885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.303043 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.303232 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.303420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.304247 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.304433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.304601 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.304749 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.304894 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.305076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.305225 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.305387 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.305541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.305687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.305840 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.305986 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.306172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.306332 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.306479 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.306636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.306781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.306935 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.307088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.307285 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.307444 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.307593 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.307738 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.307890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.308049 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.308204 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.308349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.308512 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.308667 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.308813 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.309018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.309183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.309329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.309483 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.309780 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.309944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.310196 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.310361 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.310509 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.310655 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.310893 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.311054 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.311308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.311876 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.312042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.312198 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.312395 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.312551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.312698 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.312846 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.313025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.313186 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.313396 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.313811 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.313963 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.314117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.314299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.314453 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.314607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.314772 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.315425 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.315586 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.315743 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.315899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.316063 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.316221 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.316388 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.316534 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.316680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.316833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.317002 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.317173 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.317321 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.317467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.317613 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.317759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.317914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.318064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.318472 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.318623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.318777 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.318923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.319108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.319265 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.319420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.319574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.320089 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.320395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.320562 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.320718 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.320865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.321056 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.321215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.321469 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.322047 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.322206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.322393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.322549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.322695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.322859 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.323005 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.323150 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.323297 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.323482 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.323644 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.323873 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.324029 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.324183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.324330 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.324475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.324621 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.324779 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.324932 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.325113 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.325271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.325419 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.325579 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.325738 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.325891 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.326038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.326190 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.326337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.326491 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.326638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.326791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.326946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.327098 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.327244 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.327398 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.327563 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.327709 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.327854 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.328006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.328154 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.328308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.328497 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.328647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.328801 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.328947 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.329152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.329299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.329445 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.329618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.329766 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.330081 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.330250 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.330510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.330663 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.330810 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.330962 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.331120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.331280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.331280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.331702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.332254 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.332422 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.332623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.332787 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.332935 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.333115 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.333368 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.333519 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.333974 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.334148 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.334297 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.334452 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.334606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.334794 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.334969 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.335117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.335279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.335433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.335580 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.335735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.335892 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.336038 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.336193 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.336339 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.336339 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.336678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.336835 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.337027 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.337267 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.337424 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.337572 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.337725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.337881 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.338036 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.338183 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.338330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.338330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.338655 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.338803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.338803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.339100 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.339245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.339390 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.339586 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.339745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.339891 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.340036 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.340355 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.340531 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.340774 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.340934 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.341194 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.341365 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.341513 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.341753 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.341938 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.342317 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.342661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.342817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.342965 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.343117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.343433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.343634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.343797 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.343954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.344122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.344280 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.344428 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.344575 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.344728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.344874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.345056 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.345222 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.345379 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.345533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.345687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.345687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.345972 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.346143 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.346289 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.346289 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.346565 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.346711 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.346864 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.347019 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.347173 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.347325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.347472 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.347617 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.347773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.347920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.348083 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.348237 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.348390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.348536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.348695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.348852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.349016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.349168 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.349324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.349471 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.349626 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.349771 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.349935 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.350091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.351052 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.351219 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.351377 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.351524 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.351670 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.351913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.352068 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.352454 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.352836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.353035 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.353190 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.353359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.353506 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.353661 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.353809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.353962 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.354116 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.354264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.354420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.354616 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.354768 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.354915 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.355070 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.355225 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.355390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.355551 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.355738 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.355886 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.356032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.356214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.356453 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.356610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.356772 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.356928 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.357102 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.357260 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.357422 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.357580 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.357735 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.357882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.358027 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.358172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.358331 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.358478 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.358630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.358783 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.358937 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.359091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.359447 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.359610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.359782 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.359937 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.360085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.360239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.360479 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.360656 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.360826 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.361149 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.361308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.361467 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.361621 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.361768 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.361953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.362189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.362566 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.362760 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.363108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.363264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.363264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.363559 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.363720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.363867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.363867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.364143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.364300 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.364465 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.364625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.364780 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.364926 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.365227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.365390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.365538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.365740 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.365857 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.366653 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.366863 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.367036 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.367240 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.367577 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.367772 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.367956 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.368115 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.368234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.368348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.368462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.368621 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.368815 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.369033 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.369281 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.369485 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.369687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.369908 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.370099 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.370256 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.370404 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.370843 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.371017 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.371376 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.371542 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.371698 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.371879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.372040 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.372223 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.373957 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.374131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.374290 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.374439 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.374641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.374820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.375042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.375205 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.375361 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.375516 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.375710 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.375874 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.376021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.376216 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.376375 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.376538 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.376696 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.376854 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.377054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.377241 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.377406 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.377562 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.377725 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.377874 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.378033 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.378260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.378411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.378566 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.378713 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.378860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.379007 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.379188 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.379373 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.379534 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.379682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.379827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.379992 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.380147 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.380359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.380527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.380696 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.380934 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.381213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.381583 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.381845 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.382005 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.382153 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.382413 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.382709 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.383136 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.383320 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.383716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.383866 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.384021 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.384169 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.384169 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.384169 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.384685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.384833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.384833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.385158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.385313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.385482 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.385666 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.385826 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.385974 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.385974 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.386261 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.386407 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.386594 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.386752 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.386901 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.387055 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.387210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.387366 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.387537 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.387698 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.387859 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.388012 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.388174 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.388328 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.388516 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.388708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.388708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.388708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.388708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.388708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.388708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.388708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.389814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.389986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.389986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.390426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.390696 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.390861 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.391117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.391370 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.391708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.391871 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.392024 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.392189 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.392342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.393177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.393402 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.393838 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.394012 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.394012 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.394012 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.394459 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.394616 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.394769 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.394922 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.394922 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.395244 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.395407 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.395569 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.395735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.395898 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.396052 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.396219 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.396381 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.396541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.396730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.396921 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.397097 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.397374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.397628 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.397820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.398170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.398332 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.398485 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.398651 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.398815 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.398969 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.399121 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.399283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.399507 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.399674 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.399829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.400006 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.400175 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.400328 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.400490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.400644 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.400876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.401097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.401339 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.401507 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.401916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.402082 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.402281 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.402440 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.402614 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.402769 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.403040 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.403452 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.403612 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.403988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.404160 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.404327 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.404482 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.404635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.404788 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.404788 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.405151 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.405318 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.405472 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.405637 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.405791 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.405943 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.406147 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.406316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.406471 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.406623 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.406783 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.406946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.407106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.407288 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.407451 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.407603 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.407756 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.407909 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.408061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.408229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.408390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.408543 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.408704 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.408894 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.409091 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.409247 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.409420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.409573 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.409726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.409878 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.410081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.410241 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.410443 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.410596 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.410596 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.410901 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.411068 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.411222 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.411479 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.411666 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.411992 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.412163 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.412332 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.412487 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.412640 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.413789 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.414197 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.414385 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.414542 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.414542 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.414832 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.414997 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.415158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.415158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.415472 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.415627 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.415779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.415945 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.416103 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.416265 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.416418 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.416576 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.416728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.416923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.417161 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.417161 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.417476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.417639 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.417793 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.417952 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.418119 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.418119 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.418445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.418602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.418755 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.418914 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.419076 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.419252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.419405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.419557 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.419711 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.419711 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.420015 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.420169 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.420320 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.420479 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.420639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.420801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.420979 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.421140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.421303 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.421517 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.421745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.421940 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.422246 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.422407 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.422569 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.422722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.422874 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.423038 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.423191 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.423346 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.423797 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.423976 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.424149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.424149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.424633 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.424794 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.424948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.425149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.425313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.425481 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.425634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.425798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.425949 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.425949 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.426269 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.426454 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.426614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.426774 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.426927 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.427080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.427242 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.427242 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.427541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.427694 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.427846 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.427846 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.428168 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.428322 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.428527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.429256 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.429423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.429626 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.429793 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.429948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.430055 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.430145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.430283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.430405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.430517 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.430630 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.430750 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.430864 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.430864 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.430864 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.431201 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.431322 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.431444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.431571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.431687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.431892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.432013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.432289 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.432412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.432540 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.432654 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.432775 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.432896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.433071 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.433212 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.433340 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.433455 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.433567 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.433994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.434111 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.434231 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.434606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.434749 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.434864 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.434984 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.435105 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.435105 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.435348 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.435471 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.435596 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.435710 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.435822 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.435943 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.436057 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.436170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.436289 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.436410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.436531 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.436654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.436775 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.436889 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.437075 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.437196 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.437317 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.437439 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.437560 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.437710 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.437831 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.437961 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.438088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.438211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.438334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.438454 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.438568 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.438700 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.438867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.439024 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.439151 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.439273 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.439395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.439507 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.439630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.439744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.439856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.439966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.440085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.440198 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.440323 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.440443 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.440554 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.440666 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.440784 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.440905 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.441037 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.441168 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.441299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.441419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.441539 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.441661 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.441783 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.441923 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.442111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.442388 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.442528 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.442652 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.442765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.442879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.443001 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.443114 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.443477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.443603 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.444081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.444206 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.444329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.444443 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.444588 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.444890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.445102 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.445246 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.445365 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.445477 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.445602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.445716 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.445836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.445957 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.446072 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.446183 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.446315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.446429 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.446541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.446654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.446766 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.446877 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.447001 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.447115 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.447241 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.447354 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.447473 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.447599 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.447720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.447720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.447945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.447945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.447945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.447945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.447945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.448480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.448592 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.448713 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.448826 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.448826 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.449079 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.449243 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.449368 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.449489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.449610 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.449742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.449855 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.449976 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.450096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.450096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.450324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.450438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.453268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.453418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.453561 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.453719 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.454158 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.454413 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.454546 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.454670 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.454823 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.455130 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.455275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.455393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.455506 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.455619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.455738 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.455853 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.456023 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.456141 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.456254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.456366 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.456478 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.456600 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.456722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.456844 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.456957 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.457096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.457209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.457336 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.457458 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.457572 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.457684 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.457804 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.457924 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.458053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.458167 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.458279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.458398 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.458515 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.458641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.458641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.458860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.458974 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.459093 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.459221 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.459553 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.459708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.459991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.460168 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.460284 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.460397 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.460525 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.460685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.460857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.461029 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.461164 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.461301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.461417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.461531 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.461651 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.461766 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.461879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.462072 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.462188 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.462301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.462413 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.462533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.462647 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.462774 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.462898 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.463211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.463211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.463534 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.463677 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.463812 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.463812 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.464358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.464581 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.464701 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.464701 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.464948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.465427 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.465556 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.465556 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.465840 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.465987 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.466108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.466237 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.466391 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.466509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.466637 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.466798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.466922 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.467066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.467185 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.467299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.467459 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.467579 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.467700 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.467814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.467961 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.468078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.468200 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.468323 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.468443 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.468593 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.468721 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.468971 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.469112 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.469112 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.469348 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.469348 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.469606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.469773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.469901 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.470057 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.470178 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.470299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.470412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.470538 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.470696 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.470846 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.470974 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.470974 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.471248 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.471370 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.471483 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.471594 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.471706 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.471817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.471973 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.472091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.472250 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.472372 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.472487 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.472598 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.472759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.472878 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.473079 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.473392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.473541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.473676 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.473819 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.473962 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.474103 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.474548 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.474788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.474940 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.475115 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.476122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.476281 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.476427 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.476609 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.476761 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.476922 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.477082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.477257 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.477393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.477393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.477655 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.477789 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.477922 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.478054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.478186 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.478318 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.478461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.478461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.478763 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.478905 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.479038 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.479184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.479343 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.479476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.479610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.479742 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.479875 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.480016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.480157 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.480290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.480430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.480563 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.480735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.480879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.481102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.481238 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.481401 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.481534 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.481668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.481811 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.481952 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.482085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.482085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.482342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.482488 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.482621 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.482764 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.482904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.482904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.483156 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.483316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.483603 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.484328 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.484850 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.484850 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.485170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.485314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.485477 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.485622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.485756 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.485891 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.486122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.486371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.486516 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.486666 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.486800 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.486943 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.487077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.487217 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.487351 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.487498 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.487639 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.487774 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.487916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.488048 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.488189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.488336 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.488470 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.488602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.488743 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.488904 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.489155 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.489292 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.489425 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.489591 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.489724 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.489724 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.489998 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.490132 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.490266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.490398 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.490538 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.490670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.490670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.490994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.491643 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.491779 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.491779 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.492054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.492054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.492318 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.492318 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.492581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.492714 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.492855 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.493032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.493032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.493329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.493478 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.493786 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.493938 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.493938 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.494200 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.494343 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.494477 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.494996 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.494996 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.495273 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.495415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.495415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.495683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.495825 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.495966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.496117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.496117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.496584 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.496720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.496720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.497069 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.497211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.497345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.497486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.497486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.497746 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.498134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.498134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.498300 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.498394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.498394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.498643 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.498730 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.498815 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.498900 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.498986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.499082 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.499212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.499315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.499315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.499473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.499558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.499653 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.499741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.499741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.499903 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.499990 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.500083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.500171 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.500258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.500344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.500344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.500506 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.500602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.500602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.500758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.500844 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.500929 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.501216 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.501216 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.501488 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.501606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.501727 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.501869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.501869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.502087 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.502175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.502260 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.502346 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.502346 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.502514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.502608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.502608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.502780 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.502867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.502867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.503032 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.503125 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.503218 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.503312 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.503312 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.503484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.503577 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.503683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.503904 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.503904 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.504081 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.504182 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.504270 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.504354 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.504354 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.504510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.504595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.504709 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.505097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.505097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.505283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.505368 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.505454 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.505548 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.505635 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.505727 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.505727 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.505933 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.506041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.506041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.506041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.506041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.506358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.506446 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.506805 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.506924 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.507025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.507114 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.507199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.507291 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.507387 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.507482 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.507569 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.507662 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.507756 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.507852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.507947 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.508041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.508134 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.508221 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.508314 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.508416 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.508510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.508598 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.508598 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.508752 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.508844 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.508939 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.509044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.509149 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.509245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.509405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.509496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.509591 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.509679 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.509763 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.509763 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.509934 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.510021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.510115 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.510202 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.510286 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.510286 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.510447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.510541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.510636 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.510722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.510807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.510892 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.510984 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.510984 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.511162 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.511162 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.511326 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.511418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.511505 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.511602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.511690 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.511782 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.511876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.511971 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.512066 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.512153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.512245 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.512339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.512426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.512511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.512608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.512702 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.512789 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.512873 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.512998 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.513101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.513199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.513331 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.513427 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.513514 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.513608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.513703 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.513797 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.514027 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.514121 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.514207 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.514296 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.514392 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.514487 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.514574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.514658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.514743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.514827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.514984 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.515077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.515309 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.515417 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.515513 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.515614 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.515708 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.515801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.515889 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.515982 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.516076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.516172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.516261 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.516354 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.516440 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.516532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.516626 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.516805 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.516910 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.517016 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.517104 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117876) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 20:07:23.517202 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.517202 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.517202 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.517454 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 20:07:23.517645 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 20:07:23.578491 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO dbcounter [None req-50b9577f-3f26-49bc-a424-4ac2c15f3680 None None] Registered counter for database nova_api Jul 27 20:07:23.582572 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO dbcounter [None req-ecda64e4-0fbe-4153-9c1f-46949df00cb9 None None] Registered counter for database nova_api Jul 27 20:07:23.602992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_db.sqlalchemy.engines [None req-50b9577f-3f26-49bc-a424-4ac2c15f3680 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:07:23.605310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_db.sqlalchemy.engines [None req-ecda64e4-0fbe-4153-9c1f-46949df00cb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:07:23.609931 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writer thread running {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:07:23.612035 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writer thread running {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:07:23.667715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.context [None req-50b9577f-3f26-49bc-a424-4ac2c15f3680 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9601e96c-4523-4233-9a0d-7b0bfdd5753a(cell1) {{(pid=117876) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 20:07:23.668981 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.context [None req-ecda64e4-0fbe-4153-9c1f-46949df00cb9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9601e96c-4523-4233-9a0d-7b0bfdd5753a(cell1) {{(pid=117877) load_cells /opt/stack/nova/nova/context.py:464}} Jul 27 20:07:23.671875 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-50b9577f-3f26-49bc-a424-4ac2c15f3680 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:07:23.673117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ecda64e4-0fbe-4153-9c1f-46949df00cb9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:07:23.673476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-50b9577f-3f26-49bc-a424-4ac2c15f3680 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:07:23.674291 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-50b9577f-3f26-49bc-a424-4ac2c15f3680 None None] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:07:23.674704 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ecda64e4-0fbe-4153-9c1f-46949df00cb9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:07:23.675518 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ecda64e4-0fbe-4153-9c1f-46949df00cb9 None None] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:07:23.676280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-50b9577f-3f26-49bc-a424-4ac2c15f3680 None None] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:07:23.677540 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ecda64e4-0fbe-4153-9c1f-46949df00cb9 None None] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:07:23.678306 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO dbcounter [None req-50b9577f-3f26-49bc-a424-4ac2c15f3680 None None] Registered counter for database nova_cell0 Jul 27 20:07:23.679559 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO dbcounter [None req-ecda64e4-0fbe-4153-9c1f-46949df00cb9 None None] Registered counter for database nova_cell0 Jul 27 20:07:23.682598 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO dbcounter [None req-50b9577f-3f26-49bc-a424-4ac2c15f3680 None None] Registered counter for database nova_cell1 Jul 27 20:07:23.683583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO dbcounter [None req-ecda64e4-0fbe-4153-9c1f-46949df00cb9 None None] Registered counter for database nova_cell1 Jul 27 20:07:23.689799 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_db.sqlalchemy.engines [None req-50b9577f-3f26-49bc-a424-4ac2c15f3680 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:07:23.691890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_db.sqlalchemy.engines [None req-ecda64e4-0fbe-4153-9c1f-46949df00cb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:07:23.693108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_db.sqlalchemy.engines [None req-ecda64e4-0fbe-4153-9c1f-46949df00cb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:07:23.695163 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writer thread running {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:07:23.695817 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_db.sqlalchemy.engines [None req-50b9577f-3f26-49bc-a424-4ac2c15f3680 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:07:23.702083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writer thread running {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:07:23.702431 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writer thread running {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:07:23.840213 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writer thread running {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:07:23.848934 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO dbcounter [None req-50b9577f-3f26-49bc-a424-4ac2c15f3680 None None] Registered counter for database nova_cell0 Jul 27 20:07:23.852180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO dbcounter [None req-ecda64e4-0fbe-4153-9c1f-46949df00cb9 None None] Registered counter for database nova_cell0 Jul 27 20:07:23.856893 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_db.sqlalchemy.engines [None req-50b9577f-3f26-49bc-a424-4ac2c15f3680 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117876) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:07:23.858978 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_db.sqlalchemy.engines [None req-ecda64e4-0fbe-4153-9c1f-46949df00cb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 20:07:23.862320 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writer thread running {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:07:23.866755 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writer thread running {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 20:07:24.187131 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: WARNING keystonemiddleware.auth_token [None req-ecda64e4-0fbe-4153-9c1f-46949df00cb9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 20:07:24.194774 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: WARNING keystonemiddleware.auth_token [None req-ecda64e4-0fbe-4153-9c1f-46949df00cb9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 20:07:24.196753 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: WARNING keystonemiddleware.auth_token [None req-50b9577f-3f26-49bc-a424-4ac2c15f3680 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 20:07:24.204040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: WARNING keystonemiddleware.auth_token [None req-50b9577f-3f26-49bc-a424-4ac2c15f3680 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 20:07:24.544799 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: WARNING keystonemiddleware.auth_token [None req-ecda64e4-0fbe-4153-9c1f-46949df00cb9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 20:07:24.550763 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: WARNING keystonemiddleware.auth_token [None req-ecda64e4-0fbe-4153-9c1f-46949df00cb9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 20:07:24.556182 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5615519639c0 pid: 117877 (default app) Jul 27 20:07:24.559792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: WARNING keystonemiddleware.auth_token [None req-50b9577f-3f26-49bc-a424-4ac2c15f3680 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 27 20:07:24.565778 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: WARNING keystonemiddleware.auth_token [None req-50b9577f-3f26-49bc-a424-4ac2c15f3680 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 27 20:07:24.571823 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5615519639c0 pid: 117876 (default app) Jul 27 20:08:06.360163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:08:06.362034 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:08:06.364446 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:08:06.366094 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:08:06.439547 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=3 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:08:06.450085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=3 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:08:06.451297 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=3 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:08:06.452323 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=3 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:08:08.465864 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3c3738ed-4297-4f46-bf78-e731da3184cd tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Action: 'create', calling method: .version_select at 0x7fc7f101fca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-412279669"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:08:08.710401 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8169cd8c-2b07-44f1-bd11-6b9c6159ef09 tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] Action: 'create', calling method: .version_select at 0x7fc7f1020ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1165613666", "metadata": {"Type": "work"}}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:08:08.725809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8169cd8c-2b07-44f1-bd11-6b9c6159ef09 tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] Request method failure captured: Jul 27 20:08:08.725809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 20:08:08.725809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:08:08.725809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:08:08.725809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:08:08.725809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 122 Jul 27 20:08:08.725809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:08:08.725809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:08:08.725809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:08:08.725809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:08:08.725809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4Zsm93TNYPVohAhdK8SXJQeK-emkcXFDsRH19kgIGHisDpk8r1g16aYoK2Q_7SxBH22hXHXbJnH0wgZL5I1wZWhEqH2V4y9xgdlEvIrrDQgujq-Ke2xs8TO71Qf7W9B8cReNWLOWkRYNscTbcFC6wc-9Tz_GwW-arapVhnBLzYyXxSQ Jul 27 20:08:08.725809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:08:08.725809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:08:08.725809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:08:08.725809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:08:08.725809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:08:08.725809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:08:08.725809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 730a466023454452a63effcf2672e10c Jul 27 20:08:08.725809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-VolumesNegativeTest-499964191 Jul 27 20:08:08.725809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:08:08.725809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:08:08.727211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/730a466023454452a63effcf2672e10c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/730a466023454452a63effcf2672e10c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_730a466023454452a63effcf2672e10c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/730a466023454452a63effcf2672e10c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:08:08.727211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-VolumesNegativeTest-499964191 Jul 27 20:08:08.727211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 730a466023454452a63effcf2672e10c Jul 27 20:08:08.727211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-VolumesNegativeTest-499964191 Jul 27 20:08:08.727211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-VolumesNegativeTest-499964191-project Jul 27 20:08:08.727211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:08:08.727211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:08:08.727211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: 73385c17c60d4a47b504b9fd9892762d Jul 27 20:08:08.727211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-VolumesNegativeTest-499964191-project Jul 27 20:08:08.727211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Jul 27 20:08:08.727211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1165613666", "metadata": {"Type": "work"}}} Jul 27 20:08:08.727211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: Jul 27 20:08:08.727211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 20:08:08.728135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1165613666', 'metadata': {'Type': 'work'}}}} Jul 27 20:08:08.728135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:08:08.728135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:08.728135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 20:08:08.728135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 20:08:08.728135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 20:08:08.728135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise error Jul 27 20:08:08.728135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 27 20:08:08.728135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:08.728135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 27 20:08:08.728135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 20:08:08.728135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:08.728135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 20:08:08.728135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi '#$%' Jul 27 20:08:08.728135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:08.728135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:08.728135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:08.728135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:08.728135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:08:08.728135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:08:08.728135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:08:08.728135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:08:08.729502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 20:08:08.729502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 20:08:08.729502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:08:08.729502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:08:08.729502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 20:08:08.729502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 20:08:08.729502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 20:08:08.729502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 20:08:08.729502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 20:08:08.729502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 20:08:08.729502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 20:08:08.729502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:08.729502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:08.729502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:08.729502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:08.729502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:08:08.729502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:08:08.729502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 20:08:08.729502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 20:08:08.731653 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 27 20:08:08.731653 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:08.735421 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8169cd8c-2b07-44f1-bd11-6b9c6159ef09 tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:08:08.737147 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8169cd8c-2b07-44f1-bd11-6b9c6159ef09 tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 2.316102 Jul 27 20:08:08.740082 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1/1] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Jul 27 20:08:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 2321 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 27 20:08:08.765397 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5ff4c4f4-f079-4093-9660-7e9f4d04eb01 tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] Action: 'create', calling method: .version_select at 0x7fc7f0f3c430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-749680248", "metadata": {"Type": "work"}}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:08:08.771341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5ff4c4f4-f079-4093-9660-7e9f4d04eb01 tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] Request method failure captured: Jul 27 20:08:08.771341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 20:08:08.771341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:08:08.771341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:08:08.771341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:08:08.771341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 119 Jul 27 20:08:08.771341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:08:08.771341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:08:08.771341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:08:08.771341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:08:08.771341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4Zsm93TNYPVohAhdK8SXJQeK-emkcXFDsRH19kgIGHisDpk8r1g16aYoK2Q_7SxBH22hXHXbJnH0wgZL5I1wZWhEqH2V4y9xgdlEvIrrDQgujq-Ke2xs8TO71Qf7W9B8cReNWLOWkRYNscTbcFC6wc-9Tz_GwW-arapVhnBLzYyXxSQ Jul 27 20:08:08.771341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:08:08.771341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:08:08.771341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:08:08.771341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:08:08.771341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:08:08.771341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:08:08.771341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 730a466023454452a63effcf2672e10c Jul 27 20:08:08.771341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-VolumesNegativeTest-499964191 Jul 27 20:08:08.771341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:08:08.771341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:08:08.772649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/730a466023454452a63effcf2672e10c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/730a466023454452a63effcf2672e10c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_730a466023454452a63effcf2672e10c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/730a466023454452a63effcf2672e10c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:08:08.772649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-VolumesNegativeTest-499964191 Jul 27 20:08:08.772649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 730a466023454452a63effcf2672e10c Jul 27 20:08:08.772649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-VolumesNegativeTest-499964191 Jul 27 20:08:08.772649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-VolumesNegativeTest-499964191-project Jul 27 20:08:08.772649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:08:08.772649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:08:08.772649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: 73385c17c60d4a47b504b9fd9892762d Jul 27 20:08:08.772649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-VolumesNegativeTest-499964191-project Jul 27 20:08:08.772649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Jul 27 20:08:08.772649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-749680248", "metadata": {"Type": "work"}}} Jul 27 20:08:08.772649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: Jul 27 20:08:08.772649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 20:08:08.773607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-749680248', 'metadata': {'Type': 'work'}}}} Jul 27 20:08:08.773607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:08:08.773607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:08.773607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 20:08:08.773607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 20:08:08.773607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 20:08:08.773607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise error Jul 27 20:08:08.773607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 27 20:08:08.773607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:08.773607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 27 20:08:08.773607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 20:08:08.773607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:08.773607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 20:08:08.773607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi '0' Jul 27 20:08:08.773607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:08.773607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:08.773607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:08.773607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:08.773607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:08:08.773607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:08:08.773607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:08:08.773607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:08:08.774857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 20:08:08.774857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 20:08:08.774857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:08:08.774857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:08:08.774857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 20:08:08.774857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 20:08:08.774857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 20:08:08.774857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 20:08:08.774857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 20:08:08.774857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 20:08:08.774857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 20:08:08.774857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:08.774857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:08.774857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:08.774857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:08.774857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:08:08.774857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:08:08.774857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 20:08:08.774857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 20:08:08.777946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 27 20:08:08.777946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:08.780483 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5ff4c4f4-f079-4093-9660-7e9f4d04eb01 tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:08:08.782133 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5ff4c4f4-f079-4093-9660-7e9f4d04eb01 tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.034415 Jul 27 20:08:08.783018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2/2] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Jul 27 20:08:08 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 27 20:08:08.796894 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a8991029-3788-4f55-bb99-94271367506e tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] Action: 'create', calling method: .version_select at 0x7fc7f0ed68b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1442387964", "metadata": {"Type": "work"}}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:08:08.812625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a8991029-3788-4f55-bb99-94271367506e tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] Request method failure captured: Jul 27 20:08:08.812625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 27 20:08:08.812625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:08:08.812625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:08:08.812625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:08:08.812625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 119 Jul 27 20:08:08.812625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:08:08.812625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:08:08.812625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:08:08.812625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:08:08.812625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4Zsm93TNYPVohAhdK8SXJQeK-emkcXFDsRH19kgIGHisDpk8r1g16aYoK2Q_7SxBH22hXHXbJnH0wgZL5I1wZWhEqH2V4y9xgdlEvIrrDQgujq-Ke2xs8TO71Qf7W9B8cReNWLOWkRYNscTbcFC6wc-9Tz_GwW-arapVhnBLzYyXxSQ Jul 27 20:08:08.812625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:08:08.812625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:08:08.812625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:08:08.812625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:08:08.812625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:08:08.812625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:08:08.812625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 730a466023454452a63effcf2672e10c Jul 27 20:08:08.812625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-VolumesNegativeTest-499964191 Jul 27 20:08:08.812625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:08:08.812625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:08:08.813997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/730a466023454452a63effcf2672e10c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/730a466023454452a63effcf2672e10c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_730a466023454452a63effcf2672e10c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/730a466023454452a63effcf2672e10c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:08:08.813997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-VolumesNegativeTest-499964191 Jul 27 20:08:08.813997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 730a466023454452a63effcf2672e10c Jul 27 20:08:08.813997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-VolumesNegativeTest-499964191 Jul 27 20:08:08.813997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-VolumesNegativeTest-499964191-project Jul 27 20:08:08.813997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:08:08.813997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:08:08.813997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: 73385c17c60d4a47b504b9fd9892762d Jul 27 20:08:08.813997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-VolumesNegativeTest-499964191-project Jul 27 20:08:08.813997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Jul 27 20:08:08.813997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1442387964", "metadata": {"Type": "work"}}} Jul 27 20:08:08.813997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: Jul 27 20:08:08.813997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 20:08:08.814752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1442387964', 'metadata': {'Type': 'work'}}}} Jul 27 20:08:08.814752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:08:08.814752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:08.814752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 27 20:08:08.814752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 27 20:08:08.814752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 27 20:08:08.814752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise error Jul 27 20:08:08.814752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 27 20:08:08.814752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:08.814752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 27 20:08:08.814752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 27 20:08:08.814752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:08.814752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 27 20:08:08.814752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi '' Jul 27 20:08:08.814752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:08.814752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:08.814752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:08.814752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:08.814752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:08:08.814752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:08:08.814752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:08:08.814752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:08:08.816014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 20:08:08.816014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 20:08:08.816014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:08:08.816014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:08:08.816014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 27 20:08:08.816014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 27 20:08:08.816014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 27 20:08:08.816014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 27 20:08:08.816014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 27 20:08:08.816014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 27 20:08:08.816014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 20:08:08.816014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:08.816014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:08.816014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:08.816014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:08.816014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:08:08.816014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:08:08.816014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 27 20:08:08.816014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 27 20:08:08.817139 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 27 20:08:08.817139 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:08.820637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a8991029-3788-4f55-bb99-94271367506e tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:08:08.828730 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a8991029-3788-4f55-bb99-94271367506e tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.032866 Jul 27 20:08:08.829950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 3/3] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Jul 27 20:08:08 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:08:08.842641 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8add5672-a64c-42b2-9edd-f5f9e5cf82a3 tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] Calling method '.version_select at 0x7fc7f0ed6550>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:09.666695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-8add5672-a64c-42b2-9edd-f5f9e5cf82a3 tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] HTTP exception thrown: Volume tempest-invalid-1137873417 could not be found. Jul 27 20:08:09.671308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8add5672-a64c-42b2-9edd-f5f9e5cf82a3 tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] Request method failure captured: Jul 27 20:08:09.671308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1137873417 HTTP/1.1 Jul 27 20:08:09.671308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:08:09.671308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:08:09.671308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:08:09.671308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:08:09.671308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:08:09.671308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:08:09.671308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:08:09.671308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:08:09.671308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4Zsm93TNYPVohAhdK8SXJQeK-emkcXFDsRH19kgIGHisDpk8r1g16aYoK2Q_7SxBH22hXHXbJnH0wgZL5I1wZWhEqH2V4y9xgdlEvIrrDQgujq-Ke2xs8TO71Qf7W9B8cReNWLOWkRYNscTbcFC6wc-9Tz_GwW-arapVhnBLzYyXxSQ Jul 27 20:08:09.671308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:08:09.671308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:08:09.671308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:08:09.671308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:08:09.671308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:08:09.671308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:08:09.671308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 730a466023454452a63effcf2672e10c Jul 27 20:08:09.671308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-VolumesNegativeTest-499964191 Jul 27 20:08:09.671308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:08:09.671308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:08:09.672741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/730a466023454452a63effcf2672e10c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/730a466023454452a63effcf2672e10c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_730a466023454452a63effcf2672e10c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/730a466023454452a63effcf2672e10c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:08:09.672741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-VolumesNegativeTest-499964191 Jul 27 20:08:09.672741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 730a466023454452a63effcf2672e10c Jul 27 20:08:09.672741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-VolumesNegativeTest-499964191 Jul 27 20:08:09.672741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-VolumesNegativeTest-499964191-project Jul 27 20:08:09.672741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:08:09.672741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:08:09.672741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: 73385c17c60d4a47b504b9fd9892762d Jul 27 20:08:09.672741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-VolumesNegativeTest-499964191-project Jul 27 20:08:09.672741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: Jul 27 20:08:09.672741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Volume tempest-invalid-1137873417 could not be found. Jul 27 20:08:09.672741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'id': 'tempest-invalid-1137873417'} Jul 27 20:08:09.672741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:08:09.673725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:09.673725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:08:09.673725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:08:09.673725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 20:08:09.673725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 20:08:09.673725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 20:08:09.673725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 20:08:09.673725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 20:08:09.673725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 20:08:09.673725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 20:08:09.673725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 20:08:09.673725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:08:09.673725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:08:09.673725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:08:09.673725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:08:09.673725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1137873417 could not be found. (HTTP 404) (Request-ID: req-0d38a921-7451-4b45-aa4b-057981fadb63) Jul 27 20:08:09.673725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:09.673725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:09.673725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:09.675197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:09.675197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 20:08:09.675197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 20:08:09.675197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:08:09.675197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:08:09.675197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 20:08:09.675197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 20:08:09.675197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:08:09.675197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:08:09.675197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:08:09.675197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:08:09.675197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 20:08:09.675197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 20:08:09.675197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 20:08:09.675197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 20:08:09.675197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 20:08:09.675197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 20:08:09.675197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 20:08:09.675197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 20:08:09.676558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:08:09.676558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:08:09.676558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:08:09.676558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:08:09.676558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1137873417 could not be found. Jul 27 20:08:09.676558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:09.676558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:09.676558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:09.676558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:09.676558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:08:09.676558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:08:09.676558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:08:09.676558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:08:09.676558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 20:08:09.676558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 20:08:09.676558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:08:09.676558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:08:09.676558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 20:08:09.676558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:08:09.676558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1137873417 could not be found. Jul 27 20:08:09.678145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:09.678145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:09.678145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:09.678145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:09.678145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:08:09.678145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:08:09.678145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:08:09.678145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:08:09.678145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1137873417 could not be found. Jul 27 20:08:09.678145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:09.678145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8add5672-a64c-42b2-9edd-f5f9e5cf82a3 tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] Returning 404 to user: Volume tempest-invalid-1137873417 could not be found. {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:08:09.680182 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8add5672-a64c-42b2-9edd-f5f9e5cf82a3 tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1137873417" status: 404 len: 99 microversion: 2.1 time: 0.844606 Jul 27 20:08:09.681701 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 4/4] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Jul 27 20:08:08 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1137873417 => generated 99 bytes in 847 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 27 20:08:09.695003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3f8cebe6-142b-4869-a7f3-07f0f828e7da tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007150 Jul 27 20:08:09.696602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 5/5] 10.222.0.65 () {58 vars in 1140 bytes} [Wed Jul 27 20:08:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 27 20:08:09.704880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-907c777f-c027-4447-82ea-26b802585f87 tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003937 Jul 27 20:08:09.720029 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 6/6] 10.222.0.65 () {58 vars in 1137 bytes} [Wed Jul 27 20:08:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 27 20:08:09.736508 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-06171ef7-dec4-440f-8e60-21c689c93dc1 tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] Calling method '.version_select at 0x7fc7f0e41b80>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:09.916903 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-06171ef7-dec4-440f-8e60-21c689c93dc1 tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] HTTP exception thrown: Volume ea4dc0dc-2c54-4d1e-afca-a35d710cca7b could not be found. Jul 27 20:08:09.923035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-06171ef7-dec4-440f-8e60-21c689c93dc1 tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] Request method failure captured: Jul 27 20:08:09.923035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: DELETE /compute/v2.1/os-volumes/ea4dc0dc-2c54-4d1e-afca-a35d710cca7b HTTP/1.1 Jul 27 20:08:09.923035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:08:09.923035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:08:09.923035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:08:09.923035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:08:09.923035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:08:09.923035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:08:09.923035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:08:09.923035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:08:09.923035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4Zsm93TNYPVohAhdK8SXJQeK-emkcXFDsRH19kgIGHisDpk8r1g16aYoK2Q_7SxBH22hXHXbJnH0wgZL5I1wZWhEqH2V4y9xgdlEvIrrDQgujq-Ke2xs8TO71Qf7W9B8cReNWLOWkRYNscTbcFC6wc-9Tz_GwW-arapVhnBLzYyXxSQ Jul 27 20:08:09.923035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:08:09.923035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:08:09.923035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:08:09.923035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:08:09.923035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:08:09.923035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:08:09.923035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 730a466023454452a63effcf2672e10c Jul 27 20:08:09.923035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-VolumesNegativeTest-499964191 Jul 27 20:08:09.923035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:08:09.923035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:08:09.924678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/730a466023454452a63effcf2672e10c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/730a466023454452a63effcf2672e10c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_730a466023454452a63effcf2672e10c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/730a466023454452a63effcf2672e10c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:08:09.924678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-VolumesNegativeTest-499964191 Jul 27 20:08:09.924678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 730a466023454452a63effcf2672e10c Jul 27 20:08:09.924678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-VolumesNegativeTest-499964191 Jul 27 20:08:09.924678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-VolumesNegativeTest-499964191-project Jul 27 20:08:09.924678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:08:09.924678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:08:09.924678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: 73385c17c60d4a47b504b9fd9892762d Jul 27 20:08:09.924678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-VolumesNegativeTest-499964191-project Jul 27 20:08:09.924678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: Jul 27 20:08:09.924678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Volume ea4dc0dc-2c54-4d1e-afca-a35d710cca7b could not be found. Jul 27 20:08:09.924678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'id': 'ea4dc0dc-2c54-4d1e-afca-a35d710cca7b'} Jul 27 20:08:09.924678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:08:09.925685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:09.925685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:08:09.925685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:08:09.925685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 20:08:09.925685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 20:08:09.925685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 20:08:09.925685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 20:08:09.925685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 20:08:09.925685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 20:08:09.925685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 20:08:09.925685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 20:08:09.925685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:08:09.925685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:08:09.925685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:08:09.925685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:08:09.925685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ea4dc0dc-2c54-4d1e-afca-a35d710cca7b could not be found. (HTTP 404) (Request-ID: req-72883f3e-d8bd-4003-b949-613da81bb752) Jul 27 20:08:09.925685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:09.925685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:09.925685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:09.927069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:09.927069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 20:08:09.927069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 20:08:09.927069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:08:09.927069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:08:09.927069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 20:08:09.927069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 20:08:09.927069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:08:09.927069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:08:09.927069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:08:09.927069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:08:09.927069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 20:08:09.927069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 20:08:09.927069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 20:08:09.927069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 20:08:09.927069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 20:08:09.927069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 20:08:09.927069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 20:08:09.927069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 20:08:09.928710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:08:09.928710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:08:09.928710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:08:09.928710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:08:09.928710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ea4dc0dc-2c54-4d1e-afca-a35d710cca7b could not be found. Jul 27 20:08:09.928710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:09.928710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:09.928710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:09.928710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:09.928710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:08:09.928710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:08:09.928710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:08:09.928710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:08:09.928710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 20:08:09.928710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 20:08:09.928710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:08:09.928710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:08:09.928710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 20:08:09.928710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:08:09.930046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ea4dc0dc-2c54-4d1e-afca-a35d710cca7b could not be found. Jul 27 20:08:09.930046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:09.930046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:09.930046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:09.930046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:09.930046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:08:09.930046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:08:09.930046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:08:09.930046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:08:09.930046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ea4dc0dc-2c54-4d1e-afca-a35d710cca7b could not be found. Jul 27 20:08:09.930046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:09.931819 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-06171ef7-dec4-440f-8e60-21c689c93dc1 tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] Returning 404 to user: Volume ea4dc0dc-2c54-4d1e-afca-a35d710cca7b could not be found. {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:08:09.933306 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-06171ef7-dec4-440f-8e60-21c689c93dc1 tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/ea4dc0dc-2c54-4d1e-afca-a35d710cca7b" status: 404 len: 109 microversion: 2.1 time: 0.211602 Jul 27 20:08:09.933991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 7/7] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Jul 27 20:08:09 2022] DELETE /compute/v2.1/os-volumes/ea4dc0dc-2c54-4d1e-afca-a35d710cca7b => generated 109 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:08:09.948246 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e43e4d59-2f18-4159-8f17-da8e4a1e9273 tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] Calling method '.version_select at 0x7fc7f0e41c10>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:10.166881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-e43e4d59-2f18-4159-8f17-da8e4a1e9273 tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] HTTP exception thrown: Volume 43226f29-30ea-4794-9a7f-d2c78ae17ff1 could not be found. Jul 27 20:08:10.169304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e43e4d59-2f18-4159-8f17-da8e4a1e9273 tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] Request method failure captured: Jul 27 20:08:10.169304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: GET /compute/v2.1/os-volumes/43226f29-30ea-4794-9a7f-d2c78ae17ff1 HTTP/1.1 Jul 27 20:08:10.169304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:08:10.169304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:08:10.169304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:08:10.169304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:08:10.169304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:08:10.169304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:08:10.169304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:08:10.169304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:08:10.169304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4Zsm93TNYPVohAhdK8SXJQeK-emkcXFDsRH19kgIGHisDpk8r1g16aYoK2Q_7SxBH22hXHXbJnH0wgZL5I1wZWhEqH2V4y9xgdlEvIrrDQgujq-Ke2xs8TO71Qf7W9B8cReNWLOWkRYNscTbcFC6wc-9Tz_GwW-arapVhnBLzYyXxSQ Jul 27 20:08:10.169304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:08:10.169304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:08:10.169304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:08:10.169304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:08:10.169304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:08:10.169304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:08:10.169304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 730a466023454452a63effcf2672e10c Jul 27 20:08:10.169304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-VolumesNegativeTest-499964191 Jul 27 20:08:10.169304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:08:10.169304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:08:10.170787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/730a466023454452a63effcf2672e10c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/730a466023454452a63effcf2672e10c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_730a466023454452a63effcf2672e10c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/730a466023454452a63effcf2672e10c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:08:10.170787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-VolumesNegativeTest-499964191 Jul 27 20:08:10.170787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 730a466023454452a63effcf2672e10c Jul 27 20:08:10.170787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-VolumesNegativeTest-499964191 Jul 27 20:08:10.170787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-VolumesNegativeTest-499964191-project Jul 27 20:08:10.170787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:08:10.170787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:08:10.170787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: 73385c17c60d4a47b504b9fd9892762d Jul 27 20:08:10.170787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-VolumesNegativeTest-499964191-project Jul 27 20:08:10.170787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: Jul 27 20:08:10.170787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Volume 43226f29-30ea-4794-9a7f-d2c78ae17ff1 could not be found. Jul 27 20:08:10.170787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'id': '43226f29-30ea-4794-9a7f-d2c78ae17ff1'} Jul 27 20:08:10.170787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:08:10.171695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:10.171695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:08:10.171695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:08:10.171695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 20:08:10.171695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 20:08:10.171695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 20:08:10.171695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 20:08:10.171695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 20:08:10.171695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 20:08:10.171695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 20:08:10.171695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 20:08:10.171695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:08:10.171695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:08:10.171695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:08:10.171695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:08:10.171695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 43226f29-30ea-4794-9a7f-d2c78ae17ff1 could not be found. (HTTP 404) (Request-ID: req-db983896-2fda-48d2-aeb5-6257f19be419) Jul 27 20:08:10.171695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:10.171695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:10.171695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:10.173064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:10.173064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 20:08:10.173064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 20:08:10.173064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:08:10.173064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:08:10.173064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 20:08:10.173064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 20:08:10.173064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:08:10.173064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:08:10.173064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:08:10.173064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:08:10.173064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 20:08:10.173064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 20:08:10.173064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 20:08:10.173064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 20:08:10.173064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 20:08:10.173064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 20:08:10.173064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 20:08:10.173064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 20:08:10.174374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:08:10.174374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:08:10.174374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:08:10.174374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:08:10.174374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 43226f29-30ea-4794-9a7f-d2c78ae17ff1 could not be found. Jul 27 20:08:10.174374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:10.174374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:10.174374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:10.174374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:10.174374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:08:10.174374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:08:10.174374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:08:10.174374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:08:10.174374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 20:08:10.174374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 20:08:10.174374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:08:10.174374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:08:10.174374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 20:08:10.174374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:08:10.175683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 43226f29-30ea-4794-9a7f-d2c78ae17ff1 could not be found. Jul 27 20:08:10.175683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:10.175683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:10.175683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:10.175683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:10.175683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:08:10.175683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:08:10.175683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:08:10.175683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:08:10.175683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 43226f29-30ea-4794-9a7f-d2c78ae17ff1 could not be found. Jul 27 20:08:10.175683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:10.175683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e43e4d59-2f18-4159-8f17-da8e4a1e9273 tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] Returning 404 to user: Volume 43226f29-30ea-4794-9a7f-d2c78ae17ff1 could not be found. {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:08:10.177862 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e43e4d59-2f18-4159-8f17-da8e4a1e9273 tempest-VolumesNegativeTest-499964191 tempest-VolumesNegativeTest-499964191-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/43226f29-30ea-4794-9a7f-d2c78ae17ff1" status: 404 len: 109 microversion: 2.1 time: 0.237099 Jul 27 20:08:10.182930 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 8/8] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Jul 27 20:08:09 2022] GET /compute/v2.1/os-volumes/43226f29-30ea-4794-9a7f-d2c78ae17ff1 => generated 109 bytes in 239 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:08:10.608751 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3c3738ed-4297-4f46-bf78-e731da3184cd tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.266533 Jul 27 20:08:10.609415 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1/9] 10.222.0.65 () {60 vars in 1155 bytes} [Wed Jul 27 20:08:06 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4269 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 27 20:08:10.625605 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7e9f3508-6cef-42d0-a2a1-ab7fd1240833 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Calling method '.version_select at 0x7fc7f0e41c10>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:10.869737 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7e9f3508-6cef-42d0-a2a1-ab7fd1240833 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/8fc5f0bc-32ac-4932-bf2a-122156cad49b" status: 200 len: 344 microversion: 2.1 time: 0.248443 Jul 27 20:08:10.877168 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 9/10] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Jul 27 20:08:10 2022] GET /compute/v2.1/os-volumes/8fc5f0bc-32ac-4932-bf2a-122156cad49b => generated 344 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:08:11.884883 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7c00c345-cf01-44b0-9fc3-e0d965f61f67 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Calling method '.version_select at 0x7fc7f0e78af0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:11.979047 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7c00c345-cf01-44b0-9fc3-e0d965f61f67 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/8fc5f0bc-32ac-4932-bf2a-122156cad49b" status: 200 len: 344 microversion: 2.1 time: 0.099202 Jul 27 20:08:11.979617 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2/11] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Jul 27 20:08:11 2022] GET /compute/v2.1/os-volumes/8fc5f0bc-32ac-4932-bf2a-122156cad49b => generated 344 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:08:13.010894 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f4d31418-f43d-4b42-a053-2dd98ba76172 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Calling method '.version_select at 0x7fc7f0e41160>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:13.148317 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f4d31418-f43d-4b42-a053-2dd98ba76172 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/8fc5f0bc-32ac-4932-bf2a-122156cad49b" status: 200 len: 345 microversion: 2.1 time: 0.155039 Jul 27 20:08:13.148881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 10/12] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Jul 27 20:08:12 2022] GET /compute/v2.1/os-volumes/8fc5f0bc-32ac-4932-bf2a-122156cad49b => generated 345 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:08:13.168655 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0f606df2-5d4c-4aa6-8f2b-2f89ab729188 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Action: 'create', calling method: .version_select at 0x7fc7f0e8f160>, body: {"snapshot": {"volume_id": "8fc5f0bc-32ac-4932-bf2a-122156cad49b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-75550492"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:08:13.711004 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0f606df2-5d4c-4aa6-8f2b-2f89ab729188 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] 10.222.0.65 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.552665 Jul 27 20:08:13.718368 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 3/13] 10.222.0.65 () {60 vars in 1162 bytes} [Wed Jul 27 20:08:13 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:08:13.725647 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c240c4bc-a87a-4b01-b5f8-e7eda6c2c5aa tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Calling method '.version_select at 0x7fc7f0e160d0>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:13.965137 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c240c4bc-a87a-4b01-b5f8-e7eda6c2c5aa tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/a1faa57b-4f0c-4eb7-b646-e992552c1e71" status: 200 len: 285 microversion: 2.1 time: 0.246015 Jul 27 20:08:13.971821 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 11/14] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Jul 27 20:08:13 2022] GET /compute/v2.1/os-snapshots/a1faa57b-4f0c-4eb7-b646-e992552c1e71 => generated 285 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:08:13.978042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d6a24802-e964-413f-b4f3-13fac0abc14d tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Calling method '.version_select at 0x7fc7f0e96310>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:14.039089 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d6a24802-e964-413f-b4f3-13fac0abc14d tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.065859 Jul 27 20:08:14.046052 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 4/15] 10.222.0.65 () {58 vars in 1140 bytes} [Wed Jul 27 20:08:13 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:08:14.052375 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-45a5e1e9-93a4-4d24-9278-ae8f3580488f tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Calling method '.version_select at 0x7fc7f0e16820>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:14.102166 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-45a5e1e9-93a4-4d24-9278-ae8f3580488f tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/a1faa57b-4f0c-4eb7-b646-e992552c1e71" status: 200 len: 285 microversion: 2.1 time: 0.054652 Jul 27 20:08:14.102985 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 12/16] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Jul 27 20:08:14 2022] GET /compute/v2.1/os-snapshots/a1faa57b-4f0c-4eb7-b646-e992552c1e71 => generated 285 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:08:15.118923 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-80f81102-61b9-4532-a795-48123d32d851 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Calling method '.version_select at 0x7fc7f17ec0d0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:15.179167 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-80f81102-61b9-4532-a795-48123d32d851 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/a1faa57b-4f0c-4eb7-b646-e992552c1e71" status: 200 len: 285 microversion: 2.1 time: 0.065110 Jul 27 20:08:15.184005 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 5/17] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Jul 27 20:08:15 2022] GET /compute/v2.1/os-snapshots/a1faa57b-4f0c-4eb7-b646-e992552c1e71 => generated 285 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:08:16.199711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-90ee620a-47de-4ab9-8e0d-d4b0a5eaf42d tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Calling method '.version_select at 0x7fc7f0e41820>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:16.287333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-90ee620a-47de-4ab9-8e0d-d4b0a5eaf42d tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/a1faa57b-4f0c-4eb7-b646-e992552c1e71" status: 200 len: 285 microversion: 2.1 time: 0.099054 Jul 27 20:08:16.290934 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 13/18] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Jul 27 20:08:16 2022] GET /compute/v2.1/os-snapshots/a1faa57b-4f0c-4eb7-b646-e992552c1e71 => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:08:17.302495 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-774c062f-236b-40ae-94fb-cca72ab2cbff tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Calling method '.version_select at 0x7fc7f0e78ca0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:17.352376 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-774c062f-236b-40ae-94fb-cca72ab2cbff tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/a1faa57b-4f0c-4eb7-b646-e992552c1e71" status: 200 len: 285 microversion: 2.1 time: 0.053761 Jul 27 20:08:17.353431 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 6/19] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Jul 27 20:08:17 2022] GET /compute/v2.1/os-snapshots/a1faa57b-4f0c-4eb7-b646-e992552c1e71 => generated 285 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:08:18.367623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2040bdb6-51bd-43cd-a734-447ecb16820b tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Calling method '.version_select at 0x7fc7f0e41a60>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:18.460409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2040bdb6-51bd-43cd-a734-447ecb16820b tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/a1faa57b-4f0c-4eb7-b646-e992552c1e71" status: 200 len: 285 microversion: 2.1 time: 0.099057 Jul 27 20:08:18.461330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 14/20] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Jul 27 20:08:18 2022] GET /compute/v2.1/os-snapshots/a1faa57b-4f0c-4eb7-b646-e992552c1e71 => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:08:19.472446 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-10b0c533-4bc4-4f42-bed3-5da32cdb369b tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Calling method '.version_select at 0x7fc7f0e960d0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:19.981652 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-10b0c533-4bc4-4f42-bed3-5da32cdb369b tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/a1faa57b-4f0c-4eb7-b646-e992552c1e71" status: 200 len: 285 microversion: 2.1 time: 0.513514 Jul 27 20:08:19.982546 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 7/21] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Jul 27 20:08:19 2022] GET /compute/v2.1/os-snapshots/a1faa57b-4f0c-4eb7-b646-e992552c1e71 => generated 285 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:08:20.357322 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c7626b13-9472-4738-be7d-d1336d12f362 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Action: 'create', calling method: .version_select at 0x7fc7f0ed6c10>, body: {"keypair": {"name": "tempest-keypair-789069220", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEejzS1F6WoBSRVFLwjw4E6EbP04WzNJebzInyKAg9hH3fugubnbagSPLn7zRmPuvhUolRP2xDBX/vYs04QpbuNz9OBIdr175rYIOR0w0brvWLOLI/PXcBEDDDymzgkuFQ=="}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:08:20.558338 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-c7626b13-9472-4738-be7d-d1336d12f362 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Getting quotas for project ec01b599458b451e8d04a428c1c33513. Resources: {'key_pairs'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:08:20.586382 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-c7626b13-9472-4738-be7d-d1336d12f362 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Getting quotas for user b734a345bfe5483d9a5a1e35d89c935b and project ec01b599458b451e8d04a428c1c33513. Resources: {'key_pairs'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:08:20.715888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c7626b13-9472-4738-be7d-d1336d12f362 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.206043 Jul 27 20:08:20.719139 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 15/22] 10.222.0.65 () {62 vars in 1200 bytes} [Wed Jul 27 20:08:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1212 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 27 20:08:20.995076 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e576f1be-61b1-4c3e-9514-0c415d948c71 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Calling method '.version_select at 0x7fc7f0e78e50>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:21.129265 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e576f1be-61b1-4c3e-9514-0c415d948c71 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/a1faa57b-4f0c-4eb7-b646-e992552c1e71" status: 200 len: 286 microversion: 2.1 time: 0.138484 Jul 27 20:08:21.130438 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 8/23] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Jul 27 20:08:20 2022] GET /compute/v2.1/os-snapshots/a1faa57b-4f0c-4eb7-b646-e992552c1e71 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:08:21.142782 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-de06fd65-bf9a-4733-b2c9-0de1be7b27fe tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Calling method '.version_select at 0x7fc7f0d73670>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:21.291647 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-de06fd65-bf9a-4733-b2c9-0de1be7b27fe tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] 10.222.0.65 "DELETE /compute/v2.1/os-snapshots/a1faa57b-4f0c-4eb7-b646-e992552c1e71" status: 202 len: 0 microversion: 2.1 time: 0.153377 Jul 27 20:08:21.292484 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 16/24] 10.222.0.65 () {58 vars in 1254 bytes} [Wed Jul 27 20:08:21 2022] DELETE /compute/v2.1/os-snapshots/a1faa57b-4f0c-4eb7-b646-e992552c1e71 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:08:21.307541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7be2fece-a7bd-46a7-8925-94b4b68ff043 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Calling method '.version_select at 0x7fc7f0e8f0d0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:21.418160 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7be2fece-a7bd-46a7-8925-94b4b68ff043 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/a1faa57b-4f0c-4eb7-b646-e992552c1e71" status: 200 len: 285 microversion: 2.1 time: 0.121502 Jul 27 20:08:21.423981 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 9/25] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Jul 27 20:08:21 2022] GET /compute/v2.1/os-snapshots/a1faa57b-4f0c-4eb7-b646-e992552c1e71 => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:08:22.408990 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2414a68f-b1e7-463d-86f1-dd27e3724730 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1226341967", "imageRef": "fb689bea-534a-4aac-bec3-8f55591dba58", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:08:22.637434 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.network.neutron [None req-2414a68f-b1e7-463d-86f1-dd27e3724730 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] validate_networks() for [('58ec8bb2-6628-4de2-b96e-7daa0136083e', None, None, None, None, None)] {{(pid=117876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:08:22.766908 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-41d47bb0-45d6-487d-b1b0-600c2d617a8c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Action: 'create', calling method: .version_select at 0x7fc7f0e8fb80>, body: {"keypair": {"name": "tempest-keypair-760039290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkQjgMHlBMvTMUGQTQlbvBU1NbK+3qAIVUxGCMFPrB67zHVqGCpMo9G9ctsi1Cy9UU9KF5anmSr++OYOyWOkcjrM0cgcq3PianqS/ZFnnSbFAjSnf7WHUrDrkPSoAEIBg=="}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:08:22.893010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-41d47bb0-45d6-487d-b1b0-600c2d617a8c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Getting quotas for project 8d9a9e3a2b0e4918950cfd454aab9fbb. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:08:22.923825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-41d47bb0-45d6-487d-b1b0-600c2d617a8c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Getting quotas for user ea3c5c3007e04391b5b108473da62787 and project 8d9a9e3a2b0e4918950cfd454aab9fbb. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:08:23.038247 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-41d47bb0-45d6-487d-b1b0-600c2d617a8c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.901717 Jul 27 20:08:23.039058 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 10/26] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Jul 27 20:08:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:08:23.051126 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a6357b6c-4774-44e5-961f-36d8b93a5459 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Calling method '.version_select at 0x7fc7f0e22040>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:23.147117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-a6357b6c-4774-44e5-961f-36d8b93a5459 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] HTTP exception thrown: Snapshot a1faa57b-4f0c-4eb7-b646-e992552c1e71 could not be found. Jul 27 20:08:23.151474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a6357b6c-4774-44e5-961f-36d8b93a5459 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Request method failure captured: Jul 27 20:08:23.151474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/os-snapshots/a1faa57b-4f0c-4eb7-b646-e992552c1e71 HTTP/1.1 Jul 27 20:08:23.151474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:08:23.151474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:08:23.151474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:08:23.151474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:08:23.151474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:08:23.151474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:08:23.151474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:08:23.151474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:08:23.151474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4Zsmy0-0M8XuOsUvNWab69PMYvt71fOJFmIgx6gNHw95ZGqfMUoLckdCz-rv6TsZdYff7x-WVmlWJoAfqVc5dIrSofCRQjwuPPb7w9ok6pixpBwB5Qai6u7CRQQD21xFc4zb37T5JO4Gcw1xPBAgAk6UMG0dluAwG6_4u8k-ZmQdr8M Jul 27 20:08:23.151474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:08:23.151474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:08:23.151474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:08:23.151474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:08:23.151474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:08:23.151474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:08:23.151474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: 68afb3e7ea43454fa92d2d21560432f2 Jul 27 20:08:23.151474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-70316419 Jul 27 20:08:23.151474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:08:23.151474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:08:23.152685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/68afb3e7ea43454fa92d2d21560432f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/68afb3e7ea43454fa92d2d21560432f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_68afb3e7ea43454fa92d2d21560432f2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/68afb3e7ea43454fa92d2d21560432f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:08:23.152685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-VolumesSnapshotsTestJSON-70316419 Jul 27 20:08:23.152685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 68afb3e7ea43454fa92d2d21560432f2 Jul 27 20:08:23.152685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-70316419 Jul 27 20:08:23.152685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-VolumesSnapshotsTestJSON-70316419-project Jul 27 20:08:23.152685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:08:23.152685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:08:23.152685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: f851d33b4920425ca3f7e2eec8e72999 Jul 27 20:08:23.152685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-VolumesSnapshotsTestJSON-70316419-project Jul 27 20:08:23.152685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: Jul 27 20:08:23.152685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Snapshot a1faa57b-4f0c-4eb7-b646-e992552c1e71 could not be found. Jul 27 20:08:23.152685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'id': 'a1faa57b-4f0c-4eb7-b646-e992552c1e71'} Jul 27 20:08:23.152685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:08:23.153455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:23.153455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 27 20:08:23.153455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 27 20:08:23.153455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 27 20:08:23.153455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 27 20:08:23.153455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 27 20:08:23.153455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 27 20:08:23.153455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 20:08:23.153455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 20:08:23.153455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 20:08:23.153455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 20:08:23.153455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:08:23.153455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:08:23.153455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:08:23.153455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:08:23.153455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a1faa57b-4f0c-4eb7-b646-e992552c1e71 could not be found. (HTTP 404) (Request-ID: req-4aa00ece-565d-4d89-9414-a5a60c881b68) Jul 27 20:08:23.153455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:08:23.153455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:23.154784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:08:23.154784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:23.154784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 27 20:08:23.154784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 27 20:08:23.154784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:08:23.154784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:08:23.154784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 27 20:08:23.154784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 27 20:08:23.154784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:08:23.154784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:08:23.154784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 27 20:08:23.154784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 27 20:08:23.154784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 27 20:08:23.154784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 27 20:08:23.154784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 27 20:08:23.154784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 27 20:08:23.154784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 20:08:23.154784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 20:08:23.154784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 20:08:23.155796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 20:08:23.155796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:08:23.155796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:08:23.155796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:08:23.155796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:08:23.155796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a1faa57b-4f0c-4eb7-b646-e992552c1e71 could not be found. Jul 27 20:08:23.155796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:08:23.155796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:23.155796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:08:23.155796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:23.155796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:08:23.155796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:08:23.155796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:08:23.155796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:08:23.155796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 20:08:23.155796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 20:08:23.155796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:08:23.155796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:08:23.155796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 27 20:08:23.155796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:08:23.156890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a1faa57b-4f0c-4eb7-b646-e992552c1e71 could not be found. Jul 27 20:08:23.156890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:08:23.156890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:23.156890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:08:23.156890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:23.156890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:08:23.156890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:08:23.156890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:08:23.156890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:08:23.156890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a1faa57b-4f0c-4eb7-b646-e992552c1e71 could not be found. Jul 27 20:08:23.156890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:08:23.157651 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a6357b6c-4774-44e5-961f-36d8b93a5459 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Returning 404 to user: Snapshot a1faa57b-4f0c-4eb7-b646-e992552c1e71 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:08:23.159203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a6357b6c-4774-44e5-961f-36d8b93a5459 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/a1faa57b-4f0c-4eb7-b646-e992552c1e71" status: 404 len: 111 microversion: 2.1 time: 0.111773 Jul 27 20:08:23.161667 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 11/27] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Jul 27 20:08:23 2022] GET /compute/v2.1/os-snapshots/a1faa57b-4f0c-4eb7-b646-e992552c1e71 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:08:23.175775 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9331ae38-2ffc-4a89-a9c9-fecb53096f32 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Calling method '.version_select at 0x7fc7f0e22310>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:23.373565 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9331ae38-2ffc-4a89-a9c9-fecb53096f32 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/8fc5f0bc-32ac-4932-bf2a-122156cad49b" status: 202 len: 0 microversion: 2.1 time: 0.203756 Jul 27 20:08:23.374263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 12/28] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Jul 27 20:08:23 2022] DELETE /compute/v2.1/os-volumes/8fc5f0bc-32ac-4932-bf2a-122156cad49b => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:08:23.383320 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e5e39274-4000-4c04-971a-ad4a129fb942 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Calling method '.version_select at 0x7fc7f0decee0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:23.529683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e5e39274-4000-4c04-971a-ad4a129fb942 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/8fc5f0bc-32ac-4932-bf2a-122156cad49b" status: 200 len: 344 microversion: 2.1 time: 0.151051 Jul 27 20:08:23.530691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 13/29] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Jul 27 20:08:23 2022] GET /compute/v2.1/os-volumes/8fc5f0bc-32ac-4932-bf2a-122156cad49b => generated 344 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:08:24.109667 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-694206d2-6ed7-4676-b123-56f4625a89d5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-433271569", "imageRef": "fb689bea-534a-4aac-bec3-8f55591dba58", "flavorRef": "452", "networks": [{"uuid": "f8c2d9eb-9185-4cf6-b692-6200a5caa979"}]}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:08:24.408115 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-694206d2-6ed7-4676-b123-56f4625a89d5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] validate_networks() for [('f8c2d9eb-9185-4cf6-b692-6200a5caa979', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:08:26.587930 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-2414a68f-b1e7-463d-86f1-dd27e3724730 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Flavor limits 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:08:26.588408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-2414a68f-b1e7-463d-86f1-dd27e3724730 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Image limits 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:08:26.588815 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-2414a68f-b1e7-463d-86f1-dd27e3724730 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Flavor pref 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:08:26.589338 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-2414a68f-b1e7-463d-86f1-dd27e3724730 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Image pref 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:08:26.589662 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-2414a68f-b1e7-463d-86f1-dd27e3724730 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:08:26.611805 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2414a68f-b1e7-463d-86f1-dd27e3724730 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:26.621666 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2414a68f-b1e7-463d-86f1-dd27e3724730 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:26.622599 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2414a68f-b1e7-463d-86f1-dd27e3724730 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:26.623036 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2414a68f-b1e7-463d-86f1-dd27e3724730 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:26.681918 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-2414a68f-b1e7-463d-86f1-dd27e3724730 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Getting quotas for project 1626b826d47a47429a947fa36ace64e4. Resources: {'cores', 'instances', 'ram'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:08:26.695561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-2414a68f-b1e7-463d-86f1-dd27e3724730 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Getting quotas for user a48eaef4d70b4116bd307374d819bca6 and project 1626b826d47a47429a947fa36ace64e4. Resources: {'cores', 'instances', 'ram'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:08:26.722683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2414a68f-b1e7-463d-86f1-dd27e3724730 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Going to run 1 instances... {{(pid=117876) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:08:26.730202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2414a68f-b1e7-463d-86f1-dd27e3724730 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb689bea-534a-4aac-bec3-8f55591dba58',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:08:26.802609 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-694206d2-6ed7-4676-b123-56f4625a89d5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:08:26.803345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-694206d2-6ed7-4676-b123-56f4625a89d5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:08:26.804222 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-694206d2-6ed7-4676-b123-56f4625a89d5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:08:26.805084 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-694206d2-6ed7-4676-b123-56f4625a89d5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:08:26.807310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-694206d2-6ed7-4676-b123-56f4625a89d5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:08:26.835746 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-694206d2-6ed7-4676-b123-56f4625a89d5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:26.836563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-694206d2-6ed7-4676-b123-56f4625a89d5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:26.850167 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-694206d2-6ed7-4676-b123-56f4625a89d5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:26.850646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-694206d2-6ed7-4676-b123-56f4625a89d5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:26.885682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-694206d2-6ed7-4676-b123-56f4625a89d5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Getting quotas for project 6cab65810db34765966b2ca0332088be. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:08:26.893567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2414a68f-b1e7-463d-86f1-dd27e3724730 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.327514 Jul 27 20:08:26.894789 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 17/30] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Jul 27 20:08:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 5329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:08:26.900369 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3cb5325b-24b4-48c6-9f4a-78d7b57ce4ce tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Calling method '.version_select at 0x7fc7f04c33a0>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:26.905350 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-694206d2-6ed7-4676-b123-56f4625a89d5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Getting quotas for user ec4599fb9568454ba36b01038c345248 and project 6cab65810db34765966b2ca0332088be. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:08:26.946610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-694206d2-6ed7-4676-b123-56f4625a89d5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:08:26.954787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-3cb5325b-24b4-48c6-9f4a-78d7b57ce4ce tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] HTTP exception thrown: Volume 8fc5f0bc-32ac-4932-bf2a-122156cad49b could not be found. Jul 27 20:08:26.957574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3cb5325b-24b4-48c6-9f4a-78d7b57ce4ce tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Request method failure captured: Jul 27 20:08:26.957574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: GET /compute/v2.1/os-volumes/8fc5f0bc-32ac-4932-bf2a-122156cad49b HTTP/1.1 Jul 27 20:08:26.957574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:08:26.957574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:08:26.957574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:08:26.957574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:08:26.957574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:08:26.957574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:08:26.957574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:08:26.957574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:08:26.957574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4Zsmy0-0M8XuOsUvNWab69PMYvt71fOJFmIgx6gNHw95ZGqfMUoLckdCz-rv6TsZdYff7x-WVmlWJoAfqVc5dIrSofCRQjwuPPb7w9ok6pixpBwB5Qai6u7CRQQD21xFc4zb37T5JO4Gcw1xPBAgAk6UMG0dluAwG6_4u8k-ZmQdr8M Jul 27 20:08:26.957574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:08:26.957574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:08:26.957574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:08:26.957574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:08:26.957574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:08:26.957574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:08:26.957574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 68afb3e7ea43454fa92d2d21560432f2 Jul 27 20:08:26.957574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-70316419 Jul 27 20:08:26.957574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:08:26.957574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:08:26.958630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/68afb3e7ea43454fa92d2d21560432f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/68afb3e7ea43454fa92d2d21560432f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_68afb3e7ea43454fa92d2d21560432f2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/68afb3e7ea43454fa92d2d21560432f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:08:26.958630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-VolumesSnapshotsTestJSON-70316419 Jul 27 20:08:26.958630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 68afb3e7ea43454fa92d2d21560432f2 Jul 27 20:08:26.958630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-70316419 Jul 27 20:08:26.958630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-VolumesSnapshotsTestJSON-70316419-project Jul 27 20:08:26.958630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:08:26.958630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:08:26.958630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: f851d33b4920425ca3f7e2eec8e72999 Jul 27 20:08:26.958630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-VolumesSnapshotsTestJSON-70316419-project Jul 27 20:08:26.958630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: Jul 27 20:08:26.958630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Volume 8fc5f0bc-32ac-4932-bf2a-122156cad49b could not be found. Jul 27 20:08:26.958630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'id': '8fc5f0bc-32ac-4932-bf2a-122156cad49b'} Jul 27 20:08:26.958630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:08:26.959276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:26.959276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:08:26.959276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:08:26.959276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 20:08:26.959276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 20:08:26.959276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 20:08:26.959276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 20:08:26.959276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 20:08:26.959276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 20:08:26.959276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 20:08:26.959276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 20:08:26.959276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:08:26.959276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:08:26.959276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:08:26.959276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:08:26.959276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8fc5f0bc-32ac-4932-bf2a-122156cad49b could not be found. (HTTP 404) (Request-ID: req-0446db05-028c-4f77-ba78-40d933eb0d92) Jul 27 20:08:26.959276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:26.959276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:26.959276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:26.960206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:26.960206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 20:08:26.960206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 20:08:26.960206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:08:26.960206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:08:26.960206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 20:08:26.960206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 20:08:26.960206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:08:26.960206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:08:26.960206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:08:26.960206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:08:26.960206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 20:08:26.960206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 20:08:26.960206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 20:08:26.960206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 20:08:26.960206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 20:08:26.960206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 20:08:26.960206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 20:08:26.960206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 20:08:26.961135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:08:26.961135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:08:26.961135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:08:26.961135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:08:26.961135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8fc5f0bc-32ac-4932-bf2a-122156cad49b could not be found. Jul 27 20:08:26.961135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:26.961135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:26.961135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:26.961135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:26.961135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:08:26.961135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:08:26.961135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:08:26.961135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:08:26.961135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 20:08:26.961135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 20:08:26.961135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:08:26.961135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:08:26.961135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 20:08:26.961135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:08:26.962018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8fc5f0bc-32ac-4932-bf2a-122156cad49b could not be found. Jul 27 20:08:26.962018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:26.962018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:26.962018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:26.962018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:26.962018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:08:26.962018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:08:26.962018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:08:26.962018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:08:26.962018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8fc5f0bc-32ac-4932-bf2a-122156cad49b could not be found. Jul 27 20:08:26.962018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:26.964684 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3cb5325b-24b4-48c6-9f4a-78d7b57ce4ce tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Returning 404 to user: Volume 8fc5f0bc-32ac-4932-bf2a-122156cad49b could not be found. {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:08:26.965818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3cb5325b-24b4-48c6-9f4a-78d7b57ce4ce tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/8fc5f0bc-32ac-4932-bf2a-122156cad49b" status: 404 len: 109 microversion: 2.1 time: 0.069509 Jul 27 20:08:26.966606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 18/31] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Jul 27 20:08:26 2022] GET /compute/v2.1/os-volumes/8fc5f0bc-32ac-4932-bf2a-122156cad49b => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:08:26.975348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-694206d2-6ed7-4676-b123-56f4625a89d5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb689bea-534a-4aac-bec3-8f55591dba58',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:08:26.980696 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f67f5378-b09c-48b9-ad78-a7e73f981e20 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:26.982736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f67f5378-b09c-48b9-ad78-a7e73f981e20 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:27.241710 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-694206d2-6ed7-4676-b123-56f4625a89d5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.278487 Jul 27 20:08:27.249277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 14/32] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Jul 27 20:08:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:08:27.257183 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a47e3e3e-ee32-4b85-bbda-3b791194d28d tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Calling method '.version_select at 0x7fc7f0503f70>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:27.350111 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-a47e3e3e-ee32-4b85-bbda-3b791194d28d tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] HTTP exception thrown: Volume 8fc5f0bc-32ac-4932-bf2a-122156cad49b could not be found. Jul 27 20:08:27.353854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a47e3e3e-ee32-4b85-bbda-3b791194d28d tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Request method failure captured: Jul 27 20:08:27.353854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/os-volumes/8fc5f0bc-32ac-4932-bf2a-122156cad49b HTTP/1.1 Jul 27 20:08:27.353854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:08:27.353854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:08:27.353854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:08:27.353854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:08:27.353854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:08:27.353854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:08:27.353854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:08:27.353854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:08:27.353854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4Zsmy0-0M8XuOsUvNWab69PMYvt71fOJFmIgx6gNHw95ZGqfMUoLckdCz-rv6TsZdYff7x-WVmlWJoAfqVc5dIrSofCRQjwuPPb7w9ok6pixpBwB5Qai6u7CRQQD21xFc4zb37T5JO4Gcw1xPBAgAk6UMG0dluAwG6_4u8k-ZmQdr8M Jul 27 20:08:27.353854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:08:27.353854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:08:27.353854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:08:27.353854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:08:27.353854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:08:27.353854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:08:27.353854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: 68afb3e7ea43454fa92d2d21560432f2 Jul 27 20:08:27.353854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-70316419 Jul 27 20:08:27.353854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:08:27.353854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:08:27.354914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/68afb3e7ea43454fa92d2d21560432f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/68afb3e7ea43454fa92d2d21560432f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_68afb3e7ea43454fa92d2d21560432f2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/68afb3e7ea43454fa92d2d21560432f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:08:27.354914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-VolumesSnapshotsTestJSON-70316419 Jul 27 20:08:27.354914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 68afb3e7ea43454fa92d2d21560432f2 Jul 27 20:08:27.354914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-70316419 Jul 27 20:08:27.354914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-VolumesSnapshotsTestJSON-70316419-project Jul 27 20:08:27.354914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:08:27.354914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:08:27.354914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: f851d33b4920425ca3f7e2eec8e72999 Jul 27 20:08:27.354914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-VolumesSnapshotsTestJSON-70316419-project Jul 27 20:08:27.354914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: Jul 27 20:08:27.354914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Volume 8fc5f0bc-32ac-4932-bf2a-122156cad49b could not be found. Jul 27 20:08:27.354914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'id': '8fc5f0bc-32ac-4932-bf2a-122156cad49b'} Jul 27 20:08:27.354914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:08:27.355550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:27.355550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:08:27.355550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:08:27.355550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 20:08:27.355550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 20:08:27.355550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 20:08:27.355550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 20:08:27.355550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 20:08:27.355550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 20:08:27.355550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 20:08:27.355550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 20:08:27.355550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:08:27.355550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:08:27.355550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:08:27.355550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:08:27.355550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8fc5f0bc-32ac-4932-bf2a-122156cad49b could not be found. (HTTP 404) (Request-ID: req-a059e72c-840f-434a-8c56-2d6e49046377) Jul 27 20:08:27.355550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:08:27.355550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:27.355550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:08:27.356647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:27.356647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 27 20:08:27.356647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 27 20:08:27.356647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:08:27.356647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:08:27.356647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 20:08:27.356647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 20:08:27.356647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:08:27.356647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:08:27.356647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:08:27.356647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:08:27.356647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 27 20:08:27.356647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 27 20:08:27.356647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 27 20:08:27.356647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 27 20:08:27.356647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 27 20:08:27.356647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 27 20:08:27.356647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 27 20:08:27.356647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 27 20:08:27.357741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:08:27.357741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:08:27.357741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:08:27.357741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:08:27.357741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8fc5f0bc-32ac-4932-bf2a-122156cad49b could not be found. Jul 27 20:08:27.357741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:08:27.357741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:27.357741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:08:27.357741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:27.357741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:08:27.357741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:08:27.357741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:08:27.357741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:08:27.357741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 20:08:27.357741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 20:08:27.357741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:08:27.357741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:08:27.357741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 27 20:08:27.357741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:08:27.358686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8fc5f0bc-32ac-4932-bf2a-122156cad49b could not be found. Jul 27 20:08:27.358686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:08:27.358686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:27.358686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:08:27.358686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:27.358686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:08:27.358686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:08:27.358686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:08:27.358686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:08:27.358686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8fc5f0bc-32ac-4932-bf2a-122156cad49b could not be found. Jul 27 20:08:27.358686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:08:27.360078 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a47e3e3e-ee32-4b85-bbda-3b791194d28d tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Returning 404 to user: Volume 8fc5f0bc-32ac-4932-bf2a-122156cad49b could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:08:27.361514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a47e3e3e-ee32-4b85-bbda-3b791194d28d tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/8fc5f0bc-32ac-4932-bf2a-122156cad49b" status: 404 len: 109 microversion: 2.1 time: 0.110644 Jul 27 20:08:27.362537 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 15/33] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Jul 27 20:08:27 2022] DELETE /compute/v2.1/os-volumes/8fc5f0bc-32ac-4932-bf2a-122156cad49b => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:08:27.371969 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-78c437c3-4d90-41e5-9811-3ea62797addf tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:27.375759 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-78c437c3-4d90-41e5-9811-3ea62797addf tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:27.688405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f67f5378-b09c-48b9-ad78-a7e73f981e20 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:27.705733 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f67f5378-b09c-48b9-ad78-a7e73f981e20 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1222 microversion: 2.1 time: 0.736920 Jul 27 20:08:27.706975 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 19/34] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:26 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1222 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:27.713823 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-11ddbfac-9e08-4073-bc0b-4ad33ec85e73 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Calling method '.version_select at 0x7fc7f0ee7670>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:27.725193 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-78c437c3-4d90-41e5-9811-3ea62797addf tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:27.759615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-78c437c3-4d90-41e5-9811-3ea62797addf tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1214 microversion: 2.1 time: 0.395696 Jul 27 20:08:27.760200 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 16/35] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:27 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1214 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:27.794471 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-11ddbfac-9e08-4073-bc0b-4ad33ec85e73 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] HTTP exception thrown: Volume 8fc5f0bc-32ac-4932-bf2a-122156cad49b could not be found. Jul 27 20:08:27.800409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-11ddbfac-9e08-4073-bc0b-4ad33ec85e73 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Request method failure captured: Jul 27 20:08:27.800409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: GET /compute/v2.1/os-volumes/8fc5f0bc-32ac-4932-bf2a-122156cad49b HTTP/1.1 Jul 27 20:08:27.800409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:08:27.800409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:08:27.800409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:08:27.800409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:08:27.800409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:08:27.800409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:08:27.800409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:08:27.800409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:08:27.800409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4Zsmy0-0M8XuOsUvNWab69PMYvt71fOJFmIgx6gNHw95ZGqfMUoLckdCz-rv6TsZdYff7x-WVmlWJoAfqVc5dIrSofCRQjwuPPb7w9ok6pixpBwB5Qai6u7CRQQD21xFc4zb37T5JO4Gcw1xPBAgAk6UMG0dluAwG6_4u8k-ZmQdr8M Jul 27 20:08:27.800409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:08:27.800409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:08:27.800409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:08:27.800409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:08:27.800409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:08:27.800409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:08:27.800409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 68afb3e7ea43454fa92d2d21560432f2 Jul 27 20:08:27.800409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-70316419 Jul 27 20:08:27.800409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:08:27.800409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:08:27.802226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/68afb3e7ea43454fa92d2d21560432f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/68afb3e7ea43454fa92d2d21560432f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_68afb3e7ea43454fa92d2d21560432f2", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/68afb3e7ea43454fa92d2d21560432f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:08:27.802226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-VolumesSnapshotsTestJSON-70316419 Jul 27 20:08:27.802226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 68afb3e7ea43454fa92d2d21560432f2 Jul 27 20:08:27.802226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-70316419 Jul 27 20:08:27.802226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-VolumesSnapshotsTestJSON-70316419-project Jul 27 20:08:27.802226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:08:27.802226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:08:27.802226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: f851d33b4920425ca3f7e2eec8e72999 Jul 27 20:08:27.802226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-VolumesSnapshotsTestJSON-70316419-project Jul 27 20:08:27.802226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: Jul 27 20:08:27.802226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Volume 8fc5f0bc-32ac-4932-bf2a-122156cad49b could not be found. Jul 27 20:08:27.802226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'id': '8fc5f0bc-32ac-4932-bf2a-122156cad49b'} Jul 27 20:08:27.802226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:08:27.806111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:27.806111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:08:27.806111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:08:27.806111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 20:08:27.806111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 20:08:27.806111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 20:08:27.806111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 20:08:27.806111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 20:08:27.806111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 20:08:27.806111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 20:08:27.806111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 20:08:27.806111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:08:27.806111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:08:27.806111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:08:27.806111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:08:27.806111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8fc5f0bc-32ac-4932-bf2a-122156cad49b could not be found. (HTTP 404) (Request-ID: req-6cd273a3-0d53-44d2-b42c-82bdc9d80444) Jul 27 20:08:27.806111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:27.806111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:27.806111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:27.807433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:27.807433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 20:08:27.807433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 20:08:27.807433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:08:27.807433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:08:27.807433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 20:08:27.807433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 20:08:27.807433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:08:27.807433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:08:27.807433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:08:27.807433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:08:27.807433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 20:08:27.807433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 20:08:27.807433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 20:08:27.807433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 20:08:27.807433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 20:08:27.807433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 20:08:27.807433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 20:08:27.807433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 20:08:27.808856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:08:27.808856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:08:27.808856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:08:27.808856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:08:27.808856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8fc5f0bc-32ac-4932-bf2a-122156cad49b could not be found. Jul 27 20:08:27.808856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:27.808856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:27.808856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:27.808856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:27.808856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:08:27.808856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:08:27.808856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:08:27.808856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:08:27.808856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 20:08:27.808856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 20:08:27.808856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:08:27.808856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:08:27.808856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 20:08:27.808856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:08:27.809867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8fc5f0bc-32ac-4932-bf2a-122156cad49b could not be found. Jul 27 20:08:27.809867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:27.809867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:08:27.809867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:27.809867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:08:27.809867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:08:27.809867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:08:27.809867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:08:27.809867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:08:27.809867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8fc5f0bc-32ac-4932-bf2a-122156cad49b could not be found. Jul 27 20:08:27.809867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:08:27.809867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-11ddbfac-9e08-4073-bc0b-4ad33ec85e73 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] Returning 404 to user: Volume 8fc5f0bc-32ac-4932-bf2a-122156cad49b could not be found. {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:08:27.809867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-11ddbfac-9e08-4073-bc0b-4ad33ec85e73 tempest-VolumesSnapshotsTestJSON-70316419 tempest-VolumesSnapshotsTestJSON-70316419-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/8fc5f0bc-32ac-4932-bf2a-122156cad49b" status: 404 len: 109 microversion: 2.1 time: 0.093421 Jul 27 20:08:27.809867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 20/36] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Jul 27 20:08:27 2022] GET /compute/v2.1/os-volumes/8fc5f0bc-32ac-4932-bf2a-122156cad49b => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:08:28.030318 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-681d678e-7704-4bcc-9068-161d75aaa25f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-665179563", "imageRef": "fb689bea-534a-4aac-bec3-8f55591dba58", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:08:28.179333 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-681d678e-7704-4bcc-9068-161d75aaa25f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] validate_networks() for [('58ec8bb2-6628-4de2-b96e-7daa0136083e', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:08:28.785603 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-31ecb914-75e7-4c18-ad6e-e7c7819af4cb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:28.787202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-31ecb914-75e7-4c18-ad6e-e7c7819af4cb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:28.966602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-31ecb914-75e7-4c18-ad6e-e7c7819af4cb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:28.993280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-31ecb914-75e7-4c18-ad6e-e7c7819af4cb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1214 microversion: 2.1 time: 0.212023 Jul 27 20:08:29.005698 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 21/37] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:28 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1214 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:29.012446 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c717b9b9-375e-4b0f-b5cd-287477faa01a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1863396818", "imageRef": "fb689bea-534a-4aac-bec3-8f55591dba58", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5057539b-dab4-4848-a916-7b9e9cc4f43e"}], "security_groups": [{"name": "tempest-securitygroup--1980387542"}], "key_name": "tempest-keypair-789069220", "user_data": "}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:08:29.451756 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.network.neutron [None req-c717b9b9-375e-4b0f-b5cd-287477faa01a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] validate_networks() for [('5057539b-dab4-4848-a916-7b9e9cc4f43e', None, None, None, None, None)] {{(pid=117876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:08:30.869554 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-c717b9b9-375e-4b0f-b5cd-287477faa01a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Flavor limits 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:08:30.870779 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-c717b9b9-375e-4b0f-b5cd-287477faa01a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Image limits 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:08:30.871473 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-c717b9b9-375e-4b0f-b5cd-287477faa01a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Flavor pref 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:08:30.872614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-c717b9b9-375e-4b0f-b5cd-287477faa01a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Image pref 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:08:30.873944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-c717b9b9-375e-4b0f-b5cd-287477faa01a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:08:30.891910 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c717b9b9-375e-4b0f-b5cd-287477faa01a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:30.894648 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c717b9b9-375e-4b0f-b5cd-287477faa01a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:30.897163 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c717b9b9-375e-4b0f-b5cd-287477faa01a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:30.898246 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c717b9b9-375e-4b0f-b5cd-287477faa01a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:30.946572 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-c717b9b9-375e-4b0f-b5cd-287477faa01a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Getting quotas for project ec01b599458b451e8d04a428c1c33513. Resources: {'cores', 'instances', 'ram'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:08:30.952917 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-c717b9b9-375e-4b0f-b5cd-287477faa01a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Getting quotas for user b734a345bfe5483d9a5a1e35d89c935b and project ec01b599458b451e8d04a428c1c33513. Resources: {'cores', 'instances', 'ram'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:08:30.969095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c717b9b9-375e-4b0f-b5cd-287477faa01a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Going to run 1 instances... {{(pid=117876) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:08:30.972124 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c717b9b9-375e-4b0f-b5cd-287477faa01a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb689bea-534a-4aac-bec3-8f55591dba58',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:08:31.037431 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c717b9b9-375e-4b0f-b5cd-287477faa01a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.029539 Jul 27 20:08:31.044192 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 22/38] 10.222.0.65 () {62 vars in 1188 bytes} [Wed Jul 27 20:08:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 2032 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 27 20:08:31.047719 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-90499949-1105-46e7-8e50-b2ff53c63384 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:31.048361 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-90499949-1105-46e7-8e50-b2ff53c63384 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:31.069734 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90499949-1105-46e7-8e50-b2ff53c63384 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:31.070358 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90499949-1105-46e7-8e50-b2ff53c63384 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:31.071827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90499949-1105-46e7-8e50-b2ff53c63384 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:31.072785 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90499949-1105-46e7-8e50-b2ff53c63384 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:31.081812 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-681d678e-7704-4bcc-9068-161d75aaa25f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:08:31.082290 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-681d678e-7704-4bcc-9068-161d75aaa25f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:08:31.083137 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-681d678e-7704-4bcc-9068-161d75aaa25f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:08:31.083707 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-681d678e-7704-4bcc-9068-161d75aaa25f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:08:31.084141 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-681d678e-7704-4bcc-9068-161d75aaa25f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:08:31.100802 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-681d678e-7704-4bcc-9068-161d75aaa25f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:31.101297 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-681d678e-7704-4bcc-9068-161d75aaa25f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:31.102202 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-681d678e-7704-4bcc-9068-161d75aaa25f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:31.102636 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-681d678e-7704-4bcc-9068-161d75aaa25f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:31.181815 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-681d678e-7704-4bcc-9068-161d75aaa25f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Getting quotas for project 1626b826d47a47429a947fa36ace64e4. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:08:31.198267 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-681d678e-7704-4bcc-9068-161d75aaa25f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Getting quotas for user a48eaef4d70b4116bd307374d819bca6 and project 1626b826d47a47429a947fa36ace64e4. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:08:31.221175 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-681d678e-7704-4bcc-9068-161d75aaa25f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:08:31.227170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-681d678e-7704-4bcc-9068-161d75aaa25f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb689bea-534a-4aac-bec3-8f55591dba58',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:08:31.361626 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-681d678e-7704-4bcc-9068-161d75aaa25f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.331594 Jul 27 20:08:31.368618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 17/39] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Jul 27 20:08:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 3344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 27 20:08:31.466022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d3c1aa36-ec55-4ac8-a9ce-a1b7c8d0204d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1781805950", "imageRef": "fb689bea-534a-4aac-bec3-8f55591dba58", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "33e63fd4-dc98-4fa3-abec-4f896450c787"}], "security_groups": [{"name": "tempest-securitygroup--1934796336"}], "key_name": "tempest-keypair-760039290", "user_data": "}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:08:31.564639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-90499949-1105-46e7-8e50-b2ff53c63384 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:31.607800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-90499949-1105-46e7-8e50-b2ff53c63384 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1218 microversion: 2.1 time: 0.566719 Jul 27 20:08:31.612364 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 23/40] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:31 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1218 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:31.621059 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-18ac1f59-3e14-470d-a645-e48286a8bbce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:31.621813 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-18ac1f59-3e14-470d-a645-e48286a8bbce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:31.968892 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-18ac1f59-3e14-470d-a645-e48286a8bbce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:31.979695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-18ac1f59-3e14-470d-a645-e48286a8bbce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:31.987424 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-18ac1f59-3e14-470d-a645-e48286a8bbce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:31.989393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-18ac1f59-3e14-470d-a645-e48286a8bbce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1281 microversion: 2.20 time: 0.375409 Jul 27 20:08:31.992648 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 24/41] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:08:31 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1281 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:08:32.011383 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ed570d5a-7d1a-494a-b710-f8bdc4ece77e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:32.012402 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ed570d5a-7d1a-494a-b710-f8bdc4ece77e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:32.094542 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-d3c1aa36-ec55-4ac8-a9ce-a1b7c8d0204d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] validate_networks() for [('33e63fd4-dc98-4fa3-abec-4f896450c787', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:08:32.117684 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ed570d5a-7d1a-494a-b710-f8bdc4ece77e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:32.131678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ed570d5a-7d1a-494a-b710-f8bdc4ece77e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1221 microversion: 2.1 time: 0.136127 Jul 27 20:08:32.132588 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 25/42] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:31 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1221 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:32.630001 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1265b696-f1c5-4f0b-a8a1-22a0f57cf912 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:32.630631 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1265b696-f1c5-4f0b-a8a1-22a0f57cf912 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:32.643862 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1265b696-f1c5-4f0b-a8a1-22a0f57cf912 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:32.644336 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1265b696-f1c5-4f0b-a8a1-22a0f57cf912 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:32.656995 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1265b696-f1c5-4f0b-a8a1-22a0f57cf912 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:32.657464 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1265b696-f1c5-4f0b-a8a1-22a0f57cf912 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:32.951525 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1265b696-f1c5-4f0b-a8a1-22a0f57cf912 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:32.963966 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1265b696-f1c5-4f0b-a8a1-22a0f57cf912 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1284 microversion: 2.1 time: 0.338299 Jul 27 20:08:32.970352 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 26/43] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:32 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1284 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:08:33.019320 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-84ee2273-d6f6-49e3-8cbe-8e439167e12b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:33.020903 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-84ee2273-d6f6-49e3-8cbe-8e439167e12b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:33.043636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84ee2273-d6f6-49e3-8cbe-8e439167e12b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:33.044124 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84ee2273-d6f6-49e3-8cbe-8e439167e12b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:33.050083 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84ee2273-d6f6-49e3-8cbe-8e439167e12b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:33.052854 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84ee2273-d6f6-49e3-8cbe-8e439167e12b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:33.206330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-84ee2273-d6f6-49e3-8cbe-8e439167e12b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:33.220715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-84ee2273-d6f6-49e3-8cbe-8e439167e12b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:33.229387 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-84ee2273-d6f6-49e3-8cbe-8e439167e12b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:33.238111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-84ee2273-d6f6-49e3-8cbe-8e439167e12b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1333 microversion: 2.20 time: 0.216702 Jul 27 20:08:33.251834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 27/44] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:08:33 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1333 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:08:33.261873 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0587c207-9c3a-4c0b-ac7a-e0305b8831ac tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:33.262606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0587c207-9c3a-4c0b-ac7a-e0305b8831ac tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:33.282766 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0587c207-9c3a-4c0b-ac7a-e0305b8831ac tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:33.283878 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0587c207-9c3a-4c0b-ac7a-e0305b8831ac tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:33.286115 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0587c207-9c3a-4c0b-ac7a-e0305b8831ac tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:33.286926 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0587c207-9c3a-4c0b-ac7a-e0305b8831ac tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:33.433665 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0587c207-9c3a-4c0b-ac7a-e0305b8831ac tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:33.447089 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0587c207-9c3a-4c0b-ac7a-e0305b8831ac tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1217 microversion: 2.1 time: 0.199224 Jul 27 20:08:33.448127 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 28/45] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:33 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1217 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:33.778309 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-d3c1aa36-ec55-4ac8-a9ce-a1b7c8d0204d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:08:33.778953 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-d3c1aa36-ec55-4ac8-a9ce-a1b7c8d0204d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:08:33.779938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-d3c1aa36-ec55-4ac8-a9ce-a1b7c8d0204d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:08:33.780831 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-d3c1aa36-ec55-4ac8-a9ce-a1b7c8d0204d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:08:33.790181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-d3c1aa36-ec55-4ac8-a9ce-a1b7c8d0204d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:08:33.809185 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d3c1aa36-ec55-4ac8-a9ce-a1b7c8d0204d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:33.810671 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d3c1aa36-ec55-4ac8-a9ce-a1b7c8d0204d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:33.812712 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d3c1aa36-ec55-4ac8-a9ce-a1b7c8d0204d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:33.814697 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d3c1aa36-ec55-4ac8-a9ce-a1b7c8d0204d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:33.863287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-d3c1aa36-ec55-4ac8-a9ce-a1b7c8d0204d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Getting quotas for project 8d9a9e3a2b0e4918950cfd454aab9fbb. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:08:33.873182 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-d3c1aa36-ec55-4ac8-a9ce-a1b7c8d0204d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Getting quotas for user ea3c5c3007e04391b5b108473da62787 and project 8d9a9e3a2b0e4918950cfd454aab9fbb. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:08:33.909620 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d3c1aa36-ec55-4ac8-a9ce-a1b7c8d0204d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:08:33.917529 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d3c1aa36-ec55-4ac8-a9ce-a1b7c8d0204d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb689bea-534a-4aac-bec3-8f55591dba58',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:08:33.990575 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5fd70d65-f3a5-4783-871c-4bbdbd652b34 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:33.991234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5fd70d65-f3a5-4783-871c-4bbdbd652b34 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:34.012510 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5fd70d65-f3a5-4783-871c-4bbdbd652b34 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:34.015620 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5fd70d65-f3a5-4783-871c-4bbdbd652b34 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:34.016825 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5fd70d65-f3a5-4783-871c-4bbdbd652b34 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:34.022519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5fd70d65-f3a5-4783-871c-4bbdbd652b34 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:34.066915 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d3c1aa36-ec55-4ac8-a9ce-a1b7c8d0204d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.682831 Jul 27 20:08:34.071663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 18/46] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Jul 27 20:08:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 2693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:08:34.099752 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-01f4371d-b423-478e-8743-b97159e325d1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:34.103987 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-01f4371d-b423-478e-8743-b97159e325d1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:35.022970 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5fd70d65-f3a5-4783-871c-4bbdbd652b34 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:35.042374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5fd70d65-f3a5-4783-871c-4bbdbd652b34 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1272 microversion: 2.1 time: 1.056785 Jul 27 20:08:35.047029 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 29/47] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:33 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1272 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:08:35.064085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-57500791-9b01-4621-8e7f-75b383fec1e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:35.078536 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-57500791-9b01-4621-8e7f-75b383fec1e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:35.117490 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-57500791-9b01-4621-8e7f-75b383fec1e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:35.119971 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-57500791-9b01-4621-8e7f-75b383fec1e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:35.125231 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-57500791-9b01-4621-8e7f-75b383fec1e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:35.131679 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-57500791-9b01-4621-8e7f-75b383fec1e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:35.307325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-01f4371d-b423-478e-8743-b97159e325d1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:35.328471 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-01f4371d-b423-478e-8743-b97159e325d1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1237 microversion: 2.1 time: 1.248328 Jul 27 20:08:35.331738 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 19/48] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:34 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1237 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:08:35.360428 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-95a3d35b-415c-4a67-a74c-1449d60189ce tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:35.367647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-95a3d35b-415c-4a67-a74c-1449d60189ce tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:35.400462 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95a3d35b-415c-4a67-a74c-1449d60189ce tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:35.402594 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95a3d35b-415c-4a67-a74c-1449d60189ce tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:35.407299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95a3d35b-415c-4a67-a74c-1449d60189ce tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:35.409818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95a3d35b-415c-4a67-a74c-1449d60189ce tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:35.908836 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-95a3d35b-415c-4a67-a74c-1449d60189ce tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:35.915959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-57500791-9b01-4621-8e7f-75b383fec1e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:35.926518 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-57500791-9b01-4621-8e7f-75b383fec1e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:35.945266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-57500791-9b01-4621-8e7f-75b383fec1e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:35.947371 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-95a3d35b-415c-4a67-a74c-1449d60189ce tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1279 microversion: 2.1 time: 0.611169 Jul 27 20:08:35.949355 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-57500791-9b01-4621-8e7f-75b383fec1e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1339 microversion: 2.20 time: 0.892504 Jul 27 20:08:35.950214 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 30/49] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:08:35 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1339 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:08:35.976624 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 20/50] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:35 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1279 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:36.079566 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3437c256-6a28-4b4c-a8ef-f3a6b3374d71 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:36.081226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3437c256-6a28-4b4c-a8ef-f3a6b3374d71 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:36.101931 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3437c256-6a28-4b4c-a8ef-f3a6b3374d71 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:36.103962 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3437c256-6a28-4b4c-a8ef-f3a6b3374d71 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:36.106998 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3437c256-6a28-4b4c-a8ef-f3a6b3374d71 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:36.107894 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3437c256-6a28-4b4c-a8ef-f3a6b3374d71 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:36.359002 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8fa12a07-6d79-4619-b429-ec57ce2d4c7b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:36.362760 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8fa12a07-6d79-4619-b429-ec57ce2d4c7b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:36.383910 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8fa12a07-6d79-4619-b429-ec57ce2d4c7b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:36.385557 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8fa12a07-6d79-4619-b429-ec57ce2d4c7b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:36.410133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8fa12a07-6d79-4619-b429-ec57ce2d4c7b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:36.411539 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8fa12a07-6d79-4619-b429-ec57ce2d4c7b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:36.697558 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8fa12a07-6d79-4619-b429-ec57ce2d4c7b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:36.712406 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8fa12a07-6d79-4619-b429-ec57ce2d4c7b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1289 microversion: 2.1 time: 0.354836 Jul 27 20:08:36.717258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 21/51] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:36 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1289 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:36.977084 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-deb9abd7-6696-46d3-86a6-135cac732588 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:36.978013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-deb9abd7-6696-46d3-86a6-135cac732588 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:36.989283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-deb9abd7-6696-46d3-86a6-135cac732588 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:36.993777 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-deb9abd7-6696-46d3-86a6-135cac732588 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:36.997775 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-deb9abd7-6696-46d3-86a6-135cac732588 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:36.998782 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-deb9abd7-6696-46d3-86a6-135cac732588 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:37.176779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-deb9abd7-6696-46d3-86a6-135cac732588 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:37.190346 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-deb9abd7-6696-46d3-86a6-135cac732588 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:37.195236 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-deb9abd7-6696-46d3-86a6-135cac732588 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:37.199115 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-deb9abd7-6696-46d3-86a6-135cac732588 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1339 microversion: 2.20 time: 0.225844 Jul 27 20:08:37.201543 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 22/52] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:08:36 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1339 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:08:37.220205 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9de8dfaf-f3c3-4d7a-9eb6-5de2b45e6859 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:37.224988 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9de8dfaf-f3c3-4d7a-9eb6-5de2b45e6859 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:37.246021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9de8dfaf-f3c3-4d7a-9eb6-5de2b45e6859 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:37.248090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9de8dfaf-f3c3-4d7a-9eb6-5de2b45e6859 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:37.249614 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9de8dfaf-f3c3-4d7a-9eb6-5de2b45e6859 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:37.255742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9de8dfaf-f3c3-4d7a-9eb6-5de2b45e6859 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:37.456773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9de8dfaf-f3c3-4d7a-9eb6-5de2b45e6859 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:37.472291 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9de8dfaf-f3c3-4d7a-9eb6-5de2b45e6859 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1279 microversion: 2.1 time: 0.263736 Jul 27 20:08:37.476132 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 23/53] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:37 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1279 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:37.742191 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c5729461-87fa-4481-8121-7da601ceae63 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:37.742825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c5729461-87fa-4481-8121-7da601ceae63 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:37.756249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5729461-87fa-4481-8121-7da601ceae63 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:37.757212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5729461-87fa-4481-8121-7da601ceae63 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:37.759040 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5729461-87fa-4481-8121-7da601ceae63 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:37.761594 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5729461-87fa-4481-8121-7da601ceae63 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:38.102035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3437c256-6a28-4b4c-a8ef-f3a6b3374d71 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:38.112723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3437c256-6a28-4b4c-a8ef-f3a6b3374d71 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 2.042693 Jul 27 20:08:38.123210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 31/54] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:36 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 2054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:38.231836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9f82475a-1705-4a45-b1ec-c27bd169d2d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:38.232583 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9f82475a-1705-4a45-b1ec-c27bd169d2d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:38.255793 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9f82475a-1705-4a45-b1ec-c27bd169d2d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:38.259067 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c5729461-87fa-4481-8121-7da601ceae63 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:38.261889 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9f82475a-1705-4a45-b1ec-c27bd169d2d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:38.273706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c5729461-87fa-4481-8121-7da601ceae63 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1295 microversion: 2.1 time: 0.539826 Jul 27 20:08:38.279608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9f82475a-1705-4a45-b1ec-c27bd169d2d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:38.287171 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9f82475a-1705-4a45-b1ec-c27bd169d2d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:38.289081 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 24/55] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:37 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1295 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:38.501383 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-67ab05ff-88dc-4ca7-bed4-b860814ff25f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:38.502082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-67ab05ff-88dc-4ca7-bed4-b860814ff25f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:38.518684 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-67ab05ff-88dc-4ca7-bed4-b860814ff25f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:38.519150 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-67ab05ff-88dc-4ca7-bed4-b860814ff25f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:38.525673 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-67ab05ff-88dc-4ca7-bed4-b860814ff25f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:38.527622 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-67ab05ff-88dc-4ca7-bed4-b860814ff25f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:39.452767 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9f82475a-1705-4a45-b1ec-c27bd169d2d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:39.485297 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9f82475a-1705-4a45-b1ec-c27bd169d2d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:39.485297 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9f82475a-1705-4a45-b1ec-c27bd169d2d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:39.485297 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9f82475a-1705-4a45-b1ec-c27bd169d2d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 1.254847 Jul 27 20:08:39.510521 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 32/56] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:08:38 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:08:39.515621 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7b9cf1da-7754-4a8f-af61-4f20938f0ea1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:39.516186 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7b9cf1da-7754-4a8f-af61-4f20938f0ea1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:39.563573 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7b9cf1da-7754-4a8f-af61-4f20938f0ea1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:39.564026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7b9cf1da-7754-4a8f-af61-4f20938f0ea1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:39.564814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7b9cf1da-7754-4a8f-af61-4f20938f0ea1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:39.565280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7b9cf1da-7754-4a8f-af61-4f20938f0ea1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:40.829659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-67ab05ff-88dc-4ca7-bed4-b860814ff25f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:40.839283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-67ab05ff-88dc-4ca7-bed4-b860814ff25f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 2.343028 Jul 27 20:08:40.842757 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 25/57] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:38 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 2347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:08:40.882238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b0631186-35a0-4ff1-809b-44355cf660b5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:40.884543 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b0631186-35a0-4ff1-809b-44355cf660b5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:40.905515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0631186-35a0-4ff1-809b-44355cf660b5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:40.906853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0631186-35a0-4ff1-809b-44355cf660b5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:40.909562 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0631186-35a0-4ff1-809b-44355cf660b5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:40.910252 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0631186-35a0-4ff1-809b-44355cf660b5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:40.914844 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=4 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:08:41.752785 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b0631186-35a0-4ff1-809b-44355cf660b5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:41.791173 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b0631186-35a0-4ff1-809b-44355cf660b5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1295 microversion: 2.1 time: 0.931987 Jul 27 20:08:41.795346 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 26/58] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:40 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1295 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:41.809133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-244b7000-9a69-4f85-9edf-f534c7045346 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:41.813650 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-244b7000-9a69-4f85-9edf-f534c7045346 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:41.830833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-244b7000-9a69-4f85-9edf-f534c7045346 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:41.831468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-244b7000-9a69-4f85-9edf-f534c7045346 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:41.832106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-244b7000-9a69-4f85-9edf-f534c7045346 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:41.832714 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-244b7000-9a69-4f85-9edf-f534c7045346 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:42.122672 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=24 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:08:42.223730 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7b9cf1da-7754-4a8f-af61-4f20938f0ea1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:42.235731 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7b9cf1da-7754-4a8f-af61-4f20938f0ea1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 2.723970 Jul 27 20:08:42.237448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 33/59] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:39 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 2726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:42.253327 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-771078c4-7b94-49eb-a4b1-beb3b0659c89 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:42.257261 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-771078c4-7b94-49eb-a4b1-beb3b0659c89 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:42.275075 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-771078c4-7b94-49eb-a4b1-beb3b0659c89 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:42.276595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-771078c4-7b94-49eb-a4b1-beb3b0659c89 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:42.279508 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-771078c4-7b94-49eb-a4b1-beb3b0659c89 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:42.280416 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-771078c4-7b94-49eb-a4b1-beb3b0659c89 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:43.353313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-771078c4-7b94-49eb-a4b1-beb3b0659c89 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:43.369405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-771078c4-7b94-49eb-a4b1-beb3b0659c89 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 1.128835 Jul 27 20:08:43.373051 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 34/60] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:42 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:43.386520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-562816db-6723-4671-a90d-33e709ee391a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:43.390630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-562816db-6723-4671-a90d-33e709ee391a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:43.433148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-562816db-6723-4671-a90d-33e709ee391a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:43.442380 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-562816db-6723-4671-a90d-33e709ee391a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:43.443637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-562816db-6723-4671-a90d-33e709ee391a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:43.449046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-562816db-6723-4671-a90d-33e709ee391a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:43.637578 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-244b7000-9a69-4f85-9edf-f534c7045346 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:43.657566 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-244b7000-9a69-4f85-9edf-f534c7045346 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:43.675182 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-244b7000-9a69-4f85-9edf-f534c7045346 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:43.681268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-244b7000-9a69-4f85-9edf-f534c7045346 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 1.881485 Jul 27 20:08:43.694738 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 27/61] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:08:41 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:08:43.723781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3d6143cb-8350-4f4a-87aa-0fadf958ce1e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:43.729276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3d6143cb-8350-4f4a-87aa-0fadf958ce1e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:43.763862 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d6143cb-8350-4f4a-87aa-0fadf958ce1e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:43.767147 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d6143cb-8350-4f4a-87aa-0fadf958ce1e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:43.772211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d6143cb-8350-4f4a-87aa-0fadf958ce1e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:43.775426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d6143cb-8350-4f4a-87aa-0fadf958ce1e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:43.862164 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=6 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:08:44.792892 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-562816db-6723-4671-a90d-33e709ee391a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:44.822487 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-562816db-6723-4671-a90d-33e709ee391a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 1.446423 Jul 27 20:08:44.837230 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 35/62] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:43 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:44.849132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-252b8eef-59d7-40d6-8dc2-792248101afe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:44.861302 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-252b8eef-59d7-40d6-8dc2-792248101afe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:44.887432 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-252b8eef-59d7-40d6-8dc2-792248101afe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:44.888085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-252b8eef-59d7-40d6-8dc2-792248101afe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:44.889644 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-252b8eef-59d7-40d6-8dc2-792248101afe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:44.890260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-252b8eef-59d7-40d6-8dc2-792248101afe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:44.941137 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3d6143cb-8350-4f4a-87aa-0fadf958ce1e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:44.962958 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3d6143cb-8350-4f4a-87aa-0fadf958ce1e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 1.266118 Jul 27 20:08:44.965079 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 28/63] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:43 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:44.986353 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-00bc404f-079f-408a-9be8-6a598c79f631 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:44.987311 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-00bc404f-079f-408a-9be8-6a598c79f631 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:45.009162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00bc404f-079f-408a-9be8-6a598c79f631 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:45.010226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00bc404f-079f-408a-9be8-6a598c79f631 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:45.011446 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00bc404f-079f-408a-9be8-6a598c79f631 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:45.013313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00bc404f-079f-408a-9be8-6a598c79f631 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:45.323887 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=26 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:08:45.394192 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-252b8eef-59d7-40d6-8dc2-792248101afe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:45.406576 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-252b8eef-59d7-40d6-8dc2-792248101afe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.564752 Jul 27 20:08:45.407324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 36/64] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:44 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:45.515239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-00bc404f-079f-408a-9be8-6a598c79f631 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:45.529093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-00bc404f-079f-408a-9be8-6a598c79f631 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:45.531350 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-00bc404f-079f-408a-9be8-6a598c79f631 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:45.537149 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-00bc404f-079f-408a-9be8-6a598c79f631 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.569766 Jul 27 20:08:45.538359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 29/65] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:08:44 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:08:45.845570 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0545dc67-eb91-4d5a-b596-793ba5789238 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:45.846539 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0545dc67-eb91-4d5a-b596-793ba5789238 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:45.858356 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0545dc67-eb91-4d5a-b596-793ba5789238 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:45.860660 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0545dc67-eb91-4d5a-b596-793ba5789238 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:45.861821 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0545dc67-eb91-4d5a-b596-793ba5789238 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:45.864119 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0545dc67-eb91-4d5a-b596-793ba5789238 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:45.947845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-db77f2b8-9bac-4543-b9c0-f3a89b77efa9 req-57c0e4cd-c3ea-4ec0-a610-eb3fe6d796b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea33250b-8fd3-4d34-97cb-cde5923b7a67", "tag": "694f60ee-1590-4b2a-bed2-b28fde5be035"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:08:45.970069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-db77f2b8-9bac-4543-b9c0-f3a89b77efa9 req-57c0e4cd-c3ea-4ec0-a610-eb3fe6d796b5 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:45.972074 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-db77f2b8-9bac-4543-b9c0-f3a89b77efa9 req-57c0e4cd-c3ea-4ec0-a610-eb3fe6d796b5 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:46.028445 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-db77f2b8-9bac-4543-b9c0-f3a89b77efa9 req-57c0e4cd-c3ea-4ec0-a610-eb3fe6d796b5 service nova] Creating event network-changed:694f60ee-1590-4b2a-bed2-b28fde5be035 for instance ea33250b-8fd3-4d34-97cb-cde5923b7a67 on hv-cinder-79987 Jul 27 20:08:46.029009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-db77f2b8-9bac-4543-b9c0-f3a89b77efa9 req-57c0e4cd-c3ea-4ec0-a610-eb3fe6d796b5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117876) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 27 20:08:46.030161 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-994f6b80-11b6-4887-b0d0-e8b37c75b3cb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:46.030599 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-994f6b80-11b6-4887-b0d0-e8b37c75b3cb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:46.031375 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-994f6b80-11b6-4887-b0d0-e8b37c75b3cb None None] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:46.044190 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-994f6b80-11b6-4887-b0d0-e8b37c75b3cb None None] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:46.073055 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.compute.rpcapi [None req-994f6b80-11b6-4887-b0d0-e8b37c75b3cb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 27 20:08:46.074133 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-994f6b80-11b6-4887-b0d0-e8b37c75b3cb None None] Releasing lock "compute-rpcapi-router" {{(pid=117876) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 27 20:08:46.112606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-994f6b80-11b6-4887-b0d0-e8b37c75b3cb None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.628396 Jul 27 20:08:46.114764 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 37/66] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:08:46.122405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ed5ef40f-a110-432d-a24f-db02c03889f1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:46.126322 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ed5ef40f-a110-432d-a24f-db02c03889f1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:46.136311 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ed5ef40f-a110-432d-a24f-db02c03889f1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:46.138023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ed5ef40f-a110-432d-a24f-db02c03889f1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:46.140519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ed5ef40f-a110-432d-a24f-db02c03889f1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:46.141224 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ed5ef40f-a110-432d-a24f-db02c03889f1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:46.274385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0545dc67-eb91-4d5a-b596-793ba5789238 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:46.291023 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0545dc67-eb91-4d5a-b596-793ba5789238 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.444094 Jul 27 20:08:46.292046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 30/67] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:45 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:46.431852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ed5ef40f-a110-432d-a24f-db02c03889f1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:46.442439 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ed5ef40f-a110-432d-a24f-db02c03889f1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.324863 Jul 27 20:08:46.445358 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 38/68] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:46 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:46.451369 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b8d1a4be-6b98-4e4b-aab2-f8703f7885d5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:46.452177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b8d1a4be-6b98-4e4b-aab2-f8703f7885d5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:46.462014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b8d1a4be-6b98-4e4b-aab2-f8703f7885d5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:46.462723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b8d1a4be-6b98-4e4b-aab2-f8703f7885d5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:46.464215 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b8d1a4be-6b98-4e4b-aab2-f8703f7885d5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:46.465094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b8d1a4be-6b98-4e4b-aab2-f8703f7885d5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:46.542848 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-a3b920dd-b2ba-4cd7-b617-c481362870ee req-1d5796e1-6f7c-4c47-8af6-62c66f842492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72605170-2987-4669-ac91-425028a572f9", "tag": "43f1be02-78dc-4f7e-a834-fc4c4494971d"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:08:46.561293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-a3b920dd-b2ba-4cd7-b617-c481362870ee req-1d5796e1-6f7c-4c47-8af6-62c66f842492 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:46.561846 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-a3b920dd-b2ba-4cd7-b617-c481362870ee req-1d5796e1-6f7c-4c47-8af6-62c66f842492 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:46.584501 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-a3b920dd-b2ba-4cd7-b617-c481362870ee req-1d5796e1-6f7c-4c47-8af6-62c66f842492 service nova] Creating event network-changed:43f1be02-78dc-4f7e-a834-fc4c4494971d for instance 72605170-2987-4669-ac91-425028a572f9 on hv-cinder-79987 Jul 27 20:08:46.585474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-a3b920dd-b2ba-4cd7-b617-c481362870ee req-1d5796e1-6f7c-4c47-8af6-62c66f842492 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117877) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 27 20:08:46.586820 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d1d70541-c93c-4bd8-bf88-a2007fd0da8d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:46.589038 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d1d70541-c93c-4bd8-bf88-a2007fd0da8d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:46.590210 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d1d70541-c93c-4bd8-bf88-a2007fd0da8d None None] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:46.590840 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d1d70541-c93c-4bd8-bf88-a2007fd0da8d None None] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:46.604280 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.compute.rpcapi [None req-d1d70541-c93c-4bd8-bf88-a2007fd0da8d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 27 20:08:46.605210 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d1d70541-c93c-4bd8-bf88-a2007fd0da8d None None] Releasing lock "compute-rpcapi-router" {{(pid=117877) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 27 20:08:46.632364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d1d70541-c93c-4bd8-bf88-a2007fd0da8d None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.336808 Jul 27 20:08:46.639261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 31/69] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:08:46.648412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c9ac068e-8fe1-4692-90de-6b5d497ce596 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:46.649465 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c9ac068e-8fe1-4692-90de-6b5d497ce596 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:46.655762 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9ac068e-8fe1-4692-90de-6b5d497ce596 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:46.656210 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9ac068e-8fe1-4692-90de-6b5d497ce596 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:46.657156 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9ac068e-8fe1-4692-90de-6b5d497ce596 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:46.657590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9ac068e-8fe1-4692-90de-6b5d497ce596 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:46.683258 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b8d1a4be-6b98-4e4b-aab2-f8703f7885d5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:46.692140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b8d1a4be-6b98-4e4b-aab2-f8703f7885d5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.245231 Jul 27 20:08:46.692871 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 39/70] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:46 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:46.824779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c9ac068e-8fe1-4692-90de-6b5d497ce596 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:46.834606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c9ac068e-8fe1-4692-90de-6b5d497ce596 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:46.836135 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c9ac068e-8fe1-4692-90de-6b5d497ce596 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:46.837471 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c9ac068e-8fe1-4692-90de-6b5d497ce596 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.198599 Jul 27 20:08:46.839027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 32/71] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:08:46 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:08:47.315103 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5628a48c-49a7-4194-9228-53e6ab1d7593 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:47.318267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5628a48c-49a7-4194-9228-53e6ab1d7593 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:47.329337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5628a48c-49a7-4194-9228-53e6ab1d7593 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:47.330108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5628a48c-49a7-4194-9228-53e6ab1d7593 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:47.331217 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5628a48c-49a7-4194-9228-53e6ab1d7593 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:47.332641 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5628a48c-49a7-4194-9228-53e6ab1d7593 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:47.466918 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-895fdae4-bd06-456d-bc5e-91bb5cbaf0e5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:47.467573 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-895fdae4-bd06-456d-bc5e-91bb5cbaf0e5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:47.470823 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:08:47.476249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-895fdae4-bd06-456d-bc5e-91bb5cbaf0e5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:47.478013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-895fdae4-bd06-456d-bc5e-91bb5cbaf0e5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:47.480184 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-895fdae4-bd06-456d-bc5e-91bb5cbaf0e5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:47.481140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-895fdae4-bd06-456d-bc5e-91bb5cbaf0e5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:47.494227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=83 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:08:47.541508 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5628a48c-49a7-4194-9228-53e6ab1d7593 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:47.552656 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5628a48c-49a7-4194-9228-53e6ab1d7593 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.244729 Jul 27 20:08:47.553925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 40/72] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:47 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:47.673843 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-895fdae4-bd06-456d-bc5e-91bb5cbaf0e5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:47.683050 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-895fdae4-bd06-456d-bc5e-91bb5cbaf0e5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.220622 Jul 27 20:08:47.683626 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 33/73] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:47 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:08:47.715032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0b9dfdd2-6474-4d46-8844-24d5dde43f0c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:47.715687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0b9dfdd2-6474-4d46-8844-24d5dde43f0c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:47.723430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b9dfdd2-6474-4d46-8844-24d5dde43f0c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:47.724183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b9dfdd2-6474-4d46-8844-24d5dde43f0c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:47.725264 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b9dfdd2-6474-4d46-8844-24d5dde43f0c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:47.725874 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b9dfdd2-6474-4d46-8844-24d5dde43f0c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:47.731009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:08:47.860587 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-43cec256-5a10-47f9-960b-bec1ee33efc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:47.861283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-43cec256-5a10-47f9-960b-bec1ee33efc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:47.868885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43cec256-5a10-47f9-960b-bec1ee33efc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:47.869415 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43cec256-5a10-47f9-960b-bec1ee33efc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:47.870189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43cec256-5a10-47f9-960b-bec1ee33efc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:47.871124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43cec256-5a10-47f9-960b-bec1ee33efc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:47.963083 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0b9dfdd2-6474-4d46-8844-24d5dde43f0c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:47.972291 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0b9dfdd2-6474-4d46-8844-24d5dde43f0c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.262729 Jul 27 20:08:47.978098 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 41/74] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:47 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:48.059670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-43cec256-5a10-47f9-960b-bec1ee33efc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:48.072851 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-43cec256-5a10-47f9-960b-bec1ee33efc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:48.074652 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-43cec256-5a10-47f9-960b-bec1ee33efc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:48.076030 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-43cec256-5a10-47f9-960b-bec1ee33efc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.219269 Jul 27 20:08:48.090172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 34/75] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:08:47 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:08:48.135397 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-666dca36-03d5-4afe-933f-c7672d0c58bd req-e65c574f-7383-4e66-b6ef-72014e7d0752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d725356e-73a3-486b-b590-0324916667ff", "tag": "899741ce-2752-45e1-aee9-3a2da333cdf0"}, {"name": "network-changed", "server_uuid": "f9d8996c-6f06-4199-97d5-ded471eb2e2e", "tag": "0b42e5f2-e86d-4583-bdbf-99f0bab9f1ef"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:08:48.148658 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-666dca36-03d5-4afe-933f-c7672d0c58bd req-e65c574f-7383-4e66-b6ef-72014e7d0752 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:48.149719 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-666dca36-03d5-4afe-933f-c7672d0c58bd req-e65c574f-7383-4e66-b6ef-72014e7d0752 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:48.166396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-666dca36-03d5-4afe-933f-c7672d0c58bd req-e65c574f-7383-4e66-b6ef-72014e7d0752 service nova] Creating event network-changed:899741ce-2752-45e1-aee9-3a2da333cdf0 for instance d725356e-73a3-486b-b590-0324916667ff on hv-cinder-79987 Jul 27 20:08:48.167093 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-666dca36-03d5-4afe-933f-c7672d0c58bd req-e65c574f-7383-4e66-b6ef-72014e7d0752 service nova] Creating event network-changed:0b42e5f2-e86d-4583-bdbf-99f0bab9f1ef for instance f9d8996c-6f06-4199-97d5-ded471eb2e2e on hv-cinder-79987 Jul 27 20:08:48.173799 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-666dca36-03d5-4afe-933f-c7672d0c58bd req-e65c574f-7383-4e66-b6ef-72014e7d0752 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045982 Jul 27 20:08:48.174764 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 42/76] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:08:48.576629 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d4045742-d029-4d50-85da-9782155bfa71 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:48.578380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d4045742-d029-4d50-85da-9782155bfa71 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:48.589642 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4045742-d029-4d50-85da-9782155bfa71 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:48.590726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4045742-d029-4d50-85da-9782155bfa71 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:48.591799 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4045742-d029-4d50-85da-9782155bfa71 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:48.592523 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4045742-d029-4d50-85da-9782155bfa71 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:48.655382 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-33008b15-4e73-4ecb-afb7-cb45e50db8ef req-c6b27eff-db22-47c2-b177-46536a0c499a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8779e897-ecd4-43b8-9f87-a8e0c524c94a", "tag": "17b5101e-1922-439a-82ad-033657522bc9"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:08:48.667526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:08:48.687004 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-33008b15-4e73-4ecb-afb7-cb45e50db8ef req-c6b27eff-db22-47c2-b177-46536a0c499a service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:48.687449 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-33008b15-4e73-4ecb-afb7-cb45e50db8ef req-c6b27eff-db22-47c2-b177-46536a0c499a service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:48.728319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-33008b15-4e73-4ecb-afb7-cb45e50db8ef req-c6b27eff-db22-47c2-b177-46536a0c499a service nova] Creating event network-changed:17b5101e-1922-439a-82ad-033657522bc9 for instance 8779e897-ecd4-43b8-9f87-a8e0c524c94a on hv-cinder-79987 Jul 27 20:08:48.728319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-33008b15-4e73-4ecb-afb7-cb45e50db8ef req-c6b27eff-db22-47c2-b177-46536a0c499a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075619 Jul 27 20:08:48.728319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 43/77] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:08:48.751167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2120c1b6-42c8-41aa-95d0-ff9e015da50f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:48.758095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2120c1b6-42c8-41aa-95d0-ff9e015da50f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:48.788612 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2120c1b6-42c8-41aa-95d0-ff9e015da50f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:48.789105 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2120c1b6-42c8-41aa-95d0-ff9e015da50f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:48.789906 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2120c1b6-42c8-41aa-95d0-ff9e015da50f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:48.790355 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2120c1b6-42c8-41aa-95d0-ff9e015da50f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:48.848100 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d4045742-d029-4d50-85da-9782155bfa71 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:48.861216 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d4045742-d029-4d50-85da-9782155bfa71 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.289262 Jul 27 20:08:48.875691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 35/78] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:48 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:48.995542 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b7b2a3a6-b65f-4a0e-bc18-f0939b26743f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:48.996165 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b7b2a3a6-b65f-4a0e-bc18-f0939b26743f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:49.008187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7b2a3a6-b65f-4a0e-bc18-f0939b26743f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:49.009895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7b2a3a6-b65f-4a0e-bc18-f0939b26743f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:49.011630 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7b2a3a6-b65f-4a0e-bc18-f0939b26743f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:49.012230 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7b2a3a6-b65f-4a0e-bc18-f0939b26743f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:49.275899 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b7b2a3a6-b65f-4a0e-bc18-f0939b26743f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:49.288803 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b7b2a3a6-b65f-4a0e-bc18-f0939b26743f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.296787 Jul 27 20:08:49.289497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 36/79] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:48 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:49.302612 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ca5a819a-30b2-44aa-8ae9-1c5c61b2ea2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:49.303146 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ca5a819a-30b2-44aa-8ae9-1c5c61b2ea2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:49.314192 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2120c1b6-42c8-41aa-95d0-ff9e015da50f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:49.320325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ca5a819a-30b2-44aa-8ae9-1c5c61b2ea2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:49.320792 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ca5a819a-30b2-44aa-8ae9-1c5c61b2ea2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:49.324571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ca5a819a-30b2-44aa-8ae9-1c5c61b2ea2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:49.325356 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2120c1b6-42c8-41aa-95d0-ff9e015da50f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.579973 Jul 27 20:08:49.327255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 44/80] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:48 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:49.331306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ca5a819a-30b2-44aa-8ae9-1c5c61b2ea2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:49.887637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ca0e5150-9111-4647-b40f-e2746aba845b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:49.888240 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ca0e5150-9111-4647-b40f-e2746aba845b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:49.895863 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ca0e5150-9111-4647-b40f-e2746aba845b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:49.903355 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ca0e5150-9111-4647-b40f-e2746aba845b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:49.927062 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ca0e5150-9111-4647-b40f-e2746aba845b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:49.931436 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ca0e5150-9111-4647-b40f-e2746aba845b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:50.362137 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ca5a819a-30b2-44aa-8ae9-1c5c61b2ea2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:50.372903 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ca5a819a-30b2-44aa-8ae9-1c5c61b2ea2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:50.383583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ca5a819a-30b2-44aa-8ae9-1c5c61b2ea2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:50.385897 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ca5a819a-30b2-44aa-8ae9-1c5c61b2ea2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 1.095427 Jul 27 20:08:50.388611 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 37/81] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:08:49 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:08:50.407922 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c53355b0-e693-4ee5-8481-dea2eca339e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:50.408360 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c53355b0-e693-4ee5-8481-dea2eca339e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:50.418752 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c53355b0-e693-4ee5-8481-dea2eca339e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:50.418752 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c53355b0-e693-4ee5-8481-dea2eca339e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:50.419679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c53355b0-e693-4ee5-8481-dea2eca339e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:50.420199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c53355b0-e693-4ee5-8481-dea2eca339e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:50.706357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ca0e5150-9111-4647-b40f-e2746aba845b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:50.721326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ca0e5150-9111-4647-b40f-e2746aba845b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.834125 Jul 27 20:08:50.737981 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 45/82] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:49 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:50.748481 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cdfc01f5-e693-4f30-aa3f-6e10b52b321e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:50.749681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cdfc01f5-e693-4f30-aa3f-6e10b52b321e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:50.787171 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cdfc01f5-e693-4f30-aa3f-6e10b52b321e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:50.787698 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cdfc01f5-e693-4f30-aa3f-6e10b52b321e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:50.790709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cdfc01f5-e693-4f30-aa3f-6e10b52b321e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:50.791169 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cdfc01f5-e693-4f30-aa3f-6e10b52b321e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:51.130726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c53355b0-e693-4ee5-8481-dea2eca339e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:51.140492 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c53355b0-e693-4ee5-8481-dea2eca339e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.748818 Jul 27 20:08:51.141102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 38/83] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:50 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:51.413506 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2e7848fa-9884-4789-b9bc-cc1b547fcdb7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:51.414185 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2e7848fa-9884-4789-b9bc-cc1b547fcdb7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:51.420771 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e7848fa-9884-4789-b9bc-cc1b547fcdb7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:51.421455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e7848fa-9884-4789-b9bc-cc1b547fcdb7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:51.422550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e7848fa-9884-4789-b9bc-cc1b547fcdb7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:51.423165 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e7848fa-9884-4789-b9bc-cc1b547fcdb7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:51.586286 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2e7848fa-9884-4789-b9bc-cc1b547fcdb7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:51.600156 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2e7848fa-9884-4789-b9bc-cc1b547fcdb7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:51.602013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2e7848fa-9884-4789-b9bc-cc1b547fcdb7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:51.607123 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2e7848fa-9884-4789-b9bc-cc1b547fcdb7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.198291 Jul 27 20:08:51.607948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 39/84] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:08:51 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:08:51.627188 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cdfc01f5-e693-4f30-aa3f-6e10b52b321e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:51.638330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cdfc01f5-e693-4f30-aa3f-6e10b52b321e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.898605 Jul 27 20:08:51.639178 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 46/85] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:50 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:51.745053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0cc57d55-63a4-46bf-aaf7-68abd4918931 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:51.746079 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0cc57d55-63a4-46bf-aaf7-68abd4918931 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:51.752480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0cc57d55-63a4-46bf-aaf7-68abd4918931 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:51.753435 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0cc57d55-63a4-46bf-aaf7-68abd4918931 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:51.754841 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0cc57d55-63a4-46bf-aaf7-68abd4918931 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:51.755712 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0cc57d55-63a4-46bf-aaf7-68abd4918931 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:51.929610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0cc57d55-63a4-46bf-aaf7-68abd4918931 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:51.938998 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0cc57d55-63a4-46bf-aaf7-68abd4918931 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.197675 Jul 27 20:08:51.940132 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 40/86] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:51 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:52.162631 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-afcda5a1-3161-4f64-9aa3-8b84c8b987cc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:52.163494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-afcda5a1-3161-4f64-9aa3-8b84c8b987cc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:52.174094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-afcda5a1-3161-4f64-9aa3-8b84c8b987cc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:52.175114 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-afcda5a1-3161-4f64-9aa3-8b84c8b987cc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:52.175940 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-afcda5a1-3161-4f64-9aa3-8b84c8b987cc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:52.176410 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-afcda5a1-3161-4f64-9aa3-8b84c8b987cc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:52.431614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-afcda5a1-3161-4f64-9aa3-8b84c8b987cc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:52.439243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-afcda5a1-3161-4f64-9aa3-8b84c8b987cc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.281467 Jul 27 20:08:52.439918 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 47/87] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:52 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:52.640307 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1cd29509-a2e6-48a3-9d15-4d0c28ea3c83 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:52.641447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1cd29509-a2e6-48a3-9d15-4d0c28ea3c83 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:52.656829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cd29509-a2e6-48a3-9d15-4d0c28ea3c83 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:52.657343 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cd29509-a2e6-48a3-9d15-4d0c28ea3c83 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:52.658374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cd29509-a2e6-48a3-9d15-4d0c28ea3c83 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:52.658900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cd29509-a2e6-48a3-9d15-4d0c28ea3c83 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:52.665846 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5feefb31-42b8-44e1-9f12-c2aad9658840 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:52.667553 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5feefb31-42b8-44e1-9f12-c2aad9658840 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:52.687333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5feefb31-42b8-44e1-9f12-c2aad9658840 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:52.690786 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5feefb31-42b8-44e1-9f12-c2aad9658840 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:52.695895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5feefb31-42b8-44e1-9f12-c2aad9658840 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:52.698362 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5feefb31-42b8-44e1-9f12-c2aad9658840 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:52.879944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5feefb31-42b8-44e1-9f12-c2aad9658840 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:52.895847 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5feefb31-42b8-44e1-9f12-c2aad9658840 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.239135 Jul 27 20:08:52.896769 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 48/88] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:52 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:52.964512 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6d2cf53f-56b7-467f-b999-8c3779b388d6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:52.965436 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6d2cf53f-56b7-467f-b999-8c3779b388d6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:52.974735 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d2cf53f-56b7-467f-b999-8c3779b388d6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:52.975186 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d2cf53f-56b7-467f-b999-8c3779b388d6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:52.975982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d2cf53f-56b7-467f-b999-8c3779b388d6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:52.976424 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d2cf53f-56b7-467f-b999-8c3779b388d6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:53.127021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1cd29509-a2e6-48a3-9d15-4d0c28ea3c83 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:53.136192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1cd29509-a2e6-48a3-9d15-4d0c28ea3c83 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:53.137827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1cd29509-a2e6-48a3-9d15-4d0c28ea3c83 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:53.138949 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1cd29509-a2e6-48a3-9d15-4d0c28ea3c83 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.502669 Jul 27 20:08:53.150306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 41/89] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:08:52 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:08:53.190218 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6d2cf53f-56b7-467f-b999-8c3779b388d6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:53.199763 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6d2cf53f-56b7-467f-b999-8c3779b388d6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.239801 Jul 27 20:08:53.200344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 49/90] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:52 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:08:53.461538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0a53d7cc-1fd6-41b5-a7a3-8ac63d2a95b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:53.462380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0a53d7cc-1fd6-41b5-a7a3-8ac63d2a95b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:53.468999 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0a53d7cc-1fd6-41b5-a7a3-8ac63d2a95b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:53.469660 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0a53d7cc-1fd6-41b5-a7a3-8ac63d2a95b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:53.470602 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0a53d7cc-1fd6-41b5-a7a3-8ac63d2a95b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:53.471329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0a53d7cc-1fd6-41b5-a7a3-8ac63d2a95b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:53.643117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0a53d7cc-1fd6-41b5-a7a3-8ac63d2a95b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:53.651715 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0a53d7cc-1fd6-41b5-a7a3-8ac63d2a95b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.194315 Jul 27 20:08:53.652484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 42/91] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:53 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:53.917578 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-37ea0341-4c6b-42f9-8bed-537fa0b6c30e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:53.918256 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-37ea0341-4c6b-42f9-8bed-537fa0b6c30e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:53.924523 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-37ea0341-4c6b-42f9-8bed-537fa0b6c30e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:53.925086 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-37ea0341-4c6b-42f9-8bed-537fa0b6c30e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:53.926168 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-37ea0341-4c6b-42f9-8bed-537fa0b6c30e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:53.926834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-37ea0341-4c6b-42f9-8bed-537fa0b6c30e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:54.067905 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-37ea0341-4c6b-42f9-8bed-537fa0b6c30e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:54.077586 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-37ea0341-4c6b-42f9-8bed-537fa0b6c30e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.164543 Jul 27 20:08:54.079604 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 50/92] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:53 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:54.167685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c6cff26d-b2df-461d-90b8-f6e429585419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:54.168870 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c6cff26d-b2df-461d-90b8-f6e429585419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:54.180945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c6cff26d-b2df-461d-90b8-f6e429585419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:54.182222 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c6cff26d-b2df-461d-90b8-f6e429585419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:54.183548 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c6cff26d-b2df-461d-90b8-f6e429585419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:54.184334 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c6cff26d-b2df-461d-90b8-f6e429585419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:54.224998 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4230455d-534f-4d7e-b186-026976a94066 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:54.226135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4230455d-534f-4d7e-b186-026976a94066 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:54.234415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4230455d-534f-4d7e-b186-026976a94066 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:54.235837 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4230455d-534f-4d7e-b186-026976a94066 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:54.241850 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4230455d-534f-4d7e-b186-026976a94066 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:54.242506 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4230455d-534f-4d7e-b186-026976a94066 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:54.383597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c6cff26d-b2df-461d-90b8-f6e429585419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:54.392008 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c6cff26d-b2df-461d-90b8-f6e429585419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:54.393754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c6cff26d-b2df-461d-90b8-f6e429585419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:54.396211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c6cff26d-b2df-461d-90b8-f6e429585419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.236689 Jul 27 20:08:54.396859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 43/93] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:08:54 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:08:54.442936 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4230455d-534f-4d7e-b186-026976a94066 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:54.451754 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4230455d-534f-4d7e-b186-026976a94066 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.232798 Jul 27 20:08:54.452572 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 51/94] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:54 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:54.678888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3c2e68bc-6ead-4239-bc42-a226c21459b9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:54.680847 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3c2e68bc-6ead-4239-bc42-a226c21459b9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:54.691648 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c2e68bc-6ead-4239-bc42-a226c21459b9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:54.692399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c2e68bc-6ead-4239-bc42-a226c21459b9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:54.694054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c2e68bc-6ead-4239-bc42-a226c21459b9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:54.694728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c2e68bc-6ead-4239-bc42-a226c21459b9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:54.877042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3c2e68bc-6ead-4239-bc42-a226c21459b9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:54.886578 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3c2e68bc-6ead-4239-bc42-a226c21459b9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.216669 Jul 27 20:08:54.887342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 44/95] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:54 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:55.101722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3c6c2236-47c1-40da-a819-ee82c834b548 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:55.103201 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3c6c2236-47c1-40da-a819-ee82c834b548 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:55.112120 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c6c2236-47c1-40da-a819-ee82c834b548 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:55.113562 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c6c2236-47c1-40da-a819-ee82c834b548 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:55.114850 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c6c2236-47c1-40da-a819-ee82c834b548 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:55.115517 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c6c2236-47c1-40da-a819-ee82c834b548 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:55.419734 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0f69940e-edc4-4abe-ab56-173e428d5c5e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:55.420864 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0f69940e-edc4-4abe-ab56-173e428d5c5e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:55.435098 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3c6c2236-47c1-40da-a819-ee82c834b548 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:55.456013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3c6c2236-47c1-40da-a819-ee82c834b548 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.359625 Jul 27 20:08:55.458058 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f69940e-edc4-4abe-ab56-173e428d5c5e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:55.474900 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 52/96] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:55 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:55.479232 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f69940e-edc4-4abe-ab56-173e428d5c5e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:55.479753 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f69940e-edc4-4abe-ab56-173e428d5c5e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:55.482171 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f69940e-edc4-4abe-ab56-173e428d5c5e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:55.489250 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-28421561-91ce-4a17-9fa0-521211a154aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:55.489864 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-28421561-91ce-4a17-9fa0-521211a154aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:55.507191 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-28421561-91ce-4a17-9fa0-521211a154aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:55.507682 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-28421561-91ce-4a17-9fa0-521211a154aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:55.508986 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-28421561-91ce-4a17-9fa0-521211a154aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:55.509608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-28421561-91ce-4a17-9fa0-521211a154aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:55.919719 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-28421561-91ce-4a17-9fa0-521211a154aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:55.927224 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-28421561-91ce-4a17-9fa0-521211a154aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.449687 Jul 27 20:08:55.927808 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 53/97] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:55 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:55.941172 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1f6d75c0-8714-4fcb-a665-a675217d0b13 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:55.942235 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1f6d75c0-8714-4fcb-a665-a675217d0b13 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:55.954459 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f6d75c0-8714-4fcb-a665-a675217d0b13 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:55.957903 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f6d75c0-8714-4fcb-a665-a675217d0b13 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:55.959049 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f6d75c0-8714-4fcb-a665-a675217d0b13 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:55.960456 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f6d75c0-8714-4fcb-a665-a675217d0b13 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:56.072672 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=2 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:08:56.323223 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0f69940e-edc4-4abe-ab56-173e428d5c5e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:56.334817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0f69940e-edc4-4abe-ab56-173e428d5c5e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:56.336810 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0f69940e-edc4-4abe-ab56-173e428d5c5e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:56.338190 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0f69940e-edc4-4abe-ab56-173e428d5c5e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.922581 Jul 27 20:08:56.353745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 45/98] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:08:55 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:08:56.483644 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a08b5c53-162a-4c1b-b0a1-c31a2f2986d3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:56.484171 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a08b5c53-162a-4c1b-b0a1-c31a2f2986d3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:56.493752 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a08b5c53-162a-4c1b-b0a1-c31a2f2986d3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:56.494437 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a08b5c53-162a-4c1b-b0a1-c31a2f2986d3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:56.495405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a08b5c53-162a-4c1b-b0a1-c31a2f2986d3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:56.496054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a08b5c53-162a-4c1b-b0a1-c31a2f2986d3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:56.510851 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1f6d75c0-8714-4fcb-a665-a675217d0b13 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:56.518708 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1f6d75c0-8714-4fcb-a665-a675217d0b13 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.589873 Jul 27 20:08:56.519393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 54/99] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:55 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:56.601818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:08:56.701091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a08b5c53-162a-4c1b-b0a1-c31a2f2986d3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:56.725398 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a08b5c53-162a-4c1b-b0a1-c31a2f2986d3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.247874 Jul 27 20:08:56.726957 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 46/100] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:56 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:56.955217 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6e4158ef-c571-4d15-8db4-f178cee93ded tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:56.956255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6e4158ef-c571-4d15-8db4-f178cee93ded tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:56.969354 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6e4158ef-c571-4d15-8db4-f178cee93ded tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:56.970958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6e4158ef-c571-4d15-8db4-f178cee93ded tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:56.972624 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6e4158ef-c571-4d15-8db4-f178cee93ded tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:56.973958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6e4158ef-c571-4d15-8db4-f178cee93ded tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:57.194013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6e4158ef-c571-4d15-8db4-f178cee93ded tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:57.208163 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6e4158ef-c571-4d15-8db4-f178cee93ded tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.261525 Jul 27 20:08:57.225373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 55/101] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:56 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:57.364905 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ecc08b21-b427-4787-bea8-9a01a42c976b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:57.368608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ecc08b21-b427-4787-bea8-9a01a42c976b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:57.385603 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ecc08b21-b427-4787-bea8-9a01a42c976b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:57.391271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ecc08b21-b427-4787-bea8-9a01a42c976b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:57.392284 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ecc08b21-b427-4787-bea8-9a01a42c976b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:57.394683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ecc08b21-b427-4787-bea8-9a01a42c976b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:57.544308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5664257b-1363-4d78-93ac-3425c105f465 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:57.547021 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5664257b-1363-4d78-93ac-3425c105f465 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:57.569357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5664257b-1363-4d78-93ac-3425c105f465 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:57.571709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5664257b-1363-4d78-93ac-3425c105f465 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:57.572836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5664257b-1363-4d78-93ac-3425c105f465 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:57.574659 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5664257b-1363-4d78-93ac-3425c105f465 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:57.711591 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ecc08b21-b427-4787-bea8-9a01a42c976b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:57.721367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ecc08b21-b427-4787-bea8-9a01a42c976b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:57.723550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ecc08b21-b427-4787-bea8-9a01a42c976b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:57.724997 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ecc08b21-b427-4787-bea8-9a01a42c976b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.365284 Jul 27 20:08:57.726306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 47/102] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:08:57 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:08:57.748592 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fd1ba491-d501-48d9-8c92-d3a6d4ca69c4 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:57.750396 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fd1ba491-d501-48d9-8c92-d3a6d4ca69c4 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:57.760410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fd1ba491-d501-48d9-8c92-d3a6d4ca69c4 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:57.761057 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fd1ba491-d501-48d9-8c92-d3a6d4ca69c4 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:57.762442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fd1ba491-d501-48d9-8c92-d3a6d4ca69c4 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:57.762926 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fd1ba491-d501-48d9-8c92-d3a6d4ca69c4 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:57.804514 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5664257b-1363-4d78-93ac-3425c105f465 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:57.813833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5664257b-1363-4d78-93ac-3425c105f465 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.275290 Jul 27 20:08:57.814427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 56/103] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:57 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:58.040040 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fd1ba491-d501-48d9-8c92-d3a6d4ca69c4 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:58.047689 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fd1ba491-d501-48d9-8c92-d3a6d4ca69c4 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.304276 Jul 27 20:08:58.048259 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 48/104] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:57 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:08:58.243763 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-439713a2-4ecb-41b5-aa51-2918b9f3a1a2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:58.244527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-439713a2-4ecb-41b5-aa51-2918b9f3a1a2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:58.250647 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-439713a2-4ecb-41b5-aa51-2918b9f3a1a2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:58.251180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-439713a2-4ecb-41b5-aa51-2918b9f3a1a2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:58.252024 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-439713a2-4ecb-41b5-aa51-2918b9f3a1a2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:58.252686 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-439713a2-4ecb-41b5-aa51-2918b9f3a1a2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:58.400408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-439713a2-4ecb-41b5-aa51-2918b9f3a1a2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:58.410865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-439713a2-4ecb-41b5-aa51-2918b9f3a1a2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.170763 Jul 27 20:08:58.411773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 57/105] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:58 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:58.749176 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-614642af-6f33-4770-9aff-e6284d934b92 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:58.751093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-614642af-6f33-4770-9aff-e6284d934b92 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:58.762785 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-614642af-6f33-4770-9aff-e6284d934b92 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:58.763324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-614642af-6f33-4770-9aff-e6284d934b92 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:58.764187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-614642af-6f33-4770-9aff-e6284d934b92 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:58.764635 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-614642af-6f33-4770-9aff-e6284d934b92 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:58.839551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b4632446-e4fc-4ab8-9ba0-d447c1594277 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:58.840485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b4632446-e4fc-4ab8-9ba0-d447c1594277 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:58.856740 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4632446-e4fc-4ab8-9ba0-d447c1594277 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:58.857529 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4632446-e4fc-4ab8-9ba0-d447c1594277 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:58.858459 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4632446-e4fc-4ab8-9ba0-d447c1594277 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:58.860339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4632446-e4fc-4ab8-9ba0-d447c1594277 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:59.027862 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-614642af-6f33-4770-9aff-e6284d934b92 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:59.030746 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:08:59.038793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-614642af-6f33-4770-9aff-e6284d934b92 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:59.040310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-614642af-6f33-4770-9aff-e6284d934b92 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:59.041579 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-614642af-6f33-4770-9aff-e6284d934b92 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.297211 Jul 27 20:08:59.042145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 49/106] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:08:58 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:08:59.108478 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b4632446-e4fc-4ab8-9ba0-d447c1594277 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:59.117353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b4632446-e4fc-4ab8-9ba0-d447c1594277 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.283605 Jul 27 20:08:59.118461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 58/107] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:58 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:08:59.140723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d99432ab-f04e-459c-b16c-e8d712fac360 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:59.141551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d99432ab-f04e-459c-b16c-e8d712fac360 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:59.149447 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d99432ab-f04e-459c-b16c-e8d712fac360 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:59.150376 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-c6012ea2-347c-4356-a665-4bc0adb6dd78 req-60325382-a3e5-45fb-a843-9dc4ecb59d7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9d8996c-6f06-4199-97d5-ded471eb2e2e", "name": "network-vif-plugged", "status": "completed", "tag": "0b42e5f2-e86d-4583-bdbf-99f0bab9f1ef"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:08:59.151046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d99432ab-f04e-459c-b16c-e8d712fac360 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:59.152324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d99432ab-f04e-459c-b16c-e8d712fac360 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:59.152997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d99432ab-f04e-459c-b16c-e8d712fac360 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:59.161617 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:08:59.169195 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-c6012ea2-347c-4356-a665-4bc0adb6dd78 req-60325382-a3e5-45fb-a843-9dc4ecb59d7f service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:59.170736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-c6012ea2-347c-4356-a665-4bc0adb6dd78 req-60325382-a3e5-45fb-a843-9dc4ecb59d7f service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:59.189654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-c6012ea2-347c-4356-a665-4bc0adb6dd78 req-60325382-a3e5-45fb-a843-9dc4ecb59d7f service nova] Creating event network-vif-plugged:0b42e5f2-e86d-4583-bdbf-99f0bab9f1ef for instance f9d8996c-6f06-4199-97d5-ded471eb2e2e on hv-cinder-79987 Jul 27 20:08:59.199527 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-c6012ea2-347c-4356-a665-4bc0adb6dd78 req-60325382-a3e5-45fb-a843-9dc4ecb59d7f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142731 Jul 27 20:08:59.200141 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 50/108] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:08:59.310358 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d99432ab-f04e-459c-b16c-e8d712fac360 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:59.319891 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d99432ab-f04e-459c-b16c-e8d712fac360 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.200160 Jul 27 20:08:59.320472 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 59/109] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:59 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:08:59.445348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2892867b-761e-4342-a45a-7b5617585d68 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:08:59.446139 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2892867b-761e-4342-a45a-7b5617585d68 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:08:59.456868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2892867b-761e-4342-a45a-7b5617585d68 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:59.457415 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2892867b-761e-4342-a45a-7b5617585d68 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:59.458216 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2892867b-761e-4342-a45a-7b5617585d68 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:08:59.458795 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2892867b-761e-4342-a45a-7b5617585d68 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:08:59.659134 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2892867b-761e-4342-a45a-7b5617585d68 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:08:59.667848 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2892867b-761e-4342-a45a-7b5617585d68 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.230843 Jul 27 20:08:59.668419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 51/110] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:08:59 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:00.064377 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-85e2a760-6625-460f-ab7c-050b20641c7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:00.065006 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-85e2a760-6625-460f-ab7c-050b20641c7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:00.072091 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-85e2a760-6625-460f-ab7c-050b20641c7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:00.072537 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-85e2a760-6625-460f-ab7c-050b20641c7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:00.073327 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-85e2a760-6625-460f-ab7c-050b20641c7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:00.073766 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-85e2a760-6625-460f-ab7c-050b20641c7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:00.139340 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-881bfbfb-cc3f-4598-89a3-32cc4573d341 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:00.139954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-881bfbfb-cc3f-4598-89a3-32cc4573d341 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:00.146564 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-881bfbfb-cc3f-4598-89a3-32cc4573d341 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:00.147009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-881bfbfb-cc3f-4598-89a3-32cc4573d341 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:00.147780 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-881bfbfb-cc3f-4598-89a3-32cc4573d341 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:00.148218 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-881bfbfb-cc3f-4598-89a3-32cc4573d341 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:00.213179 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-85e2a760-6625-460f-ab7c-050b20641c7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:00.223210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-85e2a760-6625-460f-ab7c-050b20641c7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:00.224796 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-85e2a760-6625-460f-ab7c-050b20641c7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:00.225962 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-85e2a760-6625-460f-ab7c-050b20641c7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.165534 Jul 27 20:09:00.226537 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 60/111] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:00 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:00.288824 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-881bfbfb-cc3f-4598-89a3-32cc4573d341 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:00.296587 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-881bfbfb-cc3f-4598-89a3-32cc4573d341 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.160954 Jul 27 20:09:00.297201 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 52/112] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:00 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:00.347916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-43417c7c-3c7a-423e-97e9-a81147eb6abb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:00.348612 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-43417c7c-3c7a-423e-97e9-a81147eb6abb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:00.355412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-43417c7c-3c7a-423e-97e9-a81147eb6abb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:00.355860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-43417c7c-3c7a-423e-97e9-a81147eb6abb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:00.356627 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-43417c7c-3c7a-423e-97e9-a81147eb6abb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:00.357091 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-43417c7c-3c7a-423e-97e9-a81147eb6abb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:00.508536 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-43417c7c-3c7a-423e-97e9-a81147eb6abb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:00.520555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-43417c7c-3c7a-423e-97e9-a81147eb6abb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.176748 Jul 27 20:09:00.521407 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 61/113] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:00 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:00.691433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d7096410-1036-426e-be37-5ae2749740d7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:00.692561 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d7096410-1036-426e-be37-5ae2749740d7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:00.701113 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d7096410-1036-426e-be37-5ae2749740d7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:00.706494 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d7096410-1036-426e-be37-5ae2749740d7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:00.708774 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d7096410-1036-426e-be37-5ae2749740d7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:00.709931 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d7096410-1036-426e-be37-5ae2749740d7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:00.911662 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d7096410-1036-426e-be37-5ae2749740d7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:00.920650 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d7096410-1036-426e-be37-5ae2749740d7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.235518 Jul 27 20:09:00.923494 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 53/114] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:00 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:01.249234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a5e7acfb-943d-4128-a6a2-d88090588c4e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:01.249867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a5e7acfb-943d-4128-a6a2-d88090588c4e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:01.256622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a5e7acfb-943d-4128-a6a2-d88090588c4e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:01.257100 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a5e7acfb-943d-4128-a6a2-d88090588c4e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:01.257861 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a5e7acfb-943d-4128-a6a2-d88090588c4e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:01.258301 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a5e7acfb-943d-4128-a6a2-d88090588c4e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:01.318771 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0beb4fd9-e72d-4ab6-9766-6703f7f002fd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:01.320211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0beb4fd9-e72d-4ab6-9766-6703f7f002fd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:01.328034 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0beb4fd9-e72d-4ab6-9766-6703f7f002fd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:01.328418 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0beb4fd9-e72d-4ab6-9766-6703f7f002fd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:01.329252 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0beb4fd9-e72d-4ab6-9766-6703f7f002fd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:01.329693 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0beb4fd9-e72d-4ab6-9766-6703f7f002fd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:01.395152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a5e7acfb-943d-4128-a6a2-d88090588c4e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:01.403207 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a5e7acfb-943d-4128-a6a2-d88090588c4e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:01.404736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a5e7acfb-943d-4128-a6a2-d88090588c4e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:01.405867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a5e7acfb-943d-4128-a6a2-d88090588c4e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.160600 Jul 27 20:09:01.406432 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 62/115] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:01 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:01.468568 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0beb4fd9-e72d-4ab6-9766-6703f7f002fd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:01.476778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0beb4fd9-e72d-4ab6-9766-6703f7f002fd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.162954 Jul 27 20:09:01.477403 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 54/116] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:01 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:01.541486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a203af50-10fa-4425-a7bb-d920e68d35c5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:01.542100 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a203af50-10fa-4425-a7bb-d920e68d35c5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:01.548037 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a203af50-10fa-4425-a7bb-d920e68d35c5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:01.548481 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a203af50-10fa-4425-a7bb-d920e68d35c5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:01.549267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a203af50-10fa-4425-a7bb-d920e68d35c5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:01.549704 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a203af50-10fa-4425-a7bb-d920e68d35c5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:01.677529 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a203af50-10fa-4425-a7bb-d920e68d35c5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:01.685052 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a203af50-10fa-4425-a7bb-d920e68d35c5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.147270 Jul 27 20:09:01.685619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 63/117] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:01 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:01.945048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-98c5872c-3bbe-4561-9be0-86dcb059dc96 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:01.945798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-98c5872c-3bbe-4561-9be0-86dcb059dc96 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:01.964628 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-98c5872c-3bbe-4561-9be0-86dcb059dc96 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:01.967516 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-98c5872c-3bbe-4561-9be0-86dcb059dc96 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:01.968718 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-98c5872c-3bbe-4561-9be0-86dcb059dc96 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:01.969581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-98c5872c-3bbe-4561-9be0-86dcb059dc96 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:02.132791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-98c5872c-3bbe-4561-9be0-86dcb059dc96 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:02.140318 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-98c5872c-3bbe-4561-9be0-86dcb059dc96 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.200452 Jul 27 20:09:02.140957 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 55/118] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:01 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:02.429543 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-38005aa5-9941-494c-b56e-a24fc76853bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:02.430159 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-38005aa5-9941-494c-b56e-a24fc76853bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:02.436238 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-38005aa5-9941-494c-b56e-a24fc76853bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:02.436687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-38005aa5-9941-494c-b56e-a24fc76853bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:02.437488 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-38005aa5-9941-494c-b56e-a24fc76853bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:02.437948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-38005aa5-9941-494c-b56e-a24fc76853bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:02.498339 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0f8010f7-7de5-4ca4-907c-c80e8a7cc0b8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:02.498950 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0f8010f7-7de5-4ca4-907c-c80e8a7cc0b8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:02.506038 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f8010f7-7de5-4ca4-907c-c80e8a7cc0b8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:02.506489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f8010f7-7de5-4ca4-907c-c80e8a7cc0b8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:02.507261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f8010f7-7de5-4ca4-907c-c80e8a7cc0b8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:02.507700 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f8010f7-7de5-4ca4-907c-c80e8a7cc0b8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:02.565703 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-38005aa5-9941-494c-b56e-a24fc76853bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:02.574271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-38005aa5-9941-494c-b56e-a24fc76853bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:02.575765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-38005aa5-9941-494c-b56e-a24fc76853bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:02.576881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-38005aa5-9941-494c-b56e-a24fc76853bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.151839 Jul 27 20:09:02.577475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 64/119] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:02 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:02.634927 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0f8010f7-7de5-4ca4-907c-c80e8a7cc0b8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:02.642288 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0f8010f7-7de5-4ca4-907c-c80e8a7cc0b8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.147894 Jul 27 20:09:02.642854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 56/120] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:02 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:02.705929 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-277ac41f-d871-4f19-af83-31042434a0c3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:02.706988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-277ac41f-d871-4f19-af83-31042434a0c3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:02.712882 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-277ac41f-d871-4f19-af83-31042434a0c3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:02.713356 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-277ac41f-d871-4f19-af83-31042434a0c3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:02.714108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-277ac41f-d871-4f19-af83-31042434a0c3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:02.714537 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-277ac41f-d871-4f19-af83-31042434a0c3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:02.845732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-277ac41f-d871-4f19-af83-31042434a0c3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:02.853665 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-277ac41f-d871-4f19-af83-31042434a0c3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.151572 Jul 27 20:09:02.854227 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 65/121] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:02 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:03.161260 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2ee94f30-0f78-4fbb-a1cf-4c14cbc5be55 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:03.161861 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2ee94f30-0f78-4fbb-a1cf-4c14cbc5be55 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:03.167681 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ee94f30-0f78-4fbb-a1cf-4c14cbc5be55 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:03.168121 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ee94f30-0f78-4fbb-a1cf-4c14cbc5be55 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:03.168868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ee94f30-0f78-4fbb-a1cf-4c14cbc5be55 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:03.169324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ee94f30-0f78-4fbb-a1cf-4c14cbc5be55 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:03.305293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2ee94f30-0f78-4fbb-a1cf-4c14cbc5be55 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:03.314540 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2ee94f30-0f78-4fbb-a1cf-4c14cbc5be55 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.157204 Jul 27 20:09:03.315100 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 57/122] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:03 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:03.599860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8a1580a6-deae-4e81-b12a-63146877e201 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:03.600364 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8a1580a6-deae-4e81-b12a-63146877e201 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:03.606446 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8a1580a6-deae-4e81-b12a-63146877e201 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:03.606886 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8a1580a6-deae-4e81-b12a-63146877e201 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:03.607635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8a1580a6-deae-4e81-b12a-63146877e201 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:03.608066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8a1580a6-deae-4e81-b12a-63146877e201 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:03.663747 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-11d177a6-5a3e-4965-a79a-01092efd0df1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:03.664359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-11d177a6-5a3e-4965-a79a-01092efd0df1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:03.670562 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11d177a6-5a3e-4965-a79a-01092efd0df1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:03.671006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11d177a6-5a3e-4965-a79a-01092efd0df1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:03.671764 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11d177a6-5a3e-4965-a79a-01092efd0df1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:03.672201 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11d177a6-5a3e-4965-a79a-01092efd0df1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:03.735568 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8a1580a6-deae-4e81-b12a-63146877e201 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:03.744233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8a1580a6-deae-4e81-b12a-63146877e201 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:03.745760 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8a1580a6-deae-4e81-b12a-63146877e201 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:03.746868 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8a1580a6-deae-4e81-b12a-63146877e201 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.151039 Jul 27 20:09:03.747567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 66/123] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:03 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:03.804338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-11d177a6-5a3e-4965-a79a-01092efd0df1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:03.811660 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-11d177a6-5a3e-4965-a79a-01092efd0df1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.152305 Jul 27 20:09:03.812218 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 58/124] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:03 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:03.874387 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-39acce43-ff3e-4ca2-b70d-8e05317dd67d tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:03.874909 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-39acce43-ff3e-4ca2-b70d-8e05317dd67d tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:03.881003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-39acce43-ff3e-4ca2-b70d-8e05317dd67d tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:03.881453 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-39acce43-ff3e-4ca2-b70d-8e05317dd67d tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:03.882196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-39acce43-ff3e-4ca2-b70d-8e05317dd67d tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:03.882627 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-39acce43-ff3e-4ca2-b70d-8e05317dd67d tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:04.010876 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-39acce43-ff3e-4ca2-b70d-8e05317dd67d tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:04.018419 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-39acce43-ff3e-4ca2-b70d-8e05317dd67d tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.147850 Jul 27 20:09:04.019019 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 67/125] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:03 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:04.336247 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-13ff735a-0768-4528-9931-23e6c0ec4366 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:04.336857 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-13ff735a-0768-4528-9931-23e6c0ec4366 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:04.342895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13ff735a-0768-4528-9931-23e6c0ec4366 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:04.343343 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13ff735a-0768-4528-9931-23e6c0ec4366 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:04.344099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13ff735a-0768-4528-9931-23e6c0ec4366 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:04.344533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13ff735a-0768-4528-9931-23e6c0ec4366 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:04.470478 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-13ff735a-0768-4528-9931-23e6c0ec4366 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:04.478033 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-13ff735a-0768-4528-9931-23e6c0ec4366 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.145616 Jul 27 20:09:04.478600 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 59/126] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:04 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:04.769522 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d36a4bdc-0ce6-437c-8d71-bce62fef6ed7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:04.770216 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d36a4bdc-0ce6-437c-8d71-bce62fef6ed7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:04.776219 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d36a4bdc-0ce6-437c-8d71-bce62fef6ed7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:04.776660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d36a4bdc-0ce6-437c-8d71-bce62fef6ed7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:04.777447 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d36a4bdc-0ce6-437c-8d71-bce62fef6ed7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:04.777883 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d36a4bdc-0ce6-437c-8d71-bce62fef6ed7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:04.831729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3db02be3-f03f-4b35-9cc2-f953bb260ce5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:04.832347 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3db02be3-f03f-4b35-9cc2-f953bb260ce5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:04.838274 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3db02be3-f03f-4b35-9cc2-f953bb260ce5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:04.838725 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3db02be3-f03f-4b35-9cc2-f953bb260ce5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:04.839494 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3db02be3-f03f-4b35-9cc2-f953bb260ce5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:04.839965 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3db02be3-f03f-4b35-9cc2-f953bb260ce5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:04.909897 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d36a4bdc-0ce6-437c-8d71-bce62fef6ed7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:04.917942 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d36a4bdc-0ce6-437c-8d71-bce62fef6ed7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:04.919429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d36a4bdc-0ce6-437c-8d71-bce62fef6ed7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:04.920526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d36a4bdc-0ce6-437c-8d71-bce62fef6ed7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.155529 Jul 27 20:09:04.921097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 68/127] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:04 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:09:04.973706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3db02be3-f03f-4b35-9cc2-f953bb260ce5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:04.981032 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3db02be3-f03f-4b35-9cc2-f953bb260ce5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.153109 Jul 27 20:09:04.981522 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 60/128] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:04 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:05.039364 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e9b88b20-78b0-438a-bd0c-a4c8a66c12f1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:05.039982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e9b88b20-78b0-438a-bd0c-a4c8a66c12f1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:05.045957 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e9b88b20-78b0-438a-bd0c-a4c8a66c12f1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:05.046407 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e9b88b20-78b0-438a-bd0c-a4c8a66c12f1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:05.047170 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e9b88b20-78b0-438a-bd0c-a4c8a66c12f1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:05.047606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e9b88b20-78b0-438a-bd0c-a4c8a66c12f1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:05.178273 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e9b88b20-78b0-438a-bd0c-a4c8a66c12f1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:05.185833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e9b88b20-78b0-438a-bd0c-a4c8a66c12f1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.150225 Jul 27 20:09:05.186404 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 69/129] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:05 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:05.498964 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3fb97efb-334f-4ced-af09-be408cf4e321 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:05.499692 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3fb97efb-334f-4ced-af09-be408cf4e321 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:05.506742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3fb97efb-334f-4ced-af09-be408cf4e321 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:05.507190 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3fb97efb-334f-4ced-af09-be408cf4e321 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:05.507958 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3fb97efb-334f-4ced-af09-be408cf4e321 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:05.508393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3fb97efb-334f-4ced-af09-be408cf4e321 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:05.636039 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3fb97efb-334f-4ced-af09-be408cf4e321 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:05.643470 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3fb97efb-334f-4ced-af09-be408cf4e321 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.148280 Jul 27 20:09:05.644261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 61/130] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:05 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:05.943711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7f5a16ee-09f4-4b47-b124-81401675b60a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:05.944319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7f5a16ee-09f4-4b47-b124-81401675b60a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:05.950473 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7f5a16ee-09f4-4b47-b124-81401675b60a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:05.950923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7f5a16ee-09f4-4b47-b124-81401675b60a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:05.951688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7f5a16ee-09f4-4b47-b124-81401675b60a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:05.952115 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7f5a16ee-09f4-4b47-b124-81401675b60a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:06.002097 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-398b4089-a147-4290-88c4-a3ada0de3934 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:06.003156 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-398b4089-a147-4290-88c4-a3ada0de3934 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:06.009332 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-398b4089-a147-4290-88c4-a3ada0de3934 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:06.009787 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-398b4089-a147-4290-88c4-a3ada0de3934 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:06.010558 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-398b4089-a147-4290-88c4-a3ada0de3934 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:06.010994 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-398b4089-a147-4290-88c4-a3ada0de3934 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:06.101917 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7f5a16ee-09f4-4b47-b124-81401675b60a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:06.111451 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7f5a16ee-09f4-4b47-b124-81401675b60a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:06.113571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7f5a16ee-09f4-4b47-b124-81401675b60a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:06.114879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7f5a16ee-09f4-4b47-b124-81401675b60a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.175337 Jul 27 20:09:06.115671 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 70/131] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:05 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:06.199437 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-398b4089-a147-4290-88c4-a3ada0de3934 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:06.207203 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-163c0347-0b15-443d-853b-b4b9ae7690c7 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:06.207578 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-398b4089-a147-4290-88c4-a3ada0de3934 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.209254 Jul 27 20:09:06.208016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-163c0347-0b15-443d-853b-b4b9ae7690c7 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:06.208380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 62/132] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:05 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:06.219321 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-163c0347-0b15-443d-853b-b4b9ae7690c7 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:06.219801 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-163c0347-0b15-443d-853b-b4b9ae7690c7 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:06.220606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-163c0347-0b15-443d-853b-b4b9ae7690c7 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:06.221063 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-163c0347-0b15-443d-853b-b4b9ae7690c7 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:06.378548 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-163c0347-0b15-443d-853b-b4b9ae7690c7 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:06.387303 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-163c0347-0b15-443d-853b-b4b9ae7690c7 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.184090 Jul 27 20:09:06.387964 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 71/133] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:06 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:06.663932 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8d6230db-c55d-4b80-ad2e-1cac8d19601e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:06.664543 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8d6230db-c55d-4b80-ad2e-1cac8d19601e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:06.671671 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d6230db-c55d-4b80-ad2e-1cac8d19601e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:06.672111 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d6230db-c55d-4b80-ad2e-1cac8d19601e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:06.672867 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d6230db-c55d-4b80-ad2e-1cac8d19601e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:06.673349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d6230db-c55d-4b80-ad2e-1cac8d19601e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:06.829468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8d6230db-c55d-4b80-ad2e-1cac8d19601e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:06.837349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8d6230db-c55d-4b80-ad2e-1cac8d19601e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.177258 Jul 27 20:09:06.837912 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 63/134] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:06 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:07.141861 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7d5eb843-6a6e-44bc-a106-7ce2680c60cc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:07.142470 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7d5eb843-6a6e-44bc-a106-7ce2680c60cc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:07.149077 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d5eb843-6a6e-44bc-a106-7ce2680c60cc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:07.149535 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d5eb843-6a6e-44bc-a106-7ce2680c60cc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:07.150295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d5eb843-6a6e-44bc-a106-7ce2680c60cc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:07.150731 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d5eb843-6a6e-44bc-a106-7ce2680c60cc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:07.229588 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ad5af3ec-6852-456a-827f-b90a1b0a6827 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:07.230202 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ad5af3ec-6852-456a-827f-b90a1b0a6827 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:07.236403 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ad5af3ec-6852-456a-827f-b90a1b0a6827 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:07.236854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ad5af3ec-6852-456a-827f-b90a1b0a6827 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:07.237703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ad5af3ec-6852-456a-827f-b90a1b0a6827 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:07.238137 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ad5af3ec-6852-456a-827f-b90a1b0a6827 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:07.297975 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7d5eb843-6a6e-44bc-a106-7ce2680c60cc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:07.306904 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7d5eb843-6a6e-44bc-a106-7ce2680c60cc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:07.308514 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7d5eb843-6a6e-44bc-a106-7ce2680c60cc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:07.309774 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7d5eb843-6a6e-44bc-a106-7ce2680c60cc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.171783 Jul 27 20:09:07.310546 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 72/135] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:07 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:07.384699 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ad5af3ec-6852-456a-827f-b90a1b0a6827 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:07.392069 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ad5af3ec-6852-456a-827f-b90a1b0a6827 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.166699 Jul 27 20:09:07.392826 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 64/136] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:07 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:07.408919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e90dbea9-d8dc-4b6f-9b42-b82d6d6f5e91 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:07.410300 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e90dbea9-d8dc-4b6f-9b42-b82d6d6f5e91 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:07.416600 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e90dbea9-d8dc-4b6f-9b42-b82d6d6f5e91 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:07.417080 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e90dbea9-d8dc-4b6f-9b42-b82d6d6f5e91 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:07.417837 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e90dbea9-d8dc-4b6f-9b42-b82d6d6f5e91 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:07.418450 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e90dbea9-d8dc-4b6f-9b42-b82d6d6f5e91 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:07.544346 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e90dbea9-d8dc-4b6f-9b42-b82d6d6f5e91 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:07.551893 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e90dbea9-d8dc-4b6f-9b42-b82d6d6f5e91 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.146768 Jul 27 20:09:07.552469 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 73/137] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:07 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:07.857884 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a2b186a0-0b12-4ba1-aea0-dfe212b85766 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:07.858426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a2b186a0-0b12-4ba1-aea0-dfe212b85766 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:07.866295 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a2b186a0-0b12-4ba1-aea0-dfe212b85766 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:07.866795 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a2b186a0-0b12-4ba1-aea0-dfe212b85766 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:07.867831 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a2b186a0-0b12-4ba1-aea0-dfe212b85766 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:07.868405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a2b186a0-0b12-4ba1-aea0-dfe212b85766 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:08.160998 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a2b186a0-0b12-4ba1-aea0-dfe212b85766 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:08.168358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a2b186a0-0b12-4ba1-aea0-dfe212b85766 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.314334 Jul 27 20:09:08.168918 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 65/138] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:07 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:08.336874 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-09b21cdc-d537-451f-8142-8affd9ef0719 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:08.337506 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-09b21cdc-d537-451f-8142-8affd9ef0719 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:08.343482 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-09b21cdc-d537-451f-8142-8affd9ef0719 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:08.343924 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-09b21cdc-d537-451f-8142-8affd9ef0719 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:08.344671 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-09b21cdc-d537-451f-8142-8affd9ef0719 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:08.345127 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-09b21cdc-d537-451f-8142-8affd9ef0719 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:08.414323 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-139d91a7-d0b5-45d1-963e-80d735d53c83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:08.414963 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-139d91a7-d0b5-45d1-963e-80d735d53c83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:08.421400 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-139d91a7-d0b5-45d1-963e-80d735d53c83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:08.421860 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-139d91a7-d0b5-45d1-963e-80d735d53c83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:08.422710 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-139d91a7-d0b5-45d1-963e-80d735d53c83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:08.423055 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-139d91a7-d0b5-45d1-963e-80d735d53c83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:08.477606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-09b21cdc-d537-451f-8142-8affd9ef0719 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:08.485522 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-09b21cdc-d537-451f-8142-8affd9ef0719 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:08.487018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-09b21cdc-d537-451f-8142-8affd9ef0719 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:08.488976 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-09b21cdc-d537-451f-8142-8affd9ef0719 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.155919 Jul 27 20:09:08.489544 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 74/139] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:08 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:08.553918 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-139d91a7-d0b5-45d1-963e-80d735d53c83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:08.561130 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-139d91a7-d0b5-45d1-963e-80d735d53c83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.151443 Jul 27 20:09:08.561696 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 66/140] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:08 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:08.572231 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f40f0c61-2564-4966-9c99-2893099eb362 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:08.572841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f40f0c61-2564-4966-9c99-2893099eb362 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:08.578848 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f40f0c61-2564-4966-9c99-2893099eb362 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:08.579297 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f40f0c61-2564-4966-9c99-2893099eb362 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:08.580054 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f40f0c61-2564-4966-9c99-2893099eb362 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:08.580486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f40f0c61-2564-4966-9c99-2893099eb362 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:08.717842 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f40f0c61-2564-4966-9c99-2893099eb362 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:08.721233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:09:08.726957 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f40f0c61-2564-4966-9c99-2893099eb362 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.158831 Jul 27 20:09:08.727569 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 75/141] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:08 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:09.190030 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d40003e7-b897-4ef0-9c88-d227874ae2fb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:09.191076 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d40003e7-b897-4ef0-9c88-d227874ae2fb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:09.197519 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d40003e7-b897-4ef0-9c88-d227874ae2fb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:09.197970 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d40003e7-b897-4ef0-9c88-d227874ae2fb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:09.198726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d40003e7-b897-4ef0-9c88-d227874ae2fb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:09.199163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d40003e7-b897-4ef0-9c88-d227874ae2fb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:09.201796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:09:09.328577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d40003e7-b897-4ef0-9c88-d227874ae2fb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:09.335975 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d40003e7-b897-4ef0-9c88-d227874ae2fb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.150169 Jul 27 20:09:09.336544 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 67/142] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:09 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:09.511700 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5f3e7b3c-918b-4af9-aaba-4e5a1cab8060 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:09.512299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5f3e7b3c-918b-4af9-aaba-4e5a1cab8060 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:09.518258 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5f3e7b3c-918b-4af9-aaba-4e5a1cab8060 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:09.518733 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5f3e7b3c-918b-4af9-aaba-4e5a1cab8060 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:09.519479 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5f3e7b3c-918b-4af9-aaba-4e5a1cab8060 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:09.519906 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5f3e7b3c-918b-4af9-aaba-4e5a1cab8060 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:09.580931 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9893cba0-336e-41ce-a99f-0356b29d8d26 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:09.581608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9893cba0-336e-41ce-a99f-0356b29d8d26 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:09.587568 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9893cba0-336e-41ce-a99f-0356b29d8d26 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:09.588016 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9893cba0-336e-41ce-a99f-0356b29d8d26 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:09.588782 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9893cba0-336e-41ce-a99f-0356b29d8d26 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:09.589245 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9893cba0-336e-41ce-a99f-0356b29d8d26 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:09.647871 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5f3e7b3c-918b-4af9-aaba-4e5a1cab8060 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:09.655711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5f3e7b3c-918b-4af9-aaba-4e5a1cab8060 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:09.657222 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5f3e7b3c-918b-4af9-aaba-4e5a1cab8060 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:09.658312 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5f3e7b3c-918b-4af9-aaba-4e5a1cab8060 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.150672 Jul 27 20:09:09.658865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 76/143] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:09 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:09.717991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9893cba0-336e-41ce-a99f-0356b29d8d26 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:09.726068 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9893cba0-336e-41ce-a99f-0356b29d8d26 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.148932 Jul 27 20:09:09.726575 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 68/144] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:09 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:09.747406 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-09a61bfd-25ae-46da-b3ce-2cc2d8034660 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:09.748010 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-09a61bfd-25ae-46da-b3ce-2cc2d8034660 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:09.754532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-09a61bfd-25ae-46da-b3ce-2cc2d8034660 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:09.754974 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-09a61bfd-25ae-46da-b3ce-2cc2d8034660 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:09.755717 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-09a61bfd-25ae-46da-b3ce-2cc2d8034660 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:09.756142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-09a61bfd-25ae-46da-b3ce-2cc2d8034660 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:09.887177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-09a61bfd-25ae-46da-b3ce-2cc2d8034660 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:09.895124 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-09a61bfd-25ae-46da-b3ce-2cc2d8034660 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.151477 Jul 27 20:09:09.895781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 77/145] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:09 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:10.356374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-afc48a79-2136-4269-85ca-a950b1440a3f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:10.356916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-afc48a79-2136-4269-85ca-a950b1440a3f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:10.363190 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-afc48a79-2136-4269-85ca-a950b1440a3f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:10.363632 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-afc48a79-2136-4269-85ca-a950b1440a3f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:10.364410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-afc48a79-2136-4269-85ca-a950b1440a3f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:10.364837 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-afc48a79-2136-4269-85ca-a950b1440a3f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:10.491580 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-afc48a79-2136-4269-85ca-a950b1440a3f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:10.498967 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-afc48a79-2136-4269-85ca-a950b1440a3f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.146299 Jul 27 20:09:10.499532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 69/146] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:10 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:10.680579 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0b2dae8f-59d4-4e7c-95f1-b2fcde03c2ce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:10.681271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0b2dae8f-59d4-4e7c-95f1-b2fcde03c2ce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:10.687166 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b2dae8f-59d4-4e7c-95f1-b2fcde03c2ce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:10.687612 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b2dae8f-59d4-4e7c-95f1-b2fcde03c2ce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:10.688371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b2dae8f-59d4-4e7c-95f1-b2fcde03c2ce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:10.688807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b2dae8f-59d4-4e7c-95f1-b2fcde03c2ce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:10.747054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-adc05eaa-19c9-49ec-8d8f-f466ecfb1410 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:10.747661 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-adc05eaa-19c9-49ec-8d8f-f466ecfb1410 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:10.754118 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-adc05eaa-19c9-49ec-8d8f-f466ecfb1410 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:10.755245 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-adc05eaa-19c9-49ec-8d8f-f466ecfb1410 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:10.756213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-adc05eaa-19c9-49ec-8d8f-f466ecfb1410 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:10.756636 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-adc05eaa-19c9-49ec-8d8f-f466ecfb1410 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:10.822704 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0b2dae8f-59d4-4e7c-95f1-b2fcde03c2ce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:10.830771 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0b2dae8f-59d4-4e7c-95f1-b2fcde03c2ce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:10.832345 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0b2dae8f-59d4-4e7c-95f1-b2fcde03c2ce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:10.833500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0b2dae8f-59d4-4e7c-95f1-b2fcde03c2ce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.156842 Jul 27 20:09:10.834052 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 78/147] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:10 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:10.893942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-adc05eaa-19c9-49ec-8d8f-f466ecfb1410 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:10.901403 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-adc05eaa-19c9-49ec-8d8f-f466ecfb1410 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.158103 Jul 27 20:09:10.901969 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 70/148] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:10 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:10.915622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d976ca14-466f-4774-8ded-c1db0cc8ad9f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:10.916186 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d976ca14-466f-4774-8ded-c1db0cc8ad9f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:10.922229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d976ca14-466f-4774-8ded-c1db0cc8ad9f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:10.922677 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d976ca14-466f-4774-8ded-c1db0cc8ad9f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:10.923487 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d976ca14-466f-4774-8ded-c1db0cc8ad9f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:10.923920 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d976ca14-466f-4774-8ded-c1db0cc8ad9f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:11.063052 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d976ca14-466f-4774-8ded-c1db0cc8ad9f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:11.071234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d976ca14-466f-4774-8ded-c1db0cc8ad9f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.159540 Jul 27 20:09:11.071791 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 79/149] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:10 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:11.520903 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4012c580-861d-4742-bac6-cee9143dc027 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:11.521508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4012c580-861d-4742-bac6-cee9143dc027 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:11.527618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4012c580-861d-4742-bac6-cee9143dc027 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:11.528062 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4012c580-861d-4742-bac6-cee9143dc027 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:11.528906 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4012c580-861d-4742-bac6-cee9143dc027 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:11.529426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4012c580-861d-4742-bac6-cee9143dc027 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:11.541747 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-61ffaf84-d66b-4046-bfab-e9da9750e3fd req-80ea679e-ab1b-4c82-8753-5dcfaea2870e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72605170-2987-4669-ac91-425028a572f9", "name": "network-vif-plugged", "status": "completed", "tag": "43f1be02-78dc-4f7e-a834-fc4c4494971d"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:09:11.554781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-61ffaf84-d66b-4046-bfab-e9da9750e3fd req-80ea679e-ab1b-4c82-8753-5dcfaea2870e service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:11.555317 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-61ffaf84-d66b-4046-bfab-e9da9750e3fd req-80ea679e-ab1b-4c82-8753-5dcfaea2870e service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:11.568555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-61ffaf84-d66b-4046-bfab-e9da9750e3fd req-80ea679e-ab1b-4c82-8753-5dcfaea2870e service nova] Creating event network-vif-plugged:43f1be02-78dc-4f7e-a834-fc4c4494971d for instance 72605170-2987-4669-ac91-425028a572f9 on hv-cinder-79987 Jul 27 20:09:11.575687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-61ffaf84-d66b-4046-bfab-e9da9750e3fd req-80ea679e-ab1b-4c82-8753-5dcfaea2870e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038913 Jul 27 20:09:11.576637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 80/150] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:09:11.702964 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4012c580-861d-4742-bac6-cee9143dc027 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:11.710896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4012c580-861d-4742-bac6-cee9143dc027 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.194845 Jul 27 20:09:11.711473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 71/151] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:11 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:11.856136 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fba67170-f648-4b3d-b3d4-3ba1124ff281 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:11.856814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fba67170-f648-4b3d-b3d4-3ba1124ff281 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:11.863213 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fba67170-f648-4b3d-b3d4-3ba1124ff281 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:11.863604 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fba67170-f648-4b3d-b3d4-3ba1124ff281 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:11.864371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fba67170-f648-4b3d-b3d4-3ba1124ff281 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:11.864812 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fba67170-f648-4b3d-b3d4-3ba1124ff281 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:11.921228 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-41197723-ece9-4d81-8d43-6f903b3e4977 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:11.921841 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-41197723-ece9-4d81-8d43-6f903b3e4977 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:11.928385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-41197723-ece9-4d81-8d43-6f903b3e4977 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:11.928834 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-41197723-ece9-4d81-8d43-6f903b3e4977 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:11.929631 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-41197723-ece9-4d81-8d43-6f903b3e4977 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:11.930068 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-41197723-ece9-4d81-8d43-6f903b3e4977 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:11.994895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fba67170-f648-4b3d-b3d4-3ba1124ff281 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:12.005497 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fba67170-f648-4b3d-b3d4-3ba1124ff281 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:12.007228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fba67170-f648-4b3d-b3d4-3ba1124ff281 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:12.008535 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fba67170-f648-4b3d-b3d4-3ba1124ff281 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.156656 Jul 27 20:09:12.020556 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 81/152] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:11 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:12.072114 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-41197723-ece9-4d81-8d43-6f903b3e4977 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:12.079484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-41197723-ece9-4d81-8d43-6f903b3e4977 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.162198 Jul 27 20:09:12.080040 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 72/153] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:11 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:12.091615 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-839a6966-2fe7-4c28-81f1-92f776b17a74 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:12.092443 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-839a6966-2fe7-4c28-81f1-92f776b17a74 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:12.098665 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-839a6966-2fe7-4c28-81f1-92f776b17a74 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:12.099114 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-839a6966-2fe7-4c28-81f1-92f776b17a74 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:12.099878 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-839a6966-2fe7-4c28-81f1-92f776b17a74 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:12.100343 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-839a6966-2fe7-4c28-81f1-92f776b17a74 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:12.224824 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-839a6966-2fe7-4c28-81f1-92f776b17a74 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:12.232296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-839a6966-2fe7-4c28-81f1-92f776b17a74 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.144542 Jul 27 20:09:12.232853 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 82/154] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:12 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:12.731156 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5220a5ca-f33c-46e3-905b-89a04ac4034a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:12.731769 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5220a5ca-f33c-46e3-905b-89a04ac4034a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:12.738672 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5220a5ca-f33c-46e3-905b-89a04ac4034a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:12.739124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5220a5ca-f33c-46e3-905b-89a04ac4034a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:12.739888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5220a5ca-f33c-46e3-905b-89a04ac4034a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:12.740359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5220a5ca-f33c-46e3-905b-89a04ac4034a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:12.866683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5220a5ca-f33c-46e3-905b-89a04ac4034a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:12.874453 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5220a5ca-f33c-46e3-905b-89a04ac4034a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.147133 Jul 27 20:09:12.875016 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 73/155] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:12 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:13.031573 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7d6b5ba6-ddd5-4922-96cf-d693656c6d7c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:13.032340 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7d6b5ba6-ddd5-4922-96cf-d693656c6d7c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:13.039298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d6b5ba6-ddd5-4922-96cf-d693656c6d7c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:13.039760 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d6b5ba6-ddd5-4922-96cf-d693656c6d7c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:13.040525 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d6b5ba6-ddd5-4922-96cf-d693656c6d7c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:13.041058 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d6b5ba6-ddd5-4922-96cf-d693656c6d7c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:13.101706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-26042d76-5194-41c3-8b3f-3c834e89e485 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:13.102320 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-26042d76-5194-41c3-8b3f-3c834e89e485 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:13.108404 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-26042d76-5194-41c3-8b3f-3c834e89e485 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:13.108853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-26042d76-5194-41c3-8b3f-3c834e89e485 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:13.109660 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-26042d76-5194-41c3-8b3f-3c834e89e485 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:13.110096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-26042d76-5194-41c3-8b3f-3c834e89e485 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:13.178620 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7d6b5ba6-ddd5-4922-96cf-d693656c6d7c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:13.187767 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7d6b5ba6-ddd5-4922-96cf-d693656c6d7c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:13.189677 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7d6b5ba6-ddd5-4922-96cf-d693656c6d7c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:13.190432 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7d6b5ba6-ddd5-4922-96cf-d693656c6d7c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.162729 Jul 27 20:09:13.190990 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 83/156] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:13 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:13.245284 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-26042d76-5194-41c3-8b3f-3c834e89e485 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:13.251471 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-050f0a73-5498-4887-9d4e-d9a1e0c81881 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:13.252116 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-050f0a73-5498-4887-9d4e-d9a1e0c81881 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:13.252911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-26042d76-5194-41c3-8b3f-3c834e89e485 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.155792 Jul 27 20:09:13.253501 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 74/157] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:13 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:13.258114 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-050f0a73-5498-4887-9d4e-d9a1e0c81881 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:13.258568 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-050f0a73-5498-4887-9d4e-d9a1e0c81881 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:13.259330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-050f0a73-5498-4887-9d4e-d9a1e0c81881 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:13.259820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-050f0a73-5498-4887-9d4e-d9a1e0c81881 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:13.384755 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-050f0a73-5498-4887-9d4e-d9a1e0c81881 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:13.393051 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-050f0a73-5498-4887-9d4e-d9a1e0c81881 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.145334 Jul 27 20:09:13.394217 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 84/158] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:13 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:13.623341 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-ada93f0f-6dc8-4fcd-84aa-4171ccc67142 req-1c78d064-3c0c-4df7-9f5d-89cb1090cd0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8779e897-ecd4-43b8-9f87-a8e0c524c94a", "name": "network-vif-plugged", "status": "completed", "tag": "17b5101e-1922-439a-82ad-033657522bc9"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:09:13.633347 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-ada93f0f-6dc8-4fcd-84aa-4171ccc67142 req-1c78d064-3c0c-4df7-9f5d-89cb1090cd0e service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:13.633789 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-ada93f0f-6dc8-4fcd-84aa-4171ccc67142 req-1c78d064-3c0c-4df7-9f5d-89cb1090cd0e service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:13.645505 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-ada93f0f-6dc8-4fcd-84aa-4171ccc67142 req-1c78d064-3c0c-4df7-9f5d-89cb1090cd0e service nova] Creating event network-vif-plugged:17b5101e-1922-439a-82ad-033657522bc9 for instance 8779e897-ecd4-43b8-9f87-a8e0c524c94a on hv-cinder-79987 Jul 27 20:09:13.650559 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-ada93f0f-6dc8-4fcd-84aa-4171ccc67142 req-1c78d064-3c0c-4df7-9f5d-89cb1090cd0e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030840 Jul 27 20:09:13.651143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 75/159] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:09:13.897877 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7f2f7717-f082-4139-84ec-9861065e8b5d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:13.898520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7f2f7717-f082-4139-84ec-9861065e8b5d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:13.904562 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7f2f7717-f082-4139-84ec-9861065e8b5d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:13.905052 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7f2f7717-f082-4139-84ec-9861065e8b5d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:13.905816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7f2f7717-f082-4139-84ec-9861065e8b5d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:13.906253 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7f2f7717-f082-4139-84ec-9861065e8b5d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:14.035092 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7f2f7717-f082-4139-84ec-9861065e8b5d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:14.042598 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7f2f7717-f082-4139-84ec-9861065e8b5d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.151574 Jul 27 20:09:14.043171 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 85/160] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:13 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:14.215882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-350d2631-cc08-4613-9673-24172a60b85f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:14.216492 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-350d2631-cc08-4613-9673-24172a60b85f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:14.223538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-350d2631-cc08-4613-9673-24172a60b85f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:14.223985 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-350d2631-cc08-4613-9673-24172a60b85f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:14.224750 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-350d2631-cc08-4613-9673-24172a60b85f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:14.225221 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-350d2631-cc08-4613-9673-24172a60b85f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:14.273374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-471e7384-4302-4909-85be-3d86f73163a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:14.273986 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-471e7384-4302-4909-85be-3d86f73163a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:14.279947 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-471e7384-4302-4909-85be-3d86f73163a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:14.280399 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-471e7384-4302-4909-85be-3d86f73163a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:14.281194 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-471e7384-4302-4909-85be-3d86f73163a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:14.281634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-471e7384-4302-4909-85be-3d86f73163a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:14.354208 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-350d2631-cc08-4613-9673-24172a60b85f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:14.362165 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-350d2631-cc08-4613-9673-24172a60b85f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:14.364283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-350d2631-cc08-4613-9673-24172a60b85f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:14.365433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-350d2631-cc08-4613-9673-24172a60b85f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.153872 Jul 27 20:09:14.365986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 76/161] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:14 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:14.414414 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-471e7384-4302-4909-85be-3d86f73163a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:14.414737 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8ef4e4a7-ff02-43f5-af0d-769d91fc71f4 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:14.415352 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8ef4e4a7-ff02-43f5-af0d-769d91fc71f4 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:14.421516 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8ef4e4a7-ff02-43f5-af0d-769d91fc71f4 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:14.421966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8ef4e4a7-ff02-43f5-af0d-769d91fc71f4 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:14.422306 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-471e7384-4302-4909-85be-3d86f73163a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.152680 Jul 27 20:09:14.422735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8ef4e4a7-ff02-43f5-af0d-769d91fc71f4 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:14.425331 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 86/162] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:14 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:14.425498 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8ef4e4a7-ff02-43f5-af0d-769d91fc71f4 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:14.549535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8ef4e4a7-ff02-43f5-af0d-769d91fc71f4 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:14.557530 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8ef4e4a7-ff02-43f5-af0d-769d91fc71f4 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.146758 Jul 27 20:09:14.558095 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 77/163] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:14 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:15.067184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a0c14d2c-88ae-4fb5-8194-9805d626edbe tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:15.067691 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a0c14d2c-88ae-4fb5-8194-9805d626edbe tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:15.074166 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a0c14d2c-88ae-4fb5-8194-9805d626edbe tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:15.074608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a0c14d2c-88ae-4fb5-8194-9805d626edbe tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:15.075360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a0c14d2c-88ae-4fb5-8194-9805d626edbe tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:15.075792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a0c14d2c-88ae-4fb5-8194-9805d626edbe tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:15.204857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a0c14d2c-88ae-4fb5-8194-9805d626edbe tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:15.212804 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a0c14d2c-88ae-4fb5-8194-9805d626edbe tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.150239 Jul 27 20:09:15.213394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 87/164] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:15 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:15.387604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4a8d5389-8163-4a8a-b116-2c07dcdaaef7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:15.388213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4a8d5389-8163-4a8a-b116-2c07dcdaaef7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:15.394365 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a8d5389-8163-4a8a-b116-2c07dcdaaef7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:15.394814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a8d5389-8163-4a8a-b116-2c07dcdaaef7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:15.395577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a8d5389-8163-4a8a-b116-2c07dcdaaef7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:15.396011 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a8d5389-8163-4a8a-b116-2c07dcdaaef7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:15.449576 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b91a0d74-67f9-4326-afea-89fe9a10b8fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:15.450187 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b91a0d74-67f9-4326-afea-89fe9a10b8fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:15.456569 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b91a0d74-67f9-4326-afea-89fe9a10b8fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:15.457007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b91a0d74-67f9-4326-afea-89fe9a10b8fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:15.458253 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b91a0d74-67f9-4326-afea-89fe9a10b8fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:15.459148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b91a0d74-67f9-4326-afea-89fe9a10b8fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:15.545277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4a8d5389-8163-4a8a-b116-2c07dcdaaef7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:15.554519 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4a8d5389-8163-4a8a-b116-2c07dcdaaef7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:15.556022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4a8d5389-8163-4a8a-b116-2c07dcdaaef7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:15.557177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4a8d5389-8163-4a8a-b116-2c07dcdaaef7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.173394 Jul 27 20:09:15.557743 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 78/165] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:15 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:15.578788 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-accae13a-e1a3-4065-a209-8ca41aa98310 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:15.579937 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-accae13a-e1a3-4065-a209-8ca41aa98310 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:15.587474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-accae13a-e1a3-4065-a209-8ca41aa98310 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:15.588406 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-accae13a-e1a3-4065-a209-8ca41aa98310 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:15.589299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-accae13a-e1a3-4065-a209-8ca41aa98310 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:15.589805 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-accae13a-e1a3-4065-a209-8ca41aa98310 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:15.605839 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b91a0d74-67f9-4326-afea-89fe9a10b8fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:15.613529 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b91a0d74-67f9-4326-afea-89fe9a10b8fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.167729 Jul 27 20:09:15.614110 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 88/166] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:15 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:15.719005 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-accae13a-e1a3-4065-a209-8ca41aa98310 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:15.726521 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-accae13a-e1a3-4065-a209-8ca41aa98310 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.152084 Jul 27 20:09:15.727087 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 79/167] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:15 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:16.233368 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-24c67cde-db30-4438-821e-9bfbc266e3fa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:16.233983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-24c67cde-db30-4438-821e-9bfbc266e3fa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:16.240653 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-24c67cde-db30-4438-821e-9bfbc266e3fa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:16.241131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-24c67cde-db30-4438-821e-9bfbc266e3fa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:16.241896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-24c67cde-db30-4438-821e-9bfbc266e3fa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:16.242332 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-24c67cde-db30-4438-821e-9bfbc266e3fa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:16.366569 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-24c67cde-db30-4438-821e-9bfbc266e3fa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:16.373832 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-24c67cde-db30-4438-821e-9bfbc266e3fa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.144331 Jul 27 20:09:16.374389 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 89/168] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:16 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:16.580263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7e3c6583-2a1a-4e46-8ac2-172a9ae9b4a1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:16.580898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7e3c6583-2a1a-4e46-8ac2-172a9ae9b4a1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:16.587033 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7e3c6583-2a1a-4e46-8ac2-172a9ae9b4a1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:16.587479 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7e3c6583-2a1a-4e46-8ac2-172a9ae9b4a1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:16.588243 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7e3c6583-2a1a-4e46-8ac2-172a9ae9b4a1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:16.588678 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7e3c6583-2a1a-4e46-8ac2-172a9ae9b4a1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:16.634275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7abb1624-96ca-457c-ab5c-d1e380afbf27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:16.634910 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7abb1624-96ca-457c-ab5c-d1e380afbf27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:16.641429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7abb1624-96ca-457c-ab5c-d1e380afbf27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:16.641874 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7abb1624-96ca-457c-ab5c-d1e380afbf27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:16.642982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7abb1624-96ca-457c-ab5c-d1e380afbf27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:16.643095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7abb1624-96ca-457c-ab5c-d1e380afbf27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:16.727548 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7e3c6583-2a1a-4e46-8ac2-172a9ae9b4a1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:16.737852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7e3c6583-2a1a-4e46-8ac2-172a9ae9b4a1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:16.739644 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7e3c6583-2a1a-4e46-8ac2-172a9ae9b4a1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:16.741619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7e3c6583-2a1a-4e46-8ac2-172a9ae9b4a1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.164670 Jul 27 20:09:16.743634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 80/169] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:16 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:16.748548 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f3febda8-5ada-4acc-bd62-b212e7895930 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:16.749535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f3febda8-5ada-4acc-bd62-b212e7895930 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:16.755982 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3febda8-5ada-4acc-bd62-b212e7895930 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:16.756433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3febda8-5ada-4acc-bd62-b212e7895930 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:16.757230 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3febda8-5ada-4acc-bd62-b212e7895930 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:16.757823 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3febda8-5ada-4acc-bd62-b212e7895930 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:16.792015 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7abb1624-96ca-457c-ab5c-d1e380afbf27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:16.799502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7abb1624-96ca-457c-ab5c-d1e380afbf27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.169014 Jul 27 20:09:16.800715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 90/170] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:16 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:16.896344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f3febda8-5ada-4acc-bd62-b212e7895930 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:16.903716 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f3febda8-5ada-4acc-bd62-b212e7895930 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.158921 Jul 27 20:09:16.904332 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 81/171] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:16 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:17.395096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-05e8b5d5-efaa-483d-aff2-658524a14a1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:17.395721 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-05e8b5d5-efaa-483d-aff2-658524a14a1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:17.401906 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-05e8b5d5-efaa-483d-aff2-658524a14a1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:17.402355 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-05e8b5d5-efaa-483d-aff2-658524a14a1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:17.403121 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-05e8b5d5-efaa-483d-aff2-658524a14a1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:17.403564 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-05e8b5d5-efaa-483d-aff2-658524a14a1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:17.533708 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-05e8b5d5-efaa-483d-aff2-658524a14a1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:17.542295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-05e8b5d5-efaa-483d-aff2-658524a14a1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.151332 Jul 27 20:09:17.542847 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 91/172] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:17 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:17.766050 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b6d6c4a1-88bc-4a77-8de4-451344e0ca7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:17.766676 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b6d6c4a1-88bc-4a77-8de4-451344e0ca7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:17.769192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=98 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:09:17.774530 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6d6c4a1-88bc-4a77-8de4-451344e0ca7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:17.774973 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6d6c4a1-88bc-4a77-8de4-451344e0ca7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:17.775722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6d6c4a1-88bc-4a77-8de4-451344e0ca7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:17.776147 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6d6c4a1-88bc-4a77-8de4-451344e0ca7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:17.820929 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-21d8f729-98e2-4a02-8a2d-7a5e100a6d06 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:17.821571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-21d8f729-98e2-4a02-8a2d-7a5e100a6d06 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:17.828566 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-21d8f729-98e2-4a02-8a2d-7a5e100a6d06 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:17.829178 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-21d8f729-98e2-4a02-8a2d-7a5e100a6d06 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:17.829944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-21d8f729-98e2-4a02-8a2d-7a5e100a6d06 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:17.830491 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-21d8f729-98e2-4a02-8a2d-7a5e100a6d06 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:17.924214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b6d6c4a1-88bc-4a77-8de4-451344e0ca7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:17.933866 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b6d6c4a1-88bc-4a77-8de4-451344e0ca7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:17.935675 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b6d6c4a1-88bc-4a77-8de4-451344e0ca7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:17.936952 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b6d6c4a1-88bc-4a77-8de4-451344e0ca7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.174762 Jul 27 20:09:17.937702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 82/173] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:17 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:17.942763 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e7db8d14-4ea0-4464-ae3a-ec76fed71c61 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:17.943787 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e7db8d14-4ea0-4464-ae3a-ec76fed71c61 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:17.952027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7db8d14-4ea0-4464-ae3a-ec76fed71c61 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:17.952688 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7db8d14-4ea0-4464-ae3a-ec76fed71c61 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:17.953912 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7db8d14-4ea0-4464-ae3a-ec76fed71c61 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:17.954488 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7db8d14-4ea0-4464-ae3a-ec76fed71c61 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:17.999989 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-21d8f729-98e2-4a02-8a2d-7a5e100a6d06 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:18.009094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-21d8f729-98e2-4a02-8a2d-7a5e100a6d06 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.192834 Jul 27 20:09:18.010027 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 92/174] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:17 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:18.122842 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e7db8d14-4ea0-4464-ae3a-ec76fed71c61 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:18.131961 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e7db8d14-4ea0-4464-ae3a-ec76fed71c61 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.193001 Jul 27 20:09:18.133016 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 83/175] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:17 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:18.566617 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f2359aaf-2634-4b21-bb5f-7211e103806a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:18.567229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f2359aaf-2634-4b21-bb5f-7211e103806a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:18.569521 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:09:18.574889 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2359aaf-2634-4b21-bb5f-7211e103806a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:18.575405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2359aaf-2634-4b21-bb5f-7211e103806a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:18.576177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2359aaf-2634-4b21-bb5f-7211e103806a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:18.576611 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2359aaf-2634-4b21-bb5f-7211e103806a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:18.580633 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:09:18.707381 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f2359aaf-2634-4b21-bb5f-7211e103806a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:18.714730 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f2359aaf-2634-4b21-bb5f-7211e103806a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.151992 Jul 27 20:09:18.715229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 93/176] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:18 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:18.965703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-18baffbb-39bd-4762-93d0-a2becad7dbc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:18.966252 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-18baffbb-39bd-4762-93d0-a2becad7dbc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:18.972480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18baffbb-39bd-4762-93d0-a2becad7dbc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:18.972928 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18baffbb-39bd-4762-93d0-a2becad7dbc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:18.973727 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18baffbb-39bd-4762-93d0-a2becad7dbc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:18.974193 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18baffbb-39bd-4762-93d0-a2becad7dbc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:18.989067 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:09:19.031365 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e97b4526-bedf-4496-b0e1-dd59cd407413 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:19.031987 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e97b4526-bedf-4496-b0e1-dd59cd407413 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:19.040289 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e97b4526-bedf-4496-b0e1-dd59cd407413 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:19.040746 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e97b4526-bedf-4496-b0e1-dd59cd407413 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:19.041547 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e97b4526-bedf-4496-b0e1-dd59cd407413 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:19.041989 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e97b4526-bedf-4496-b0e1-dd59cd407413 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:19.139851 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-18baffbb-39bd-4762-93d0-a2becad7dbc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:19.150880 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-18baffbb-39bd-4762-93d0-a2becad7dbc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:19.152391 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-18baffbb-39bd-4762-93d0-a2becad7dbc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:19.153527 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-18baffbb-39bd-4762-93d0-a2becad7dbc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.191844 Jul 27 20:09:19.154073 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 84/177] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:18 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:19.158745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-077f3525-8f0d-41c0-a9a4-c573f3e98a92 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:19.160120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-077f3525-8f0d-41c0-a9a4-c573f3e98a92 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:19.166038 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-077f3525-8f0d-41c0-a9a4-c573f3e98a92 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:19.166671 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-077f3525-8f0d-41c0-a9a4-c573f3e98a92 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:19.167722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-077f3525-8f0d-41c0-a9a4-c573f3e98a92 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:19.168298 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-077f3525-8f0d-41c0-a9a4-c573f3e98a92 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:19.187590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e97b4526-bedf-4496-b0e1-dd59cd407413 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:19.195264 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e97b4526-bedf-4496-b0e1-dd59cd407413 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.168301 Jul 27 20:09:19.199161 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 94/178] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:19 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:19.319143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-077f3525-8f0d-41c0-a9a4-c573f3e98a92 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:19.326693 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-077f3525-8f0d-41c0-a9a4-c573f3e98a92 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.171459 Jul 27 20:09:19.327241 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 85/179] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:19 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:19.735057 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cf098b56-abf5-47db-86df-ccdafb38c455 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:19.735778 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cf098b56-abf5-47db-86df-ccdafb38c455 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:19.742229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf098b56-abf5-47db-86df-ccdafb38c455 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:19.742684 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf098b56-abf5-47db-86df-ccdafb38c455 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:19.743480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf098b56-abf5-47db-86df-ccdafb38c455 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:19.743916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf098b56-abf5-47db-86df-ccdafb38c455 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:19.889591 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cf098b56-abf5-47db-86df-ccdafb38c455 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:19.896927 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cf098b56-abf5-47db-86df-ccdafb38c455 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.165774 Jul 27 20:09:19.897578 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 95/180] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:19 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:20.179116 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-59cca6a0-3f02-4747-9194-b6a4bfcfae89 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:20.179717 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-59cca6a0-3f02-4747-9194-b6a4bfcfae89 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:20.185773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-59cca6a0-3f02-4747-9194-b6a4bfcfae89 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:20.186215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-59cca6a0-3f02-4747-9194-b6a4bfcfae89 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:20.186964 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-59cca6a0-3f02-4747-9194-b6a4bfcfae89 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:20.187391 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-59cca6a0-3f02-4747-9194-b6a4bfcfae89 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:20.215640 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d0148aec-12a3-47df-89cf-74d5163d77d9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:20.216243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d0148aec-12a3-47df-89cf-74d5163d77d9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:20.222916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d0148aec-12a3-47df-89cf-74d5163d77d9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:20.223359 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d0148aec-12a3-47df-89cf-74d5163d77d9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:20.224182 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d0148aec-12a3-47df-89cf-74d5163d77d9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:20.224608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d0148aec-12a3-47df-89cf-74d5163d77d9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:20.335882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-59cca6a0-3f02-4747-9194-b6a4bfcfae89 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:20.344072 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-59cca6a0-3f02-4747-9194-b6a4bfcfae89 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:20.345594 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-59cca6a0-3f02-4747-9194-b6a4bfcfae89 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:20.347479 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-59cca6a0-3f02-4747-9194-b6a4bfcfae89 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.172209 Jul 27 20:09:20.348220 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 86/181] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:20 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:20.352554 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0e2e71ce-ebd5-4223-8090-15194358cbcc tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:20.353186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0e2e71ce-ebd5-4223-8090-15194358cbcc tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:20.358690 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d0148aec-12a3-47df-89cf-74d5163d77d9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:20.361593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e2e71ce-ebd5-4223-8090-15194358cbcc tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:20.362083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e2e71ce-ebd5-4223-8090-15194358cbcc tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:20.363379 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e2e71ce-ebd5-4223-8090-15194358cbcc tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:20.363807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e2e71ce-ebd5-4223-8090-15194358cbcc tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:20.366863 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d0148aec-12a3-47df-89cf-74d5163d77d9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.155016 Jul 27 20:09:20.367429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 96/182] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:20 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:20.494064 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0e2e71ce-ebd5-4223-8090-15194358cbcc tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:20.501937 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0e2e71ce-ebd5-4223-8090-15194358cbcc tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.152774 Jul 27 20:09:20.502582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 87/183] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:20 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:20.917529 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9fb9e38f-334c-449d-ad40-e39125646574 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:20.918132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9fb9e38f-334c-449d-ad40-e39125646574 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:20.924094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9fb9e38f-334c-449d-ad40-e39125646574 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:20.924661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9fb9e38f-334c-449d-ad40-e39125646574 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:20.925615 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9fb9e38f-334c-449d-ad40-e39125646574 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:20.926044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9fb9e38f-334c-449d-ad40-e39125646574 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:21.053969 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9fb9e38f-334c-449d-ad40-e39125646574 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:21.061371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9fb9e38f-334c-449d-ad40-e39125646574 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.147597 Jul 27 20:09:21.061931 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 97/184] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:20 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:21.371389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-73b77852-2419-495d-8963-efe2aa142f61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:21.372226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-73b77852-2419-495d-8963-efe2aa142f61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:21.379625 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73b77852-2419-495d-8963-efe2aa142f61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:21.380220 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73b77852-2419-495d-8963-efe2aa142f61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:21.381424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73b77852-2419-495d-8963-efe2aa142f61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:21.387199 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-17cdfcdc-8fca-4604-8fe1-c7e401f52dcc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:21.388111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-17cdfcdc-8fca-4604-8fe1-c7e401f52dcc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:21.394213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73b77852-2419-495d-8963-efe2aa142f61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:21.405927 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-17cdfcdc-8fca-4604-8fe1-c7e401f52dcc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:21.406378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-17cdfcdc-8fca-4604-8fe1-c7e401f52dcc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:21.407155 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-17cdfcdc-8fca-4604-8fe1-c7e401f52dcc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:21.407650 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-17cdfcdc-8fca-4604-8fe1-c7e401f52dcc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:21.573338 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-17cdfcdc-8fca-4604-8fe1-c7e401f52dcc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:21.576034 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-73b77852-2419-495d-8963-efe2aa142f61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:21.582176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-17cdfcdc-8fca-4604-8fe1-c7e401f52dcc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.199134 Jul 27 20:09:21.582743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 98/185] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:21 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:21.584708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-73b77852-2419-495d-8963-efe2aa142f61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:21.586224 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-73b77852-2419-495d-8963-efe2aa142f61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:21.587334 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-73b77852-2419-495d-8963-efe2aa142f61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.220183 Jul 27 20:09:21.589801 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2ac6f2ca-2acf-4d94-ad88-127ff57295c3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:21.595072 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2ac6f2ca-2acf-4d94-ad88-127ff57295c3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:21.597308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 88/186] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:21 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:21.602551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ac6f2ca-2acf-4d94-ad88-127ff57295c3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:21.603235 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ac6f2ca-2acf-4d94-ad88-127ff57295c3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:21.604449 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ac6f2ca-2acf-4d94-ad88-127ff57295c3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:21.604888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ac6f2ca-2acf-4d94-ad88-127ff57295c3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:21.841903 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2ac6f2ca-2acf-4d94-ad88-127ff57295c3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:21.855134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2ac6f2ca-2acf-4d94-ad88-127ff57295c3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.270219 Jul 27 20:09:21.856800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 99/187] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:21 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:21.929373 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-871269e6-7fd0-48a2-9261-8f83876e579e req-0509d376-72de-4ea4-b4af-dd36f4858962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d725356e-73a3-486b-b590-0324916667ff", "name": "network-vif-plugged", "status": "completed", "tag": "899741ce-2752-45e1-aee9-3a2da333cdf0"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:09:21.947817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-871269e6-7fd0-48a2-9261-8f83876e579e req-0509d376-72de-4ea4-b4af-dd36f4858962 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:21.948139 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-871269e6-7fd0-48a2-9261-8f83876e579e req-0509d376-72de-4ea4-b4af-dd36f4858962 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:21.963874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-871269e6-7fd0-48a2-9261-8f83876e579e req-0509d376-72de-4ea4-b4af-dd36f4858962 service nova] Creating event network-vif-plugged:899741ce-2752-45e1-aee9-3a2da333cdf0 for instance d725356e-73a3-486b-b590-0324916667ff on hv-cinder-79987 Jul 27 20:09:21.969229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-871269e6-7fd0-48a2-9261-8f83876e579e req-0509d376-72de-4ea4-b4af-dd36f4858962 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043565 Jul 27 20:09:21.969828 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 89/188] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:09:22.082861 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8b022480-8dbe-4838-98c9-b83dfd8eea99 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:22.083476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8b022480-8dbe-4838-98c9-b83dfd8eea99 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:22.089415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8b022480-8dbe-4838-98c9-b83dfd8eea99 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:22.089788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8b022480-8dbe-4838-98c9-b83dfd8eea99 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:22.090540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8b022480-8dbe-4838-98c9-b83dfd8eea99 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:22.090968 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8b022480-8dbe-4838-98c9-b83dfd8eea99 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:22.233899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8b022480-8dbe-4838-98c9-b83dfd8eea99 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:22.242385 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8b022480-8dbe-4838-98c9-b83dfd8eea99 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.162994 Jul 27 20:09:22.242943 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 100/189] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:22 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:22.603728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-28babf32-73f0-4777-9aee-8765af6c023c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:22.604534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-28babf32-73f0-4777-9aee-8765af6c023c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:22.610639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-953c1706-1fad-45f1-8972-94e0e13e8e2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:22.610905 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28babf32-73f0-4777-9aee-8765af6c023c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:22.611245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-953c1706-1fad-45f1-8972-94e0e13e8e2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:22.611420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28babf32-73f0-4777-9aee-8765af6c023c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:22.612504 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28babf32-73f0-4777-9aee-8765af6c023c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:22.613519 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28babf32-73f0-4777-9aee-8765af6c023c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:22.617886 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-953c1706-1fad-45f1-8972-94e0e13e8e2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:22.618327 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-953c1706-1fad-45f1-8972-94e0e13e8e2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:22.619078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-953c1706-1fad-45f1-8972-94e0e13e8e2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:22.619503 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-953c1706-1fad-45f1-8972-94e0e13e8e2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:22.749394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-953c1706-1fad-45f1-8972-94e0e13e8e2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:22.753230 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-28babf32-73f0-4777-9aee-8765af6c023c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:22.759755 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-953c1706-1fad-45f1-8972-94e0e13e8e2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:22.760577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-28babf32-73f0-4777-9aee-8765af6c023c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.161053 Jul 27 20:09:22.761400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-953c1706-1fad-45f1-8972-94e0e13e8e2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:22.761535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 90/190] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:22 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:22.762569 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-953c1706-1fad-45f1-8972-94e0e13e8e2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.155758 Jul 27 20:09:22.763253 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 101/191] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:22 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:09:22.877973 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-580c1f58-3e9f-4975-b898-9bea30bb68ea tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:22.878582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-580c1f58-3e9f-4975-b898-9bea30bb68ea tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:22.884781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-580c1f58-3e9f-4975-b898-9bea30bb68ea tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:22.885261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-580c1f58-3e9f-4975-b898-9bea30bb68ea tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:22.886033 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-580c1f58-3e9f-4975-b898-9bea30bb68ea tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:22.886473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-580c1f58-3e9f-4975-b898-9bea30bb68ea tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:23.015192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-580c1f58-3e9f-4975-b898-9bea30bb68ea tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:23.023113 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-580c1f58-3e9f-4975-b898-9bea30bb68ea tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.149050 Jul 27 20:09:23.023675 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 91/192] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:22 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:23.265318 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2ef06136-19b4-42e3-9431-4ebf18a2a939 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:23.266031 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2ef06136-19b4-42e3-9431-4ebf18a2a939 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:23.273254 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ef06136-19b4-42e3-9431-4ebf18a2a939 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:23.273693 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ef06136-19b4-42e3-9431-4ebf18a2a939 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:23.274466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ef06136-19b4-42e3-9431-4ebf18a2a939 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:23.275044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ef06136-19b4-42e3-9431-4ebf18a2a939 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:23.411857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2ef06136-19b4-42e3-9431-4ebf18a2a939 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:23.419210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2ef06136-19b4-42e3-9431-4ebf18a2a939 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.158410 Jul 27 20:09:23.419782 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 102/193] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:23 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:23.782118 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-29c62a8e-dca4-4351-8e5d-fe5ca39b551b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:23.783295 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-29c62a8e-dca4-4351-8e5d-fe5ca39b551b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:23.785258 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bcc23477-76e1-4b4e-b09e-d6f225c70ef1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:23.785736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bcc23477-76e1-4b4e-b09e-d6f225c70ef1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:23.798943 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bcc23477-76e1-4b4e-b09e-d6f225c70ef1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:23.799906 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bcc23477-76e1-4b4e-b09e-d6f225c70ef1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:23.800703 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bcc23477-76e1-4b4e-b09e-d6f225c70ef1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:23.801174 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bcc23477-76e1-4b4e-b09e-d6f225c70ef1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:23.807564 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-29c62a8e-dca4-4351-8e5d-fe5ca39b551b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:23.807564 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-29c62a8e-dca4-4351-8e5d-fe5ca39b551b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:23.811319 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-29c62a8e-dca4-4351-8e5d-fe5ca39b551b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:23.812906 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-29c62a8e-dca4-4351-8e5d-fe5ca39b551b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:23.968787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bcc23477-76e1-4b4e-b09e-d6f225c70ef1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:23.985007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bcc23477-76e1-4b4e-b09e-d6f225c70ef1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:23.985007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bcc23477-76e1-4b4e-b09e-d6f225c70ef1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:23.985007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bcc23477-76e1-4b4e-b09e-d6f225c70ef1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.203462 Jul 27 20:09:23.999703 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 103/194] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:23 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:09:24.056879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-470de740-1d32-4411-ab1d-dce9434d3b86 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:24.060802 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-470de740-1d32-4411-ab1d-dce9434d3b86 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:24.076359 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-470de740-1d32-4411-ab1d-dce9434d3b86 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:24.081560 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-470de740-1d32-4411-ab1d-dce9434d3b86 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:24.082929 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-470de740-1d32-4411-ab1d-dce9434d3b86 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:24.083375 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-470de740-1d32-4411-ab1d-dce9434d3b86 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:24.109840 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-29c62a8e-dca4-4351-8e5d-fe5ca39b551b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:24.122683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-29c62a8e-dca4-4351-8e5d-fe5ca39b551b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.345320 Jul 27 20:09:24.137131 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 92/195] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:23 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:24.285647 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-470de740-1d32-4411-ab1d-dce9434d3b86 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:24.296806 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-470de740-1d32-4411-ab1d-dce9434d3b86 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.247160 Jul 27 20:09:24.297650 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 104/196] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:24 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:24.444442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-22a310fc-ef7c-4280-bd75-5b11e187031f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:24.445536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-22a310fc-ef7c-4280-bd75-5b11e187031f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:24.454229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-22a310fc-ef7c-4280-bd75-5b11e187031f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:24.455007 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-22a310fc-ef7c-4280-bd75-5b11e187031f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:24.456560 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-22a310fc-ef7c-4280-bd75-5b11e187031f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:24.457271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-22a310fc-ef7c-4280-bd75-5b11e187031f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:24.668980 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-22a310fc-ef7c-4280-bd75-5b11e187031f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:24.680706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-22a310fc-ef7c-4280-bd75-5b11e187031f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.243429 Jul 27 20:09:24.682213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 93/197] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:24 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:25.010146 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1bb43d36-0800-4e9d-a434-58268de0c3c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:25.011008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1bb43d36-0800-4e9d-a434-58268de0c3c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:25.018283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1bb43d36-0800-4e9d-a434-58268de0c3c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:25.021035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1bb43d36-0800-4e9d-a434-58268de0c3c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:25.022031 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1bb43d36-0800-4e9d-a434-58268de0c3c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:25.022626 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1bb43d36-0800-4e9d-a434-58268de0c3c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:25.150182 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d26cbdc3-845f-48ac-bf0c-ad0d0f6db4f7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:25.151392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d26cbdc3-845f-48ac-bf0c-ad0d0f6db4f7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:25.157513 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d26cbdc3-845f-48ac-bf0c-ad0d0f6db4f7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:25.157962 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d26cbdc3-845f-48ac-bf0c-ad0d0f6db4f7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:25.159708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d26cbdc3-845f-48ac-bf0c-ad0d0f6db4f7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:25.160316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d26cbdc3-845f-48ac-bf0c-ad0d0f6db4f7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:25.221614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1bb43d36-0800-4e9d-a434-58268de0c3c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:25.231579 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1bb43d36-0800-4e9d-a434-58268de0c3c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:25.233564 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1bb43d36-0800-4e9d-a434-58268de0c3c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:25.234866 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1bb43d36-0800-4e9d-a434-58268de0c3c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.228907 Jul 27 20:09:25.236026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 105/198] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:25 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:25.326609 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-251a45e6-5dbb-47d8-b951-8e5a8fadb498 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:25.327299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-251a45e6-5dbb-47d8-b951-8e5a8fadb498 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:25.339288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-251a45e6-5dbb-47d8-b951-8e5a8fadb498 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:25.339745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-251a45e6-5dbb-47d8-b951-8e5a8fadb498 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:25.344636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-251a45e6-5dbb-47d8-b951-8e5a8fadb498 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:25.345129 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-251a45e6-5dbb-47d8-b951-8e5a8fadb498 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:25.377751 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d26cbdc3-845f-48ac-bf0c-ad0d0f6db4f7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:25.385518 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d26cbdc3-845f-48ac-bf0c-ad0d0f6db4f7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1321 microversion: 2.1 time: 0.239671 Jul 27 20:09:25.387613 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 94/199] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:25 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:25.571405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-251a45e6-5dbb-47d8-b951-8e5a8fadb498 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:25.584771 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-251a45e6-5dbb-47d8-b951-8e5a8fadb498 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1314 microversion: 2.1 time: 0.266076 Jul 27 20:09:25.586067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 106/200] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:25 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:25.702249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3e3e5fd9-fbd3-474a-9ab4-3920910d55bf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:25.702885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3e3e5fd9-fbd3-474a-9ab4-3920910d55bf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:25.714305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e3e5fd9-fbd3-474a-9ab4-3920910d55bf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:25.714767 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e3e5fd9-fbd3-474a-9ab4-3920910d55bf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:25.715683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e3e5fd9-fbd3-474a-9ab4-3920910d55bf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:25.716011 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e3e5fd9-fbd3-474a-9ab4-3920910d55bf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:25.905292 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3e3e5fd9-fbd3-474a-9ab4-3920910d55bf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:25.905292 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3e3e5fd9-fbd3-474a-9ab4-3920910d55bf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1363 microversion: 2.1 time: 0.204561 Jul 27 20:09:25.918004 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 95/201] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:25 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:26.260247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-24ffad65-534c-4926-96f0-3bf28116308c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:26.261143 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-24ffad65-534c-4926-96f0-3bf28116308c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:26.270087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-24ffad65-534c-4926-96f0-3bf28116308c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:26.270646 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-24ffad65-534c-4926-96f0-3bf28116308c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:26.271527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-24ffad65-534c-4926-96f0-3bf28116308c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:26.272060 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-24ffad65-534c-4926-96f0-3bf28116308c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:26.311857 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-5bdad033-58ff-4c8c-bc6d-d8bedc34a5af req-b5c41609-829a-4ce1-aa60-be426b239bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea33250b-8fd3-4d34-97cb-cde5923b7a67", "name": "network-vif-plugged", "status": "completed", "tag": "694f60ee-1590-4b2a-bed2-b28fde5be035"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:09:26.332890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-5bdad033-58ff-4c8c-bc6d-d8bedc34a5af req-b5c41609-829a-4ce1-aa60-be426b239bb7 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:26.333638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-5bdad033-58ff-4c8c-bc6d-d8bedc34a5af req-b5c41609-829a-4ce1-aa60-be426b239bb7 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:26.346426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-5bdad033-58ff-4c8c-bc6d-d8bedc34a5af req-b5c41609-829a-4ce1-aa60-be426b239bb7 service nova] Creating event network-vif-plugged:694f60ee-1590-4b2a-bed2-b28fde5be035 for instance ea33250b-8fd3-4d34-97cb-cde5923b7a67 on hv-cinder-79987 Jul 27 20:09:26.352766 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-5bdad033-58ff-4c8c-bc6d-d8bedc34a5af req-b5c41609-829a-4ce1-aa60-be426b239bb7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045416 Jul 27 20:09:26.353458 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 96/202] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:09:26.412066 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d5b1baad-579b-4f44-b6fd-5228ccf5e1da tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:26.412872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d5b1baad-579b-4f44-b6fd-5228ccf5e1da tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:26.419635 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5b1baad-579b-4f44-b6fd-5228ccf5e1da tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:26.420669 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5b1baad-579b-4f44-b6fd-5228ccf5e1da tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:26.421673 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5b1baad-579b-4f44-b6fd-5228ccf5e1da tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:26.422267 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5b1baad-579b-4f44-b6fd-5228ccf5e1da tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:26.461608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-24ffad65-534c-4926-96f0-3bf28116308c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:26.480168 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-24ffad65-534c-4926-96f0-3bf28116308c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:26.486372 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-24ffad65-534c-4926-96f0-3bf28116308c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:26.488216 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-24ffad65-534c-4926-96f0-3bf28116308c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.231743 Jul 27 20:09:26.488787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 107/203] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:26 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:26.574394 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d5b1baad-579b-4f44-b6fd-5228ccf5e1da tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:26.582819 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d5b1baad-579b-4f44-b6fd-5228ccf5e1da tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1513 microversion: 2.1 time: 0.175847 Jul 27 20:09:26.583592 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 97/204] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:26 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:26.605912 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-adb3dac5-eab7-48d0-af55-6944e09ed06f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:09:26.608708 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-adb3dac5-eab7-48d0-af55-6944e09ed06f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:26.611179 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-23363b1d-bf5f-4f04-8fed-51d086c2b2a1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:26.611829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-23363b1d-bf5f-4f04-8fed-51d086c2b2a1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:26.615555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-adb3dac5-eab7-48d0-af55-6944e09ed06f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:26.616188 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-adb3dac5-eab7-48d0-af55-6944e09ed06f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:26.617144 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-adb3dac5-eab7-48d0-af55-6944e09ed06f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:26.617708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-23363b1d-bf5f-4f04-8fed-51d086c2b2a1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:26.617866 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-adb3dac5-eab7-48d0-af55-6944e09ed06f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:26.618152 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-23363b1d-bf5f-4f04-8fed-51d086c2b2a1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:26.619083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-23363b1d-bf5f-4f04-8fed-51d086c2b2a1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:26.619528 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-23363b1d-bf5f-4f04-8fed-51d086c2b2a1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:26.683981 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.objects.instance [None req-adb3dac5-eab7-48d0-af55-6944e09ed06f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lazy-loading 'flavor' on Instance uuid 72605170-2987-4669-ac91-425028a572f9 {{(pid=117876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:09:26.770003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:09:26.817285 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-23363b1d-bf5f-4f04-8fed-51d086c2b2a1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:26.828228 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-23363b1d-bf5f-4f04-8fed-51d086c2b2a1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1501 microversion: 2.1 time: 0.220578 Jul 27 20:09:26.828637 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 98/205] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:26 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1501 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:26.870413 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-adb3dac5-eab7-48d0-af55-6944e09ed06f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "POST /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9/action" status: 200 len: 32 microversion: 2.1 time: 0.269666 Jul 27 20:09:26.871818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 108/206] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Jul 27 20:09:26 2022] POST /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9/action => generated 32 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 20:09:26.884845 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7abdcb8a-71d0-4937-9ff6-eb09b17ebda0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:26.887038 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7abdcb8a-71d0-4937-9ff6-eb09b17ebda0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:26.902119 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7abdcb8a-71d0-4937-9ff6-eb09b17ebda0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:26.903581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7abdcb8a-71d0-4937-9ff6-eb09b17ebda0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:26.908070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7abdcb8a-71d0-4937-9ff6-eb09b17ebda0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:26.910832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7abdcb8a-71d0-4937-9ff6-eb09b17ebda0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:26.926356 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-84cacaed-beb7-4c6d-b7e9-de5944bfe689 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:26.928528 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-84cacaed-beb7-4c6d-b7e9-de5944bfe689 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:26.946609 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84cacaed-beb7-4c6d-b7e9-de5944bfe689 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:26.947992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84cacaed-beb7-4c6d-b7e9-de5944bfe689 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:26.952880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84cacaed-beb7-4c6d-b7e9-de5944bfe689 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:26.953577 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84cacaed-beb7-4c6d-b7e9-de5944bfe689 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:27.162009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7abdcb8a-71d0-4937-9ff6-eb09b17ebda0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:27.171157 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7abdcb8a-71d0-4937-9ff6-eb09b17ebda0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.293300 Jul 27 20:09:27.171966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 99/207] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:26 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:27.323377 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-84cacaed-beb7-4c6d-b7e9-de5944bfe689 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:27.337139 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-84cacaed-beb7-4c6d-b7e9-de5944bfe689 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1549 microversion: 2.1 time: 0.417113 Jul 27 20:09:27.337731 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 109/208] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:26 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1549 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:27.367402 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a139762c-be10-4403-8f2d-979cac92e554 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:27.367941 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a139762c-be10-4403-8f2d-979cac92e554 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:27.389363 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a139762c-be10-4403-8f2d-979cac92e554 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:27.390807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a139762c-be10-4403-8f2d-979cac92e554 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:27.392651 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a139762c-be10-4403-8f2d-979cac92e554 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:27.394054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a139762c-be10-4403-8f2d-979cac92e554 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:27.511721 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b2c85f4b-efdf-41eb-bfe2-58033cd6f992 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:27.512531 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b2c85f4b-efdf-41eb-bfe2-58033cd6f992 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:27.526036 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b2c85f4b-efdf-41eb-bfe2-58033cd6f992 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:27.526498 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b2c85f4b-efdf-41eb-bfe2-58033cd6f992 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:27.527268 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b2c85f4b-efdf-41eb-bfe2-58033cd6f992 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:27.527708 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b2c85f4b-efdf-41eb-bfe2-58033cd6f992 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:27.585522 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a139762c-be10-4403-8f2d-979cac92e554 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.226874 Jul 27 20:09:27.586475 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 100/209] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Jul 27 20:09:27 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-interface => generated 285 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:09:27.798064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b2c85f4b-efdf-41eb-bfe2-58033cd6f992 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:27.816191 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b2c85f4b-efdf-41eb-bfe2-58033cd6f992 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:27.818474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b2c85f4b-efdf-41eb-bfe2-58033cd6f992 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:27.819785 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b2c85f4b-efdf-41eb-bfe2-58033cd6f992 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.313465 Jul 27 20:09:27.820599 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 110/210] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:27 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:28.194927 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-29c50f54-20f6-4b3a-a7b8-dfa46f29509a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:28.195728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-29c50f54-20f6-4b3a-a7b8-dfa46f29509a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:28.202529 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-29c50f54-20f6-4b3a-a7b8-dfa46f29509a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:28.203268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-29c50f54-20f6-4b3a-a7b8-dfa46f29509a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:28.208411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-29c50f54-20f6-4b3a-a7b8-dfa46f29509a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:28.209692 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-29c50f54-20f6-4b3a-a7b8-dfa46f29509a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:28.811757 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-29c50f54-20f6-4b3a-a7b8-dfa46f29509a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:28.831532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-29c50f54-20f6-4b3a-a7b8-dfa46f29509a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.630363 Jul 27 20:09:28.849507 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 101/211] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:28 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:28.859711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a14d91ac-d8f4-484e-8d65-f4a5256561bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:28.860984 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a14d91ac-d8f4-484e-8d65-f4a5256561bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:28.869815 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a14d91ac-d8f4-484e-8d65-f4a5256561bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:28.870608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a14d91ac-d8f4-484e-8d65-f4a5256561bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:28.871637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a14d91ac-d8f4-484e-8d65-f4a5256561bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:28.872276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a14d91ac-d8f4-484e-8d65-f4a5256561bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:29.255433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a14d91ac-d8f4-484e-8d65-f4a5256561bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:29.279988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a14d91ac-d8f4-484e-8d65-f4a5256561bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:29.288170 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a14d91ac-d8f4-484e-8d65-f4a5256561bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:29.289838 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a14d91ac-d8f4-484e-8d65-f4a5256561bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.440912 Jul 27 20:09:29.310822 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 111/212] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:28 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:29.736207 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-c322af59-6dac-405f-8111-131572a9ab17 req-c0590472-bc23-4b41-bf98-185180e3d2bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8779e897-ecd4-43b8-9f87-a8e0c524c94a", "tag": "17b5101e-1922-439a-82ad-033657522bc9"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:09:29.763919 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-c322af59-6dac-405f-8111-131572a9ab17 req-c0590472-bc23-4b41-bf98-185180e3d2bd service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:29.763919 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-c322af59-6dac-405f-8111-131572a9ab17 req-c0590472-bc23-4b41-bf98-185180e3d2bd service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:29.797522 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-c322af59-6dac-405f-8111-131572a9ab17 req-c0590472-bc23-4b41-bf98-185180e3d2bd service nova] Creating event network-changed:17b5101e-1922-439a-82ad-033657522bc9 for instance 8779e897-ecd4-43b8-9f87-a8e0c524c94a on hv-cinder-79987 Jul 27 20:09:29.803735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-c322af59-6dac-405f-8111-131572a9ab17 req-c0590472-bc23-4b41-bf98-185180e3d2bd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073194 Jul 27 20:09:29.809463 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 102/213] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:09:29.866571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4790dc38-9bd5-4e0f-87f7-bd9d14ba7482 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:29.867635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4790dc38-9bd5-4e0f-87f7-bd9d14ba7482 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:29.877144 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4790dc38-9bd5-4e0f-87f7-bd9d14ba7482 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:29.879922 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4790dc38-9bd5-4e0f-87f7-bd9d14ba7482 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:29.881364 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4790dc38-9bd5-4e0f-87f7-bd9d14ba7482 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:29.882762 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4790dc38-9bd5-4e0f-87f7-bd9d14ba7482 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:30.172171 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4790dc38-9bd5-4e0f-87f7-bd9d14ba7482 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:30.185737 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4790dc38-9bd5-4e0f-87f7-bd9d14ba7482 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.337233 Jul 27 20:09:30.188533 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 112/214] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:29 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:30.332662 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-24362132-bc9a-4bf9-a981-daba5957d929 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:30.333458 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-24362132-bc9a-4bf9-a981-daba5957d929 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:30.345628 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-24362132-bc9a-4bf9-a981-daba5957d929 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:30.346410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-24362132-bc9a-4bf9-a981-daba5957d929 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:30.349501 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-24362132-bc9a-4bf9-a981-daba5957d929 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:30.352311 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-24362132-bc9a-4bf9-a981-daba5957d929 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:30.402939 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:09:30.774005 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-24362132-bc9a-4bf9-a981-daba5957d929 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:30.792737 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-24362132-bc9a-4bf9-a981-daba5957d929 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:30.794301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-24362132-bc9a-4bf9-a981-daba5957d929 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:30.807406 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-24362132-bc9a-4bf9-a981-daba5957d929 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.468099 Jul 27 20:09:30.814041 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 103/215] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:30 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:31.208690 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fe661a03-3439-4a3c-a073-a1984cf098fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:31.209389 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fe661a03-3439-4a3c-a073-a1984cf098fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:31.216366 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fe661a03-3439-4a3c-a073-a1984cf098fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:31.216818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fe661a03-3439-4a3c-a073-a1984cf098fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:31.219358 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fe661a03-3439-4a3c-a073-a1984cf098fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:31.220117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fe661a03-3439-4a3c-a073-a1984cf098fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:31.389968 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fe661a03-3439-4a3c-a073-a1984cf098fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:31.398783 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fe661a03-3439-4a3c-a073-a1984cf098fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.194828 Jul 27 20:09:31.399947 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 113/216] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:31 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:31.834545 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fd20e0fb-58bf-42b4-b95f-21e057c61bca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:31.835171 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fd20e0fb-58bf-42b4-b95f-21e057c61bca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:31.853217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fd20e0fb-58bf-42b4-b95f-21e057c61bca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:31.853667 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fd20e0fb-58bf-42b4-b95f-21e057c61bca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:31.858275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fd20e0fb-58bf-42b4-b95f-21e057c61bca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:31.858735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fd20e0fb-58bf-42b4-b95f-21e057c61bca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:32.007871 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-29acfd7c-a745-4633-a653-cdead21d2890 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9085b4b-aaa6-483f-98c9-be8ad06f3a79"}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:09:32.010280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-29acfd7c-a745-4633-a653-cdead21d2890 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:32.030015 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-29acfd7c-a745-4633-a653-cdead21d2890 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:32.030524 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-29acfd7c-a745-4633-a653-cdead21d2890 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:32.036671 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-29acfd7c-a745-4633-a653-cdead21d2890 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:32.037325 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-29acfd7c-a745-4633-a653-cdead21d2890 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:32.384986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fd20e0fb-58bf-42b4-b95f-21e057c61bca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:32.402364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fd20e0fb-58bf-42b4-b95f-21e057c61bca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:32.409431 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fd20e0fb-58bf-42b4-b95f-21e057c61bca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:32.412418 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fd20e0fb-58bf-42b4-b95f-21e057c61bca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.583243 Jul 27 20:09:32.416570 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 104/217] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:31 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:32.425238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3363fb25-0311-402c-8c09-b1fc46580ad9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:32.426895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3363fb25-0311-402c-8c09-b1fc46580ad9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:32.434881 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3363fb25-0311-402c-8c09-b1fc46580ad9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:32.435883 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3363fb25-0311-402c-8c09-b1fc46580ad9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:32.438518 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3363fb25-0311-402c-8c09-b1fc46580ad9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:32.439371 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3363fb25-0311-402c-8c09-b1fc46580ad9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:32.713789 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3363fb25-0311-402c-8c09-b1fc46580ad9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:32.724936 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3363fb25-0311-402c-8c09-b1fc46580ad9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.304694 Jul 27 20:09:32.725774 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 105/218] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:32 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:33.300382 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-29acfd7c-a745-4633-a653-cdead21d2890 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "POST /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.296410 Jul 27 20:09:33.303680 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 114/219] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Jul 27 20:09:32 2022] POST /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e/os-volume_attachments => generated 194 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:09:33.446664 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f889286d-7c5b-40dd-9e9f-c7933771fbc4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:33.448345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f889286d-7c5b-40dd-9e9f-c7933771fbc4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:33.458872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f889286d-7c5b-40dd-9e9f-c7933771fbc4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:33.459323 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f889286d-7c5b-40dd-9e9f-c7933771fbc4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:33.460096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f889286d-7c5b-40dd-9e9f-c7933771fbc4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:33.460708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f889286d-7c5b-40dd-9e9f-c7933771fbc4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:33.708077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f889286d-7c5b-40dd-9e9f-c7933771fbc4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:33.728482 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f889286d-7c5b-40dd-9e9f-c7933771fbc4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:33.732468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f889286d-7c5b-40dd-9e9f-c7933771fbc4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:33.736092 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f889286d-7c5b-40dd-9e9f-c7933771fbc4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.297829 Jul 27 20:09:33.738888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 106/220] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:33 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:33.748514 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-eb3e219c-1f83-43b9-b105-3a584fae2a46 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:33.750976 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-eb3e219c-1f83-43b9-b105-3a584fae2a46 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:33.764276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eb3e219c-1f83-43b9-b105-3a584fae2a46 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:33.764728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eb3e219c-1f83-43b9-b105-3a584fae2a46 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:33.765848 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eb3e219c-1f83-43b9-b105-3a584fae2a46 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:33.766443 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eb3e219c-1f83-43b9-b105-3a584fae2a46 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:33.942073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-eb3e219c-1f83-43b9-b105-3a584fae2a46 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:33.950094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-eb3e219c-1f83-43b9-b105-3a584fae2a46 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.206903 Jul 27 20:09:33.950929 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 115/221] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:33 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:34.763867 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-14d20cc8-29ed-4d97-b187-e65cb4b2ed49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:34.764415 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-14d20cc8-29ed-4d97-b187-e65cb4b2ed49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:34.771229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14d20cc8-29ed-4d97-b187-e65cb4b2ed49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:34.771918 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14d20cc8-29ed-4d97-b187-e65cb4b2ed49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:34.772697 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14d20cc8-29ed-4d97-b187-e65cb4b2ed49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:34.773154 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14d20cc8-29ed-4d97-b187-e65cb4b2ed49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:34.973363 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6f0a7de9-2175-41c6-b38c-42d099687ccb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:34.974042 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6f0a7de9-2175-41c6-b38c-42d099687ccb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:34.982610 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6f0a7de9-2175-41c6-b38c-42d099687ccb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:34.983068 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6f0a7de9-2175-41c6-b38c-42d099687ccb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:34.984079 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6f0a7de9-2175-41c6-b38c-42d099687ccb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:34.984551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6f0a7de9-2175-41c6-b38c-42d099687ccb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:35.031740 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-14d20cc8-29ed-4d97-b187-e65cb4b2ed49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:35.043746 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-14d20cc8-29ed-4d97-b187-e65cb4b2ed49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:35.046201 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-14d20cc8-29ed-4d97-b187-e65cb4b2ed49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:35.047624 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-14d20cc8-29ed-4d97-b187-e65cb4b2ed49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.287639 Jul 27 20:09:35.048353 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 107/222] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:34 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:35.148548 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6f0a7de9-2175-41c6-b38c-42d099687ccb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:35.157112 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6f0a7de9-2175-41c6-b38c-42d099687ccb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.188994 Jul 27 20:09:35.169345 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 116/223] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:34 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:36.073526 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9da93473-2377-4a42-a6e3-2f50b32cdd7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:36.075008 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9da93473-2377-4a42-a6e3-2f50b32cdd7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:36.081779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9da93473-2377-4a42-a6e3-2f50b32cdd7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:36.082295 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9da93473-2377-4a42-a6e3-2f50b32cdd7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:36.083126 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9da93473-2377-4a42-a6e3-2f50b32cdd7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:36.083620 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9da93473-2377-4a42-a6e3-2f50b32cdd7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:36.179361 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7b95290a-0957-45f5-a42f-76735dd0ac53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:36.179973 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7b95290a-0957-45f5-a42f-76735dd0ac53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:36.186724 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7b95290a-0957-45f5-a42f-76735dd0ac53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:36.187437 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7b95290a-0957-45f5-a42f-76735dd0ac53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:36.188639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7b95290a-0957-45f5-a42f-76735dd0ac53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:36.189319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7b95290a-0957-45f5-a42f-76735dd0ac53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:36.303076 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9da93473-2377-4a42-a6e3-2f50b32cdd7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:36.325797 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9da93473-2377-4a42-a6e3-2f50b32cdd7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:36.334954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9da93473-2377-4a42-a6e3-2f50b32cdd7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:36.336108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9da93473-2377-4a42-a6e3-2f50b32cdd7f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.267254 Jul 27 20:09:36.337560 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 108/224] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:36 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:36.390655 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7b95290a-0957-45f5-a42f-76735dd0ac53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:36.400902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7b95290a-0957-45f5-a42f-76735dd0ac53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.225356 Jul 27 20:09:36.414499 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 117/225] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:36 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:37.362150 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-66f592e5-b3bb-4ee9-a1a1-6970befd04bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:37.363404 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-66f592e5-b3bb-4ee9-a1a1-6970befd04bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:37.372316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-66f592e5-b3bb-4ee9-a1a1-6970befd04bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:37.373567 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-66f592e5-b3bb-4ee9-a1a1-6970befd04bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:37.375295 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-66f592e5-b3bb-4ee9-a1a1-6970befd04bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:37.375954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-66f592e5-b3bb-4ee9-a1a1-6970befd04bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:37.435728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1db43b86-7946-4216-ad9c-6c74728ddd0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:37.436535 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1db43b86-7946-4216-ad9c-6c74728ddd0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:37.444572 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1db43b86-7946-4216-ad9c-6c74728ddd0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:37.450953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1db43b86-7946-4216-ad9c-6c74728ddd0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:37.453581 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1db43b86-7946-4216-ad9c-6c74728ddd0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:37.454141 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1db43b86-7946-4216-ad9c-6c74728ddd0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:37.748117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-66f592e5-b3bb-4ee9-a1a1-6970befd04bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:37.761305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-66f592e5-b3bb-4ee9-a1a1-6970befd04bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:37.782995 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-66f592e5-b3bb-4ee9-a1a1-6970befd04bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:37.785801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-66f592e5-b3bb-4ee9-a1a1-6970befd04bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1407 microversion: 2.20 time: 0.429120 Jul 27 20:09:37.786984 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 109/226] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:37 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1407 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:09:38.275925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1db43b86-7946-4216-ad9c-6c74728ddd0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:38.293539 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1db43b86-7946-4216-ad9c-6c74728ddd0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.861562 Jul 27 20:09:38.294468 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 118/227] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:37 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:38.812716 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-725e515f-41c6-4a54-9243-e4074f473056 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:38.813994 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-725e515f-41c6-4a54-9243-e4074f473056 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:38.830710 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-725e515f-41c6-4a54-9243-e4074f473056 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:38.831174 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-725e515f-41c6-4a54-9243-e4074f473056 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:38.834094 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-725e515f-41c6-4a54-9243-e4074f473056 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:38.834935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-725e515f-41c6-4a54-9243-e4074f473056 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:39.214581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-725e515f-41c6-4a54-9243-e4074f473056 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:39.233122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-725e515f-41c6-4a54-9243-e4074f473056 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:39.235124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-725e515f-41c6-4a54-9243-e4074f473056 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:39.238724 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-725e515f-41c6-4a54-9243-e4074f473056 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1598 microversion: 2.20 time: 0.430417 Jul 27 20:09:39.256131 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 110/228] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:09:38 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1598 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:09:39.270237 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8298418e-c99e-454f-8be2-13fc577a413f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:39.274079 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8298418e-c99e-454f-8be2-13fc577a413f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:39.282670 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8298418e-c99e-454f-8be2-13fc577a413f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:39.284789 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8298418e-c99e-454f-8be2-13fc577a413f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:39.285797 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8298418e-c99e-454f-8be2-13fc577a413f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:39.286383 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8298418e-c99e-454f-8be2-13fc577a413f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:39.316819 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1958dfba-d6a5-4b79-80f7-f7c44174b31a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:39.317775 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1958dfba-d6a5-4b79-80f7-f7c44174b31a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:39.334526 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1958dfba-d6a5-4b79-80f7-f7c44174b31a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:39.335269 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1958dfba-d6a5-4b79-80f7-f7c44174b31a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:39.336228 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1958dfba-d6a5-4b79-80f7-f7c44174b31a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:39.336951 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1958dfba-d6a5-4b79-80f7-f7c44174b31a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:39.554663 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8298418e-c99e-454f-8be2-13fc577a413f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.289072 Jul 27 20:09:39.556661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 119/229] 10.222.0.65 () {60 vars in 1316 bytes} [Wed Jul 27 20:09:39 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-interface => generated 284 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:09:39.585600 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c90b4eb2-5f76-4fc3-aa91-3ce91cc1eed2 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-950683285", "imageRef": "fb689bea-534a-4aac-bec3-8f55591dba58", "flavorRef": "452"}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:09:39.714213 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.network.neutron [None req-c90b4eb2-5f76-4fc3-aa91-3ce91cc1eed2 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] validate_networks() for None {{(pid=117876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:09:39.846504 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1958dfba-d6a5-4b79-80f7-f7c44174b31a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:39.863263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1958dfba-d6a5-4b79-80f7-f7c44174b31a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.552411 Jul 27 20:09:39.864378 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 111/230] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:39 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:40.372391 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-c90b4eb2-5f76-4fc3-aa91-3ce91cc1eed2 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Flavor limits 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:09:40.374374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-c90b4eb2-5f76-4fc3-aa91-3ce91cc1eed2 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Image limits 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:09:40.374925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-c90b4eb2-5f76-4fc3-aa91-3ce91cc1eed2 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Flavor pref 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:09:40.375338 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-c90b4eb2-5f76-4fc3-aa91-3ce91cc1eed2 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Image pref 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:09:40.375974 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-c90b4eb2-5f76-4fc3-aa91-3ce91cc1eed2 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:09:40.400172 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c90b4eb2-5f76-4fc3-aa91-3ce91cc1eed2 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:40.400632 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c90b4eb2-5f76-4fc3-aa91-3ce91cc1eed2 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:40.401469 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c90b4eb2-5f76-4fc3-aa91-3ce91cc1eed2 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:40.403666 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c90b4eb2-5f76-4fc3-aa91-3ce91cc1eed2 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:40.424449 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-c90b4eb2-5f76-4fc3-aa91-3ce91cc1eed2 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Getting quotas for project 725810398afd433c9bff3fcd261b0f6f. Resources: {'cores', 'instances', 'ram'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:09:40.430481 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-c90b4eb2-5f76-4fc3-aa91-3ce91cc1eed2 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Getting quotas for user f6aba59bcb664b8bbc1469d71b6a276d and project 725810398afd433c9bff3fcd261b0f6f. Resources: {'cores', 'instances', 'ram'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:09:40.446218 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c90b4eb2-5f76-4fc3-aa91-3ce91cc1eed2 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Going to run 1 instances... {{(pid=117876) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:09:40.450208 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c90b4eb2-5f76-4fc3-aa91-3ce91cc1eed2 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb689bea-534a-4aac-bec3-8f55591dba58',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:09:40.508043 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c90b4eb2-5f76-4fc3-aa91-3ce91cc1eed2 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.949625 Jul 27 20:09:40.508699 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 120/231] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Jul 27 20:09:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:09:40.520728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-903f6d66-aa71-4711-9eca-b87809d05610 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:40.521678 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-903f6d66-aa71-4711-9eca-b87809d05610 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:40.583639 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-903f6d66-aa71-4711-9eca-b87809d05610 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:40.600355 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-903f6d66-aa71-4711-9eca-b87809d05610 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1214 microversion: 2.1 time: 0.084494 Jul 27 20:09:40.600952 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 112/232] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:40 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:40.888161 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-854b44cd-2291-48b6-8d87-9fe12c6e6f27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:40.888781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-854b44cd-2291-48b6-8d87-9fe12c6e6f27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:40.900493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-854b44cd-2291-48b6-8d87-9fe12c6e6f27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:40.901202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-854b44cd-2291-48b6-8d87-9fe12c6e6f27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:40.902136 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-854b44cd-2291-48b6-8d87-9fe12c6e6f27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:40.902729 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-854b44cd-2291-48b6-8d87-9fe12c6e6f27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:41.386307 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-76278400-0a57-4dd7-a146-c82181a6a190 req-ace9d8d1-fa50-4064-94da-c214241fac28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d725356e-73a3-486b-b590-0324916667ff", "tag": "899741ce-2752-45e1-aee9-3a2da333cdf0"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:09:41.407528 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-76278400-0a57-4dd7-a146-c82181a6a190 req-ace9d8d1-fa50-4064-94da-c214241fac28 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:41.408853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-76278400-0a57-4dd7-a146-c82181a6a190 req-ace9d8d1-fa50-4064-94da-c214241fac28 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:41.438704 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-76278400-0a57-4dd7-a146-c82181a6a190 req-ace9d8d1-fa50-4064-94da-c214241fac28 service nova] Creating event network-changed:899741ce-2752-45e1-aee9-3a2da333cdf0 for instance d725356e-73a3-486b-b590-0324916667ff on hv-cinder-79987 Jul 27 20:09:41.445756 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-76278400-0a57-4dd7-a146-c82181a6a190 req-ace9d8d1-fa50-4064-94da-c214241fac28 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063000 Jul 27 20:09:41.446786 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 113/233] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:09:41.631898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d4c4cfe8-771c-4d76-aca4-555850222035 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:41.632603 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d4c4cfe8-771c-4d76-aca4-555850222035 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:41.663515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4c4cfe8-771c-4d76-aca4-555850222035 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:41.663515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4c4cfe8-771c-4d76-aca4-555850222035 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:41.666507 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4c4cfe8-771c-4d76-aca4-555850222035 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:41.670875 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4c4cfe8-771c-4d76-aca4-555850222035 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:41.800605 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d4c4cfe8-771c-4d76-aca4-555850222035 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:41.814101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-854b44cd-2291-48b6-8d87-9fe12c6e6f27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:41.822238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d4c4cfe8-771c-4d76-aca4-555850222035 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1210 microversion: 2.1 time: 0.202969 Jul 27 20:09:41.822846 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 114/234] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:41 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1210 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:41.833271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-854b44cd-2291-48b6-8d87-9fe12c6e6f27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.941722 Jul 27 20:09:41.840332 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 121/235] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:40 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:42.853237 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-20ef4f46-da1a-4e72-bdbd-3b2ca67e19ac tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:42.854223 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0a8abc1d-2ccc-49c6-afc6-2846513d0c71 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:42.855132 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-20ef4f46-da1a-4e72-bdbd-3b2ca67e19ac tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:42.855434 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0a8abc1d-2ccc-49c6-afc6-2846513d0c71 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:42.888733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-20ef4f46-da1a-4e72-bdbd-3b2ca67e19ac tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:42.889857 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-20ef4f46-da1a-4e72-bdbd-3b2ca67e19ac tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:42.890280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a8abc1d-2ccc-49c6-afc6-2846513d0c71 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:42.891679 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a8abc1d-2ccc-49c6-afc6-2846513d0c71 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:42.894784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-20ef4f46-da1a-4e72-bdbd-3b2ca67e19ac tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:42.900644 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a8abc1d-2ccc-49c6-afc6-2846513d0c71 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:42.901491 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-20ef4f46-da1a-4e72-bdbd-3b2ca67e19ac tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:42.903597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a8abc1d-2ccc-49c6-afc6-2846513d0c71 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:43.224689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0a8abc1d-2ccc-49c6-afc6-2846513d0c71 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:43.240941 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0a8abc1d-2ccc-49c6-afc6-2846513d0c71 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1284 microversion: 2.1 time: 0.393232 Jul 27 20:09:43.244463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 122/236] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:42 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1284 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:43.830731 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-20ef4f46-da1a-4e72-bdbd-3b2ca67e19ac tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:43.849946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-20ef4f46-da1a-4e72-bdbd-3b2ca67e19ac tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.999370 Jul 27 20:09:43.865612 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 115/237] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:42 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:44.268243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-73e2cf83-b8d2-47ae-a965-2061f1a2012f tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:44.269527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-73e2cf83-b8d2-47ae-a965-2061f1a2012f tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:44.286274 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-73e2cf83-b8d2-47ae-a965-2061f1a2012f tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:44.288231 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-73e2cf83-b8d2-47ae-a965-2061f1a2012f tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:44.289844 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-73e2cf83-b8d2-47ae-a965-2061f1a2012f tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:44.292336 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-73e2cf83-b8d2-47ae-a965-2061f1a2012f tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:44.483321 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-73e2cf83-b8d2-47ae-a965-2061f1a2012f tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:44.492070 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-73e2cf83-b8d2-47ae-a965-2061f1a2012f tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1272 microversion: 2.1 time: 0.229195 Jul 27 20:09:44.497288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 123/238] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:44 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1272 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:44.880593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0207e6f7-6746-4e8e-933d-ca93a09dd3cc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:44.881223 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0207e6f7-6746-4e8e-933d-ca93a09dd3cc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:44.891826 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0207e6f7-6746-4e8e-933d-ca93a09dd3cc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:44.892271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0207e6f7-6746-4e8e-933d-ca93a09dd3cc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:44.893620 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0207e6f7-6746-4e8e-933d-ca93a09dd3cc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:44.894055 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0207e6f7-6746-4e8e-933d-ca93a09dd3cc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:45.374023 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0207e6f7-6746-4e8e-933d-ca93a09dd3cc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:45.407363 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0207e6f7-6746-4e8e-933d-ca93a09dd3cc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.533396 Jul 27 20:09:45.428822 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 116/239] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:44 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:45.518502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-19a1e929-9d72-4fc9-a83c-8a7c34ce2e11 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:45.519844 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-19a1e929-9d72-4fc9-a83c-8a7c34ce2e11 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:45.538314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19a1e929-9d72-4fc9-a83c-8a7c34ce2e11 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:45.538774 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19a1e929-9d72-4fc9-a83c-8a7c34ce2e11 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:45.543913 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19a1e929-9d72-4fc9-a83c-8a7c34ce2e11 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:45.544365 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19a1e929-9d72-4fc9-a83c-8a7c34ce2e11 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:45.573279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:09:46.148319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-19a1e929-9d72-4fc9-a83c-8a7c34ce2e11 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:46.160764 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-19a1e929-9d72-4fc9-a83c-8a7c34ce2e11 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.647038 Jul 27 20:09:46.163609 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 124/240] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:45 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:46.436062 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8ff424de-b6ed-452c-b2e8-1d1bdb29aa4f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:46.437476 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8ff424de-b6ed-452c-b2e8-1d1bdb29aa4f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:46.455031 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8ff424de-b6ed-452c-b2e8-1d1bdb29aa4f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:46.455825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8ff424de-b6ed-452c-b2e8-1d1bdb29aa4f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:46.458604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8ff424de-b6ed-452c-b2e8-1d1bdb29aa4f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:46.459823 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8ff424de-b6ed-452c-b2e8-1d1bdb29aa4f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:46.823635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-48560ab9-ca65-4a33-85ad-62f43e6ad85b req-0a826fb1-0057-41c5-b48e-dc12ff4507f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "014540d5-3197-434b-8d02-c3f66e493c51", "tag": "7ded7eab-2013-4dcc-b623-82dc0e095b6a"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:09:46.849201 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-48560ab9-ca65-4a33-85ad-62f43e6ad85b req-0a826fb1-0057-41c5-b48e-dc12ff4507f7 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:46.850040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-48560ab9-ca65-4a33-85ad-62f43e6ad85b req-0a826fb1-0057-41c5-b48e-dc12ff4507f7 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:46.883549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-48560ab9-ca65-4a33-85ad-62f43e6ad85b req-0a826fb1-0057-41c5-b48e-dc12ff4507f7 service nova] Creating event network-changed:7ded7eab-2013-4dcc-b623-82dc0e095b6a for instance 014540d5-3197-434b-8d02-c3f66e493c51 on hv-cinder-79987 Jul 27 20:09:46.905973 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-48560ab9-ca65-4a33-85ad-62f43e6ad85b req-0a826fb1-0057-41c5-b48e-dc12ff4507f7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087423 Jul 27 20:09:46.911338 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 125/241] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:09:47.074902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8ff424de-b6ed-452c-b2e8-1d1bdb29aa4f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:47.095749 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8ff424de-b6ed-452c-b2e8-1d1bdb29aa4f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.663940 Jul 27 20:09:47.096816 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 117/242] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:46 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:47.185957 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-787f8d6c-e8cf-4835-8735-f2f0e2360b4b tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:47.186958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-787f8d6c-e8cf-4835-8735-f2f0e2360b4b tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:47.212955 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-787f8d6c-e8cf-4835-8735-f2f0e2360b4b tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:47.219772 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-787f8d6c-e8cf-4835-8735-f2f0e2360b4b tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:47.221287 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-787f8d6c-e8cf-4835-8735-f2f0e2360b4b tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:47.221743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-787f8d6c-e8cf-4835-8735-f2f0e2360b4b tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:47.428646 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-787f8d6c-e8cf-4835-8735-f2f0e2360b4b tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:47.441125 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-787f8d6c-e8cf-4835-8735-f2f0e2360b4b tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.258610 Jul 27 20:09:47.457649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 126/243] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:47 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:48.116912 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5d7cce58-55f3-4e6d-b03d-bd5268de5340 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:48.117691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5d7cce58-55f3-4e6d-b03d-bd5268de5340 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:48.124076 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=74 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:09:48.125908 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d7cce58-55f3-4e6d-b03d-bd5268de5340 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:48.127268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d7cce58-55f3-4e6d-b03d-bd5268de5340 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:48.128150 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d7cce58-55f3-4e6d-b03d-bd5268de5340 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:48.128654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d7cce58-55f3-4e6d-b03d-bd5268de5340 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:48.370731 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5d7cce58-55f3-4e6d-b03d-bd5268de5340 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:48.379670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5d7cce58-55f3-4e6d-b03d-bd5268de5340 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.267720 Jul 27 20:09:48.389174 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 118/244] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:48 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:48.484578 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-00d55fb0-c41b-4ec9-b911-7e1c1d225b94 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:48.486100 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-00d55fb0-c41b-4ec9-b911-7e1c1d225b94 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:48.497583 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00d55fb0-c41b-4ec9-b911-7e1c1d225b94 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:48.500042 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00d55fb0-c41b-4ec9-b911-7e1c1d225b94 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:48.501041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00d55fb0-c41b-4ec9-b911-7e1c1d225b94 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:48.503542 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00d55fb0-c41b-4ec9-b911-7e1c1d225b94 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:48.896399 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-00d55fb0-c41b-4ec9-b911-7e1c1d225b94 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:48.915506 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-00d55fb0-c41b-4ec9-b911-7e1c1d225b94 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.438993 Jul 27 20:09:48.916385 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 127/245] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:48 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:49.056728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6426af12-c528-4dd8-bf63-a5a22894bcf8 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:49.057489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6426af12-c528-4dd8-bf63-a5a22894bcf8 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:49.066306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6426af12-c528-4dd8-bf63-a5a22894bcf8 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:49.066908 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6426af12-c528-4dd8-bf63-a5a22894bcf8 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:49.068148 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6426af12-c528-4dd8-bf63-a5a22894bcf8 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:49.068690 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6426af12-c528-4dd8-bf63-a5a22894bcf8 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:49.109378 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6426af12-c528-4dd8-bf63-a5a22894bcf8 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:09:49.243865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6426af12-c528-4dd8-bf63-a5a22894bcf8 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 204 len: 0 microversion: 2.1 time: 0.189598 Jul 27 20:09:49.248275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 119/246] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 20:09:49 2022] DELETE /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:09:49.256444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7001b152-6622-494f-b46e-d04015caa689 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:49.257085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7001b152-6622-494f-b46e-d04015caa689 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:49.270737 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:09:49.272298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7001b152-6622-494f-b46e-d04015caa689 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:49.272865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7001b152-6622-494f-b46e-d04015caa689 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:49.273926 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7001b152-6622-494f-b46e-d04015caa689 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:49.274359 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7001b152-6622-494f-b46e-d04015caa689 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:49.411911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9dd44626-9454-404e-a34d-06eb36a94540 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:49.412660 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9dd44626-9454-404e-a34d-06eb36a94540 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:49.424273 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9dd44626-9454-404e-a34d-06eb36a94540 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:49.426756 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9dd44626-9454-404e-a34d-06eb36a94540 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:49.427781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9dd44626-9454-404e-a34d-06eb36a94540 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:49.428221 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9dd44626-9454-404e-a34d-06eb36a94540 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:49.439153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7001b152-6622-494f-b46e-d04015caa689 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:49.448290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7001b152-6622-494f-b46e-d04015caa689 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1553 microversion: 2.1 time: 0.198702 Jul 27 20:09:49.449264 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 128/247] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:49 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1553 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:49.468086 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:09:49.627151 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9dd44626-9454-404e-a34d-06eb36a94540 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:49.636028 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9dd44626-9454-404e-a34d-06eb36a94540 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.238341 Jul 27 20:09:49.636650 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 120/248] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:49 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:49.935476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-02c0089e-8b64-4273-b2bf-95a61ff810c0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:49.936085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-02c0089e-8b64-4273-b2bf-95a61ff810c0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:49.947028 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-02c0089e-8b64-4273-b2bf-95a61ff810c0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:49.947483 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-02c0089e-8b64-4273-b2bf-95a61ff810c0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:49.948250 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-02c0089e-8b64-4273-b2bf-95a61ff810c0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:49.948686 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-02c0089e-8b64-4273-b2bf-95a61ff810c0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:50.150502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-02c0089e-8b64-4273-b2bf-95a61ff810c0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:50.158593 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-02c0089e-8b64-4273-b2bf-95a61ff810c0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.226279 Jul 27 20:09:50.159630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 129/249] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:49 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:50.470802 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-24c22661-7fa9-479b-a278-0cc061088d97 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:50.472155 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-24c22661-7fa9-479b-a278-0cc061088d97 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:50.487447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-24c22661-7fa9-479b-a278-0cc061088d97 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:50.488031 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-24c22661-7fa9-479b-a278-0cc061088d97 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:50.488913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-24c22661-7fa9-479b-a278-0cc061088d97 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:50.489488 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-24c22661-7fa9-479b-a278-0cc061088d97 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:50.587163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:09:50.647885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-24c22661-7fa9-479b-a278-0cc061088d97 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:50.656265 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-24c22661-7fa9-479b-a278-0cc061088d97 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1553 microversion: 2.1 time: 0.190390 Jul 27 20:09:50.658485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-52756b69-2585-4450-be39-5d7d33dcdc74 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:50.659109 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-52756b69-2585-4450-be39-5d7d33dcdc74 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:50.661276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=2 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:09:50.662276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=6 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:09:50.672934 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 121/250] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:50 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1553 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:50.678237 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-52756b69-2585-4450-be39-5d7d33dcdc74 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:50.680911 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-52756b69-2585-4450-be39-5d7d33dcdc74 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:50.681734 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-52756b69-2585-4450-be39-5d7d33dcdc74 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:50.682318 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-52756b69-2585-4450-be39-5d7d33dcdc74 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:50.886677 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-52756b69-2585-4450-be39-5d7d33dcdc74 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:50.896214 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-52756b69-2585-4450-be39-5d7d33dcdc74 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.242506 Jul 27 20:09:50.909668 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 130/251] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:50 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:51.180301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ec22d87a-fc72-41a9-a825-b951aa82967b tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:51.180991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ec22d87a-fc72-41a9-a825-b951aa82967b tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:51.187415 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec22d87a-fc72-41a9-a825-b951aa82967b tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:51.188080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec22d87a-fc72-41a9-a825-b951aa82967b tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:51.189703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec22d87a-fc72-41a9-a825-b951aa82967b tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:51.190210 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec22d87a-fc72-41a9-a825-b951aa82967b tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:51.411142 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ec22d87a-fc72-41a9-a825-b951aa82967b tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:51.419776 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ec22d87a-fc72-41a9-a825-b951aa82967b tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.243768 Jul 27 20:09:51.420342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 122/252] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:51 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:51.679881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8238ccf3-1941-4045-a5fd-ed2f49bd72dd tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:51.680575 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8238ccf3-1941-4045-a5fd-ed2f49bd72dd tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:51.687322 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8238ccf3-1941-4045-a5fd-ed2f49bd72dd tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:51.688024 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8238ccf3-1941-4045-a5fd-ed2f49bd72dd tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:51.689513 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8238ccf3-1941-4045-a5fd-ed2f49bd72dd tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:51.689964 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8238ccf3-1941-4045-a5fd-ed2f49bd72dd tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:51.853267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8238ccf3-1941-4045-a5fd-ed2f49bd72dd tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:51.864705 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8238ccf3-1941-4045-a5fd-ed2f49bd72dd tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1553 microversion: 2.1 time: 0.188554 Jul 27 20:09:51.865355 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 131/253] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:51 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1553 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:51.916345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b3874f3d-1483-4a58-962d-0029a9938881 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:51.916939 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b3874f3d-1483-4a58-962d-0029a9938881 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:51.922883 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3874f3d-1483-4a58-962d-0029a9938881 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:51.923365 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3874f3d-1483-4a58-962d-0029a9938881 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:51.924221 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3874f3d-1483-4a58-962d-0029a9938881 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:51.924643 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3874f3d-1483-4a58-962d-0029a9938881 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:52.073501 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b3874f3d-1483-4a58-962d-0029a9938881 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:52.082337 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b3874f3d-1483-4a58-962d-0029a9938881 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.169745 Jul 27 20:09:52.083421 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 123/254] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:51 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:52.444666 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-dd84a393-c8ad-4583-9977-9d3c65837f5d tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:52.446808 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-dd84a393-c8ad-4583-9977-9d3c65837f5d tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:52.453555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dd84a393-c8ad-4583-9977-9d3c65837f5d tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:52.456654 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dd84a393-c8ad-4583-9977-9d3c65837f5d tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:52.457698 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dd84a393-c8ad-4583-9977-9d3c65837f5d tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:52.458339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dd84a393-c8ad-4583-9977-9d3c65837f5d tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:52.614453 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-dd84a393-c8ad-4583-9977-9d3c65837f5d tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:52.624757 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-dd84a393-c8ad-4583-9977-9d3c65837f5d tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.185814 Jul 27 20:09:52.625374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 132/255] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:52 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:52.886059 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-49db8c78-2fa5-4232-9c32-b50b5c086d30 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:52.886942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-49db8c78-2fa5-4232-9c32-b50b5c086d30 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:52.893316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49db8c78-2fa5-4232-9c32-b50b5c086d30 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:52.894023 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49db8c78-2fa5-4232-9c32-b50b5c086d30 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:52.894956 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49db8c78-2fa5-4232-9c32-b50b5c086d30 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:52.895612 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49db8c78-2fa5-4232-9c32-b50b5c086d30 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:53.046170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-49db8c78-2fa5-4232-9c32-b50b5c086d30 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:53.055826 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-49db8c78-2fa5-4232-9c32-b50b5c086d30 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1553 microversion: 2.1 time: 0.173465 Jul 27 20:09:53.056327 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 124/256] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:52 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:53.105452 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d6bec6f0-d51e-4b72-bb5d-9f7035ea8155 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:53.106864 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d6bec6f0-d51e-4b72-bb5d-9f7035ea8155 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:53.114688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d6bec6f0-d51e-4b72-bb5d-9f7035ea8155 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:53.115379 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d6bec6f0-d51e-4b72-bb5d-9f7035ea8155 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:53.116933 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d6bec6f0-d51e-4b72-bb5d-9f7035ea8155 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:53.117398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d6bec6f0-d51e-4b72-bb5d-9f7035ea8155 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:53.258595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d6bec6f0-d51e-4b72-bb5d-9f7035ea8155 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:53.268457 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d6bec6f0-d51e-4b72-bb5d-9f7035ea8155 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.167494 Jul 27 20:09:53.269390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 133/257] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:53 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:53.651942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-91c125e9-deff-4402-9b4a-f6f1ef353f5d tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:53.653129 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-91c125e9-deff-4402-9b4a-f6f1ef353f5d tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:53.661602 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-91c125e9-deff-4402-9b4a-f6f1ef353f5d tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:53.664668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-91c125e9-deff-4402-9b4a-f6f1ef353f5d tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:53.665911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-91c125e9-deff-4402-9b4a-f6f1ef353f5d tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:53.666510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-91c125e9-deff-4402-9b4a-f6f1ef353f5d tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:53.812670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-91c125e9-deff-4402-9b4a-f6f1ef353f5d tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:53.821276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-91c125e9-deff-4402-9b4a-f6f1ef353f5d tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.177069 Jul 27 20:09:53.822399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 125/258] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:53 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:54.085520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cbfed45d-eb38-4eac-8995-e6a2b85d6c6f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:54.086527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cbfed45d-eb38-4eac-8995-e6a2b85d6c6f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:54.100582 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cbfed45d-eb38-4eac-8995-e6a2b85d6c6f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:54.101479 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cbfed45d-eb38-4eac-8995-e6a2b85d6c6f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:54.102438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cbfed45d-eb38-4eac-8995-e6a2b85d6c6f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:54.103030 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cbfed45d-eb38-4eac-8995-e6a2b85d6c6f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:54.278825 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cbfed45d-eb38-4eac-8995-e6a2b85d6c6f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:54.289308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-123aebaf-875c-4ea4-b685-9473f6fead66 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:54.290341 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-123aebaf-875c-4ea4-b685-9473f6fead66 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:54.299367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-123aebaf-875c-4ea4-b685-9473f6fead66 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:54.299883 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-123aebaf-875c-4ea4-b685-9473f6fead66 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:54.300730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-123aebaf-875c-4ea4-b685-9473f6fead66 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:54.301206 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-123aebaf-875c-4ea4-b685-9473f6fead66 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:54.301445 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cbfed45d-eb38-4eac-8995-e6a2b85d6c6f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1553 microversion: 2.1 time: 0.223468 Jul 27 20:09:54.302743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 134/259] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:54 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1553 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:54.478460 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-123aebaf-875c-4ea4-b685-9473f6fead66 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:54.487522 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-123aebaf-875c-4ea4-b685-9473f6fead66 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.201791 Jul 27 20:09:54.488347 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 126/260] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:54 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:54.847519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c8dd5ad6-9e94-4f8b-bd4b-b8021cb7c52e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:54.848423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c8dd5ad6-9e94-4f8b-bd4b-b8021cb7c52e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:54.854757 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c8dd5ad6-9e94-4f8b-bd4b-b8021cb7c52e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:54.855399 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c8dd5ad6-9e94-4f8b-bd4b-b8021cb7c52e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:54.856532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c8dd5ad6-9e94-4f8b-bd4b-b8021cb7c52e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:54.857185 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c8dd5ad6-9e94-4f8b-bd4b-b8021cb7c52e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:55.003803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c8dd5ad6-9e94-4f8b-bd4b-b8021cb7c52e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:55.012604 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c8dd5ad6-9e94-4f8b-bd4b-b8021cb7c52e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.170198 Jul 27 20:09:55.023910 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 135/261] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:54 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:55.192150 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-960ba601-cad5-49bf-8795-3e9685c8157f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Action: 'create', calling method: .version_select at 0x7fc7f03c21f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1468549466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwwji4tuN7MFi7XMWdGLAQNpNdAs4n5Cht+rlsc5apZMQyrfrVBv02RJOrfQENj0x3gPCeRt1cIlRnOi8WMdMXQbXYEIE3o7Fkl31RqddrL/q6CLHnYLgw8KLeJv6aFug=="}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:09:55.208720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-960ba601-cad5-49bf-8795-3e9685c8157f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Getting quotas for project 4d888dcf554944adae3e03bc1c24c52b. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:09:55.212758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-960ba601-cad5-49bf-8795-3e9685c8157f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Getting quotas for user 5fa85a53bfbe4ef5a36c01031f9016aa and project 4d888dcf554944adae3e03bc1c24c52b. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:09:55.235762 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-960ba601-cad5-49bf-8795-3e9685c8157f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.047427 Jul 27 20:09:55.236348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 127/262] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Jul 27 20:09:55 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:09:55.322654 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-56a8cef6-4964-4c05-902e-6c84c6761552 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:55.323266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-56a8cef6-4964-4c05-902e-6c84c6761552 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:55.329814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56a8cef6-4964-4c05-902e-6c84c6761552 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:55.330575 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56a8cef6-4964-4c05-902e-6c84c6761552 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:55.331351 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56a8cef6-4964-4c05-902e-6c84c6761552 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:55.331786 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56a8cef6-4964-4c05-902e-6c84c6761552 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:55.333754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-055b8f2f-a228-4392-a8a3-d575f83363ed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1486508398", "imageRef": "5d9992a3-c197-4367-a5e5-8ee36f4d66de", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1468549466", "networks": [{"uuid": "7b7f62f3-bb77-47c7-a62d-aeacbe764924"}]}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:09:55.387418 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-055b8f2f-a228-4392-a8a3-d575f83363ed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] validate_networks() for [('7b7f62f3-bb77-47c7-a62d-aeacbe764924', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:09:55.464096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-56a8cef6-4964-4c05-902e-6c84c6761552 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:55.473228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-56a8cef6-4964-4c05-902e-6c84c6761552 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1553 microversion: 2.1 time: 0.154279 Jul 27 20:09:55.473994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 136/263] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:55 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:55.508622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-98028feb-f6f7-4730-b1dd-c254129fce8c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:55.509353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-98028feb-f6f7-4730-b1dd-c254129fce8c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:55.515584 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-98028feb-f6f7-4730-b1dd-c254129fce8c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:55.516038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-98028feb-f6f7-4730-b1dd-c254129fce8c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:55.516799 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-98028feb-f6f7-4730-b1dd-c254129fce8c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:55.517541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-98028feb-f6f7-4730-b1dd-c254129fce8c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:55.648660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-98028feb-f6f7-4730-b1dd-c254129fce8c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:55.656074 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-98028feb-f6f7-4730-b1dd-c254129fce8c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.151190 Jul 27 20:09:55.656642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 137/264] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:55 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:55.773407 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-055b8f2f-a228-4392-a8a3-d575f83363ed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:09:55.773825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-055b8f2f-a228-4392-a8a3-d575f83363ed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:09:55.774292 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-055b8f2f-a228-4392-a8a3-d575f83363ed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:09:55.774693 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-055b8f2f-a228-4392-a8a3-d575f83363ed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:09:55.775106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-055b8f2f-a228-4392-a8a3-d575f83363ed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:09:55.783852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-055b8f2f-a228-4392-a8a3-d575f83363ed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:55.784294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-055b8f2f-a228-4392-a8a3-d575f83363ed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:55.785108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-055b8f2f-a228-4392-a8a3-d575f83363ed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:55.785549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-055b8f2f-a228-4392-a8a3-d575f83363ed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:55.802028 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-055b8f2f-a228-4392-a8a3-d575f83363ed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Getting quotas for project 4d888dcf554944adae3e03bc1c24c52b. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:09:55.805928 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-055b8f2f-a228-4392-a8a3-d575f83363ed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Getting quotas for user 5fa85a53bfbe4ef5a36c01031f9016aa and project 4d888dcf554944adae3e03bc1c24c52b. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:09:55.817170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-055b8f2f-a228-4392-a8a3-d575f83363ed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:09:55.819542 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-055b8f2f-a228-4392-a8a3-d575f83363ed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d9992a3-c197-4367-a5e5-8ee36f4d66de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:09:55.868354 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-055b8f2f-a228-4392-a8a3-d575f83363ed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538709 Jul 27 20:09:55.869206 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 128/265] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Jul 27 20:09:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:09:55.880769 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-63ecbaf9-56dd-44f5-8c75-c6a724fb3638 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:55.881435 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-63ecbaf9-56dd-44f5-8c75-c6a724fb3638 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:55.935853 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-63ecbaf9-56dd-44f5-8c75-c6a724fb3638 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:55.943786 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-63ecbaf9-56dd-44f5-8c75-c6a724fb3638 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1259 microversion: 2.1 time: 0.067311 Jul 27 20:09:55.944360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 138/266] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:55 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:56.033547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8b129b17-9ac4-4d01-b709-0e203d45bda7 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:56.034161 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8b129b17-9ac4-4d01-b709-0e203d45bda7 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:56.040905 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b129b17-9ac4-4d01-b709-0e203d45bda7 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:56.041435 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b129b17-9ac4-4d01-b709-0e203d45bda7 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:56.042294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b129b17-9ac4-4d01-b709-0e203d45bda7 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:56.042729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b129b17-9ac4-4d01-b709-0e203d45bda7 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:56.184072 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8b129b17-9ac4-4d01-b709-0e203d45bda7 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:56.192341 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8b129b17-9ac4-4d01-b709-0e203d45bda7 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.162597 Jul 27 20:09:56.193214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 129/267] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:56 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:56.494404 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d19d6205-0c66-4fbe-a2a1-359a5622a26a tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:56.495041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d19d6205-0c66-4fbe-a2a1-359a5622a26a tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:56.502306 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d19d6205-0c66-4fbe-a2a1-359a5622a26a tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:56.502753 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d19d6205-0c66-4fbe-a2a1-359a5622a26a tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:56.503509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d19d6205-0c66-4fbe-a2a1-359a5622a26a tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:56.503944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d19d6205-0c66-4fbe-a2a1-359a5622a26a tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:56.629088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d19d6205-0c66-4fbe-a2a1-359a5622a26a tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:56.637039 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d19d6205-0c66-4fbe-a2a1-359a5622a26a tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1553 microversion: 2.1 time: 0.146493 Jul 27 20:09:56.637602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 139/268] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:56 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:56.677241 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b546d0b8-715e-4cc1-bd0a-524f01fd818e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:56.677847 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b546d0b8-715e-4cc1-bd0a-524f01fd818e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:56.683894 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b546d0b8-715e-4cc1-bd0a-524f01fd818e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:56.684332 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b546d0b8-715e-4cc1-bd0a-524f01fd818e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:56.685110 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b546d0b8-715e-4cc1-bd0a-524f01fd818e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:56.685539 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b546d0b8-715e-4cc1-bd0a-524f01fd818e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:56.818974 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b546d0b8-715e-4cc1-bd0a-524f01fd818e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:56.826641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b546d0b8-715e-4cc1-bd0a-524f01fd818e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.153269 Jul 27 20:09:56.827204 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 130/269] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:56 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:56.964539 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-aef200fb-2757-4c4b-9bde-e042ef7e52cd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:56.965186 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-aef200fb-2757-4c4b-9bde-e042ef7e52cd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:56.971246 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aef200fb-2757-4c4b-9bde-e042ef7e52cd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:56.971688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aef200fb-2757-4c4b-9bde-e042ef7e52cd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:56.972430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aef200fb-2757-4c4b-9bde-e042ef7e52cd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:56.972862 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aef200fb-2757-4c4b-9bde-e042ef7e52cd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:57.034442 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-aef200fb-2757-4c4b-9bde-e042ef7e52cd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:57.041705 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-aef200fb-2757-4c4b-9bde-e042ef7e52cd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1263 microversion: 2.1 time: 0.080907 Jul 27 20:09:57.042257 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 140/270] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:56 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:57.213745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-917d4824-f1f9-4823-8687-d6a2b562fad0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:57.214310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-917d4824-f1f9-4823-8687-d6a2b562fad0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:57.220810 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-917d4824-f1f9-4823-8687-d6a2b562fad0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:57.221294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-917d4824-f1f9-4823-8687-d6a2b562fad0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:57.222056 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-917d4824-f1f9-4823-8687-d6a2b562fad0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:57.222525 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-917d4824-f1f9-4823-8687-d6a2b562fad0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:57.354270 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-917d4824-f1f9-4823-8687-d6a2b562fad0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:57.361648 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-917d4824-f1f9-4823-8687-d6a2b562fad0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.151827 Jul 27 20:09:57.362215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 131/271] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:57 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:57.659297 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-aaae7c74-1372-4458-afaa-34db1d53f282 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:57.659905 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-aaae7c74-1372-4458-afaa-34db1d53f282 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:57.666404 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aaae7c74-1372-4458-afaa-34db1d53f282 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:57.666851 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aaae7c74-1372-4458-afaa-34db1d53f282 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:57.667607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aaae7c74-1372-4458-afaa-34db1d53f282 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:57.668073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aaae7c74-1372-4458-afaa-34db1d53f282 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:57.795953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-aaae7c74-1372-4458-afaa-34db1d53f282 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:57.803836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-aaae7c74-1372-4458-afaa-34db1d53f282 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1553 microversion: 2.1 time: 0.149335 Jul 27 20:09:57.804394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 141/272] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:57 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:57.847747 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3507c030-2787-44ac-8837-8b85149772a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:57.848356 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3507c030-2787-44ac-8837-8b85149772a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:57.854362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3507c030-2787-44ac-8837-8b85149772a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:57.854812 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3507c030-2787-44ac-8837-8b85149772a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:57.855585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3507c030-2787-44ac-8837-8b85149772a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:57.856022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3507c030-2787-44ac-8837-8b85149772a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:57.981803 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3507c030-2787-44ac-8837-8b85149772a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:57.989411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3507c030-2787-44ac-8837-8b85149772a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.145446 Jul 27 20:09:57.990114 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 132/273] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:57 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:58.062940 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c5b5d298-a1da-4db7-89cd-871b3ee4e939 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:58.063546 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c5b5d298-a1da-4db7-89cd-871b3ee4e939 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:58.070326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c5b5d298-a1da-4db7-89cd-871b3ee4e939 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:58.070954 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c5b5d298-a1da-4db7-89cd-871b3ee4e939 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:58.071517 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c5b5d298-a1da-4db7-89cd-871b3ee4e939 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:58.071951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c5b5d298-a1da-4db7-89cd-871b3ee4e939 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:58.089600 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:09:58.131792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c5b5d298-a1da-4db7-89cd-871b3ee4e939 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:58.139086 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c5b5d298-a1da-4db7-89cd-871b3ee4e939 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1263 microversion: 2.1 time: 0.079910 Jul 27 20:09:58.139645 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 142/274] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:58 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1263 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:58.382073 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-63a52d1a-79e4-4e81-b293-9937071cbe8e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:58.382677 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-63a52d1a-79e4-4e81-b293-9937071cbe8e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:58.388645 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63a52d1a-79e4-4e81-b293-9937071cbe8e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:58.389127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63a52d1a-79e4-4e81-b293-9937071cbe8e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:58.389881 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63a52d1a-79e4-4e81-b293-9937071cbe8e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:58.390318 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63a52d1a-79e4-4e81-b293-9937071cbe8e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:58.519005 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-63a52d1a-79e4-4e81-b293-9937071cbe8e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:58.526301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-63a52d1a-79e4-4e81-b293-9937071cbe8e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.147986 Jul 27 20:09:58.526864 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 133/275] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:58 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:58.825202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c655190f-fc48-4b2c-a793-2725c22a073b tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:58.825820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c655190f-fc48-4b2c-a793-2725c22a073b tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:58.832553 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c655190f-fc48-4b2c-a793-2725c22a073b tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:58.833039 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c655190f-fc48-4b2c-a793-2725c22a073b tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:58.833802 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c655190f-fc48-4b2c-a793-2725c22a073b tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:58.834240 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c655190f-fc48-4b2c-a793-2725c22a073b tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:58.968260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c655190f-fc48-4b2c-a793-2725c22a073b tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:58.976841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c655190f-fc48-4b2c-a793-2725c22a073b tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1553 microversion: 2.1 time: 0.155586 Jul 27 20:09:58.977473 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 143/276] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:58 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:59.010705 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-55ef0d3a-745f-439c-9e77-8a332a9dc82c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:59.011312 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-55ef0d3a-745f-439c-9e77-8a332a9dc82c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:59.017799 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55ef0d3a-745f-439c-9e77-8a332a9dc82c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:59.018328 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55ef0d3a-745f-439c-9e77-8a332a9dc82c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:59.019035 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55ef0d3a-745f-439c-9e77-8a332a9dc82c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:59.019717 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55ef0d3a-745f-439c-9e77-8a332a9dc82c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:59.150452 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-55ef0d3a-745f-439c-9e77-8a332a9dc82c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:59.159001 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-55ef0d3a-745f-439c-9e77-8a332a9dc82c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.151974 Jul 27 20:09:59.159565 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 134/277] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:59 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:59.160134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b3cdfd64-d45a-4a05-8532-044bdffddf02 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:59.160753 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b3cdfd64-d45a-4a05-8532-044bdffddf02 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:59.166762 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b3cdfd64-d45a-4a05-8532-044bdffddf02 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:59.167235 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b3cdfd64-d45a-4a05-8532-044bdffddf02 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:59.168001 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b3cdfd64-d45a-4a05-8532-044bdffddf02 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:59.168442 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b3cdfd64-d45a-4a05-8532-044bdffddf02 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:59.362446 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b3cdfd64-d45a-4a05-8532-044bdffddf02 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:59.369951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b3cdfd64-d45a-4a05-8532-044bdffddf02 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1263 microversion: 2.1 time: 0.214262 Jul 27 20:09:59.370513 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 144/278] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:59 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1263 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:09:59.546905 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-81d77239-4e41-45f9-96dc-82d81fbd1bf5 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:59.547577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-81d77239-4e41-45f9-96dc-82d81fbd1bf5 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:09:59.554623 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81d77239-4e41-45f9-96dc-82d81fbd1bf5 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:59.555107 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81d77239-4e41-45f9-96dc-82d81fbd1bf5 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:59.555982 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81d77239-4e41-45f9-96dc-82d81fbd1bf5 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:09:59.556463 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81d77239-4e41-45f9-96dc-82d81fbd1bf5 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:09:59.692555 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-81d77239-4e41-45f9-96dc-82d81fbd1bf5 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:09:59.700253 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-81d77239-4e41-45f9-96dc-82d81fbd1bf5 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.157157 Jul 27 20:09:59.700926 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 135/279] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:59 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:09:59.997493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bba4af4e-5409-439e-86c4-4d68cd349dbf tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:09:59.998101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bba4af4e-5409-439e-86c4-4d68cd349dbf tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:00.004478 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bba4af4e-5409-439e-86c4-4d68cd349dbf tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:00.004923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bba4af4e-5409-439e-86c4-4d68cd349dbf tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:00.005703 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bba4af4e-5409-439e-86c4-4d68cd349dbf tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:00.006137 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bba4af4e-5409-439e-86c4-4d68cd349dbf tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:00.134250 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bba4af4e-5409-439e-86c4-4d68cd349dbf tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:00.142358 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bba4af4e-5409-439e-86c4-4d68cd349dbf tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1553 microversion: 2.1 time: 0.148469 Jul 27 20:10:00.143079 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 145/280] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:09:59 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:00.180226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-377db942-d7e3-4489-9a68-3e303ccfe516 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:00.180834 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-377db942-d7e3-4489-9a68-3e303ccfe516 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:00.186815 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-377db942-d7e3-4489-9a68-3e303ccfe516 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:00.187257 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-377db942-d7e3-4489-9a68-3e303ccfe516 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:00.188014 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-377db942-d7e3-4489-9a68-3e303ccfe516 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:00.188448 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-377db942-d7e3-4489-9a68-3e303ccfe516 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:00.316111 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-377db942-d7e3-4489-9a68-3e303ccfe516 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:00.323848 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-377db942-d7e3-4489-9a68-3e303ccfe516 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.147405 Jul 27 20:10:00.324412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 136/281] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:00 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:00.391230 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b6a8f794-63cc-4365-a61a-c19467e737f6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:00.391991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b6a8f794-63cc-4365-a61a-c19467e737f6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:00.398119 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b6a8f794-63cc-4365-a61a-c19467e737f6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:00.398569 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b6a8f794-63cc-4365-a61a-c19467e737f6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:00.399374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b6a8f794-63cc-4365-a61a-c19467e737f6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:00.399789 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b6a8f794-63cc-4365-a61a-c19467e737f6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:00.461335 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b6a8f794-63cc-4365-a61a-c19467e737f6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:00.468565 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b6a8f794-63cc-4365-a61a-c19467e737f6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1255 microversion: 2.1 time: 0.081163 Jul 27 20:10:00.469167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 146/282] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:00 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1255 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:00.721774 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5f14e61b-cecb-4a96-94b3-2e7d43103b61 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:00.722386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5f14e61b-cecb-4a96-94b3-2e7d43103b61 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:00.728528 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5f14e61b-cecb-4a96-94b3-2e7d43103b61 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:00.728995 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5f14e61b-cecb-4a96-94b3-2e7d43103b61 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:00.729765 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5f14e61b-cecb-4a96-94b3-2e7d43103b61 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:00.730199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5f14e61b-cecb-4a96-94b3-2e7d43103b61 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:00.861846 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5f14e61b-cecb-4a96-94b3-2e7d43103b61 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:00.869584 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5f14e61b-cecb-4a96-94b3-2e7d43103b61 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.152563 Jul 27 20:10:00.870157 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 137/283] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:00 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:01.162980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1460aada-6c39-41c8-a5e3-6ae08f422b52 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:01.163596 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1460aada-6c39-41c8-a5e3-6ae08f422b52 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:01.170050 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1460aada-6c39-41c8-a5e3-6ae08f422b52 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:01.170502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1460aada-6c39-41c8-a5e3-6ae08f422b52 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:01.171271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1460aada-6c39-41c8-a5e3-6ae08f422b52 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:01.171711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1460aada-6c39-41c8-a5e3-6ae08f422b52 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:01.302139 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1460aada-6c39-41c8-a5e3-6ae08f422b52 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:01.310693 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1460aada-6c39-41c8-a5e3-6ae08f422b52 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1553 microversion: 2.1 time: 0.151566 Jul 27 20:10:01.311344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 147/284] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:01 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:01.344278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-66297e41-4ce1-4c20-bdcd-ddd85ba6dca6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:01.344897 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-66297e41-4ce1-4c20-bdcd-ddd85ba6dca6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:01.352487 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-66297e41-4ce1-4c20-bdcd-ddd85ba6dca6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:01.353064 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-66297e41-4ce1-4c20-bdcd-ddd85ba6dca6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:01.365950 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-66297e41-4ce1-4c20-bdcd-ddd85ba6dca6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:01.365950 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-66297e41-4ce1-4c20-bdcd-ddd85ba6dca6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:01.371564 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:10:01.490022 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-82f96e83-9317-441a-8872-fb5712b76e25 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:01.490702 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-82f96e83-9317-441a-8872-fb5712b76e25 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:01.496675 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-82f96e83-9317-441a-8872-fb5712b76e25 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:01.497164 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-82f96e83-9317-441a-8872-fb5712b76e25 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:01.498138 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-82f96e83-9317-441a-8872-fb5712b76e25 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:01.498909 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-82f96e83-9317-441a-8872-fb5712b76e25 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:01.515708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-66297e41-4ce1-4c20-bdcd-ddd85ba6dca6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:01.523351 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-66297e41-4ce1-4c20-bdcd-ddd85ba6dca6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.182887 Jul 27 20:10:01.523945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 138/285] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:01 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:01.578542 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-82f96e83-9317-441a-8872-fb5712b76e25 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:01.587423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-82f96e83-9317-441a-8872-fb5712b76e25 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1255 microversion: 2.1 time: 0.101768 Jul 27 20:10:01.587991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 148/286] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:01 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1255 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:01.890431 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f9d6db66-03fd-40e8-bf91-4032eded020c tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:01.891047 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f9d6db66-03fd-40e8-bf91-4032eded020c tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:01.897488 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9d6db66-03fd-40e8-bf91-4032eded020c tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:01.897918 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9d6db66-03fd-40e8-bf91-4032eded020c tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:01.898669 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9d6db66-03fd-40e8-bf91-4032eded020c tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:01.899097 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9d6db66-03fd-40e8-bf91-4032eded020c tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:02.027119 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f9d6db66-03fd-40e8-bf91-4032eded020c tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:02.034987 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f9d6db66-03fd-40e8-bf91-4032eded020c tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.147785 Jul 27 20:10:02.035587 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 139/287] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:01 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:02.334038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0717bbdc-8100-4db4-b7e2-6c2f0f9a5bbb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:02.334575 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0717bbdc-8100-4db4-b7e2-6c2f0f9a5bbb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:02.340549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0717bbdc-8100-4db4-b7e2-6c2f0f9a5bbb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:02.341022 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0717bbdc-8100-4db4-b7e2-6c2f0f9a5bbb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:02.341785 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0717bbdc-8100-4db4-b7e2-6c2f0f9a5bbb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:02.342223 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0717bbdc-8100-4db4-b7e2-6c2f0f9a5bbb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:02.470993 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0717bbdc-8100-4db4-b7e2-6c2f0f9a5bbb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:02.479176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0717bbdc-8100-4db4-b7e2-6c2f0f9a5bbb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1553 microversion: 2.1 time: 0.149864 Jul 27 20:10:02.479731 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 149/288] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:02 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:02.544698 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f662c532-2e85-44ff-8eee-05a1a65e4b37 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:02.545323 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f662c532-2e85-44ff-8eee-05a1a65e4b37 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:02.551766 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f662c532-2e85-44ff-8eee-05a1a65e4b37 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:02.552224 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f662c532-2e85-44ff-8eee-05a1a65e4b37 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:02.553057 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f662c532-2e85-44ff-8eee-05a1a65e4b37 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:02.553540 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f662c532-2e85-44ff-8eee-05a1a65e4b37 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:02.608415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0448ae67-55be-4f40-bbc4-a0199ab8a9f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:02.609110 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0448ae67-55be-4f40-bbc4-a0199ab8a9f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:02.616043 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0448ae67-55be-4f40-bbc4-a0199ab8a9f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:02.616488 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0448ae67-55be-4f40-bbc4-a0199ab8a9f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:02.617400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0448ae67-55be-4f40-bbc4-a0199ab8a9f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:02.617867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0448ae67-55be-4f40-bbc4-a0199ab8a9f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:02.680076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0448ae67-55be-4f40-bbc4-a0199ab8a9f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:02.687446 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0448ae67-55be-4f40-bbc4-a0199ab8a9f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1255 microversion: 2.1 time: 0.082736 Jul 27 20:10:02.688005 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 150/289] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:02 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1255 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:02.691051 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f662c532-2e85-44ff-8eee-05a1a65e4b37 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:02.698812 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f662c532-2e85-44ff-8eee-05a1a65e4b37 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.157954 Jul 27 20:10:02.699374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 140/290] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:02 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:03.056064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-05822bef-2f4e-4efd-b658-b2147a036427 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:03.056705 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-05822bef-2f4e-4efd-b658-b2147a036427 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:03.062709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-05822bef-2f4e-4efd-b658-b2147a036427 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:03.063159 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-05822bef-2f4e-4efd-b658-b2147a036427 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:03.063920 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-05822bef-2f4e-4efd-b658-b2147a036427 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:03.064359 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-05822bef-2f4e-4efd-b658-b2147a036427 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:03.190199 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-05822bef-2f4e-4efd-b658-b2147a036427 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:03.198093 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-05822bef-2f4e-4efd-b658-b2147a036427 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.145839 Jul 27 20:10:03.198657 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 151/291] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:03 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:03.499401 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-11a97527-5c64-4bd7-a5dd-53dd6b576c12 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:03.500010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-11a97527-5c64-4bd7-a5dd-53dd6b576c12 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:03.506154 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11a97527-5c64-4bd7-a5dd-53dd6b576c12 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:03.506600 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11a97527-5c64-4bd7-a5dd-53dd6b576c12 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:03.507362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11a97527-5c64-4bd7-a5dd-53dd6b576c12 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:03.507793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11a97527-5c64-4bd7-a5dd-53dd6b576c12 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:03.638780 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-11a97527-5c64-4bd7-a5dd-53dd6b576c12 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:03.651516 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-11a97527-5c64-4bd7-a5dd-53dd6b576c12 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1553 microversion: 2.1 time: 0.155585 Jul 27 20:10:03.652786 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 141/292] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:03 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:03.710081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1bee66fb-2238-4e8b-956f-db83bcda5d9d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:03.711034 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1bee66fb-2238-4e8b-956f-db83bcda5d9d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:03.719532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1bee66fb-2238-4e8b-956f-db83bcda5d9d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:03.719993 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1bee66fb-2238-4e8b-956f-db83bcda5d9d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:03.720768 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1bee66fb-2238-4e8b-956f-db83bcda5d9d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:03.721122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-08107075-875d-4562-9a87-306edb3257f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:03.721266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1bee66fb-2238-4e8b-956f-db83bcda5d9d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:03.722228 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-08107075-875d-4562-9a87-306edb3257f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:03.728459 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-08107075-875d-4562-9a87-306edb3257f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:03.728901 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-08107075-875d-4562-9a87-306edb3257f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:03.729891 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-08107075-875d-4562-9a87-306edb3257f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:03.730323 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-08107075-875d-4562-9a87-306edb3257f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:03.792217 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1bee66fb-2238-4e8b-956f-db83bcda5d9d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:03.798814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1bee66fb-2238-4e8b-956f-db83bcda5d9d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1255 microversion: 2.1 time: 0.093495 Jul 27 20:10:03.800437 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 152/293] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:03 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1255 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:03.873492 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-08107075-875d-4562-9a87-306edb3257f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:03.880943 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-08107075-875d-4562-9a87-306edb3257f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.165163 Jul 27 20:10:03.881531 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 142/294] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:03 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:04.218701 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a1f43f44-b63e-4a35-a005-b18a400796c0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:04.219314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a1f43f44-b63e-4a35-a005-b18a400796c0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:04.225500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a1f43f44-b63e-4a35-a005-b18a400796c0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:04.225952 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a1f43f44-b63e-4a35-a005-b18a400796c0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:04.226716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a1f43f44-b63e-4a35-a005-b18a400796c0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:04.227155 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a1f43f44-b63e-4a35-a005-b18a400796c0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:04.351787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a1f43f44-b63e-4a35-a005-b18a400796c0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:04.359380 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a1f43f44-b63e-4a35-a005-b18a400796c0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.144565 Jul 27 20:10:04.359928 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 153/295] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:04 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:04.675405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cdcea87d-2647-453e-b0bc-c033dac31210 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:04.676047 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cdcea87d-2647-453e-b0bc-c033dac31210 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:04.682254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdcea87d-2647-453e-b0bc-c033dac31210 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:04.682706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdcea87d-2647-453e-b0bc-c033dac31210 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:04.683508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdcea87d-2647-453e-b0bc-c033dac31210 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:04.683947 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdcea87d-2647-453e-b0bc-c033dac31210 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:04.812842 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cdcea87d-2647-453e-b0bc-c033dac31210 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:04.820433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e15d6763-e540-4a6a-8489-0dfd667eda36 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:04.821096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e15d6763-e540-4a6a-8489-0dfd667eda36 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:04.822026 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cdcea87d-2647-453e-b0bc-c033dac31210 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1553 microversion: 2.1 time: 0.150986 Jul 27 20:10:04.822700 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 143/296] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:04 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:04.827516 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e15d6763-e540-4a6a-8489-0dfd667eda36 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:04.827957 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e15d6763-e540-4a6a-8489-0dfd667eda36 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:04.828706 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e15d6763-e540-4a6a-8489-0dfd667eda36 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:04.829169 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e15d6763-e540-4a6a-8489-0dfd667eda36 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:04.888412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e15d6763-e540-4a6a-8489-0dfd667eda36 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:04.896017 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e15d6763-e540-4a6a-8489-0dfd667eda36 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1255 microversion: 2.1 time: 0.080301 Jul 27 20:10:04.896581 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 154/297] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:04 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1255 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:04.907030 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-63627660-e31e-4821-aaa7-4e5c960e6c2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:04.907638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-63627660-e31e-4821-aaa7-4e5c960e6c2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:04.913760 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63627660-e31e-4821-aaa7-4e5c960e6c2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:04.914145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63627660-e31e-4821-aaa7-4e5c960e6c2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:04.914902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63627660-e31e-4821-aaa7-4e5c960e6c2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:04.915337 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63627660-e31e-4821-aaa7-4e5c960e6c2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:05.043740 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-63627660-e31e-4821-aaa7-4e5c960e6c2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:05.051675 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-63627660-e31e-4821-aaa7-4e5c960e6c2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.148705 Jul 27 20:10:05.052232 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 144/298] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:04 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:05.380247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8d217467-9ff5-47bf-9f89-fc6d2e542001 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:05.380861 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8d217467-9ff5-47bf-9f89-fc6d2e542001 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:05.386888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8d217467-9ff5-47bf-9f89-fc6d2e542001 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:05.387339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8d217467-9ff5-47bf-9f89-fc6d2e542001 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:05.388098 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8d217467-9ff5-47bf-9f89-fc6d2e542001 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:05.388536 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8d217467-9ff5-47bf-9f89-fc6d2e542001 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:05.516266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8d217467-9ff5-47bf-9f89-fc6d2e542001 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:05.524222 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8d217467-9ff5-47bf-9f89-fc6d2e542001 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.148498 Jul 27 20:10:05.524776 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 155/299] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:05 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:05.842672 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2da36084-d99e-4531-ad81-83bba229fdc4 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:05.843196 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2da36084-d99e-4531-ad81-83bba229fdc4 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:05.845055 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:10:05.845693 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=10 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:10:05.851341 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2da36084-d99e-4531-ad81-83bba229fdc4 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:05.851778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2da36084-d99e-4531-ad81-83bba229fdc4 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:05.852529 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2da36084-d99e-4531-ad81-83bba229fdc4 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:05.852958 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2da36084-d99e-4531-ad81-83bba229fdc4 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:05.916722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4323bc6c-b2f6-49f8-952e-f0b90fa78303 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:05.917363 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4323bc6c-b2f6-49f8-952e-f0b90fa78303 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:05.924093 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4323bc6c-b2f6-49f8-952e-f0b90fa78303 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:05.924665 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4323bc6c-b2f6-49f8-952e-f0b90fa78303 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:05.926244 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4323bc6c-b2f6-49f8-952e-f0b90fa78303 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:05.926681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4323bc6c-b2f6-49f8-952e-f0b90fa78303 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:05.941904 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=2 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:10:05.985286 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2da36084-d99e-4531-ad81-83bba229fdc4 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:05.988860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4323bc6c-b2f6-49f8-952e-f0b90fa78303 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:05.994735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2da36084-d99e-4531-ad81-83bba229fdc4 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1553 microversion: 2.1 time: 0.155899 Jul 27 20:10:05.995321 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 145/300] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:05 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:05.996704 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4323bc6c-b2f6-49f8-952e-f0b90fa78303 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1255 microversion: 2.1 time: 0.083937 Jul 27 20:10:05.997290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 156/301] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:05 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1255 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:06.071929 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-117e4c59-fc9a-4d70-a4d2-8d2b5942890b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:06.072536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-117e4c59-fc9a-4d70-a4d2-8d2b5942890b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:06.078592 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-117e4c59-fc9a-4d70-a4d2-8d2b5942890b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:06.079045 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-117e4c59-fc9a-4d70-a4d2-8d2b5942890b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:06.079814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-117e4c59-fc9a-4d70-a4d2-8d2b5942890b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:06.080252 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-117e4c59-fc9a-4d70-a4d2-8d2b5942890b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:06.213896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-117e4c59-fc9a-4d70-a4d2-8d2b5942890b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:06.222955 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-117e4c59-fc9a-4d70-a4d2-8d2b5942890b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.155077 Jul 27 20:10:06.223638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 146/302] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:06 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:06.544889 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-045f6bc2-5bd8-465d-b7ce-c71e0d1e467f tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:06.545641 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-045f6bc2-5bd8-465d-b7ce-c71e0d1e467f tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:06.551839 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-045f6bc2-5bd8-465d-b7ce-c71e0d1e467f tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:06.552291 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-045f6bc2-5bd8-465d-b7ce-c71e0d1e467f tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:06.553086 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-045f6bc2-5bd8-465d-b7ce-c71e0d1e467f tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:06.553521 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-045f6bc2-5bd8-465d-b7ce-c71e0d1e467f tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:06.678275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-045f6bc2-5bd8-465d-b7ce-c71e0d1e467f tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:06.685696 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-045f6bc2-5bd8-465d-b7ce-c71e0d1e467f tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.145457 Jul 27 20:10:06.686258 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 157/303] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:06 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:07.015151 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-62312932-19f2-4eb6-9490-fbd96c2cfb9e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:07.015758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-62312932-19f2-4eb6-9490-fbd96c2cfb9e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:07.017122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1ea60643-55f1-4299-b462-6e017ecf4aeb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:07.017739 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1ea60643-55f1-4299-b462-6e017ecf4aeb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:07.022601 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-62312932-19f2-4eb6-9490-fbd96c2cfb9e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:07.023054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-62312932-19f2-4eb6-9490-fbd96c2cfb9e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:07.023818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-62312932-19f2-4eb6-9490-fbd96c2cfb9e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:07.024253 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-62312932-19f2-4eb6-9490-fbd96c2cfb9e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:07.024722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1ea60643-55f1-4299-b462-6e017ecf4aeb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:07.025207 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1ea60643-55f1-4299-b462-6e017ecf4aeb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:07.025982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1ea60643-55f1-4299-b462-6e017ecf4aeb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:07.026424 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1ea60643-55f1-4299-b462-6e017ecf4aeb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:07.096154 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1ea60643-55f1-4299-b462-6e017ecf4aeb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:07.104489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1ea60643-55f1-4299-b462-6e017ecf4aeb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1255 microversion: 2.1 time: 0.091172 Jul 27 20:10:07.105095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 158/304] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:07 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1255 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:07.164018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-62312932-19f2-4eb6-9490-fbd96c2cfb9e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:07.172310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-62312932-19f2-4eb6-9490-fbd96c2cfb9e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1553 microversion: 2.1 time: 0.160965 Jul 27 20:10:07.173266 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 147/305] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:07 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:07.243633 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-65ca8dd0-27ab-4ee7-a29d-03288ec68316 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:07.244228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-65ca8dd0-27ab-4ee7-a29d-03288ec68316 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:07.250180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-65ca8dd0-27ab-4ee7-a29d-03288ec68316 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:07.250624 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-65ca8dd0-27ab-4ee7-a29d-03288ec68316 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:07.251369 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-65ca8dd0-27ab-4ee7-a29d-03288ec68316 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:07.251800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-65ca8dd0-27ab-4ee7-a29d-03288ec68316 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:07.255866 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:10:07.386102 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-65ca8dd0-27ab-4ee7-a29d-03288ec68316 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:07.395293 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-65ca8dd0-27ab-4ee7-a29d-03288ec68316 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.155457 Jul 27 20:10:07.395859 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 159/306] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:07 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:07.707109 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6522a806-a5a6-41e4-9dfd-0e922601d94b tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:07.707762 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6522a806-a5a6-41e4-9dfd-0e922601d94b tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:07.714620 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6522a806-a5a6-41e4-9dfd-0e922601d94b tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:07.715060 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6522a806-a5a6-41e4-9dfd-0e922601d94b tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:07.715812 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6522a806-a5a6-41e4-9dfd-0e922601d94b tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:07.716239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6522a806-a5a6-41e4-9dfd-0e922601d94b tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:07.851195 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6522a806-a5a6-41e4-9dfd-0e922601d94b tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:07.858483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6522a806-a5a6-41e4-9dfd-0e922601d94b tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.155265 Jul 27 20:10:07.859036 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 148/307] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:07 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:08.125783 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c5e1c713-5a2b-438e-a133-0dc7e197d9be tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:08.126390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c5e1c713-5a2b-438e-a133-0dc7e197d9be tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:08.133529 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c5e1c713-5a2b-438e-a133-0dc7e197d9be tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:08.133970 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c5e1c713-5a2b-438e-a133-0dc7e197d9be tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:08.134718 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c5e1c713-5a2b-438e-a133-0dc7e197d9be tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:08.135147 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c5e1c713-5a2b-438e-a133-0dc7e197d9be tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:08.193710 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cf11ffe7-8c87-4937-8404-2b36b4943354 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:08.194283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c5e1c713-5a2b-438e-a133-0dc7e197d9be tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:08.194409 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cf11ffe7-8c87-4937-8404-2b36b4943354 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:08.200371 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cf11ffe7-8c87-4937-8404-2b36b4943354 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:08.200819 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cf11ffe7-8c87-4937-8404-2b36b4943354 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:08.201540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c5e1c713-5a2b-438e-a133-0dc7e197d9be tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1255 microversion: 2.1 time: 0.079675 Jul 27 20:10:08.201659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cf11ffe7-8c87-4937-8404-2b36b4943354 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:08.202051 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cf11ffe7-8c87-4937-8404-2b36b4943354 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:08.202176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 160/308] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:08 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1255 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:08.329229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cf11ffe7-8c87-4937-8404-2b36b4943354 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:08.337206 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cf11ffe7-8c87-4937-8404-2b36b4943354 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1553 microversion: 2.1 time: 0.147768 Jul 27 20:10:08.337765 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 149/309] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:08 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:08.415972 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-23c33477-ef3a-49f9-9e20-ade2d343e7f8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:08.416578 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-23c33477-ef3a-49f9-9e20-ade2d343e7f8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:08.422528 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-23c33477-ef3a-49f9-9e20-ade2d343e7f8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:08.422969 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-23c33477-ef3a-49f9-9e20-ade2d343e7f8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:08.423761 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-23c33477-ef3a-49f9-9e20-ade2d343e7f8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:08.424195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-23c33477-ef3a-49f9-9e20-ade2d343e7f8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:08.552892 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-23c33477-ef3a-49f9-9e20-ade2d343e7f8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:08.560363 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-23c33477-ef3a-49f9-9e20-ade2d343e7f8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.148192 Jul 27 20:10:08.560927 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 161/310] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:08 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:08.880861 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2739049c-0203-496e-a14d-a1322baa9040 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:08.881517 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2739049c-0203-496e-a14d-a1322baa9040 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:08.887640 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2739049c-0203-496e-a14d-a1322baa9040 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:08.888126 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2739049c-0203-496e-a14d-a1322baa9040 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:08.888858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2739049c-0203-496e-a14d-a1322baa9040 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:08.889347 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2739049c-0203-496e-a14d-a1322baa9040 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:09.023097 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2739049c-0203-496e-a14d-a1322baa9040 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:09.031238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2739049c-0203-496e-a14d-a1322baa9040 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.155426 Jul 27 20:10:09.031813 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 150/311] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:08 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:09.222167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cf9642a2-a512-41e0-b161-41c55b4afdab tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:09.222796 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cf9642a2-a512-41e0-b161-41c55b4afdab tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:09.229365 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf9642a2-a512-41e0-b161-41c55b4afdab tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:09.229821 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf9642a2-a512-41e0-b161-41c55b4afdab tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:09.230592 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf9642a2-a512-41e0-b161-41c55b4afdab tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:09.231035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf9642a2-a512-41e0-b161-41c55b4afdab tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:09.290604 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cf9642a2-a512-41e0-b161-41c55b4afdab tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:09.297971 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cf9642a2-a512-41e0-b161-41c55b4afdab tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1255 microversion: 2.1 time: 0.079802 Jul 27 20:10:09.298535 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 162/312] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:09 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1255 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:09.359545 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f9ebbd85-8961-4a7f-9119-8d28a7caf6e3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:09.360082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f9ebbd85-8961-4a7f-9119-8d28a7caf6e3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:09.366785 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9ebbd85-8961-4a7f-9119-8d28a7caf6e3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:09.367230 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9ebbd85-8961-4a7f-9119-8d28a7caf6e3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:09.367987 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9ebbd85-8961-4a7f-9119-8d28a7caf6e3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:09.368420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9ebbd85-8961-4a7f-9119-8d28a7caf6e3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:09.503798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f9ebbd85-8961-4a7f-9119-8d28a7caf6e3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:09.511523 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f9ebbd85-8961-4a7f-9119-8d28a7caf6e3 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1553 microversion: 2.1 time: 0.155846 Jul 27 20:10:09.512075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 151/313] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:09 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:09.581210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2ff85fc7-3b68-4e0b-bbe1-87ba009b3182 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:09.581895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2ff85fc7-3b68-4e0b-bbe1-87ba009b3182 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:09.587855 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ff85fc7-3b68-4e0b-bbe1-87ba009b3182 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:09.588306 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ff85fc7-3b68-4e0b-bbe1-87ba009b3182 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:09.589101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ff85fc7-3b68-4e0b-bbe1-87ba009b3182 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:09.589539 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ff85fc7-3b68-4e0b-bbe1-87ba009b3182 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:09.738803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2ff85fc7-3b68-4e0b-bbe1-87ba009b3182 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:09.748951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2ff85fc7-3b68-4e0b-bbe1-87ba009b3182 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.171662 Jul 27 20:10:09.749551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 163/314] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:09 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:10.052889 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3cb9123a-4350-46ce-8c23-79898cea3a2e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:10.053744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3cb9123a-4350-46ce-8c23-79898cea3a2e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:10.073263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:10:10.074824 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3cb9123a-4350-46ce-8c23-79898cea3a2e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:10.075164 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3cb9123a-4350-46ce-8c23-79898cea3a2e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:10.083144 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3cb9123a-4350-46ce-8c23-79898cea3a2e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:10.083593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3cb9123a-4350-46ce-8c23-79898cea3a2e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:10.248727 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3cb9123a-4350-46ce-8c23-79898cea3a2e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:10.256919 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3cb9123a-4350-46ce-8c23-79898cea3a2e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.208525 Jul 27 20:10:10.258158 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 152/315] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:10 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:10.320531 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f2bcd4c1-60cd-46c7-8d97-3cc847c46785 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:10.321717 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f2bcd4c1-60cd-46c7-8d97-3cc847c46785 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:10.328688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2bcd4c1-60cd-46c7-8d97-3cc847c46785 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:10.329371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2bcd4c1-60cd-46c7-8d97-3cc847c46785 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:10.330144 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2bcd4c1-60cd-46c7-8d97-3cc847c46785 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:10.330866 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2bcd4c1-60cd-46c7-8d97-3cc847c46785 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:10.403989 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f2bcd4c1-60cd-46c7-8d97-3cc847c46785 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:10.412208 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f2bcd4c1-60cd-46c7-8d97-3cc847c46785 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1311 microversion: 2.1 time: 0.096773 Jul 27 20:10:10.412775 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 164/316] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:10 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:10.533204 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d2f7278c-b02d-4701-af5a-d540c0f118b0 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:10.534434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d2f7278c-b02d-4701-af5a-d540c0f118b0 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:10.541694 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2f7278c-b02d-4701-af5a-d540c0f118b0 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:10.542402 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2f7278c-b02d-4701-af5a-d540c0f118b0 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:10.543384 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2f7278c-b02d-4701-af5a-d540c0f118b0 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:10.545057 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2f7278c-b02d-4701-af5a-d540c0f118b0 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:10.778323 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d88be968-3110-4327-8de1-5d9bb11cd1b8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:10.779549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d88be968-3110-4327-8de1-5d9bb11cd1b8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:10.789648 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d88be968-3110-4327-8de1-5d9bb11cd1b8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:10.790396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d88be968-3110-4327-8de1-5d9bb11cd1b8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:10.791183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d88be968-3110-4327-8de1-5d9bb11cd1b8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:10.792140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d88be968-3110-4327-8de1-5d9bb11cd1b8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:10.883114 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d2f7278c-b02d-4701-af5a-d540c0f118b0 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:10.891993 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d2f7278c-b02d-4701-af5a-d540c0f118b0 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1553 microversion: 2.1 time: 0.363694 Jul 27 20:10:10.892880 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 153/317] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:10 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1553 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:11.106815 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-4d7d7a95-bf3d-47c6-9d51-979339932a32 req-985b5d6d-cd28-4b78-86fd-3235230d7905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "014540d5-3197-434b-8d02-c3f66e493c51", "name": "network-vif-plugged", "status": "completed", "tag": "7ded7eab-2013-4dcc-b623-82dc0e095b6a"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:10:11.119946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-4d7d7a95-bf3d-47c6-9d51-979339932a32 req-985b5d6d-cd28-4b78-86fd-3235230d7905 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:11.120986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-4d7d7a95-bf3d-47c6-9d51-979339932a32 req-985b5d6d-cd28-4b78-86fd-3235230d7905 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:11.135133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-4d7d7a95-bf3d-47c6-9d51-979339932a32 req-985b5d6d-cd28-4b78-86fd-3235230d7905 service nova] Creating event network-vif-plugged:7ded7eab-2013-4dcc-b623-82dc0e095b6a for instance 014540d5-3197-434b-8d02-c3f66e493c51 on hv-cinder-79987 Jul 27 20:10:11.141378 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-4d7d7a95-bf3d-47c6-9d51-979339932a32 req-985b5d6d-cd28-4b78-86fd-3235230d7905 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038375 Jul 27 20:10:11.142908 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 154/318] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:10:11.280902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-43f55ca3-a9ab-427e-ad65-d1ebcccd1372 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:11.281831 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-43f55ca3-a9ab-427e-ad65-d1ebcccd1372 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:11.296708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43f55ca3-a9ab-427e-ad65-d1ebcccd1372 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:11.297496 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43f55ca3-a9ab-427e-ad65-d1ebcccd1372 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:11.298289 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43f55ca3-a9ab-427e-ad65-d1ebcccd1372 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:11.298804 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43f55ca3-a9ab-427e-ad65-d1ebcccd1372 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:11.372462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d88be968-3110-4327-8de1-5d9bb11cd1b8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:11.388659 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d88be968-3110-4327-8de1-5d9bb11cd1b8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.617711 Jul 27 20:10:11.405097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 165/319] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:10 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:11.443048 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d12473cc-bb32-45bc-a999-5d816e0dbab3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:11.445998 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d12473cc-bb32-45bc-a999-5d816e0dbab3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:11.464438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d12473cc-bb32-45bc-a999-5d816e0dbab3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:11.468104 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d12473cc-bb32-45bc-a999-5d816e0dbab3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:11.470325 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d12473cc-bb32-45bc-a999-5d816e0dbab3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:11.470910 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d12473cc-bb32-45bc-a999-5d816e0dbab3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:11.585409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d12473cc-bb32-45bc-a999-5d816e0dbab3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:11.597895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d12473cc-bb32-45bc-a999-5d816e0dbab3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1317 microversion: 2.1 time: 0.164055 Jul 27 20:10:11.599865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 166/320] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:11 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:11.726467 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-43f55ca3-a9ab-427e-ad65-d1ebcccd1372 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:11.733179 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:10:11.740690 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-43f55ca3-a9ab-427e-ad65-d1ebcccd1372 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.465569 Jul 27 20:10:11.741668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 155/321] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:11 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:11.814480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-be6be069-1138-41a4-9515-82decbb84634 req-9929a54a-eeb8-4f02-bf16-4312c53ac82c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9d8996c-6f06-4199-97d5-ded471eb2e2e", "name": "network-vif-deleted", "tag": "0b42e5f2-e86d-4583-bdbf-99f0bab9f1ef"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:10:11.841263 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-be6be069-1138-41a4-9515-82decbb84634 req-9929a54a-eeb8-4f02-bf16-4312c53ac82c service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:11.843548 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-be6be069-1138-41a4-9515-82decbb84634 req-9929a54a-eeb8-4f02-bf16-4312c53ac82c service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:11.864151 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-be6be069-1138-41a4-9515-82decbb84634 req-9929a54a-eeb8-4f02-bf16-4312c53ac82c service nova] Creating event network-vif-deleted:0b42e5f2-e86d-4583-bdbf-99f0bab9f1ef for instance f9d8996c-6f06-4199-97d5-ded471eb2e2e on hv-cinder-79987 Jul 27 20:10:11.871461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-be6be069-1138-41a4-9515-82decbb84634 req-9929a54a-eeb8-4f02-bf16-4312c53ac82c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068031 Jul 27 20:10:11.875084 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 167/322] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:10:11.923163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8969b5ab-3720-43fc-8647-528f4000323c tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:11.923903 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8969b5ab-3720-43fc-8647-528f4000323c tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:11.932768 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8969b5ab-3720-43fc-8647-528f4000323c tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:11.933350 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8969b5ab-3720-43fc-8647-528f4000323c tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:11.934137 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8969b5ab-3720-43fc-8647-528f4000323c tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:11.934798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8969b5ab-3720-43fc-8647-528f4000323c tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:12.036898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8969b5ab-3720-43fc-8647-528f4000323c tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:12.051283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8969b5ab-3720-43fc-8647-528f4000323c tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1511 microversion: 2.1 time: 0.132228 Jul 27 20:10:12.052237 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 156/323] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:11 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1511 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:12.410718 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3895aa53-c026-4dad-b50d-c12e4e36ad34 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:12.411428 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3895aa53-c026-4dad-b50d-c12e4e36ad34 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:12.418201 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3895aa53-c026-4dad-b50d-c12e4e36ad34 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:12.418654 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3895aa53-c026-4dad-b50d-c12e4e36ad34 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:12.419440 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3895aa53-c026-4dad-b50d-c12e4e36ad34 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:12.419866 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3895aa53-c026-4dad-b50d-c12e4e36ad34 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:12.555275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3895aa53-c026-4dad-b50d-c12e4e36ad34 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:12.562634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3895aa53-c026-4dad-b50d-c12e4e36ad34 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.156643 Jul 27 20:10:12.563195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 168/324] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:12 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:12.621877 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-117d6cbe-045b-47b9-8122-aa6c0fb2f627 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:12.622725 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-117d6cbe-045b-47b9-8122-aa6c0fb2f627 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:12.630647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-117d6cbe-045b-47b9-8122-aa6c0fb2f627 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:12.631552 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-117d6cbe-045b-47b9-8122-aa6c0fb2f627 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:12.632539 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-117d6cbe-045b-47b9-8122-aa6c0fb2f627 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:12.632993 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-117d6cbe-045b-47b9-8122-aa6c0fb2f627 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:12.765091 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7ba9ec95-da30-42f3-9bf1-1827e484b037 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:12.766285 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7ba9ec95-da30-42f3-9bf1-1827e484b037 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:12.774299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7ba9ec95-da30-42f3-9bf1-1827e484b037 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:12.774838 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7ba9ec95-da30-42f3-9bf1-1827e484b037 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:12.775697 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7ba9ec95-da30-42f3-9bf1-1827e484b037 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:12.776765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7ba9ec95-da30-42f3-9bf1-1827e484b037 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:12.917503 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-117d6cbe-045b-47b9-8122-aa6c0fb2f627 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:12.926054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-117d6cbe-045b-47b9-8122-aa6c0fb2f627 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.308327 Jul 27 20:10:12.929008 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 157/325] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:12 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:13.006421 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7ba9ec95-da30-42f3-9bf1-1827e484b037 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:13.020044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7ba9ec95-da30-42f3-9bf1-1827e484b037 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.257770 Jul 27 20:10:13.021300 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 169/326] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:12 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:13.073221 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-46a510e7-9bf7-44a6-af8e-29d1be5f56dd tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:13.073868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-46a510e7-9bf7-44a6-af8e-29d1be5f56dd tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:13.081217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-46a510e7-9bf7-44a6-af8e-29d1be5f56dd tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:13.082229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-46a510e7-9bf7-44a6-af8e-29d1be5f56dd tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:13.083293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-46a510e7-9bf7-44a6-af8e-29d1be5f56dd tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:13.084030 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-46a510e7-9bf7-44a6-af8e-29d1be5f56dd tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:13.160790 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-46a510e7-9bf7-44a6-af8e-29d1be5f56dd tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:13.169781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-46a510e7-9bf7-44a6-af8e-29d1be5f56dd tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1511 microversion: 2.1 time: 0.100333 Jul 27 20:10:13.181567 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 158/327] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:13 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1511 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:13.194464 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-174932f0-d044-4d1f-b493-c6d040fa2c68 req-90bf59a3-98e0-4822-88b0-208b3602d002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9d8996c-6f06-4199-97d5-ded471eb2e2e", "name": "network-vif-unplugged", "status": "completed", "tag": "0b42e5f2-e86d-4583-bdbf-99f0bab9f1ef"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:10:13.205147 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-174932f0-d044-4d1f-b493-c6d040fa2c68 req-90bf59a3-98e0-4822-88b0-208b3602d002 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:13.206329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-174932f0-d044-4d1f-b493-c6d040fa2c68 req-90bf59a3-98e0-4822-88b0-208b3602d002 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:13.220107 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-174932f0-d044-4d1f-b493-c6d040fa2c68 req-90bf59a3-98e0-4822-88b0-208b3602d002 service nova] Creating event network-vif-unplugged:0b42e5f2-e86d-4583-bdbf-99f0bab9f1ef for instance f9d8996c-6f06-4199-97d5-ded471eb2e2e on hv-cinder-79987 Jul 27 20:10:13.226103 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-174932f0-d044-4d1f-b493-c6d040fa2c68 req-90bf59a3-98e0-4822-88b0-208b3602d002 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035784 Jul 27 20:10:13.226934 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 170/328] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:10:13.589379 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9e324947-cf40-492a-b18d-6aa8811acc4d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:13.590338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9e324947-cf40-492a-b18d-6aa8811acc4d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:13.597380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9e324947-cf40-492a-b18d-6aa8811acc4d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:13.598320 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9e324947-cf40-492a-b18d-6aa8811acc4d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:13.599579 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9e324947-cf40-492a-b18d-6aa8811acc4d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:13.600247 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9e324947-cf40-492a-b18d-6aa8811acc4d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:13.779204 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9e324947-cf40-492a-b18d-6aa8811acc4d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:13.791717 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9e324947-cf40-492a-b18d-6aa8811acc4d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.211597 Jul 27 20:10:13.792629 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 159/329] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:13 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:13.950580 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c626f300-7281-4b30-a4eb-1b489ecbef76 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:13.951486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c626f300-7281-4b30-a4eb-1b489ecbef76 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:13.959641 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c626f300-7281-4b30-a4eb-1b489ecbef76 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:13.960187 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c626f300-7281-4b30-a4eb-1b489ecbef76 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:13.961242 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c626f300-7281-4b30-a4eb-1b489ecbef76 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:13.961767 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c626f300-7281-4b30-a4eb-1b489ecbef76 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:14.045478 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0b28a9ff-ffa0-413a-998b-ad4fb5fbd258 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:14.046815 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0b28a9ff-ffa0-413a-998b-ad4fb5fbd258 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:14.061134 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b28a9ff-ffa0-413a-998b-ad4fb5fbd258 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:14.061906 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b28a9ff-ffa0-413a-998b-ad4fb5fbd258 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:14.062841 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b28a9ff-ffa0-413a-998b-ad4fb5fbd258 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:14.063461 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b28a9ff-ffa0-413a-998b-ad4fb5fbd258 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:14.148132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c626f300-7281-4b30-a4eb-1b489ecbef76 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:14.178158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c626f300-7281-4b30-a4eb-1b489ecbef76 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.213098 Jul 27 20:10:14.180035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 171/330] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:13 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:14.190507 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3b37a5c3-6aa4-4b3f-8f22-809adb58edb6 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:14.200493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3b37a5c3-6aa4-4b3f-8f22-809adb58edb6 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:14.225953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3b37a5c3-6aa4-4b3f-8f22-809adb58edb6 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:14.226814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3b37a5c3-6aa4-4b3f-8f22-809adb58edb6 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:14.227614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3b37a5c3-6aa4-4b3f-8f22-809adb58edb6 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:14.228066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3b37a5c3-6aa4-4b3f-8f22-809adb58edb6 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:14.326393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3b37a5c3-6aa4-4b3f-8f22-809adb58edb6 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:14.336042 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3b37a5c3-6aa4-4b3f-8f22-809adb58edb6 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1511 microversion: 2.1 time: 0.149389 Jul 27 20:10:14.336627 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 172/331] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:14 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:14.365099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0b28a9ff-ffa0-413a-998b-ad4fb5fbd258 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:14.373163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0b28a9ff-ffa0-413a-998b-ad4fb5fbd258 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.331294 Jul 27 20:10:14.381161 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 160/332] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:14 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:14.813425 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7358702f-30f6-4faa-bcc5-612c917d0430 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:14.814033 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7358702f-30f6-4faa-bcc5-612c917d0430 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:14.822593 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7358702f-30f6-4faa-bcc5-612c917d0430 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:14.823259 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7358702f-30f6-4faa-bcc5-612c917d0430 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:14.824193 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7358702f-30f6-4faa-bcc5-612c917d0430 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:14.824778 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7358702f-30f6-4faa-bcc5-612c917d0430 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:14.976289 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7358702f-30f6-4faa-bcc5-612c917d0430 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:14.984047 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7358702f-30f6-4faa-bcc5-612c917d0430 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.174367 Jul 27 20:10:14.984611 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 173/333] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:14 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:15.199919 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b5f4171d-562d-4e08-bc84-66c1d831b874 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:15.200777 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b5f4171d-562d-4e08-bc84-66c1d831b874 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:15.217628 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b5f4171d-562d-4e08-bc84-66c1d831b874 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:15.218279 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b5f4171d-562d-4e08-bc84-66c1d831b874 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:15.219174 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b5f4171d-562d-4e08-bc84-66c1d831b874 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:15.219737 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b5f4171d-562d-4e08-bc84-66c1d831b874 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:15.356685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-41cd511a-4e42-49a3-9162-dcb86aaa5194 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:15.358179 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-41cd511a-4e42-49a3-9162-dcb86aaa5194 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:15.370579 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41cd511a-4e42-49a3-9162-dcb86aaa5194 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:15.372041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41cd511a-4e42-49a3-9162-dcb86aaa5194 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:15.375702 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41cd511a-4e42-49a3-9162-dcb86aaa5194 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:15.376165 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41cd511a-4e42-49a3-9162-dcb86aaa5194 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:15.407669 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b5f4171d-562d-4e08-bc84-66c1d831b874 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:15.417046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b5f4171d-562d-4e08-bc84-66c1d831b874 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.221070 Jul 27 20:10:15.417557 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 161/334] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:15 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:15.457177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-699de911-1703-4ab9-8836-bb3ef5474c4e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:15.459737 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-699de911-1703-4ab9-8836-bb3ef5474c4e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:15.467635 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-699de911-1703-4ab9-8836-bb3ef5474c4e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:15.468371 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-699de911-1703-4ab9-8836-bb3ef5474c4e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:15.469753 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-699de911-1703-4ab9-8836-bb3ef5474c4e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:15.470938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-699de911-1703-4ab9-8836-bb3ef5474c4e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:15.515291 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-41cd511a-4e42-49a3-9162-dcb86aaa5194 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:15.533280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-41cd511a-4e42-49a3-9162-dcb86aaa5194 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1511 microversion: 2.1 time: 0.180303 Jul 27 20:10:15.534498 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 174/335] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:15 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:15.962253 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-699de911-1703-4ab9-8836-bb3ef5474c4e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:15.969744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-699de911-1703-4ab9-8836-bb3ef5474c4e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.550491 Jul 27 20:10:15.970325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 162/336] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:15 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:16.006312 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6b506070-dc29-4875-aa99-606b6ca83f10 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:16.006931 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6b506070-dc29-4875-aa99-606b6ca83f10 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:16.014934 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6b506070-dc29-4875-aa99-606b6ca83f10 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:16.015573 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6b506070-dc29-4875-aa99-606b6ca83f10 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:16.016577 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6b506070-dc29-4875-aa99-606b6ca83f10 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:16.018918 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6b506070-dc29-4875-aa99-606b6ca83f10 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:16.194776 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6b506070-dc29-4875-aa99-606b6ca83f10 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:16.204759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6b506070-dc29-4875-aa99-606b6ca83f10 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.202581 Jul 27 20:10:16.205960 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 175/337] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:16 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:16.438887 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4232b66f-078f-4996-944e-526dff2cec0e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:16.439495 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4232b66f-078f-4996-944e-526dff2cec0e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:16.447794 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4232b66f-078f-4996-944e-526dff2cec0e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:16.448485 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4232b66f-078f-4996-944e-526dff2cec0e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:16.449477 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4232b66f-078f-4996-944e-526dff2cec0e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:16.450221 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4232b66f-078f-4996-944e-526dff2cec0e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:16.554575 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-60a1e80f-d2d4-4c3d-a9f9-6edb04dc7321 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:16.555558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-60a1e80f-d2d4-4c3d-a9f9-6edb04dc7321 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:16.563194 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-60a1e80f-d2d4-4c3d-a9f9-6edb04dc7321 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:16.563649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-60a1e80f-d2d4-4c3d-a9f9-6edb04dc7321 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:16.564422 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-60a1e80f-d2d4-4c3d-a9f9-6edb04dc7321 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:16.565454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-60a1e80f-d2d4-4c3d-a9f9-6edb04dc7321 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:16.635593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4232b66f-078f-4996-944e-526dff2cec0e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:16.643780 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4232b66f-078f-4996-944e-526dff2cec0e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.208854 Jul 27 20:10:16.644430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 163/338] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:16 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:16.646897 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-60a1e80f-d2d4-4c3d-a9f9-6edb04dc7321 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:16.655308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-60a1e80f-d2d4-4c3d-a9f9-6edb04dc7321 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1511 microversion: 2.1 time: 0.104473 Jul 27 20:10:16.655891 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 176/339] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:16 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1511 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:16.992475 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e9226835-43f1-45b5-9e8a-fc9bcdc32b29 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:16.992982 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e9226835-43f1-45b5-9e8a-fc9bcdc32b29 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:16.999134 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e9226835-43f1-45b5-9e8a-fc9bcdc32b29 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:16.999570 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e9226835-43f1-45b5-9e8a-fc9bcdc32b29 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:17.000329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e9226835-43f1-45b5-9e8a-fc9bcdc32b29 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:17.000755 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e9226835-43f1-45b5-9e8a-fc9bcdc32b29 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:17.136953 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e9226835-43f1-45b5-9e8a-fc9bcdc32b29 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:17.145322 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e9226835-43f1-45b5-9e8a-fc9bcdc32b29 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.156734 Jul 27 20:10:17.145897 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 164/340] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:16 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:17.227268 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-59b648db-623f-4e1e-844f-82b8252d3f61 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:17.228225 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-59b648db-623f-4e1e-844f-82b8252d3f61 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:17.230753 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:10:17.235805 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-59b648db-623f-4e1e-844f-82b8252d3f61 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:17.236262 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-59b648db-623f-4e1e-844f-82b8252d3f61 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:17.238032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-59b648db-623f-4e1e-844f-82b8252d3f61 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:17.238617 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-59b648db-623f-4e1e-844f-82b8252d3f61 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:17.243348 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:10:17.375937 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-59b648db-623f-4e1e-844f-82b8252d3f61 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:17.384207 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-59b648db-623f-4e1e-844f-82b8252d3f61 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.160851 Jul 27 20:10:17.384775 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 177/341] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:17 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:17.665889 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e1a95618-93ca-4d30-b431-edd2105c2146 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:17.666490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e1a95618-93ca-4d30-b431-edd2105c2146 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:17.672374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1a95618-93ca-4d30-b431-edd2105c2146 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:17.672810 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1a95618-93ca-4d30-b431-edd2105c2146 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:17.673595 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1a95618-93ca-4d30-b431-edd2105c2146 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:17.674020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1a95618-93ca-4d30-b431-edd2105c2146 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:17.676888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0f7cf818-29df-4507-8a15-6263c659e497 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:17.677569 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0f7cf818-29df-4507-8a15-6263c659e497 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:17.683489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0f7cf818-29df-4507-8a15-6263c659e497 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:17.683937 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0f7cf818-29df-4507-8a15-6263c659e497 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:17.684694 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0f7cf818-29df-4507-8a15-6263c659e497 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:17.685156 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0f7cf818-29df-4507-8a15-6263c659e497 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:17.747439 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0f7cf818-29df-4507-8a15-6263c659e497 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:17.755547 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0f7cf818-29df-4507-8a15-6263c659e497 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1511 microversion: 2.1 time: 0.082456 Jul 27 20:10:17.756109 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 178/342] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:17 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1511 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:17.804302 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e1a95618-93ca-4d30-b431-edd2105c2146 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:17.811560 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e1a95618-93ca-4d30-b431-edd2105c2146 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.149553 Jul 27 20:10:17.812111 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 165/343] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:17 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:18.166723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-046179c6-987b-4eac-ae67-dc555e3f49f0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:18.167361 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-046179c6-987b-4eac-ae67-dc555e3f49f0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:18.174088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-046179c6-987b-4eac-ae67-dc555e3f49f0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:18.174965 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-046179c6-987b-4eac-ae67-dc555e3f49f0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:18.175921 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-046179c6-987b-4eac-ae67-dc555e3f49f0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:18.176361 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-046179c6-987b-4eac-ae67-dc555e3f49f0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:18.315970 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-046179c6-987b-4eac-ae67-dc555e3f49f0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:18.323992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-046179c6-987b-4eac-ae67-dc555e3f49f0 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.161059 Jul 27 20:10:18.324572 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 179/344] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:18 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:18.405199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cd64737e-1e9d-45cd-a1e8-8637a1924468 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:18.405878 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cd64737e-1e9d-45cd-a1e8-8637a1924468 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:18.412318 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd64737e-1e9d-45cd-a1e8-8637a1924468 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:18.412829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd64737e-1e9d-45cd-a1e8-8637a1924468 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:18.413626 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd64737e-1e9d-45cd-a1e8-8637a1924468 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:18.414267 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd64737e-1e9d-45cd-a1e8-8637a1924468 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:18.558178 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cd64737e-1e9d-45cd-a1e8-8637a1924468 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:18.567588 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cd64737e-1e9d-45cd-a1e8-8637a1924468 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.166122 Jul 27 20:10:18.569427 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 166/345] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:18 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:18.776861 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6eae1618-53ce-43c3-91f9-bde05eb9ede5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:18.777849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6eae1618-53ce-43c3-91f9-bde05eb9ede5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:18.785714 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6eae1618-53ce-43c3-91f9-bde05eb9ede5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:18.786288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6eae1618-53ce-43c3-91f9-bde05eb9ede5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:18.787615 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6eae1618-53ce-43c3-91f9-bde05eb9ede5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:18.788143 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6eae1618-53ce-43c3-91f9-bde05eb9ede5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:18.831604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6a202a06-8d25-4ed0-93cb-760e321e06f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:18.832301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6a202a06-8d25-4ed0-93cb-760e321e06f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:18.838384 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6a202a06-8d25-4ed0-93cb-760e321e06f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:18.838826 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6a202a06-8d25-4ed0-93cb-760e321e06f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:18.839588 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6a202a06-8d25-4ed0-93cb-760e321e06f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:18.840017 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6a202a06-8d25-4ed0-93cb-760e321e06f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:18.854029 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6eae1618-53ce-43c3-91f9-bde05eb9ede5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:18.862820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6eae1618-53ce-43c3-91f9-bde05eb9ede5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1511 microversion: 2.1 time: 0.089778 Jul 27 20:10:18.863387 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 180/346] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:18 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1511 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:18.972496 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6a202a06-8d25-4ed0-93cb-760e321e06f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:18.979836 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6a202a06-8d25-4ed0-93cb-760e321e06f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.152175 Jul 27 20:10:18.980389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 167/347] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:18 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:19.345636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bba8037b-5162-417f-ad54-8729aac54480 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:19.346775 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bba8037b-5162-417f-ad54-8729aac54480 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:19.353208 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bba8037b-5162-417f-ad54-8729aac54480 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:19.353661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bba8037b-5162-417f-ad54-8729aac54480 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:19.354420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bba8037b-5162-417f-ad54-8729aac54480 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:19.354856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bba8037b-5162-417f-ad54-8729aac54480 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:19.485482 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bba8037b-5162-417f-ad54-8729aac54480 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:19.492810 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bba8037b-5162-417f-ad54-8729aac54480 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.151127 Jul 27 20:10:19.493410 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 181/348] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:19 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:19.590031 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6d632166-2127-4e7b-863a-659ee64dd72d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:19.590629 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6d632166-2127-4e7b-863a-659ee64dd72d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:19.596695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6d632166-2127-4e7b-863a-659ee64dd72d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:19.597116 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6d632166-2127-4e7b-863a-659ee64dd72d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:19.597901 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6d632166-2127-4e7b-863a-659ee64dd72d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:19.598332 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6d632166-2127-4e7b-863a-659ee64dd72d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:19.724733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6d632166-2127-4e7b-863a-659ee64dd72d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:19.732115 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6d632166-2127-4e7b-863a-659ee64dd72d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.145857 Jul 27 20:10:19.732669 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 168/349] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:19 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:19.887394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1085cd4c-362a-4a42-a380-dc6dca2f4dfb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:19.888007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1085cd4c-362a-4a42-a380-dc6dca2f4dfb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:19.894319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1085cd4c-362a-4a42-a380-dc6dca2f4dfb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:19.894764 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1085cd4c-362a-4a42-a380-dc6dca2f4dfb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:19.895520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1085cd4c-362a-4a42-a380-dc6dca2f4dfb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:19.895955 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1085cd4c-362a-4a42-a380-dc6dca2f4dfb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:19.956550 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1085cd4c-362a-4a42-a380-dc6dca2f4dfb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:19.964500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1085cd4c-362a-4a42-a380-dc6dca2f4dfb tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1511 microversion: 2.1 time: 0.083265 Jul 27 20:10:19.965085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 182/350] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:19 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1511 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:20.001618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1bf00058-1c6c-4998-aa0d-bce3e270eb13 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:20.002860 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1bf00058-1c6c-4998-aa0d-bce3e270eb13 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:20.008901 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1bf00058-1c6c-4998-aa0d-bce3e270eb13 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:20.009416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1bf00058-1c6c-4998-aa0d-bce3e270eb13 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:20.010180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1bf00058-1c6c-4998-aa0d-bce3e270eb13 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:20.010964 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1bf00058-1c6c-4998-aa0d-bce3e270eb13 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:20.137983 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1bf00058-1c6c-4998-aa0d-bce3e270eb13 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:20.145238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1bf00058-1c6c-4998-aa0d-bce3e270eb13 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.147644 Jul 27 20:10:20.145798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 169/351] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:19 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:20.514239 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-35c24097-4146-4199-a2f6-bb37b2fc4d29 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:20.514763 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-35c24097-4146-4199-a2f6-bb37b2fc4d29 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:20.521886 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-35c24097-4146-4199-a2f6-bb37b2fc4d29 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:20.522341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-35c24097-4146-4199-a2f6-bb37b2fc4d29 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:20.523106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-35c24097-4146-4199-a2f6-bb37b2fc4d29 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:20.523547 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-35c24097-4146-4199-a2f6-bb37b2fc4d29 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:20.663485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-35c24097-4146-4199-a2f6-bb37b2fc4d29 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:20.675897 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-35c24097-4146-4199-a2f6-bb37b2fc4d29 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.163605 Jul 27 20:10:20.676497 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 183/352] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:20 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:20.756669 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a3d49551-1f0e-4f4a-9056-d7b8698be8c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:20.758012 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a3d49551-1f0e-4f4a-9056-d7b8698be8c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:20.766353 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a3d49551-1f0e-4f4a-9056-d7b8698be8c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:20.768814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a3d49551-1f0e-4f4a-9056-d7b8698be8c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:20.770149 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a3d49551-1f0e-4f4a-9056-d7b8698be8c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:20.770755 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a3d49551-1f0e-4f4a-9056-d7b8698be8c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:20.928330 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a3d49551-1f0e-4f4a-9056-d7b8698be8c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:20.937898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a3d49551-1f0e-4f4a-9056-d7b8698be8c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.187435 Jul 27 20:10:20.938738 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 170/353] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:20 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:20.985150 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0b091f1c-425b-4548-a94e-5fc1f3f56c12 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:20.985888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0b091f1c-425b-4548-a94e-5fc1f3f56c12 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:20.992778 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b091f1c-425b-4548-a94e-5fc1f3f56c12 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:20.993279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b091f1c-425b-4548-a94e-5fc1f3f56c12 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:20.994059 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b091f1c-425b-4548-a94e-5fc1f3f56c12 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:20.994495 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b091f1c-425b-4548-a94e-5fc1f3f56c12 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:21.060709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0b091f1c-425b-4548-a94e-5fc1f3f56c12 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:21.070402 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0b091f1c-425b-4548-a94e-5fc1f3f56c12 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1511 microversion: 2.1 time: 0.089134 Jul 27 20:10:21.071179 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 184/354] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:20 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1511 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:21.166880 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1bc7e36f-b094-4b8f-9144-85eb7fb10365 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:21.168851 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1bc7e36f-b094-4b8f-9144-85eb7fb10365 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:21.176645 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1bc7e36f-b094-4b8f-9144-85eb7fb10365 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:21.177513 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1bc7e36f-b094-4b8f-9144-85eb7fb10365 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:21.178463 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1bc7e36f-b094-4b8f-9144-85eb7fb10365 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:21.179080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1bc7e36f-b094-4b8f-9144-85eb7fb10365 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:21.320747 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1bc7e36f-b094-4b8f-9144-85eb7fb10365 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:21.330098 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1bc7e36f-b094-4b8f-9144-85eb7fb10365 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.166675 Jul 27 20:10:21.339688 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 171/355] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:21 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:21.703577 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-754dc5db-cc9b-4465-ba5f-b7e396a04c13 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:21.704249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-754dc5db-cc9b-4465-ba5f-b7e396a04c13 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:21.710793 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-754dc5db-cc9b-4465-ba5f-b7e396a04c13 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:21.711242 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-754dc5db-cc9b-4465-ba5f-b7e396a04c13 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:21.712000 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-754dc5db-cc9b-4465-ba5f-b7e396a04c13 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:21.712438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-754dc5db-cc9b-4465-ba5f-b7e396a04c13 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:21.839067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-754dc5db-cc9b-4465-ba5f-b7e396a04c13 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:21.847192 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-754dc5db-cc9b-4465-ba5f-b7e396a04c13 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.147349 Jul 27 20:10:21.847840 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 185/356] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:21 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:21.959814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ed35ce69-28e0-4118-ab07-94b93efb6106 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:21.960493 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ed35ce69-28e0-4118-ab07-94b93efb6106 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:21.966773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed35ce69-28e0-4118-ab07-94b93efb6106 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:21.967310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed35ce69-28e0-4118-ab07-94b93efb6106 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:21.968169 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed35ce69-28e0-4118-ab07-94b93efb6106 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:21.968684 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed35ce69-28e0-4118-ab07-94b93efb6106 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:21.988742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:10:22.091446 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a0d8031e-8b43-4609-b788-98d6c60f966a tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:22.092064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a0d8031e-8b43-4609-b788-98d6c60f966a tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:22.098996 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a0d8031e-8b43-4609-b788-98d6c60f966a tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:22.099454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a0d8031e-8b43-4609-b788-98d6c60f966a tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:22.100230 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a0d8031e-8b43-4609-b788-98d6c60f966a tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:22.100671 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a0d8031e-8b43-4609-b788-98d6c60f966a tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:22.122409 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ed35ce69-28e0-4118-ab07-94b93efb6106 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:22.130699 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ed35ce69-28e0-4118-ab07-94b93efb6106 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.175339 Jul 27 20:10:22.131550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 172/357] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:21 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:22.173250 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a0d8031e-8b43-4609-b788-98d6c60f966a tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:22.181542 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a0d8031e-8b43-4609-b788-98d6c60f966a tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1511 microversion: 2.1 time: 0.093824 Jul 27 20:10:22.182305 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 186/358] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:22 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1511 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:22.351224 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-02b242f3-aeb8-4bc1-81f9-29fe51ee6c42 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:22.351786 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-02b242f3-aeb8-4bc1-81f9-29fe51ee6c42 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:22.357968 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02b242f3-aeb8-4bc1-81f9-29fe51ee6c42 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:22.358426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02b242f3-aeb8-4bc1-81f9-29fe51ee6c42 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:22.359199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02b242f3-aeb8-4bc1-81f9-29fe51ee6c42 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:22.359632 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02b242f3-aeb8-4bc1-81f9-29fe51ee6c42 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:22.502606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-02b242f3-aeb8-4bc1-81f9-29fe51ee6c42 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:22.510132 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-02b242f3-aeb8-4bc1-81f9-29fe51ee6c42 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.162736 Jul 27 20:10:22.510893 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 173/359] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:22 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:22.867774 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e1448337-3abc-40d0-bc04-5a642e062345 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:22.868391 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e1448337-3abc-40d0-bc04-5a642e062345 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:22.877125 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1448337-3abc-40d0-bc04-5a642e062345 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:22.877633 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1448337-3abc-40d0-bc04-5a642e062345 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:22.878771 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1448337-3abc-40d0-bc04-5a642e062345 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:22.879229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1448337-3abc-40d0-bc04-5a642e062345 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:23.022653 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e1448337-3abc-40d0-bc04-5a642e062345 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:23.030195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e1448337-3abc-40d0-bc04-5a642e062345 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.166300 Jul 27 20:10:23.030758 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 187/360] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:22 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:23.154230 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-03166354-4ba9-4ef7-ae30-d9b829ac2747 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:23.154970 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-03166354-4ba9-4ef7-ae30-d9b829ac2747 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:23.161136 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03166354-4ba9-4ef7-ae30-d9b829ac2747 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:23.161585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03166354-4ba9-4ef7-ae30-d9b829ac2747 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:23.162354 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03166354-4ba9-4ef7-ae30-d9b829ac2747 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:23.162796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03166354-4ba9-4ef7-ae30-d9b829ac2747 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:23.202352 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1c23d661-afde-4e3a-8c36-e56e3af1e2b9 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:23.202999 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1c23d661-afde-4e3a-8c36-e56e3af1e2b9 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:23.210027 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1c23d661-afde-4e3a-8c36-e56e3af1e2b9 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:23.210483 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1c23d661-afde-4e3a-8c36-e56e3af1e2b9 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:23.211255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1c23d661-afde-4e3a-8c36-e56e3af1e2b9 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:23.211692 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1c23d661-afde-4e3a-8c36-e56e3af1e2b9 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:23.277231 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1c23d661-afde-4e3a-8c36-e56e3af1e2b9 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:23.285330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1c23d661-afde-4e3a-8c36-e56e3af1e2b9 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1511 microversion: 2.1 time: 0.086746 Jul 27 20:10:23.285886 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 188/361] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:23 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1511 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:23.303703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-03166354-4ba9-4ef7-ae30-d9b829ac2747 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:23.311634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-03166354-4ba9-4ef7-ae30-d9b829ac2747 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.161567 Jul 27 20:10:23.323166 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 174/362] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:23 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:23.531531 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-96b75ce0-98e5-4ad4-8cb9-658b12e26a97 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:23.532135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-96b75ce0-98e5-4ad4-8cb9-658b12e26a97 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:23.538182 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-96b75ce0-98e5-4ad4-8cb9-658b12e26a97 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:23.538624 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-96b75ce0-98e5-4ad4-8cb9-658b12e26a97 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:23.539375 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-96b75ce0-98e5-4ad4-8cb9-658b12e26a97 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:23.539803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-96b75ce0-98e5-4ad4-8cb9-658b12e26a97 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:23.666914 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-96b75ce0-98e5-4ad4-8cb9-658b12e26a97 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:23.674863 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-96b75ce0-98e5-4ad4-8cb9-658b12e26a97 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.147159 Jul 27 20:10:23.675537 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 189/363] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:23 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:24.051973 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-14098ea6-6698-46e6-b6c5-4e0a903da0c9 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:24.052622 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-14098ea6-6698-46e6-b6c5-4e0a903da0c9 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:24.058643 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14098ea6-6698-46e6-b6c5-4e0a903da0c9 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:24.059093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14098ea6-6698-46e6-b6c5-4e0a903da0c9 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:24.059853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14098ea6-6698-46e6-b6c5-4e0a903da0c9 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:24.060290 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14098ea6-6698-46e6-b6c5-4e0a903da0c9 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:24.195329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-14098ea6-6698-46e6-b6c5-4e0a903da0c9 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:24.202704 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-14098ea6-6698-46e6-b6c5-4e0a903da0c9 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.155282 Jul 27 20:10:24.203263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 175/364] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:24 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:24.306209 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-27cc904e-616e-435d-8f78-2ccb3a826d7e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:24.306840 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-27cc904e-616e-435d-8f78-2ccb3a826d7e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:24.315522 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-27cc904e-616e-435d-8f78-2ccb3a826d7e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:24.316184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-27cc904e-616e-435d-8f78-2ccb3a826d7e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:24.317056 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-27cc904e-616e-435d-8f78-2ccb3a826d7e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:24.317497 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-27cc904e-616e-435d-8f78-2ccb3a826d7e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:24.335725 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-305016b4-9537-4a1e-90f5-1420747350ec tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:24.336713 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-305016b4-9537-4a1e-90f5-1420747350ec tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:24.342957 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-305016b4-9537-4a1e-90f5-1420747350ec tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:24.343650 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-305016b4-9537-4a1e-90f5-1420747350ec tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:24.344431 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-305016b4-9537-4a1e-90f5-1420747350ec tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:24.344871 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-305016b4-9537-4a1e-90f5-1420747350ec tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:24.404118 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-27cc904e-616e-435d-8f78-2ccb3a826d7e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:24.412927 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-27cc904e-616e-435d-8f78-2ccb3a826d7e tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1511 microversion: 2.1 time: 0.110507 Jul 27 20:10:24.413546 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 190/365] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:24 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1511 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:24.510244 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-305016b4-9537-4a1e-90f5-1420747350ec tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:24.517813 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-305016b4-9537-4a1e-90f5-1420747350ec tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.186761 Jul 27 20:10:24.518430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 176/366] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:24 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:24.695808 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f5efae79-66ce-41c6-b353-01db1175bde2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:24.696337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f5efae79-66ce-41c6-b353-01db1175bde2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:24.702417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f5efae79-66ce-41c6-b353-01db1175bde2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:24.702869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f5efae79-66ce-41c6-b353-01db1175bde2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:24.703629 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f5efae79-66ce-41c6-b353-01db1175bde2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:24.704066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f5efae79-66ce-41c6-b353-01db1175bde2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:24.840193 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f5efae79-66ce-41c6-b353-01db1175bde2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:24.849707 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f5efae79-66ce-41c6-b353-01db1175bde2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.158139 Jul 27 20:10:24.850278 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 191/367] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:24 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:25.224188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4db57e87-1836-4dcd-8b07-0d720dddaf25 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:25.224923 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4db57e87-1836-4dcd-8b07-0d720dddaf25 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:25.232910 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4db57e87-1836-4dcd-8b07-0d720dddaf25 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:25.233476 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4db57e87-1836-4dcd-8b07-0d720dddaf25 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:25.234338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4db57e87-1836-4dcd-8b07-0d720dddaf25 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:25.234870 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4db57e87-1836-4dcd-8b07-0d720dddaf25 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:25.412574 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4db57e87-1836-4dcd-8b07-0d720dddaf25 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:25.420361 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4db57e87-1836-4dcd-8b07-0d720dddaf25 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.201090 Jul 27 20:10:25.420921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 177/368] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:25 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:25.435585 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e3756444-147c-423b-a3d9-d0c8706ceba5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:25.447162 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e3756444-147c-423b-a3d9-d0c8706ceba5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:25.454138 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e3756444-147c-423b-a3d9-d0c8706ceba5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:25.454520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e3756444-147c-423b-a3d9-d0c8706ceba5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:25.456434 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e3756444-147c-423b-a3d9-d0c8706ceba5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:25.457122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e3756444-147c-423b-a3d9-d0c8706ceba5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:25.541931 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fba37d3b-1710-4912-bbd1-32910a3b772a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:25.542539 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fba37d3b-1710-4912-bbd1-32910a3b772a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:25.554947 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fba37d3b-1710-4912-bbd1-32910a3b772a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:25.555400 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fba37d3b-1710-4912-bbd1-32910a3b772a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:25.556189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fba37d3b-1710-4912-bbd1-32910a3b772a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:25.556627 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fba37d3b-1710-4912-bbd1-32910a3b772a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:25.583104 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e3756444-147c-423b-a3d9-d0c8706ceba5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:25.591323 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e3756444-147c-423b-a3d9-d0c8706ceba5 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1511 microversion: 2.1 time: 0.159563 Jul 27 20:10:25.591890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 192/369] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:25 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:25.731459 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fba37d3b-1710-4912-bbd1-32910a3b772a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:25.739448 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fba37d3b-1710-4912-bbd1-32910a3b772a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.203701 Jul 27 20:10:25.740005 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 178/370] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:25 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:25.871248 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-200db7b6-e1b5-44ac-8019-b48a3c6e6ef1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:25.871791 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-200db7b6-e1b5-44ac-8019-b48a3c6e6ef1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:25.878025 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-200db7b6-e1b5-44ac-8019-b48a3c6e6ef1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:25.878465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-200db7b6-e1b5-44ac-8019-b48a3c6e6ef1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:25.879218 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-200db7b6-e1b5-44ac-8019-b48a3c6e6ef1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:25.879679 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-200db7b6-e1b5-44ac-8019-b48a3c6e6ef1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:26.021373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-200db7b6-e1b5-44ac-8019-b48a3c6e6ef1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:26.024770 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:10:26.029916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-200db7b6-e1b5-44ac-8019-b48a3c6e6ef1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.162621 Jul 27 20:10:26.030551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 193/371] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:25 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:26.442029 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8d1b827e-a96f-455b-b860-996fd53d6b20 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:26.442885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8d1b827e-a96f-455b-b860-996fd53d6b20 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:26.449005 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d1b827e-a96f-455b-b860-996fd53d6b20 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:26.449465 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d1b827e-a96f-455b-b860-996fd53d6b20 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:26.450224 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d1b827e-a96f-455b-b860-996fd53d6b20 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:26.450664 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d1b827e-a96f-455b-b860-996fd53d6b20 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:26.583570 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8d1b827e-a96f-455b-b860-996fd53d6b20 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:26.590996 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8d1b827e-a96f-455b-b860-996fd53d6b20 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.153505 Jul 27 20:10:26.591556 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 179/372] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:26 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:26.613294 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9c8303aa-1e3d-4750-9e9e-0021ce812b63 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:26.613897 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9c8303aa-1e3d-4750-9e9e-0021ce812b63 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:26.620220 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9c8303aa-1e3d-4750-9e9e-0021ce812b63 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:26.620662 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9c8303aa-1e3d-4750-9e9e-0021ce812b63 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:26.621463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9c8303aa-1e3d-4750-9e9e-0021ce812b63 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:26.621894 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9c8303aa-1e3d-4750-9e9e-0021ce812b63 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:26.682653 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9c8303aa-1e3d-4750-9e9e-0021ce812b63 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:26.690796 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9c8303aa-1e3d-4750-9e9e-0021ce812b63 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1511 microversion: 2.1 time: 0.081634 Jul 27 20:10:26.691354 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 194/373] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:26 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1511 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:26.761370 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fa136fa6-7d3a-4c88-8bcf-79b829555edc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:26.761985 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fa136fa6-7d3a-4c88-8bcf-79b829555edc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:26.768447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fa136fa6-7d3a-4c88-8bcf-79b829555edc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:26.768898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fa136fa6-7d3a-4c88-8bcf-79b829555edc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:26.769723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fa136fa6-7d3a-4c88-8bcf-79b829555edc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:26.770160 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fa136fa6-7d3a-4c88-8bcf-79b829555edc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:26.910347 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fa136fa6-7d3a-4c88-8bcf-79b829555edc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:26.918226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fa136fa6-7d3a-4c88-8bcf-79b829555edc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.160551 Jul 27 20:10:26.919048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 180/374] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:26 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:27.051556 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-691940c9-4ce7-4404-9aa6-71122efc6b4d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:27.052240 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-691940c9-4ce7-4404-9aa6-71122efc6b4d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:27.058368 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-691940c9-4ce7-4404-9aa6-71122efc6b4d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:27.058894 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-691940c9-4ce7-4404-9aa6-71122efc6b4d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:27.059705 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-691940c9-4ce7-4404-9aa6-71122efc6b4d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:27.060142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-691940c9-4ce7-4404-9aa6-71122efc6b4d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:27.233825 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-691940c9-4ce7-4404-9aa6-71122efc6b4d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:27.242090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-691940c9-4ce7-4404-9aa6-71122efc6b4d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.194176 Jul 27 20:10:27.257142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 195/375] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:27 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:27.612349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-83904f09-6b67-4bbd-8652-6130b15a7871 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:27.613028 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-83904f09-6b67-4bbd-8652-6130b15a7871 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:27.619314 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83904f09-6b67-4bbd-8652-6130b15a7871 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:27.619522 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83904f09-6b67-4bbd-8652-6130b15a7871 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:27.620273 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83904f09-6b67-4bbd-8652-6130b15a7871 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:27.620720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83904f09-6b67-4bbd-8652-6130b15a7871 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:27.712033 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e083d9cc-4376-48dd-885b-2c557d6f070f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:27.713530 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e083d9cc-4376-48dd-885b-2c557d6f070f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:27.721848 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e083d9cc-4376-48dd-885b-2c557d6f070f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:27.722560 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e083d9cc-4376-48dd-885b-2c557d6f070f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:27.723503 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e083d9cc-4376-48dd-885b-2c557d6f070f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:27.724102 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e083d9cc-4376-48dd-885b-2c557d6f070f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:27.759991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e083d9cc-4376-48dd-885b-2c557d6f070f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:27.760439 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e083d9cc-4376-48dd-885b-2c557d6f070f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:27.760890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.objects.instance [None req-e083d9cc-4376-48dd-885b-2c557d6f070f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lazy-loading 'fault' on Instance uuid f9d8996c-6f06-4199-97d5-ded471eb2e2e {{(pid=117876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:10:27.808867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e083d9cc-4376-48dd-885b-2c557d6f070f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:27.818058 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e083d9cc-4376-48dd-885b-2c557d6f070f tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1350 microversion: 2.1 time: 0.110129 Jul 27 20:10:27.818734 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 196/376] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:27 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:27.834947 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-83904f09-6b67-4bbd-8652-6130b15a7871 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:27.843987 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-83904f09-6b67-4bbd-8652-6130b15a7871 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.236143 Jul 27 20:10:27.844648 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 181/377] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:27 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:27.941321 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f668329a-ce69-4b4e-87af-3d2c44021915 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:27.943507 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f668329a-ce69-4b4e-87af-3d2c44021915 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:27.951685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f668329a-ce69-4b4e-87af-3d2c44021915 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:27.952397 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f668329a-ce69-4b4e-87af-3d2c44021915 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:27.953380 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f668329a-ce69-4b4e-87af-3d2c44021915 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:27.953974 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f668329a-ce69-4b4e-87af-3d2c44021915 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:27.965477 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-3688405e-50b0-4765-b761-43a1df810b0a req-b6bb6b85-28b6-4364-bada-de779de5c67a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a92495d-74f4-4470-b9a4-919eb729c2a7", "tag": "f9060715-d759-4b5a-9395-c2ef1b01d78e"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:10:27.987680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-3688405e-50b0-4765-b761-43a1df810b0a req-b6bb6b85-28b6-4364-bada-de779de5c67a service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:27.988130 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-3688405e-50b0-4765-b761-43a1df810b0a req-b6bb6b85-28b6-4364-bada-de779de5c67a service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:28.148991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f668329a-ce69-4b4e-87af-3d2c44021915 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:28.159133 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f668329a-ce69-4b4e-87af-3d2c44021915 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.222607 Jul 27 20:10:28.160146 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 197/378] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:27 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:28.175140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-3688405e-50b0-4765-b761-43a1df810b0a req-b6bb6b85-28b6-4364-bada-de779de5c67a service nova] Creating event network-changed:f9060715-d759-4b5a-9395-c2ef1b01d78e for instance 8a92495d-74f4-4470-b9a4-919eb729c2a7 on hv-cinder-79987 Jul 27 20:10:28.180656 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-3688405e-50b0-4765-b761-43a1df810b0a req-b6bb6b85-28b6-4364-bada-de779de5c67a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226979 Jul 27 20:10:28.181593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 182/379] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:10:28.268125 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f90776bf-68b5-484b-b202-952dd5c4c680 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:28.268722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f90776bf-68b5-484b-b202-952dd5c4c680 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:28.276157 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f90776bf-68b5-484b-b202-952dd5c4c680 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:28.276711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f90776bf-68b5-484b-b202-952dd5c4c680 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:28.277556 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f90776bf-68b5-484b-b202-952dd5c4c680 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:28.277983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f90776bf-68b5-484b-b202-952dd5c4c680 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:28.418232 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f90776bf-68b5-484b-b202-952dd5c4c680 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:28.425741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f90776bf-68b5-484b-b202-952dd5c4c680 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.165873 Jul 27 20:10:28.426312 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 198/380] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:28 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:28.840411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dd0e0b8a-4baf-4734-9cdf-c57d358dce64 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:28.841167 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dd0e0b8a-4baf-4734-9cdf-c57d358dce64 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:28.848105 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd0e0b8a-4baf-4734-9cdf-c57d358dce64 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:28.848686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd0e0b8a-4baf-4734-9cdf-c57d358dce64 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:28.849489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd0e0b8a-4baf-4734-9cdf-c57d358dce64 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:28.849929 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd0e0b8a-4baf-4734-9cdf-c57d358dce64 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:28.866712 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e074f70c-5fe8-4d7d-82cc-e44ae3d2e339 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:28.867333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e074f70c-5fe8-4d7d-82cc-e44ae3d2e339 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:28.875329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e074f70c-5fe8-4d7d-82cc-e44ae3d2e339 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:28.876090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e074f70c-5fe8-4d7d-82cc-e44ae3d2e339 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:28.877796 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e074f70c-5fe8-4d7d-82cc-e44ae3d2e339 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:28.878842 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e074f70c-5fe8-4d7d-82cc-e44ae3d2e339 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:28.896206 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd0e0b8a-4baf-4734-9cdf-c57d358dce64 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:28.896740 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd0e0b8a-4baf-4734-9cdf-c57d358dce64 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:28.897436 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-dd0e0b8a-4baf-4734-9cdf-c57d358dce64 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lazy-loading 'fault' on Instance uuid f9d8996c-6f06-4199-97d5-ded471eb2e2e {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:10:28.962127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dd0e0b8a-4baf-4734-9cdf-c57d358dce64 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:28.970453 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dd0e0b8a-4baf-4734-9cdf-c57d358dce64 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1350 microversion: 2.1 time: 0.134476 Jul 27 20:10:28.971251 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 183/381] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:28 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:29.055387 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e074f70c-5fe8-4d7d-82cc-e44ae3d2e339 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:29.063518 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e074f70c-5fe8-4d7d-82cc-e44ae3d2e339 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.202182 Jul 27 20:10:29.064081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 199/382] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:28 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:29.181306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-10adeca0-e9c3-4ef9-a1bb-ef6f490fc664 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:29.181842 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-10adeca0-e9c3-4ef9-a1bb-ef6f490fc664 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:29.190363 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10adeca0-e9c3-4ef9-a1bb-ef6f490fc664 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:29.190942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10adeca0-e9c3-4ef9-a1bb-ef6f490fc664 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:29.191879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10adeca0-e9c3-4ef9-a1bb-ef6f490fc664 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:29.192473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10adeca0-e9c3-4ef9-a1bb-ef6f490fc664 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:29.377421 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-10adeca0-e9c3-4ef9-a1bb-ef6f490fc664 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:29.385252 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-10adeca0-e9c3-4ef9-a1bb-ef6f490fc664 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1519 microversion: 2.1 time: 0.208404 Jul 27 20:10:29.385844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 184/383] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:29 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1519 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:29.448278 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e50a5176-6e8c-4bfa-b341-8dc0ab148f72 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:29.448994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e50a5176-6e8c-4bfa-b341-8dc0ab148f72 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:29.457638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e50a5176-6e8c-4bfa-b341-8dc0ab148f72 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:29.458458 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e50a5176-6e8c-4bfa-b341-8dc0ab148f72 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:29.459453 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e50a5176-6e8c-4bfa-b341-8dc0ab148f72 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:29.459936 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e50a5176-6e8c-4bfa-b341-8dc0ab148f72 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:29.654255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e50a5176-6e8c-4bfa-b341-8dc0ab148f72 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:29.670683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e50a5176-6e8c-4bfa-b341-8dc0ab148f72 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.227014 Jul 27 20:10:29.671653 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 200/384] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:29 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:29.991544 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d611afb4-9c7d-45f7-8410-19ab3877d313 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:29.992752 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d611afb4-9c7d-45f7-8410-19ab3877d313 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:29.999440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d611afb4-9c7d-45f7-8410-19ab3877d313 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:29.999886 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d611afb4-9c7d-45f7-8410-19ab3877d313 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:30.000617 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d611afb4-9c7d-45f7-8410-19ab3877d313 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:30.001082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d611afb4-9c7d-45f7-8410-19ab3877d313 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:30.034604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d611afb4-9c7d-45f7-8410-19ab3877d313 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:30.035051 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d611afb4-9c7d-45f7-8410-19ab3877d313 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:30.035490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-d611afb4-9c7d-45f7-8410-19ab3877d313 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lazy-loading 'fault' on Instance uuid f9d8996c-6f06-4199-97d5-ded471eb2e2e {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:10:30.086574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7d7fdb4f-3870-4172-acab-125b5691cb6e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:30.087190 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7d7fdb4f-3870-4172-acab-125b5691cb6e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:30.094491 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d7fdb4f-3870-4172-acab-125b5691cb6e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:30.096078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d7fdb4f-3870-4172-acab-125b5691cb6e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:30.098333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d7fdb4f-3870-4172-acab-125b5691cb6e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:30.099399 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d7fdb4f-3870-4172-acab-125b5691cb6e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:30.099613 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d611afb4-9c7d-45f7-8410-19ab3877d313 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:30.110222 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d611afb4-9c7d-45f7-8410-19ab3877d313 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1350 microversion: 2.1 time: 0.122160 Jul 27 20:10:30.112127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 185/385] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:29 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1350 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:30.257792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7d7fdb4f-3870-4172-acab-125b5691cb6e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:30.265279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7d7fdb4f-3870-4172-acab-125b5691cb6e tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1314 microversion: 2.1 time: 0.182570 Jul 27 20:10:30.265839 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 201/386] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:30 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:30.407427 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5b076cfc-b954-477b-8813-aa08cb1102aa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:30.408212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5b076cfc-b954-477b-8813-aa08cb1102aa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:30.414871 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b076cfc-b954-477b-8813-aa08cb1102aa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:30.415376 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b076cfc-b954-477b-8813-aa08cb1102aa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:30.416174 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b076cfc-b954-477b-8813-aa08cb1102aa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:30.416615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b076cfc-b954-477b-8813-aa08cb1102aa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:30.553527 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5b076cfc-b954-477b-8813-aa08cb1102aa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:30.561135 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5b076cfc-b954-477b-8813-aa08cb1102aa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1499 microversion: 2.1 time: 0.157493 Jul 27 20:10:30.561696 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 186/387] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:30 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1499 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:30.582961 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a279b3e3-1468-4891-8112-8685d9478081 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:30.583661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a279b3e3-1468-4891-8112-8685d9478081 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:30.590486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a279b3e3-1468-4891-8112-8685d9478081 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:30.591322 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a279b3e3-1468-4891-8112-8685d9478081 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:30.592295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a279b3e3-1468-4891-8112-8685d9478081 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:30.592933 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a279b3e3-1468-4891-8112-8685d9478081 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:30.701335 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7d9fc6aa-fa4b-4e48-9616-91cee51cf3ab tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:30.702066 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7d9fc6aa-fa4b-4e48-9616-91cee51cf3ab tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:30.709933 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d9fc6aa-fa4b-4e48-9616-91cee51cf3ab tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:30.710671 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d9fc6aa-fa4b-4e48-9616-91cee51cf3ab tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:30.711621 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d9fc6aa-fa4b-4e48-9616-91cee51cf3ab tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:30.712256 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d9fc6aa-fa4b-4e48-9616-91cee51cf3ab tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:30.762159 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a279b3e3-1468-4891-8112-8685d9478081 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:30.771408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a279b3e3-1468-4891-8112-8685d9478081 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1515 microversion: 2.1 time: 0.192380 Jul 27 20:10:30.772734 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 202/388] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:30 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1515 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:30.905675 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7d9fc6aa-fa4b-4e48-9616-91cee51cf3ab tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:30.913594 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7d9fc6aa-fa4b-4e48-9616-91cee51cf3ab tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.215887 Jul 27 20:10:30.914317 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 187/389] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:30 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:31.133335 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-adfbcc35-94d3-4779-8e5d-b2b12bd178d1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:31.134622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-adfbcc35-94d3-4779-8e5d-b2b12bd178d1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:31.143045 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-adfbcc35-94d3-4779-8e5d-b2b12bd178d1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:31.144127 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-adfbcc35-94d3-4779-8e5d-b2b12bd178d1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:31.146364 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-adfbcc35-94d3-4779-8e5d-b2b12bd178d1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:31.147125 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-adfbcc35-94d3-4779-8e5d-b2b12bd178d1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:31.203946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-adfbcc35-94d3-4779-8e5d-b2b12bd178d1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:31.205395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-adfbcc35-94d3-4779-8e5d-b2b12bd178d1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:31.206597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.objects.instance [None req-adfbcc35-94d3-4779-8e5d-b2b12bd178d1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lazy-loading 'fault' on Instance uuid f9d8996c-6f06-4199-97d5-ded471eb2e2e {{(pid=117876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:10:31.259587 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-adfbcc35-94d3-4779-8e5d-b2b12bd178d1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4599fb9568454ba36b01038c345248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cab65810db34765966b2ca0332088be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:31.270933 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-adfbcc35-94d3-4779-8e5d-b2b12bd178d1 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 200 len: 1304 microversion: 2.1 time: 0.142779 Jul 27 20:10:31.271464 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 203/390] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:31 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 1304 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:31.287234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-90ece828-4210-41d5-8f19-0ff5579e71f8 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:31.287844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-90ece828-4210-41d5-8f19-0ff5579e71f8 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:31.296322 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-90ece828-4210-41d5-8f19-0ff5579e71f8 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:31.296895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-90ece828-4210-41d5-8f19-0ff5579e71f8 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:31.297808 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-90ece828-4210-41d5-8f19-0ff5579e71f8 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:31.298452 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-90ece828-4210-41d5-8f19-0ff5579e71f8 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:31.509968 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-90ece828-4210-41d5-8f19-0ff5579e71f8 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:31.518093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-90ece828-4210-41d5-8f19-0ff5579e71f8 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1464 microversion: 2.1 time: 0.234984 Jul 27 20:10:31.519017 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 188/391] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:31 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1464 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:31.565958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e4fb5b93-852c-4991-87fa-fc9e9d40a630 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:31.566577 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e4fb5b93-852c-4991-87fa-fc9e9d40a630 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:31.573019 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4fb5b93-852c-4991-87fa-fc9e9d40a630 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:31.573470 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4fb5b93-852c-4991-87fa-fc9e9d40a630 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:31.574229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4fb5b93-852c-4991-87fa-fc9e9d40a630 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:31.574657 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4fb5b93-852c-4991-87fa-fc9e9d40a630 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:31.601032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e4fb5b93-852c-4991-87fa-fc9e9d40a630 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Going to try to terminate instance {{(pid=117876) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:10:31.682312 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e4fb5b93-852c-4991-87fa-fc9e9d40a630 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "DELETE /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 204 len: 0 microversion: 2.1 time: 0.121598 Jul 27 20:10:31.682885 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 204/392] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 20:10:31 2022] DELETE /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:10:31.691487 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dc9cbdd7-c746-4491-967b-07c413817cda tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:31.692097 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dc9cbdd7-c746-4491-967b-07c413817cda tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:31.698292 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc9cbdd7-c746-4491-967b-07c413817cda tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:31.698746 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc9cbdd7-c746-4491-967b-07c413817cda tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:31.699504 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc9cbdd7-c746-4491-967b-07c413817cda tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:31.699948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc9cbdd7-c746-4491-967b-07c413817cda tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:31.703907 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:10:31.865128 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dc9cbdd7-c746-4491-967b-07c413817cda tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:31.872837 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dc9cbdd7-c746-4491-967b-07c413817cda tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1470 microversion: 2.1 time: 0.185643 Jul 27 20:10:31.873546 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 189/393] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:31 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1470 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:31.935844 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cb6e9cd4-188d-43e8-8c2c-b7b6f93a3d64 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:31.936547 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cb6e9cd4-188d-43e8-8c2c-b7b6f93a3d64 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:31.943482 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb6e9cd4-188d-43e8-8c2c-b7b6f93a3d64 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:31.943937 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb6e9cd4-188d-43e8-8c2c-b7b6f93a3d64 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:31.944702 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb6e9cd4-188d-43e8-8c2c-b7b6f93a3d64 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:31.945250 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb6e9cd4-188d-43e8-8c2c-b7b6f93a3d64 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:32.090167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cb6e9cd4-188d-43e8-8c2c-b7b6f93a3d64 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:32.098180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cb6e9cd4-188d-43e8-8c2c-b7b6f93a3d64 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.166498 Jul 27 20:10:32.098741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 205/394] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:31 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:32.170357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5d033ff6-21a7-4427-a8b0-7c91113588de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:10:32.172623 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5d033ff6-21a7-4427-a8b0-7c91113588de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:32.178610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d033ff6-21a7-4427-a8b0-7c91113588de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:32.179056 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d033ff6-21a7-4427-a8b0-7c91113588de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:32.179816 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d033ff6-21a7-4427-a8b0-7c91113588de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:32.180255 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d033ff6-21a7-4427-a8b0-7c91113588de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:32.203026 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-5d033ff6-21a7-4427-a8b0-7c91113588de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lazy-loading 'flavor' on Instance uuid ea33250b-8fd3-4d34-97cb-cde5923b7a67 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:10:32.292397 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-745b2e29-f76d-4541-9144-18076eca6e41 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:32.293105 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-745b2e29-f76d-4541-9144-18076eca6e41 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:32.299544 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-745b2e29-f76d-4541-9144-18076eca6e41 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:32.299992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-745b2e29-f76d-4541-9144-18076eca6e41 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:32.300764 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-745b2e29-f76d-4541-9144-18076eca6e41 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:32.301225 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-745b2e29-f76d-4541-9144-18076eca6e41 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:32.309793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5d033ff6-21a7-4427-a8b0-7c91113588de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "POST /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67/action" status: 200 len: 32 microversion: 2.1 time: 0.143286 Jul 27 20:10:32.310420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 190/395] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Jul 27 20:10:32 2022] POST /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67/action => generated 32 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 20:10:32.316280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-745b2e29-f76d-4541-9144-18076eca6e41 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] HTTP exception thrown: Instance f9d8996c-6f06-4199-97d5-ded471eb2e2e could not be found. Jul 27 20:10:32.321145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-745b2e29-f76d-4541-9144-18076eca6e41 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Request method failure captured: Jul 27 20:10:32.321145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e HTTP/1.1 Jul 27 20:10:32.321145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:10:32.321145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:10:32.321145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:10:32.321145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:10:32.321145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:10:32.321145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:10:32.321145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:10:32.321145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:10:32.321145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4Zs3-Y2kdx4uwOSSm_qADpqRdyrlX4eI0TQ3bLjmy2tLI8WaudPsb6pNiuyoz7IQd0Hk6MrD5Vzad7JR1ADQJnpCLsNEFfA40cn_cihKnil2RsvmVwPrUM6LHHgtmu6nUBasj28X-Efei6FydgtlOgjnXr9g-fhebywgZ_K9K7ag8y0 Jul 27 20:10:32.321145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:10:32.321145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:10:32.321145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:10:32.321145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:10:32.321145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:10:32.321145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:10:32.321145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 6cab65810db34765966b2ca0332088be Jul 27 20:10:32.321145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-DeleteServersTestJSON-2080011329 Jul 27 20:10:32.321145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:10:32.321145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:10:32.322635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6cab65810db34765966b2ca0332088be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6cab65810db34765966b2ca0332088be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6cab65810db34765966b2ca0332088be", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6cab65810db34765966b2ca0332088be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:10:32.322635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-DeleteServersTestJSON-2080011329 Jul 27 20:10:32.322635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 6cab65810db34765966b2ca0332088be Jul 27 20:10:32.322635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-DeleteServersTestJSON-2080011329 Jul 27 20:10:32.322635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-DeleteServersTestJSON-2080011329-project Jul 27 20:10:32.322635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:10:32.322635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:10:32.322635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: ec4599fb9568454ba36b01038c345248 Jul 27 20:10:32.322635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-DeleteServersTestJSON-2080011329-project Jul 27 20:10:32.322635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:10:32.322635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Instance f9d8996c-6f06-4199-97d5-ded471eb2e2e could not be found. Jul 27 20:10:32.322635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'id': 'f9d8996c-6f06-4199-97d5-ded471eb2e2e'} Jul 27 20:10:32.323465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:10:32.323465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:10:32.323465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:10:32.323465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:10:32.323465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:10:32.323465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:10:32.323465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:10:32.323465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:10:32.323465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:10:32.323465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:10:32.323465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9d8996c-6f06-4199-97d5-ded471eb2e2e could not be found. Jul 27 20:10:32.323465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:32.323465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:10:32.323465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:32.323465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:10:32.323465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:10:32.323465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:10:32.323465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:10:32.323465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:10:32.323465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:10:32.324865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:10:32.324865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:10:32.324865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:10:32.324865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:10:32.324865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:10:32.324865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:10:32.324865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:10:32.324865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9d8996c-6f06-4199-97d5-ded471eb2e2e could not be found. Jul 27 20:10:32.324865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:32.324865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:10:32.324865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:32.324865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:10:32.324865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:10:32.324865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:10:32.324865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:10:32.324865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:10:32.324865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9d8996c-6f06-4199-97d5-ded471eb2e2e could not be found. Jul 27 20:10:32.324865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:32.326121 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bd5d16e0-4e99-4a3d-ba79-a2491ee8dabd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:32.326210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-745b2e29-f76d-4541-9144-18076eca6e41 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Returning 404 to user: Instance f9d8996c-6f06-4199-97d5-ded471eb2e2e could not be found. {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:10:32.326293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bd5d16e0-4e99-4a3d-ba79-a2491ee8dabd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:32.326375 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-745b2e29-f76d-4541-9144-18076eca6e41 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 404 len: 111 microversion: 2.1 time: 0.034777 Jul 27 20:10:32.327251 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 206/396] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:32 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 20:10:32.333935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bd5d16e0-4e99-4a3d-ba79-a2491ee8dabd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:32.334386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bd5d16e0-4e99-4a3d-ba79-a2491ee8dabd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:32.335361 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bd5d16e0-4e99-4a3d-ba79-a2491ee8dabd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:32.336155 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bd5d16e0-4e99-4a3d-ba79-a2491ee8dabd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:32.443744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a6557bef-f81e-4e9a-b6c0-b9a79238ac72 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:32.446058 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a6557bef-f81e-4e9a-b6c0-b9a79238ac72 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:32.452055 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6557bef-f81e-4e9a-b6c0-b9a79238ac72 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:32.452711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6557bef-f81e-4e9a-b6c0-b9a79238ac72 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:32.453524 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6557bef-f81e-4e9a-b6c0-b9a79238ac72 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:32.453966 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6557bef-f81e-4e9a-b6c0-b9a79238ac72 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:32.467638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-a6557bef-f81e-4e9a-b6c0-b9a79238ac72 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] HTTP exception thrown: Instance f9d8996c-6f06-4199-97d5-ded471eb2e2e could not be found. Jul 27 20:10:32.469249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a6557bef-f81e-4e9a-b6c0-b9a79238ac72 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Request method failure captured: Jul 27 20:10:32.469249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e/os-volume_attachments HTTP/1.1 Jul 27 20:10:32.469249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:10:32.469249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:10:32.469249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:10:32.469249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:10:32.469249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:10:32.469249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:10:32.469249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:10:32.469249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:10:32.469249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4Zs3-Y2kdx4uwOSSm_qADpqRdyrlX4eI0TQ3bLjmy2tLI8WaudPsb6pNiuyoz7IQd0Hk6MrD5Vzad7JR1ADQJnpCLsNEFfA40cn_cihKnil2RsvmVwPrUM6LHHgtmu6nUBasj28X-Efei6FydgtlOgjnXr9g-fhebywgZ_K9K7ag8y0 Jul 27 20:10:32.469249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:10:32.469249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:10:32.469249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:10:32.469249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:10:32.469249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:10:32.469249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:10:32.469249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 6cab65810db34765966b2ca0332088be Jul 27 20:10:32.469249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-DeleteServersTestJSON-2080011329 Jul 27 20:10:32.469249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:10:32.469249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:10:32.471329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6cab65810db34765966b2ca0332088be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6cab65810db34765966b2ca0332088be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6cab65810db34765966b2ca0332088be", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6cab65810db34765966b2ca0332088be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:10:32.471329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-DeleteServersTestJSON-2080011329 Jul 27 20:10:32.471329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 6cab65810db34765966b2ca0332088be Jul 27 20:10:32.471329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-DeleteServersTestJSON-2080011329 Jul 27 20:10:32.471329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-DeleteServersTestJSON-2080011329-project Jul 27 20:10:32.471329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:10:32.471329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:10:32.471329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: ec4599fb9568454ba36b01038c345248 Jul 27 20:10:32.471329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-DeleteServersTestJSON-2080011329-project Jul 27 20:10:32.471329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:10:32.471329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Instance f9d8996c-6f06-4199-97d5-ded471eb2e2e could not be found. Jul 27 20:10:32.471329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'server_id': 'f9d8996c-6f06-4199-97d5-ded471eb2e2e'} Jul 27 20:10:32.472149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:10:32.472149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:10:32.472149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:10:32.472149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:10:32.472149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:10:32.472149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:10:32.472149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:10:32.472149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:10:32.472149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:10:32.472149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:10:32.472149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9d8996c-6f06-4199-97d5-ded471eb2e2e could not be found. Jul 27 20:10:32.472149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:32.472149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:10:32.472149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:32.472149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:10:32.472149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:10:32.472149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:10:32.472149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:10:32.472149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:10:32.472149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:10:32.473570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:10:32.473570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 27 20:10:32.473570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 20:10:32.473570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 27 20:10:32.473570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 20:10:32.473570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 27 20:10:32.473570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 27 20:10:32.473570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:10:32.473570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:10:32.473570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9d8996c-6f06-4199-97d5-ded471eb2e2e could not be found. Jul 27 20:10:32.473570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:32.473570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:10:32.473570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:32.473570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:10:32.473570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:10:32.473570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:10:32.473570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:10:32.473570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:10:32.473570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9d8996c-6f06-4199-97d5-ded471eb2e2e could not be found. Jul 27 20:10:32.473570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:32.475107 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a6557bef-f81e-4e9a-b6c0-b9a79238ac72 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Returning 404 to user: Instance f9d8996c-6f06-4199-97d5-ded471eb2e2e could not be found. {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:10:32.475192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bd5d16e0-4e99-4a3d-ba79-a2491ee8dabd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:32.475304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a6557bef-f81e-4e9a-b6c0-b9a79238ac72 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031986 Jul 27 20:10:32.475304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 207/397] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:10:32 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 20:10:32.478695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bd5d16e0-4e99-4a3d-ba79-a2491ee8dabd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1521 microversion: 2.1 time: 0.161528 Jul 27 20:10:32.479259 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 191/398] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:32 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:32.895794 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-edc957c6-686c-4f5f-9f34-b757d392b836 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:32.896415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-edc957c6-686c-4f5f-9f34-b757d392b836 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:32.902355 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-edc957c6-686c-4f5f-9f34-b757d392b836 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:32.902808 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-edc957c6-686c-4f5f-9f34-b757d392b836 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:32.903578 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-edc957c6-686c-4f5f-9f34-b757d392b836 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:32.904017 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-edc957c6-686c-4f5f-9f34-b757d392b836 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:33.047531 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-edc957c6-686c-4f5f-9f34-b757d392b836 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:33.055458 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-edc957c6-686c-4f5f-9f34-b757d392b836 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1470 microversion: 2.1 time: 0.164179 Jul 27 20:10:33.056028 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 208/399] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:32 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:33.118152 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c783e003-a75b-4f48-90de-d94816b201e0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:33.118763 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c783e003-a75b-4f48-90de-d94816b201e0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:33.124876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c783e003-a75b-4f48-90de-d94816b201e0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:33.125368 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c783e003-a75b-4f48-90de-d94816b201e0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:33.126129 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c783e003-a75b-4f48-90de-d94816b201e0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:33.126566 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c783e003-a75b-4f48-90de-d94816b201e0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:33.304917 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c783e003-a75b-4f48-90de-d94816b201e0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:33.312368 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c783e003-a75b-4f48-90de-d94816b201e0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.198142 Jul 27 20:10:33.312938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 192/400] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:33 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:33.499502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-56334ed8-3362-4f29-b202-e5a3bf494663 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:33.500028 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-56334ed8-3362-4f29-b202-e5a3bf494663 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:33.507513 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56334ed8-3362-4f29-b202-e5a3bf494663 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:33.507958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56334ed8-3362-4f29-b202-e5a3bf494663 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:33.508712 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56334ed8-3362-4f29-b202-e5a3bf494663 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:33.509178 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56334ed8-3362-4f29-b202-e5a3bf494663 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:33.526827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:10:33.644807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-56334ed8-3362-4f29-b202-e5a3bf494663 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:33.652272 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-56334ed8-3362-4f29-b202-e5a3bf494663 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1521 microversion: 2.1 time: 0.156630 Jul 27 20:10:33.654131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 209/401] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:33 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:33.688782 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-138df7de-9af7-4d91-92a2-712bdf420714 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:33.689916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-138df7de-9af7-4d91-92a2-712bdf420714 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:33.696569 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-138df7de-9af7-4d91-92a2-712bdf420714 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:33.697258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-138df7de-9af7-4d91-92a2-712bdf420714 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:33.698123 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-138df7de-9af7-4d91-92a2-712bdf420714 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:33.698639 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-138df7de-9af7-4d91-92a2-712bdf420714 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:33.714089 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-138df7de-9af7-4d91-92a2-712bdf420714 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] HTTP exception thrown: Instance f9d8996c-6f06-4199-97d5-ded471eb2e2e could not be found. Jul 27 20:10:33.719466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-138df7de-9af7-4d91-92a2-712bdf420714 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Request method failure captured: Jul 27 20:10:33.719466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e HTTP/1.1 Jul 27 20:10:33.719466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:10:33.719466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:10:33.719466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:10:33.719466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:10:33.719466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:10:33.719466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:10:33.719466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:10:33.719466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:10:33.719466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4Zs3-Y2kdx4uwOSSm_qADpqRdyrlX4eI0TQ3bLjmy2tLI8WaudPsb6pNiuyoz7IQd0Hk6MrD5Vzad7JR1ADQJnpCLsNEFfA40cn_cihKnil2RsvmVwPrUM6LHHgtmu6nUBasj28X-Efei6FydgtlOgjnXr9g-fhebywgZ_K9K7ag8y0 Jul 27 20:10:33.719466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:10:33.719466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:10:33.719466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:10:33.719466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:10:33.719466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:10:33.719466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:10:33.719466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: 6cab65810db34765966b2ca0332088be Jul 27 20:10:33.719466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-DeleteServersTestJSON-2080011329 Jul 27 20:10:33.719466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:10:33.719466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:10:33.721563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6cab65810db34765966b2ca0332088be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6cab65810db34765966b2ca0332088be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6cab65810db34765966b2ca0332088be", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6cab65810db34765966b2ca0332088be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:10:33.721563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-DeleteServersTestJSON-2080011329 Jul 27 20:10:33.721563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 6cab65810db34765966b2ca0332088be Jul 27 20:10:33.721563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-DeleteServersTestJSON-2080011329 Jul 27 20:10:33.721563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-DeleteServersTestJSON-2080011329-project Jul 27 20:10:33.721563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:10:33.721563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:10:33.721563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: ec4599fb9568454ba36b01038c345248 Jul 27 20:10:33.721563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-DeleteServersTestJSON-2080011329-project Jul 27 20:10:33.721563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:10:33.721563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Instance f9d8996c-6f06-4199-97d5-ded471eb2e2e could not be found. Jul 27 20:10:33.721563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'id': 'f9d8996c-6f06-4199-97d5-ded471eb2e2e'} Jul 27 20:10:33.722590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:10:33.722590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:10:33.722590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:10:33.722590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:10:33.722590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:10:33.722590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:10:33.722590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:10:33.722590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:10:33.722590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:10:33.722590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:10:33.722590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9d8996c-6f06-4199-97d5-ded471eb2e2e could not be found. Jul 27 20:10:33.722590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:10:33.722590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:10:33.722590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:10:33.722590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:10:33.722590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:10:33.722590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:10:33.722590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:10:33.722590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:10:33.722590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:10:33.725303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:10:33.725303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 20:10:33.725303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 20:10:33.725303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 20:10:33.725303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 20:10:33.725303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:10:33.725303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:10:33.725303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:10:33.725303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:10:33.725303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9d8996c-6f06-4199-97d5-ded471eb2e2e could not be found. Jul 27 20:10:33.725303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:10:33.725303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:10:33.725303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:10:33.725303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:10:33.725303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:10:33.725303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:10:33.725303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:10:33.725303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:10:33.725303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9d8996c-6f06-4199-97d5-ded471eb2e2e could not be found. Jul 27 20:10:33.725303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:10:33.726885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-138df7de-9af7-4d91-92a2-712bdf420714 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Returning 404 to user: Instance f9d8996c-6f06-4199-97d5-ded471eb2e2e could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:10:33.726885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-138df7de-9af7-4d91-92a2-712bdf420714 tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 404 len: 111 microversion: 2.1 time: 0.036302 Jul 27 20:10:33.726885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 193/402] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 20:10:33 2022] DELETE /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:10:33.731332 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-eb9808f5-860e-4ed6-bad3-49524a16d16d tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:33.731880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-eb9808f5-860e-4ed6-bad3-49524a16d16d tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] [instance: f9d8996c-6f06-4199-97d5-ded471eb2e2e] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:33.738809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eb9808f5-860e-4ed6-bad3-49524a16d16d tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:33.739333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eb9808f5-860e-4ed6-bad3-49524a16d16d tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:33.740370 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eb9808f5-860e-4ed6-bad3-49524a16d16d tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:33.740882 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eb9808f5-860e-4ed6-bad3-49524a16d16d tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:33.757139 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-eb9808f5-860e-4ed6-bad3-49524a16d16d tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] HTTP exception thrown: Instance f9d8996c-6f06-4199-97d5-ded471eb2e2e could not be found. Jul 27 20:10:33.758944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-eb9808f5-860e-4ed6-bad3-49524a16d16d tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Request method failure captured: Jul 27 20:10:33.758944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e HTTP/1.1 Jul 27 20:10:33.758944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:10:33.758944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:10:33.758944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:10:33.758944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:10:33.758944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:10:33.758944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:10:33.758944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:10:33.758944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:10:33.758944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4Zs3-Y2kdx4uwOSSm_qADpqRdyrlX4eI0TQ3bLjmy2tLI8WaudPsb6pNiuyoz7IQd0Hk6MrD5Vzad7JR1ADQJnpCLsNEFfA40cn_cihKnil2RsvmVwPrUM6LHHgtmu6nUBasj28X-Efei6FydgtlOgjnXr9g-fhebywgZ_K9K7ag8y0 Jul 27 20:10:33.758944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:10:33.758944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:10:33.758944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:10:33.758944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:10:33.758944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:10:33.758944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:10:33.758944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 6cab65810db34765966b2ca0332088be Jul 27 20:10:33.758944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-DeleteServersTestJSON-2080011329 Jul 27 20:10:33.758944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:10:33.758944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:10:33.760405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6cab65810db34765966b2ca0332088be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6cab65810db34765966b2ca0332088be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6cab65810db34765966b2ca0332088be", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6cab65810db34765966b2ca0332088be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:10:33.760405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-DeleteServersTestJSON-2080011329 Jul 27 20:10:33.760405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 6cab65810db34765966b2ca0332088be Jul 27 20:10:33.760405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-DeleteServersTestJSON-2080011329 Jul 27 20:10:33.760405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-DeleteServersTestJSON-2080011329-project Jul 27 20:10:33.760405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:10:33.760405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:10:33.760405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: ec4599fb9568454ba36b01038c345248 Jul 27 20:10:33.760405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-DeleteServersTestJSON-2080011329-project Jul 27 20:10:33.760405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:10:33.760405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Instance f9d8996c-6f06-4199-97d5-ded471eb2e2e could not be found. Jul 27 20:10:33.760405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'id': 'f9d8996c-6f06-4199-97d5-ded471eb2e2e'} Jul 27 20:10:33.761255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:10:33.761255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:10:33.761255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:10:33.761255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:10:33.761255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:10:33.761255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:10:33.761255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:10:33.761255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:10:33.761255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:10:33.761255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:10:33.761255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9d8996c-6f06-4199-97d5-ded471eb2e2e could not be found. Jul 27 20:10:33.761255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:33.761255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:10:33.761255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:33.761255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:10:33.761255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:10:33.761255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:10:33.761255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:10:33.761255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:10:33.761255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:10:33.762460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:10:33.762460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:10:33.762460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:10:33.762460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:10:33.762460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:10:33.762460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:10:33.762460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:10:33.762460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9d8996c-6f06-4199-97d5-ded471eb2e2e could not be found. Jul 27 20:10:33.762460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:33.762460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:10:33.762460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:33.762460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:10:33.762460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:10:33.762460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:10:33.762460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:10:33.762460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:10:33.762460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9d8996c-6f06-4199-97d5-ded471eb2e2e could not be found. Jul 27 20:10:33.762460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:33.764806 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-eb9808f5-860e-4ed6-bad3-49524a16d16d tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] Returning 404 to user: Instance f9d8996c-6f06-4199-97d5-ded471eb2e2e could not be found. {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:10:33.765973 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-eb9808f5-860e-4ed6-bad3-49524a16d16d tempest-DeleteServersTestJSON-2080011329 tempest-DeleteServersTestJSON-2080011329-project] 10.222.0.65 "GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e" status: 404 len: 111 microversion: 2.1 time: 0.039472 Jul 27 20:10:33.766731 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 210/403] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:33 2022] GET /compute/v2.1/servers/f9d8996c-6f06-4199-97d5-ded471eb2e2e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 20:10:34.082114 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0232d5b2-e0bd-4160-9590-c0eb20680ef5 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:34.082855 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0232d5b2-e0bd-4160-9590-c0eb20680ef5 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:34.094886 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0232d5b2-e0bd-4160-9590-c0eb20680ef5 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:34.095530 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0232d5b2-e0bd-4160-9590-c0eb20680ef5 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:34.096729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0232d5b2-e0bd-4160-9590-c0eb20680ef5 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:34.097315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0232d5b2-e0bd-4160-9590-c0eb20680ef5 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:34.333255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-b7d41ab9-7dd3-48d4-a11c-b6550cbdd530 req-45ead4ee-027b-4742-9845-c9631650f255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "014540d5-3197-434b-8d02-c3f66e493c51", "name": "network-vif-deleted", "tag": "7ded7eab-2013-4dcc-b623-82dc0e095b6a"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:10:34.347093 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-b7d41ab9-7dd3-48d4-a11c-b6550cbdd530 req-45ead4ee-027b-4742-9845-c9631650f255 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:34.347648 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-b7d41ab9-7dd3-48d4-a11c-b6550cbdd530 req-45ead4ee-027b-4742-9845-c9631650f255 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:34.375335 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-b7d41ab9-7dd3-48d4-a11c-b6550cbdd530 req-45ead4ee-027b-4742-9845-c9631650f255 service nova] Creating event network-vif-deleted:7ded7eab-2013-4dcc-b623-82dc0e095b6a for instance 014540d5-3197-434b-8d02-c3f66e493c51 on hv-cinder-79987 Jul 27 20:10:34.382176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-b7d41ab9-7dd3-48d4-a11c-b6550cbdd530 req-45ead4ee-027b-4742-9845-c9631650f255 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054316 Jul 27 20:10:34.383229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 211/404] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:10:34.389788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2b0da6f6-3f30-445e-9b0c-d2dd4d1775e7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:34.390541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2b0da6f6-3f30-445e-9b0c-d2dd4d1775e7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:34.398313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2b0da6f6-3f30-445e-9b0c-d2dd4d1775e7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:34.398759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2b0da6f6-3f30-445e-9b0c-d2dd4d1775e7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:34.400147 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2b0da6f6-3f30-445e-9b0c-d2dd4d1775e7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:34.400147 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2b0da6f6-3f30-445e-9b0c-d2dd4d1775e7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:34.570279 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0232d5b2-e0bd-4160-9590-c0eb20680ef5 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:34.578966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0232d5b2-e0bd-4160-9590-c0eb20680ef5 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1470 microversion: 2.1 time: 0.504562 Jul 27 20:10:34.579484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 194/405] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:34 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1470 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:34.583879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2b0da6f6-3f30-445e-9b0c-d2dd4d1775e7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:34.591904 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2b0da6f6-3f30-445e-9b0c-d2dd4d1775e7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.206188 Jul 27 20:10:34.592478 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 212/406] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:34 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:34.675860 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5ed50c11-c9f4-4791-9eff-e48aee133273 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:34.676483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5ed50c11-c9f4-4791-9eff-e48aee133273 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:34.682470 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5ed50c11-c9f4-4791-9eff-e48aee133273 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:34.682921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5ed50c11-c9f4-4791-9eff-e48aee133273 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:34.683694 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5ed50c11-c9f4-4791-9eff-e48aee133273 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:34.684132 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5ed50c11-c9f4-4791-9eff-e48aee133273 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:35.036151 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5ed50c11-c9f4-4791-9eff-e48aee133273 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:35.044037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5ed50c11-c9f4-4791-9eff-e48aee133273 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1521 microversion: 2.1 time: 0.372703 Jul 27 20:10:35.057813 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 195/407] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:34 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:35.600917 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7c31757e-83e7-43bf-99f9-7687fd70b251 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:35.601589 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7c31757e-83e7-43bf-99f9-7687fd70b251 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:35.608190 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7c31757e-83e7-43bf-99f9-7687fd70b251 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:35.608588 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7c31757e-83e7-43bf-99f9-7687fd70b251 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:35.609478 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7c31757e-83e7-43bf-99f9-7687fd70b251 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:35.609897 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7c31757e-83e7-43bf-99f9-7687fd70b251 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:35.616776 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-58cc7dd5-4a71-4c69-b4bb-8f98232335e5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:35.617426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-58cc7dd5-4a71-4c69-b4bb-8f98232335e5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:35.631841 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-58cc7dd5-4a71-4c69-b4bb-8f98232335e5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:35.632859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-58cc7dd5-4a71-4c69-b4bb-8f98232335e5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:35.634490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-58cc7dd5-4a71-4c69-b4bb-8f98232335e5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:35.635134 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-58cc7dd5-4a71-4c69-b4bb-8f98232335e5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:35.645603 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7c31757e-83e7-43bf-99f9-7687fd70b251 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:35.646237 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7c31757e-83e7-43bf-99f9-7687fd70b251 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:35.647186 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.objects.instance [None req-7c31757e-83e7-43bf-99f9-7687fd70b251 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lazy-loading 'fault' on Instance uuid 014540d5-3197-434b-8d02-c3f66e493c51 {{(pid=117876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:10:35.706691 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7c31757e-83e7-43bf-99f9-7687fd70b251 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:35.714353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7c31757e-83e7-43bf-99f9-7687fd70b251 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1304 microversion: 2.1 time: 0.118262 Jul 27 20:10:35.727955 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 213/408] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:35 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1304 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:36.066070 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c6e50c23-eb88-4dfe-9d3e-f8810d3e8e9a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:36.066839 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c6e50c23-eb88-4dfe-9d3e-f8810d3e8e9a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:36.074169 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c6e50c23-eb88-4dfe-9d3e-f8810d3e8e9a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:36.074903 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c6e50c23-eb88-4dfe-9d3e-f8810d3e8e9a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:36.075855 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c6e50c23-eb88-4dfe-9d3e-f8810d3e8e9a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:36.076459 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c6e50c23-eb88-4dfe-9d3e-f8810d3e8e9a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:36.121921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-58cc7dd5-4a71-4c69-b4bb-8f98232335e5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:36.130660 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-58cc7dd5-4a71-4c69-b4bb-8f98232335e5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.521572 Jul 27 20:10:36.131330 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 196/409] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:35 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:36.253593 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c6e50c23-eb88-4dfe-9d3e-f8810d3e8e9a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:36.261198 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c6e50c23-eb88-4dfe-9d3e-f8810d3e8e9a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1521 microversion: 2.1 time: 0.199915 Jul 27 20:10:36.261774 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 214/410] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:36 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:36.735352 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-34688489-56fc-4c13-8e39-7a0f6e6915a3 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:36.737338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-34688489-56fc-4c13-8e39-7a0f6e6915a3 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:36.744756 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-34688489-56fc-4c13-8e39-7a0f6e6915a3 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:36.745558 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-34688489-56fc-4c13-8e39-7a0f6e6915a3 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:36.746443 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-34688489-56fc-4c13-8e39-7a0f6e6915a3 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:36.747220 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-34688489-56fc-4c13-8e39-7a0f6e6915a3 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:36.789520 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-34688489-56fc-4c13-8e39-7a0f6e6915a3 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:36.790029 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-34688489-56fc-4c13-8e39-7a0f6e6915a3 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:36.790499 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-34688489-56fc-4c13-8e39-7a0f6e6915a3 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lazy-loading 'fault' on Instance uuid 014540d5-3197-434b-8d02-c3f66e493c51 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:10:36.856680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-34688489-56fc-4c13-8e39-7a0f6e6915a3 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6aba59bcb664b8bbc1469d71b6a276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '725810398afd433c9bff3fcd261b0f6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:36.878503 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-34688489-56fc-4c13-8e39-7a0f6e6915a3 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 200 len: 1304 microversion: 2.1 time: 0.147014 Jul 27 20:10:36.880527 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 197/411] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:36 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 1304 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:37.152696 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c6c07a52-8082-4dcf-9458-0d1b67c2dfac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:37.153374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c6c07a52-8082-4dcf-9458-0d1b67c2dfac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:37.161610 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c6c07a52-8082-4dcf-9458-0d1b67c2dfac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:37.162077 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c6c07a52-8082-4dcf-9458-0d1b67c2dfac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:37.162873 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c6c07a52-8082-4dcf-9458-0d1b67c2dfac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:37.163310 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c6c07a52-8082-4dcf-9458-0d1b67c2dfac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:37.283826 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c5f20dcd-e796-46a1-841d-b18b93838f42 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:37.284446 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c5f20dcd-e796-46a1-841d-b18b93838f42 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:37.290662 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5f20dcd-e796-46a1-841d-b18b93838f42 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:37.291206 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5f20dcd-e796-46a1-841d-b18b93838f42 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:37.292035 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5f20dcd-e796-46a1-841d-b18b93838f42 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:37.292766 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5f20dcd-e796-46a1-841d-b18b93838f42 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:37.311836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c6c07a52-8082-4dcf-9458-0d1b67c2dfac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:37.321066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c6c07a52-8082-4dcf-9458-0d1b67c2dfac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.172874 Jul 27 20:10:37.324383 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 215/412] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:37 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:37.613182 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c5f20dcd-e796-46a1-841d-b18b93838f42 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:37.621670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c5f20dcd-e796-46a1-841d-b18b93838f42 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1521 microversion: 2.1 time: 0.341855 Jul 27 20:10:37.622755 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 198/413] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:37 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:37.911620 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fa0fb3ee-ffe1-4985-9f58-7671f2b9f732 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:37.912246 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fa0fb3ee-ffe1-4985-9f58-7671f2b9f732 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] [instance: 014540d5-3197-434b-8d02-c3f66e493c51] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:37.921027 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa0fb3ee-ffe1-4985-9f58-7671f2b9f732 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:37.921919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa0fb3ee-ffe1-4985-9f58-7671f2b9f732 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:37.924438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa0fb3ee-ffe1-4985-9f58-7671f2b9f732 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:37.926562 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa0fb3ee-ffe1-4985-9f58-7671f2b9f732 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:37.950190 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-fa0fb3ee-ffe1-4985-9f58-7671f2b9f732 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] HTTP exception thrown: Instance 014540d5-3197-434b-8d02-c3f66e493c51 could not be found. Jul 27 20:10:37.952709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fa0fb3ee-ffe1-4985-9f58-7671f2b9f732 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Request method failure captured: Jul 27 20:10:37.952709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 HTTP/1.1 Jul 27 20:10:37.952709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:10:37.952709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:10:37.952709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:10:37.952709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:10:37.952709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:10:37.952709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:10:37.952709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:10:37.952709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:10:37.952709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4Zt9zI_i_7aeIxwhsxAVnYRP7mRZtUoo7e4yiyGSRWZCXRXpAD24AVJEfC4qmC2Lwkb-sRrfiVEruAbih6xpFuzvmzu6UZ2-w-5ua8D8pWfk1WvjiIElFjcZzvZYKeTwAIkik6C9ZfAMkyvV5K5zYRzwxNvwYDWDb6wNAa3oqx4Qx9g Jul 27 20:10:37.952709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:10:37.952709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:10:37.952709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:10:37.952709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:10:37.952709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:10:37.952709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:10:37.952709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 725810398afd433c9bff3fcd261b0f6f Jul 27 20:10:37.952709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-VolumesNegativeTest-536729523 Jul 27 20:10:37.952709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:10:37.952709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:10:37.954106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/725810398afd433c9bff3fcd261b0f6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/725810398afd433c9bff3fcd261b0f6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_725810398afd433c9bff3fcd261b0f6f", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/725810398afd433c9bff3fcd261b0f6f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:10:37.954106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-VolumesNegativeTest-536729523 Jul 27 20:10:37.954106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 725810398afd433c9bff3fcd261b0f6f Jul 27 20:10:37.954106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-VolumesNegativeTest-536729523 Jul 27 20:10:37.954106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-VolumesNegativeTest-536729523-project Jul 27 20:10:37.954106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:10:37.954106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:10:37.954106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: f6aba59bcb664b8bbc1469d71b6a276d Jul 27 20:10:37.954106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-VolumesNegativeTest-536729523-project Jul 27 20:10:37.954106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:10:37.954106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Instance 014540d5-3197-434b-8d02-c3f66e493c51 could not be found. Jul 27 20:10:37.954106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'id': '014540d5-3197-434b-8d02-c3f66e493c51'} Jul 27 20:10:37.955008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:10:37.955008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:10:37.955008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:10:37.955008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:10:37.955008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:10:37.955008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:10:37.955008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:10:37.955008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:10:37.955008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:10:37.955008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:10:37.955008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 014540d5-3197-434b-8d02-c3f66e493c51 could not be found. Jul 27 20:10:37.955008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:37.955008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:10:37.955008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:37.955008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:10:37.955008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:10:37.955008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:10:37.955008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:10:37.955008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:10:37.955008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:10:37.956427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:10:37.956427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:10:37.956427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:10:37.956427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:10:37.956427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:10:37.956427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:10:37.956427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:10:37.956427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 014540d5-3197-434b-8d02-c3f66e493c51 could not be found. Jul 27 20:10:37.956427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:37.956427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:10:37.956427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:37.956427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:10:37.956427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:10:37.956427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:10:37.956427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:10:37.956427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:10:37.956427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 014540d5-3197-434b-8d02-c3f66e493c51 could not be found. Jul 27 20:10:37.956427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:37.957939 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fa0fb3ee-ffe1-4985-9f58-7671f2b9f732 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] Returning 404 to user: Instance 014540d5-3197-434b-8d02-c3f66e493c51 could not be found. {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:10:37.959073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fa0fb3ee-ffe1-4985-9f58-7671f2b9f732 tempest-VolumesNegativeTest-536729523 tempest-VolumesNegativeTest-536729523-project] 10.222.0.65 "GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51" status: 404 len: 111 microversion: 2.1 time: 0.057093 Jul 27 20:10:37.959711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 216/414] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:37 2022] GET /compute/v2.1/servers/014540d5-3197-434b-8d02-c3f66e493c51 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:10:38.345347 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-387fc79f-78ea-4750-a4ea-fbf34f563473 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:38.346474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-387fc79f-78ea-4750-a4ea-fbf34f563473 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:38.358883 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:10:38.358883 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-387fc79f-78ea-4750-a4ea-fbf34f563473 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:38.358883 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-387fc79f-78ea-4750-a4ea-fbf34f563473 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:38.358883 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-387fc79f-78ea-4750-a4ea-fbf34f563473 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:38.362345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-387fc79f-78ea-4750-a4ea-fbf34f563473 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:38.509673 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-387fc79f-78ea-4750-a4ea-fbf34f563473 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:38.517831 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-387fc79f-78ea-4750-a4ea-fbf34f563473 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.178080 Jul 27 20:10:38.518394 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 199/415] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:38 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:38.647272 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-000a6b39-a72a-48b8-84a0-104b6c2d30b0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:38.648233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-000a6b39-a72a-48b8-84a0-104b6c2d30b0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:38.655715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-000a6b39-a72a-48b8-84a0-104b6c2d30b0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:38.656171 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-000a6b39-a72a-48b8-84a0-104b6c2d30b0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:38.657034 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-000a6b39-a72a-48b8-84a0-104b6c2d30b0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:38.657480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-000a6b39-a72a-48b8-84a0-104b6c2d30b0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:38.879524 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-000a6b39-a72a-48b8-84a0-104b6c2d30b0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:38.888180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-000a6b39-a72a-48b8-84a0-104b6c2d30b0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1521 microversion: 2.1 time: 0.246905 Jul 27 20:10:38.888744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 217/416] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:38 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:39.539438 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1914516c-41d8-48a6-bf9f-fa48cf99510c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:39.540124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1914516c-41d8-48a6-bf9f-fa48cf99510c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:39.546355 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1914516c-41d8-48a6-bf9f-fa48cf99510c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:39.546977 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1914516c-41d8-48a6-bf9f-fa48cf99510c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:39.547932 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1914516c-41d8-48a6-bf9f-fa48cf99510c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:39.549051 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1914516c-41d8-48a6-bf9f-fa48cf99510c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:39.703091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1914516c-41d8-48a6-bf9f-fa48cf99510c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:39.714078 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1914516c-41d8-48a6-bf9f-fa48cf99510c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.178813 Jul 27 20:10:39.719212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 200/417] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:39 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:39.910434 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3c89825f-a032-4008-bd83-aee4a5447d0e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:39.911376 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3c89825f-a032-4008-bd83-aee4a5447d0e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:39.920111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c89825f-a032-4008-bd83-aee4a5447d0e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:39.920635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c89825f-a032-4008-bd83-aee4a5447d0e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:39.922200 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c89825f-a032-4008-bd83-aee4a5447d0e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:39.922715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c89825f-a032-4008-bd83-aee4a5447d0e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:40.097875 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3c89825f-a032-4008-bd83-aee4a5447d0e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:40.105769 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3c89825f-a032-4008-bd83-aee4a5447d0e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1521 microversion: 2.1 time: 0.200068 Jul 27 20:10:40.106591 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 218/418] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:39 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:40.735179 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0f8249a2-3a33-4b63-8598-cbd79b9f102c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:40.735791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0f8249a2-3a33-4b63-8598-cbd79b9f102c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:40.745702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f8249a2-3a33-4b63-8598-cbd79b9f102c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:40.746155 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f8249a2-3a33-4b63-8598-cbd79b9f102c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:40.746892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f8249a2-3a33-4b63-8598-cbd79b9f102c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:40.747490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f8249a2-3a33-4b63-8598-cbd79b9f102c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:40.879562 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0f8249a2-3a33-4b63-8598-cbd79b9f102c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:40.887449 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0f8249a2-3a33-4b63-8598-cbd79b9f102c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.155983 Jul 27 20:10:40.887935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 201/419] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:40 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:41.129911 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-25c93b55-ed0e-433b-a448-7ad9a0c225af tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:41.130543 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-25c93b55-ed0e-433b-a448-7ad9a0c225af tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:41.137162 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-25c93b55-ed0e-433b-a448-7ad9a0c225af tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:41.137679 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-25c93b55-ed0e-433b-a448-7ad9a0c225af tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:41.138413 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-25c93b55-ed0e-433b-a448-7ad9a0c225af tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:41.138886 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-25c93b55-ed0e-433b-a448-7ad9a0c225af tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:41.148473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-a5b01335-3626-4ebe-bcd8-df6e75332806 req-652368a7-8684-4a0b-a34c-d90c80e0a1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a92495d-74f4-4470-b9a4-919eb729c2a7", "name": "network-vif-plugged", "status": "completed", "tag": "f9060715-d759-4b5a-9395-c2ef1b01d78e"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:10:41.176915 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-a5b01335-3626-4ebe-bcd8-df6e75332806 req-652368a7-8684-4a0b-a34c-d90c80e0a1a2 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:41.177389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-a5b01335-3626-4ebe-bcd8-df6e75332806 req-652368a7-8684-4a0b-a34c-d90c80e0a1a2 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:41.200389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-a5b01335-3626-4ebe-bcd8-df6e75332806 req-652368a7-8684-4a0b-a34c-d90c80e0a1a2 service nova] Creating event network-vif-plugged:f9060715-d759-4b5a-9395-c2ef1b01d78e for instance 8a92495d-74f4-4470-b9a4-919eb729c2a7 on hv-cinder-79987 Jul 27 20:10:41.215306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-a5b01335-3626-4ebe-bcd8-df6e75332806 req-652368a7-8684-4a0b-a34c-d90c80e0a1a2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070411 Jul 27 20:10:41.217295 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 202/420] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:10:41.302580 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-25c93b55-ed0e-433b-a448-7ad9a0c225af tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:41.311308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-25c93b55-ed0e-433b-a448-7ad9a0c225af tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1521 microversion: 2.1 time: 0.187737 Jul 27 20:10:41.312152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 219/421] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:41 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:41.601981 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4a40c3b1-ac91-430c-bb3d-152d02319930 tempest-VolumesTestJSON-570801043 tempest-VolumesTestJSON-570801043-project] Calling method '.version_select at 0x7fc7f0180790>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:41.649870 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4a40c3b1-ac91-430c-bb3d-152d02319930 tempest-VolumesTestJSON-570801043 tempest-VolumesTestJSON-570801043-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/29be8bb1-8bcc-429a-b21a-d3aa58948ddc" status: 200 len: 351 microversion: 2.1 time: 0.051869 Jul 27 20:10:41.650463 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 203/422] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Jul 27 20:10:41 2022] GET /compute/v2.1/os-volumes/29be8bb1-8bcc-429a-b21a-d3aa58948ddc => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:10:41.910731 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f12dec12-21e6-47eb-950d-012da6bb5ad9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:41.911550 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f12dec12-21e6-47eb-950d-012da6bb5ad9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:41.918988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f12dec12-21e6-47eb-950d-012da6bb5ad9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:41.919555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f12dec12-21e6-47eb-950d-012da6bb5ad9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:41.920439 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f12dec12-21e6-47eb-950d-012da6bb5ad9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:41.921000 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f12dec12-21e6-47eb-950d-012da6bb5ad9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:42.060229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f12dec12-21e6-47eb-950d-012da6bb5ad9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:42.069924 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f12dec12-21e6-47eb-950d-012da6bb5ad9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.164324 Jul 27 20:10:42.070945 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 220/423] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:41 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:42.334487 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5ff5ebd0-bc63-4188-816f-7e34fb2668a0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:42.335144 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5ff5ebd0-bc63-4188-816f-7e34fb2668a0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:42.341684 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5ff5ebd0-bc63-4188-816f-7e34fb2668a0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:42.342134 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5ff5ebd0-bc63-4188-816f-7e34fb2668a0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:42.342901 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5ff5ebd0-bc63-4188-816f-7e34fb2668a0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:42.343342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5ff5ebd0-bc63-4188-816f-7e34fb2668a0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:42.471816 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5ff5ebd0-bc63-4188-816f-7e34fb2668a0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:42.479191 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5ff5ebd0-bc63-4188-816f-7e34fb2668a0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1521 microversion: 2.1 time: 0.148969 Jul 27 20:10:42.479746 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 204/424] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:42 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:42.994808 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-dbea35a3-5edc-4d47-9cca-7f99c5b2dc89 tempest-VolumesTestJSON-570801043 tempest-VolumesTestJSON-570801043-project] Calling method '.version_select at 0x7fc7f0123a60>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:43.045026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-dbea35a3-5edc-4d47-9cca-7f99c5b2dc89 tempest-VolumesTestJSON-570801043 tempest-VolumesTestJSON-570801043-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/d9f764c3-c0b0-4d67-9c46-5563d5bbd3db" status: 200 len: 351 microversion: 2.1 time: 0.054193 Jul 27 20:10:43.045686 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 221/425] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Jul 27 20:10:42 2022] GET /compute/v2.1/os-volumes/d9f764c3-c0b0-4d67-9c46-5563d5bbd3db => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:10:43.100257 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f8d2c3e2-b8c1-4242-8619-509db2ec9180 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:43.100900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f8d2c3e2-b8c1-4242-8619-509db2ec9180 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:43.109459 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8d2c3e2-b8c1-4242-8619-509db2ec9180 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:43.110289 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8d2c3e2-b8c1-4242-8619-509db2ec9180 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:43.111288 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8d2c3e2-b8c1-4242-8619-509db2ec9180 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:43.112031 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8d2c3e2-b8c1-4242-8619-509db2ec9180 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:43.304626 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f8d2c3e2-b8c1-4242-8619-509db2ec9180 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:43.307522 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:10:43.334317 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f8d2c3e2-b8c1-4242-8619-509db2ec9180 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1359 microversion: 2.1 time: 0.240056 Jul 27 20:10:43.334904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 205/426] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:43 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:43.499675 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1f9943e1-bee1-46a5-920a-2165cdd0beff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:43.500302 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1f9943e1-bee1-46a5-920a-2165cdd0beff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:43.502684 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:10:43.510084 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f9943e1-bee1-46a5-920a-2165cdd0beff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:43.510549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f9943e1-bee1-46a5-920a-2165cdd0beff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:43.511337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f9943e1-bee1-46a5-920a-2165cdd0beff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:43.511783 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f9943e1-bee1-46a5-920a-2165cdd0beff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:43.643332 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1f9943e1-bee1-46a5-920a-2165cdd0beff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:43.650838 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1f9943e1-bee1-46a5-920a-2165cdd0beff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1521 microversion: 2.1 time: 0.155069 Jul 27 20:10:43.651359 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 222/427] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:43 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:44.356193 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7c58791a-1748-469e-87bb-ee0521d42918 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:44.357029 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7c58791a-1748-469e-87bb-ee0521d42918 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:44.364117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c58791a-1748-469e-87bb-ee0521d42918 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:44.364881 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c58791a-1748-469e-87bb-ee0521d42918 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:44.366038 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c58791a-1748-469e-87bb-ee0521d42918 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:44.366510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c58791a-1748-469e-87bb-ee0521d42918 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:44.448591 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8cd7e774-bd7e-4bbf-b0f4-36ad541bd2c6 tempest-VolumesTestJSON-570801043 tempest-VolumesTestJSON-570801043-project] Calling method '.version_select at 0x7fc7f01239d0>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:44.500528 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8cd7e774-bd7e-4bbf-b0f4-36ad541bd2c6 tempest-VolumesTestJSON-570801043 tempest-VolumesTestJSON-570801043-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/468e3eec-21dd-4df5-85bb-1e13a97d5582" status: 200 len: 351 microversion: 2.1 time: 0.055948 Jul 27 20:10:44.501879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 223/428] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Jul 27 20:10:44 2022] GET /compute/v2.1/os-volumes/468e3eec-21dd-4df5-85bb-1e13a97d5582 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:10:44.514443 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e2b8c8ef-8028-4c3e-a288-5d9d78805b2a tempest-VolumesTestJSON-570801043 tempest-VolumesTestJSON-570801043-project] Calling method '.version_select at 0x7fc7f0109c10>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:44.599483 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e2b8c8ef-8028-4c3e-a288-5d9d78805b2a tempest-VolumesTestJSON-570801043 tempest-VolumesTestJSON-570801043-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.089057 Jul 27 20:10:44.608454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 224/429] 10.222.0.65 () {58 vars in 1134 bytes} [Wed Jul 27 20:10:44 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:44.613818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-83d48893-ac6c-4c23-9644-03a5945ec6bb tempest-VolumesTestJSON-570801043 tempest-VolumesTestJSON-570801043-project] Calling method '.version_select at 0x7fc7f0208790>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:44.616728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7c58791a-1748-469e-87bb-ee0521d42918 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:44.624718 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7c58791a-1748-469e-87bb-ee0521d42918 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1550 microversion: 2.1 time: 0.272811 Jul 27 20:10:44.625307 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 206/430] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:44 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1550 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:44.647478 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-43935a8c-406f-4aba-bcc4-5e3c58da0f31 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:44.648379 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-43935a8c-406f-4aba-bcc4-5e3c58da0f31 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:44.654806 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43935a8c-406f-4aba-bcc4-5e3c58da0f31 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:44.655396 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43935a8c-406f-4aba-bcc4-5e3c58da0f31 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:44.656255 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43935a8c-406f-4aba-bcc4-5e3c58da0f31 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:44.656766 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43935a8c-406f-4aba-bcc4-5e3c58da0f31 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:44.709622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-83d48893-ac6c-4c23-9644-03a5945ec6bb tempest-VolumesTestJSON-570801043 tempest-VolumesTestJSON-570801043-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.099706 Jul 27 20:10:44.710224 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 225/431] 10.222.0.65 () {58 vars in 1149 bytes} [Wed Jul 27 20:10:44 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:10:44.715148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0a3aa598-c21e-443f-a59a-f273ef47fa9d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:44.715970 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0a3aa598-c21e-443f-a59a-f273ef47fa9d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:44.723301 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a3aa598-c21e-443f-a59a-f273ef47fa9d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:44.723754 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a3aa598-c21e-443f-a59a-f273ef47fa9d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:44.724540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a3aa598-c21e-443f-a59a-f273ef47fa9d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:44.725037 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a3aa598-c21e-443f-a59a-f273ef47fa9d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:45.052853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-43935a8c-406f-4aba-bcc4-5e3c58da0f31 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:45.063219 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-43935a8c-406f-4aba-bcc4-5e3c58da0f31 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1550 microversion: 2.1 time: 0.419612 Jul 27 20:10:45.063718 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 207/432] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:44 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1550 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:45.068920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c55bf351-1121-47b2-b854-3947b304d4ff tempest-VolumesTestJSON-570801043 tempest-VolumesTestJSON-570801043-project] Calling method '.version_select at 0x7fc7f03e25e0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:45.107435 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0a3aa598-c21e-443f-a59a-f273ef47fa9d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:45.119318 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0a3aa598-c21e-443f-a59a-f273ef47fa9d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1521 microversion: 2.1 time: 0.407640 Jul 27 20:10:45.119959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 226/433] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:44 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1521 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:45.136145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f9f0f5af-41da-4265-8f6d-42afa48b8789 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:45.141739 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f9f0f5af-41da-4265-8f6d-42afa48b8789 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:45.143326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f9f0f5af-41da-4265-8f6d-42afa48b8789 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Searching by: {'deleted': False, 'project_id': '4d888dcf554944adae3e03bc1c24c52b'} {{(pid=117876) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 27 20:10:45.151755 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f9f0f5af-41da-4265-8f6d-42afa48b8789 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:45.152991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f9f0f5af-41da-4265-8f6d-42afa48b8789 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:45.154749 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f9f0f5af-41da-4265-8f6d-42afa48b8789 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:45.155252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f9f0f5af-41da-4265-8f6d-42afa48b8789 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:45.169051 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c55bf351-1121-47b2-b854-3947b304d4ff tempest-VolumesTestJSON-570801043 tempest-VolumesTestJSON-570801043-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.104264 Jul 27 20:10:45.170386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 208/434] 10.222.0.65 () {58 vars in 1134 bytes} [Wed Jul 27 20:10:45 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:45.184071 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-881e6823-86bf-4cee-baf6-f91975a02956 tempest-VolumesTestJSON-570801043 tempest-VolumesTestJSON-570801043-project] Calling method '.version_select at 0x7fc7f01918b0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:45.270164 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.multi_cell_list [None req-f9f0f5af-41da-4265-8f6d-42afa48b8789 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117876) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 27 20:10:45.281272 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-881e6823-86bf-4cee-baf6-f91975a02956 tempest-VolumesTestJSON-570801043 tempest-VolumesTestJSON-570801043-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.101393 Jul 27 20:10:45.282002 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 209/435] 10.222.0.65 () {58 vars in 1167 bytes} [Wed Jul 27 20:10:45 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:10:45.296247 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-82af8e88-c8e3-4f04-aff5-1a3f137682b6 tempest-VolumesTestJSON-570801043 tempest-VolumesTestJSON-570801043-project] Calling method '.version_select at 0x7fc7f0198dc0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:45.379681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f9f0f5af-41da-4265-8f6d-42afa48b8789 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.258280 Jul 27 20:10:45.386595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 227/436] 10.222.0.65 () {58 vars in 1125 bytes} [Wed Jul 27 20:10:45 2022] GET /compute/v2.1/servers => generated 343 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:10:45.392622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c92ccff7-8626-400d-bf10-1791ef91529b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:45.393655 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c92ccff7-8626-400d-bf10-1791ef91529b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:45.399715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c92ccff7-8626-400d-bf10-1791ef91529b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:45.400178 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c92ccff7-8626-400d-bf10-1791ef91529b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:45.400991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c92ccff7-8626-400d-bf10-1791ef91529b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:45.401436 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c92ccff7-8626-400d-bf10-1791ef91529b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:45.406456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-82af8e88-c8e3-4f04-aff5-1a3f137682b6 tempest-VolumesTestJSON-570801043 tempest-VolumesTestJSON-570801043-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.113807 Jul 27 20:10:45.407213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 210/437] 10.222.0.65 () {58 vars in 1170 bytes} [Wed Jul 27 20:10:45 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:10:45.422452 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b547b9e8-dace-499f-9889-3bd7ba80a74e tempest-VolumesTestJSON-570801043 tempest-VolumesTestJSON-570801043-project] Calling method '.version_select at 0x7fc7f0180af0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:45.521460 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b547b9e8-dace-499f-9889-3bd7ba80a74e tempest-VolumesTestJSON-570801043 tempest-VolumesTestJSON-570801043-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.104685 Jul 27 20:10:45.522211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 211/438] 10.222.0.65 () {58 vars in 1155 bytes} [Wed Jul 27 20:10:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:45.535253 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-09ca762c-459f-4dad-974a-efc91358ee22 tempest-VolumesTestJSON-570801043 tempest-VolumesTestJSON-570801043-project] Calling method '.version_select at 0x7fc7f01911f0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:45.547520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c92ccff7-8626-400d-bf10-1791ef91529b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:45.557758 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c92ccff7-8626-400d-bf10-1791ef91529b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1550 microversion: 2.1 time: 0.169893 Jul 27 20:10:45.558646 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 228/439] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:45 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1550 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:45.648179 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-09ca762c-459f-4dad-974a-efc91358ee22 tempest-VolumesTestJSON-570801043 tempest-VolumesTestJSON-570801043-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.116771 Jul 27 20:10:45.648742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 212/440] 10.222.0.65 () {58 vars in 1188 bytes} [Wed Jul 27 20:10:45 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:10:45.662267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a4af58f5-96c6-4906-a0c6-a168832facea tempest-VolumesTestJSON-570801043 tempest-VolumesTestJSON-570801043-project] Calling method '.version_select at 0x7fc7f01099d0>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:45.928200 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a4af58f5-96c6-4906-a0c6-a168832facea tempest-VolumesTestJSON-570801043 tempest-VolumesTestJSON-570801043-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.269609 Jul 27 20:10:45.929334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 229/441] 10.222.0.65 () {58 vars in 1155 bytes} [Wed Jul 27 20:10:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:46.145865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-13548722-05ad-46cf-9aaf-ccf63a040858 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:46.146858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-13548722-05ad-46cf-9aaf-ccf63a040858 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:46.154735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13548722-05ad-46cf-9aaf-ccf63a040858 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:46.155247 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13548722-05ad-46cf-9aaf-ccf63a040858 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:46.156101 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13548722-05ad-46cf-9aaf-ccf63a040858 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:46.156614 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13548722-05ad-46cf-9aaf-ccf63a040858 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:46.401833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-13548722-05ad-46cf-9aaf-ccf63a040858 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:46.410105 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-13548722-05ad-46cf-9aaf-ccf63a040858 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1521 microversion: 2.1 time: 0.271502 Jul 27 20:10:46.410731 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 213/442] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:46 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:47.346172 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-06c586c7-8c11-4241-a508-8a33da134622 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d1afb1c-74a8-4609-bb99-2a7c6a98a47a"}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:10:47.348760 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-06c586c7-8c11-4241-a508-8a33da134622 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:47.356301 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-06c586c7-8c11-4241-a508-8a33da134622 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:47.356661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-06c586c7-8c11-4241-a508-8a33da134622 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:47.357470 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-06c586c7-8c11-4241-a508-8a33da134622 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:47.357927 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-06c586c7-8c11-4241-a508-8a33da134622 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:47.430851 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e3c1be40-7391-4a1c-b7a1-922070c31319 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:47.432073 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e3c1be40-7391-4a1c-b7a1-922070c31319 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:47.439566 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e3c1be40-7391-4a1c-b7a1-922070c31319 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:47.440264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e3c1be40-7391-4a1c-b7a1-922070c31319 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:47.441077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e3c1be40-7391-4a1c-b7a1-922070c31319 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:47.441677 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e3c1be40-7391-4a1c-b7a1-922070c31319 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:47.705192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e3c1be40-7391-4a1c-b7a1-922070c31319 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:47.711066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-06c586c7-8c11-4241-a508-8a33da134622 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "POST /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.369067 Jul 27 20:10:47.711958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 230/443] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Jul 27 20:10:47 2022] POST /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 194 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:10:47.717394 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e3c1be40-7391-4a1c-b7a1-922070c31319 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1521 microversion: 2.1 time: 0.290099 Jul 27 20:10:47.733120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 214/444] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:47 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:48.754255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8f998692-0922-4639-a6cb-c33dc0d2d47d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:48.754957 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8f998692-0922-4639-a6cb-c33dc0d2d47d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:48.765083 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8f998692-0922-4639-a6cb-c33dc0d2d47d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:48.765538 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8f998692-0922-4639-a6cb-c33dc0d2d47d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:48.769970 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8f998692-0922-4639-a6cb-c33dc0d2d47d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:48.773471 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8f998692-0922-4639-a6cb-c33dc0d2d47d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:48.779199 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:10:49.028188 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8f998692-0922-4639-a6cb-c33dc0d2d47d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:49.036695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8f998692-0922-4639-a6cb-c33dc0d2d47d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1521 microversion: 2.1 time: 0.286723 Jul 27 20:10:49.037311 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 231/445] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:48 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:50.059942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-71bb222f-221b-4212-b78a-b032f45f1bfd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:50.060618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-71bb222f-221b-4212-b78a-b032f45f1bfd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:50.076133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71bb222f-221b-4212-b78a-b032f45f1bfd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:50.076643 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71bb222f-221b-4212-b78a-b032f45f1bfd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:50.079858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71bb222f-221b-4212-b78a-b032f45f1bfd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:50.080314 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71bb222f-221b-4212-b78a-b032f45f1bfd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:50.524112 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-71bb222f-221b-4212-b78a-b032f45f1bfd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:50.531768 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-71bb222f-221b-4212-b78a-b032f45f1bfd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1521 microversion: 2.1 time: 0.476547 Jul 27 20:10:50.533127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 215/446] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:50 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1521 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:10:51.556324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5bcb64e5-02f2-4100-916e-5a2d53531c8a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:51.558081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5bcb64e5-02f2-4100-916e-5a2d53531c8a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:51.566837 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5bcb64e5-02f2-4100-916e-5a2d53531c8a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:51.567991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5bcb64e5-02f2-4100-916e-5a2d53531c8a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:51.569324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5bcb64e5-02f2-4100-916e-5a2d53531c8a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:51.569694 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5bcb64e5-02f2-4100-916e-5a2d53531c8a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:51.859327 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5bcb64e5-02f2-4100-916e-5a2d53531c8a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:51.873348 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5bcb64e5-02f2-4100-916e-5a2d53531c8a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1521 microversion: 2.1 time: 0.323468 Jul 27 20:10:51.885643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 232/447] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:51 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:52.901702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cdea061b-32fb-4920-a6b0-4430f039369e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:52.902435 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cdea061b-32fb-4920-a6b0-4430f039369e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:52.917054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdea061b-32fb-4920-a6b0-4430f039369e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:52.921167 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdea061b-32fb-4920-a6b0-4430f039369e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:52.923927 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdea061b-32fb-4920-a6b0-4430f039369e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:52.924911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdea061b-32fb-4920-a6b0-4430f039369e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:53.308010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cdea061b-32fb-4920-a6b0-4430f039369e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:53.318153 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cdea061b-32fb-4920-a6b0-4430f039369e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1501 microversion: 2.1 time: 0.422690 Jul 27 20:10:53.333547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 216/448] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:52 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1501 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:53.341598 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1f1dc181-06e1-4172-ac4c-d6140e356a5c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b06720b-e35f-45d3-aa7f-1538e02731ca"}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:10:53.344302 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1f1dc181-06e1-4172-ac4c-d6140e356a5c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:53.352035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f1dc181-06e1-4172-ac4c-d6140e356a5c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:53.352711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f1dc181-06e1-4172-ac4c-d6140e356a5c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:53.353954 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f1dc181-06e1-4172-ac4c-d6140e356a5c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:53.354552 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f1dc181-06e1-4172-ac4c-d6140e356a5c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:53.383617 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-1f1dc181-06e1-4172-ac4c-d6140e356a5c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] HTTP exception thrown: Cannot 'attach_volume' instance ea33250b-8fd3-4d34-97cb-cde5923b7a67 while it is in vm_state rescued Jul 27 20:10:53.386167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1f1dc181-06e1-4172-ac4c-d6140e356a5c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Request method failure captured: Jul 27 20:10:53.386167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: POST /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67/os-volume_attachments HTTP/1.1 Jul 27 20:10:53.386167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:10:53.386167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:10:53.386167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:10:53.386167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 74 Jul 27 20:10:53.386167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:10:53.386167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:10:53.386167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:10:53.386167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:10:53.386167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4Zs1w1g_5EBOAJHGXZvQfsbeerbcd37lKRD5mUkafMdHZAX3P44SwOy9NISSA8Lh2nFLwJ2io24pgRqnG4EvPMR-HJKAS2sxbES-VziDHtkha7CtqVpqP38PRAt1Y6btPfnsUjV-NLhIZjiSnTrYjlnZs4PaFMjmKlQulWMSRQRQQCg Jul 27 20:10:53.386167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:10:53.386167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:10:53.386167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:10:53.386167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:10:53.386167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:10:53.386167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:10:53.386167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 1626b826d47a47429a947fa36ace64e4 Jul 27 20:10:53.386167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:10:53.386167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:10:53.386167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:10:53.387476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1626b826d47a47429a947fa36ace64e4", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:10:53.387476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:10:53.387476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 1626b826d47a47429a947fa36ace64e4 Jul 27 20:10:53.387476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:10:53.387476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-ServerRescueNegativeTestJSON-2064775453-project Jul 27 20:10:53.387476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:10:53.387476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:10:53.387476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: a48eaef4d70b4116bd307374d819bca6 Jul 27 20:10:53.387476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2064775453-project Jul 27 20:10:53.387476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Jul 27 20:10:53.387476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {"volumeAttachment": {"volumeId": "3b06720b-e35f-45d3-aa7f-1538e02731ca"}} Jul 27 20:10:53.387476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:10:53.388183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Cannot 'attach_volume' instance ea33250b-8fd3-4d34-97cb-cde5923b7a67 while it is in vm_state rescued Jul 27 20:10:53.388183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'server_id': 'ea33250b-8fd3-4d34-97cb-cde5923b7a67', 'body': {'volumeAttachment': {'volumeId': '3b06720b-e35f-45d3-aa7f-1538e02731ca'}}} Jul 27 20:10:53.388183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:10:53.388183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:10:53.388183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 20:10:53.388183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 20:10:53.388183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:10:53.388183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:10:53.388183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 27 20:10:53.388183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 27 20:10:53.388183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ea33250b-8fd3-4d34-97cb-cde5923b7a67 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 27 20:10:53.388183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:53.388183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:10:53.388183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:53.388183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:10:53.388183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:10:53.388183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:10:53.388183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:10:53.388183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:10:53.389314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:10:53.389314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:10:53.389314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 20:10:53.389314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 20:10:53.389314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 20:10:53.389314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 20:10:53.389314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 20:10:53.389314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 20:10:53.389314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 27 20:10:53.389314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 27 20:10:53.389314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 27 20:10:53.389314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 27 20:10:53.389314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ea33250b-8fd3-4d34-97cb-cde5923b7a67 while it is in vm_state rescued Jul 27 20:10:53.389314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:53.389314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:10:53.389314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:53.389314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:10:53.389314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:10:53.389314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:10:53.392491 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:10:53.392491 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:10:53.392491 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ea33250b-8fd3-4d34-97cb-cde5923b7a67 while it is in vm_state rescued Jul 27 20:10:53.392491 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:10:53.394741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1f1dc181-06e1-4172-ac4c-d6140e356a5c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Returning 409 to user: Cannot 'attach_volume' instance ea33250b-8fd3-4d34-97cb-cde5923b7a67 while it is in vm_state rescued {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:10:53.395915 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1f1dc181-06e1-4172-ac4c-d6140e356a5c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "POST /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.058666 Jul 27 20:10:53.406109 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c9017a8a-1b5c-4cd9-84e4-5fb256009dfc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:10:53.408255 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c9017a8a-1b5c-4cd9-84e4-5fb256009dfc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:53.414216 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 233/449] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Jul 27 20:10:53 2022] POST /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67/os-volume_attachments => generated 152 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 27 20:10:53.416188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9017a8a-1b5c-4cd9-84e4-5fb256009dfc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:53.416646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9017a8a-1b5c-4cd9-84e4-5fb256009dfc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:53.417465 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9017a8a-1b5c-4cd9-84e4-5fb256009dfc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:53.417902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9017a8a-1b5c-4cd9-84e4-5fb256009dfc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:53.504342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c9017a8a-1b5c-4cd9-84e4-5fb256009dfc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "POST /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67/action" status: 202 len: 0 microversion: 2.1 time: 0.102197 Jul 27 20:10:53.505670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 217/450] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Jul 27 20:10:53 2022] POST /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:10:53.516091 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9b780c78-3860-46f7-b2d6-8f1b0b399ba8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:53.517726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9b780c78-3860-46f7-b2d6-8f1b0b399ba8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:53.526022 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9b780c78-3860-46f7-b2d6-8f1b0b399ba8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:53.528132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9b780c78-3860-46f7-b2d6-8f1b0b399ba8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:53.529243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9b780c78-3860-46f7-b2d6-8f1b0b399ba8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:53.529913 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9b780c78-3860-46f7-b2d6-8f1b0b399ba8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:53.743756 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9b780c78-3860-46f7-b2d6-8f1b0b399ba8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:53.754975 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9b780c78-3860-46f7-b2d6-8f1b0b399ba8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1509 microversion: 2.1 time: 0.245223 Jul 27 20:10:53.756295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 234/451] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:53 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1509 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:54.779177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-80dc89b1-4b1f-4a77-9211-0e18b2bc5797 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:54.780078 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-80dc89b1-4b1f-4a77-9211-0e18b2bc5797 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:54.803039 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80dc89b1-4b1f-4a77-9211-0e18b2bc5797 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:54.803699 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80dc89b1-4b1f-4a77-9211-0e18b2bc5797 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:54.805202 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80dc89b1-4b1f-4a77-9211-0e18b2bc5797 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:54.806377 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80dc89b1-4b1f-4a77-9211-0e18b2bc5797 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:55.179257 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-80dc89b1-4b1f-4a77-9211-0e18b2bc5797 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:55.187600 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-80dc89b1-4b1f-4a77-9211-0e18b2bc5797 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1509 microversion: 2.1 time: 0.414308 Jul 27 20:10:55.188308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 218/452] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:54 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1509 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:55.605649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=2 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:10:55.775096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6e44b57a-d2d2-4564-8ee2-3a7ad1da1182 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Action: 'create', calling method: .version_select at 0x7fc7eaf83d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-684913906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI8sOk2OzeXLRWA6Bq+V6ytlsAm10PwoVqTrqLN1KyvnPbDEvpOOckH1sswkymXGk9eFKlOusr8qNXuPYQhYNJmCSnI58TBBPBVHEGp06XjTaDH7RQxTGv5gibbUbCtEQ=="}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:10:55.790634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-6e44b57a-d2d2-4564-8ee2-3a7ad1da1182 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Getting quotas for project 87d5b073df6b48908d97ae613731adc1. Resources: {'key_pairs'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:10:55.794453 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-6e44b57a-d2d2-4564-8ee2-3a7ad1da1182 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Getting quotas for user 5f8ecfcb241d468685b22c3f883b6623 and project 87d5b073df6b48908d97ae613731adc1. Resources: {'key_pairs'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:10:55.818586 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6e44b57a-d2d2-4564-8ee2-3a7ad1da1182 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.217882 Jul 27 20:10:55.819102 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 235/453] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Jul 27 20:10:55 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:10:56.212053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d05647f5-6c4a-41fb-9675-26332480ad9c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:56.212629 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d05647f5-6c4a-41fb-9675-26332480ad9c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:56.220830 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d05647f5-6c4a-41fb-9675-26332480ad9c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:56.221721 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d05647f5-6c4a-41fb-9675-26332480ad9c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:56.222528 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d05647f5-6c4a-41fb-9675-26332480ad9c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:56.222995 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d05647f5-6c4a-41fb-9675-26332480ad9c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:56.612296 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d05647f5-6c4a-41fb-9675-26332480ad9c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:56.620849 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d05647f5-6c4a-41fb-9675-26332480ad9c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1509 microversion: 2.1 time: 0.413329 Jul 27 20:10:56.621654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 219/454] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:56 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1509 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:57.643356 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4b4c692f-0c26-4ea2-8133-a2223d319ced tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:57.643964 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4b4c692f-0c26-4ea2-8133-a2223d319ced tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:57.651034 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4b4c692f-0c26-4ea2-8133-a2223d319ced tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:57.651478 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4b4c692f-0c26-4ea2-8133-a2223d319ced tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:57.652237 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4b4c692f-0c26-4ea2-8133-a2223d319ced tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:57.652673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4b4c692f-0c26-4ea2-8133-a2223d319ced tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:57.783764 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4b4c692f-0c26-4ea2-8133-a2223d319ced tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:57.791520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4b4c692f-0c26-4ea2-8133-a2223d319ced tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1509 microversion: 2.1 time: 0.152634 Jul 27 20:10:57.792172 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 236/455] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:57 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:10:58.813936 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6b6467eb-31dc-4029-8799-00a7ab5415d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:10:58.814587 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6b6467eb-31dc-4029-8799-00a7ab5415d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:10:58.821325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b6467eb-31dc-4029-8799-00a7ab5415d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:58.821793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b6467eb-31dc-4029-8799-00a7ab5415d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:58.822566 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b6467eb-31dc-4029-8799-00a7ab5415d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:10:58.823152 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b6467eb-31dc-4029-8799-00a7ab5415d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:10:59.024373 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6b6467eb-31dc-4029-8799-00a7ab5415d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:10:59.035303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6b6467eb-31dc-4029-8799-00a7ab5415d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1509 microversion: 2.1 time: 0.225356 Jul 27 20:10:59.051323 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 220/456] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:10:58 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1509 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:00.058961 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-214d6089-6d31-4562-8b1f-c6013cb8cd45 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:00.059581 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-214d6089-6d31-4562-8b1f-c6013cb8cd45 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:00.066438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-214d6089-6d31-4562-8b1f-c6013cb8cd45 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:00.066898 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-214d6089-6d31-4562-8b1f-c6013cb8cd45 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:00.067940 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-214d6089-6d31-4562-8b1f-c6013cb8cd45 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:00.068384 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-214d6089-6d31-4562-8b1f-c6013cb8cd45 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:00.200224 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-214d6089-6d31-4562-8b1f-c6013cb8cd45 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:00.208528 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-214d6089-6d31-4562-8b1f-c6013cb8cd45 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1509 microversion: 2.1 time: 0.153421 Jul 27 20:11:00.209120 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 237/457] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:00 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:01.230008 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-517b622a-a52f-41b8-9643-56ef2e5774e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:01.230648 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-517b622a-a52f-41b8-9643-56ef2e5774e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:01.237185 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-517b622a-a52f-41b8-9643-56ef2e5774e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:01.237630 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-517b622a-a52f-41b8-9643-56ef2e5774e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:01.238386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-517b622a-a52f-41b8-9643-56ef2e5774e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:01.238815 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-517b622a-a52f-41b8-9643-56ef2e5774e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:01.397690 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-517b622a-a52f-41b8-9643-56ef2e5774e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:01.406850 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-517b622a-a52f-41b8-9643-56ef2e5774e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1509 microversion: 2.1 time: 0.180492 Jul 27 20:11:01.420907 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 221/458] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:01 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1509 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:02.428636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b1f75852-88b5-44f9-b412-e1ea612a2c1e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:02.431066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b1f75852-88b5-44f9-b412-e1ea612a2c1e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:02.438070 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b1f75852-88b5-44f9-b412-e1ea612a2c1e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:02.438690 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b1f75852-88b5-44f9-b412-e1ea612a2c1e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:02.439655 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b1f75852-88b5-44f9-b412-e1ea612a2c1e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:02.440095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b1f75852-88b5-44f9-b412-e1ea612a2c1e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:02.573055 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b1f75852-88b5-44f9-b412-e1ea612a2c1e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:02.581500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b1f75852-88b5-44f9-b412-e1ea612a2c1e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1515 microversion: 2.1 time: 0.156865 Jul 27 20:11:02.582106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 238/459] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:02 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:03.052252 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-33fc8453-933f-4b73-be1f-05c82dcc856f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:03.052858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-33fc8453-933f-4b73-be1f-05c82dcc856f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:03.058867 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33fc8453-933f-4b73-be1f-05c82dcc856f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:03.059310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33fc8453-933f-4b73-be1f-05c82dcc856f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:03.060094 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33fc8453-933f-4b73-be1f-05c82dcc856f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:03.060523 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33fc8453-933f-4b73-be1f-05c82dcc856f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:03.209976 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-33fc8453-933f-4b73-be1f-05c82dcc856f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:03.218044 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-33fc8453-933f-4b73-be1f-05c82dcc856f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1596 microversion: 2.1 time: 0.169696 Jul 27 20:11:03.218615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 222/460] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:03 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1596 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:03.949196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e5615412-850a-45c2-95f8-e25eb5af4eeb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Action: 'create', calling method: .version_select at 0x7fc7f003e790>, body: {"keypair": {"name": "tempest-keypair-425300320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkywI0tmnNM57Z0I2NjcdRtX+3LhrIM2byM6DHJ+p0kweAOnggGWfZNQue8nC+jnPHHAK4ldIa+/TEFZzbdFP6rSTtiYWMWMTbAiInK2SsFT0saNAHPX+y1sM73JgBZ+Q=="}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:11:03.965950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-e5615412-850a-45c2-95f8-e25eb5af4eeb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Getting quotas for project 1626b826d47a47429a947fa36ace64e4. Resources: {'key_pairs'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:11:03.971616 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-e5615412-850a-45c2-95f8-e25eb5af4eeb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Getting quotas for user a48eaef4d70b4116bd307374d819bca6 and project 1626b826d47a47429a947fa36ace64e4. Resources: {'key_pairs'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:11:03.995011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e5615412-850a-45c2-95f8-e25eb5af4eeb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049781 Jul 27 20:11:03.995684 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 239/461] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Jul 27 20:11:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:11:05.569695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-80ef26f7-eda7-4899-a00a-75c420c8c51e req-f21e734e-ce19-4262-a4bc-3d834e934d4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a92495d-74f4-4470-b9a4-919eb729c2a7", "tag": "f9060715-d759-4b5a-9395-c2ef1b01d78e"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:11:05.591784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-80ef26f7-eda7-4899-a00a-75c420c8c51e req-f21e734e-ce19-4262-a4bc-3d834e934d4e service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:05.592180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-80ef26f7-eda7-4899-a00a-75c420c8c51e req-f21e734e-ce19-4262-a4bc-3d834e934d4e service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:05.650348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-80ef26f7-eda7-4899-a00a-75c420c8c51e req-f21e734e-ce19-4262-a4bc-3d834e934d4e service nova] Creating event network-changed:f9060715-d759-4b5a-9395-c2ef1b01d78e for instance 8a92495d-74f4-4470-b9a4-919eb729c2a7 on hv-cinder-79987 Jul 27 20:11:05.662610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-80ef26f7-eda7-4899-a00a-75c420c8c51e req-f21e734e-ce19-4262-a4bc-3d834e934d4e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098514 Jul 27 20:11:05.663213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 223/462] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:11:05.789913 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6d9a7c21-5276-4cee-b1b1-53a6aff23ed2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-647979451", "imageRef": "fb689bea-534a-4aac-bec3-8f55591dba58", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58ec8bb2-6628-4de2-b96e-7daa0136083e"}], "security_groups": [{"name": "tempest-securitygroup--957651489"}], "key_name": "tempest-keypair-425300320", "user_data": "}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:11:05.990170 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.network.neutron [None req-6d9a7c21-5276-4cee-b1b1-53a6aff23ed2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] validate_networks() for [('58ec8bb2-6628-4de2-b96e-7daa0136083e', None, None, None, None, None)] {{(pid=117876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:11:06.485706 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-6d9a7c21-5276-4cee-b1b1-53a6aff23ed2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Flavor limits 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:11:06.486460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-6d9a7c21-5276-4cee-b1b1-53a6aff23ed2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Image limits 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:11:06.487132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-6d9a7c21-5276-4cee-b1b1-53a6aff23ed2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Flavor pref 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:11:06.487881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-6d9a7c21-5276-4cee-b1b1-53a6aff23ed2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Image pref 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:11:06.490240 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-6d9a7c21-5276-4cee-b1b1-53a6aff23ed2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:11:06.514152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d9a7c21-5276-4cee-b1b1-53a6aff23ed2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:06.515214 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d9a7c21-5276-4cee-b1b1-53a6aff23ed2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:06.517941 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d9a7c21-5276-4cee-b1b1-53a6aff23ed2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:06.518726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d9a7c21-5276-4cee-b1b1-53a6aff23ed2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:06.554319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-6d9a7c21-5276-4cee-b1b1-53a6aff23ed2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Getting quotas for project 1626b826d47a47429a947fa36ace64e4. Resources: {'cores', 'instances', 'ram'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:11:06.559948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-6d9a7c21-5276-4cee-b1b1-53a6aff23ed2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Getting quotas for user a48eaef4d70b4116bd307374d819bca6 and project 1626b826d47a47429a947fa36ace64e4. Resources: {'cores', 'instances', 'ram'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:11:06.582630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6d9a7c21-5276-4cee-b1b1-53a6aff23ed2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Going to run 1 instances... {{(pid=117876) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:11:06.585110 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6d9a7c21-5276-4cee-b1b1-53a6aff23ed2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb689bea-534a-4aac-bec3-8f55591dba58',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:11:06.647344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6d9a7c21-5276-4cee-b1b1-53a6aff23ed2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.862650 Jul 27 20:11:06.648797 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 240/463] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Jul 27 20:11:05 2022] POST /compute/v2.1/servers => generated 408 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:11:06.663124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-86a80f8a-3f33-4e80-bd06-73662d5a04a1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:06.664719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-86a80f8a-3f33-4e80-bd06-73662d5a04a1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:06.792690 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-86a80f8a-3f33-4e80-bd06-73662d5a04a1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:06.805367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-86a80f8a-3f33-4e80-bd06-73662d5a04a1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1244 microversion: 2.1 time: 0.149232 Jul 27 20:11:06.811066 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 224/464] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:06 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1244 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:07.566846 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-80f4b42b-f19b-453f-9bbf-f1789dddf2d9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2037569023"}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:11:07.567690 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-80f4b42b-f19b-453f-9bbf-f1789dddf2d9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:07.574500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-80f4b42b-f19b-453f-9bbf-f1789dddf2d9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:07.575190 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-80f4b42b-f19b-453f-9bbf-f1789dddf2d9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:07.576728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-80f4b42b-f19b-453f-9bbf-f1789dddf2d9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:07.577355 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-80f4b42b-f19b-453f-9bbf-f1789dddf2d9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:07.759637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.network.security_group_api [None req-80f4b42b-f19b-453f-9bbf-f1789dddf2d9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Adding security group 5deb60a0-12cb-4d16-a057-409f38ac5263 to port f9060715-d759-4b5a-9395-c2ef1b01d78e Jul 27 20:11:07.832505 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6be8d90e-7001-4edb-9100-4a8bb023f6a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:07.833683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6be8d90e-7001-4edb-9100-4a8bb023f6a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:07.842156 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6be8d90e-7001-4edb-9100-4a8bb023f6a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:07.842613 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6be8d90e-7001-4edb-9100-4a8bb023f6a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:07.843394 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6be8d90e-7001-4edb-9100-4a8bb023f6a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:07.843833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6be8d90e-7001-4edb-9100-4a8bb023f6a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:07.915133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6be8d90e-7001-4edb-9100-4a8bb023f6a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:07.923550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6be8d90e-7001-4edb-9100-4a8bb023f6a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1296 microversion: 2.1 time: 0.095734 Jul 27 20:11:07.924348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 225/465] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:07 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1296 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:11:08.214269 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-80f4b42b-f19b-453f-9bbf-f1789dddf2d9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "POST /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/action" status: 202 len: 0 microversion: 2.1 time: 0.651821 Jul 27 20:11:08.215319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 241/466] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Jul 27 20:11:07 2022] POST /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/action => generated 0 bytes in 654 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:11:08.235852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-c8efa446-697d-40f3-a62c-977c208c1deb req-d0d2ad27-da71-4a2c-8fa8-356691a5b7cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a92495d-74f4-4470-b9a4-919eb729c2a7", "tag": "f9060715-d759-4b5a-9395-c2ef1b01d78e"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:11:08.237974 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9144c06c-f521-4733-a02d-64399315b7c7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:08.238938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9144c06c-f521-4733-a02d-64399315b7c7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:08.249814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9144c06c-f521-4733-a02d-64399315b7c7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:08.252003 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9144c06c-f521-4733-a02d-64399315b7c7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:08.255406 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9144c06c-f521-4733-a02d-64399315b7c7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:08.256360 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9144c06c-f521-4733-a02d-64399315b7c7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:08.259760 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-c8efa446-697d-40f3-a62c-977c208c1deb req-d0d2ad27-da71-4a2c-8fa8-356691a5b7cb service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:08.260188 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-c8efa446-697d-40f3-a62c-977c208c1deb req-d0d2ad27-da71-4a2c-8fa8-356691a5b7cb service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:08.284943 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-c8efa446-697d-40f3-a62c-977c208c1deb req-d0d2ad27-da71-4a2c-8fa8-356691a5b7cb service nova] Creating event network-changed:f9060715-d759-4b5a-9395-c2ef1b01d78e for instance 8a92495d-74f4-4470-b9a4-919eb729c2a7 on hv-cinder-79987 Jul 27 20:11:08.312018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-c8efa446-697d-40f3-a62c-977c208c1deb req-d0d2ad27-da71-4a2c-8fa8-356691a5b7cb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081881 Jul 27 20:11:08.314851 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 242/467] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:11:08.613125 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9144c06c-f521-4733-a02d-64399315b7c7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:08.622483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9144c06c-f521-4733-a02d-64399315b7c7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1762 microversion: 2.1 time: 0.403368 Jul 27 20:11:08.623057 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 226/468] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:08 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1762 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:08.946909 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7f28601b-079e-4f89-b094-3b5e58364520 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:08.948420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7f28601b-079e-4f89-b094-3b5e58364520 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:08.959313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7f28601b-079e-4f89-b094-3b5e58364520 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:08.960158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7f28601b-079e-4f89-b094-3b5e58364520 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:08.961461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7f28601b-079e-4f89-b094-3b5e58364520 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:08.962173 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7f28601b-079e-4f89-b094-3b5e58364520 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:09.051187 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7f28601b-079e-4f89-b094-3b5e58364520 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:09.060669 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7f28601b-079e-4f89-b094-3b5e58364520 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1302 microversion: 2.1 time: 0.120113 Jul 27 20:11:09.062261 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 243/469] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:08 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1302 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:10.087664 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1ba5488e-18f8-4c32-a2fc-e24056648719 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:10.088289 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1ba5488e-18f8-4c32-a2fc-e24056648719 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:10.091639 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=46 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:11:10.096668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1ba5488e-18f8-4c32-a2fc-e24056648719 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:10.097143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1ba5488e-18f8-4c32-a2fc-e24056648719 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:10.097916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1ba5488e-18f8-4c32-a2fc-e24056648719 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:10.098354 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1ba5488e-18f8-4c32-a2fc-e24056648719 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:10.340216 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1ba5488e-18f8-4c32-a2fc-e24056648719 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:10.359389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1ba5488e-18f8-4c32-a2fc-e24056648719 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.275369 Jul 27 20:11:10.360608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 227/470] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:10 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:10.557381 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-18637901-e5c8-4325-8216-392b48c4a6a7 req-dea4d442-43ab-48b0-9729-af10b95b7b1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d634922-ac08-46f6-aa94-44abf09f6bc3", "tag": "63624ac2-681a-4488-9360-3a3a6dc129bc"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:11:10.571971 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-18637901-e5c8-4325-8216-392b48c4a6a7 req-dea4d442-43ab-48b0-9729-af10b95b7b1b service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:10.573071 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-18637901-e5c8-4325-8216-392b48c4a6a7 req-dea4d442-43ab-48b0-9729-af10b95b7b1b service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:10.586075 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-18637901-e5c8-4325-8216-392b48c4a6a7 req-dea4d442-43ab-48b0-9729-af10b95b7b1b service nova] Creating event network-changed:63624ac2-681a-4488-9360-3a3a6dc129bc for instance 0d634922-ac08-46f6-aa94-44abf09f6bc3 on hv-cinder-79987 Jul 27 20:11:10.592312 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-18637901-e5c8-4325-8216-392b48c4a6a7 req-dea4d442-43ab-48b0-9729-af10b95b7b1b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076108 Jul 27 20:11:10.592928 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 244/471] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:11:11.380084 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f91a0667-a44d-44f9-9070-e8049037d71d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:11.380691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f91a0667-a44d-44f9-9070-e8049037d71d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:11.386592 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f91a0667-a44d-44f9-9070-e8049037d71d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:11.387033 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f91a0667-a44d-44f9-9070-e8049037d71d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:11.387788 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f91a0667-a44d-44f9-9070-e8049037d71d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:11.388213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f91a0667-a44d-44f9-9070-e8049037d71d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:11.390691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:11:11.519911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f91a0667-a44d-44f9-9070-e8049037d71d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:11.527199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f91a0667-a44d-44f9-9070-e8049037d71d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.151502 Jul 27 20:11:11.527768 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 228/472] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:11 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:12.549090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-502f4609-6234-4e17-a719-74bf4bb8eb13 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:12.549832 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-502f4609-6234-4e17-a719-74bf4bb8eb13 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:12.555990 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-502f4609-6234-4e17-a719-74bf4bb8eb13 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:12.556438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-502f4609-6234-4e17-a719-74bf4bb8eb13 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:12.557225 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-502f4609-6234-4e17-a719-74bf4bb8eb13 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:12.557662 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-502f4609-6234-4e17-a719-74bf4bb8eb13 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:12.683904 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-502f4609-6234-4e17-a719-74bf4bb8eb13 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:12.692075 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-502f4609-6234-4e17-a719-74bf4bb8eb13 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.147752 Jul 27 20:11:12.692788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 245/473] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:12 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:13.712624 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ff29adc5-89ab-401a-9d6c-bb40e169c212 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:13.713200 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ff29adc5-89ab-401a-9d6c-bb40e169c212 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:13.720357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff29adc5-89ab-401a-9d6c-bb40e169c212 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:13.720808 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff29adc5-89ab-401a-9d6c-bb40e169c212 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:13.721610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff29adc5-89ab-401a-9d6c-bb40e169c212 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:13.722050 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff29adc5-89ab-401a-9d6c-bb40e169c212 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:13.918403 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ff29adc5-89ab-401a-9d6c-bb40e169c212 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:13.925911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ff29adc5-89ab-401a-9d6c-bb40e169c212 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.217084 Jul 27 20:11:13.926475 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 229/474] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:13 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:14.946925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cb1a12f4-e342-4ed8-9099-169c23bd4917 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:14.947634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cb1a12f4-e342-4ed8-9099-169c23bd4917 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:14.950050 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=5 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:11:14.955416 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb1a12f4-e342-4ed8-9099-169c23bd4917 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:14.955860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb1a12f4-e342-4ed8-9099-169c23bd4917 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:14.956616 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb1a12f4-e342-4ed8-9099-169c23bd4917 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:14.957152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb1a12f4-e342-4ed8-9099-169c23bd4917 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:15.092202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cb1a12f4-e342-4ed8-9099-169c23bd4917 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:15.100288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cb1a12f4-e342-4ed8-9099-169c23bd4917 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.157544 Jul 27 20:11:15.100848 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 246/475] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:14 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:16.120644 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0658fc1e-1772-4da4-b02e-e693f1ae13aa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:16.121278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0658fc1e-1772-4da4-b02e-e693f1ae13aa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:16.127829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0658fc1e-1772-4da4-b02e-e693f1ae13aa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:16.128269 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0658fc1e-1772-4da4-b02e-e693f1ae13aa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:16.129051 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0658fc1e-1772-4da4-b02e-e693f1ae13aa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:16.129489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0658fc1e-1772-4da4-b02e-e693f1ae13aa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:16.262784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0658fc1e-1772-4da4-b02e-e693f1ae13aa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:16.270329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0658fc1e-1772-4da4-b02e-e693f1ae13aa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.153557 Jul 27 20:11:16.270888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 230/476] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:16 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:17.290654 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3311cc3e-1a0a-4cf2-955b-992e140a0dbf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:17.291275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3311cc3e-1a0a-4cf2-955b-992e140a0dbf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:17.293643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=2 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:11:17.294329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=14 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:11:17.300095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3311cc3e-1a0a-4cf2-955b-992e140a0dbf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:17.300554 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3311cc3e-1a0a-4cf2-955b-992e140a0dbf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:17.301351 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3311cc3e-1a0a-4cf2-955b-992e140a0dbf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:17.301798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3311cc3e-1a0a-4cf2-955b-992e140a0dbf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:17.430087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3311cc3e-1a0a-4cf2-955b-992e140a0dbf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:17.437467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3311cc3e-1a0a-4cf2-955b-992e140a0dbf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.150653 Jul 27 20:11:17.438557 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 247/477] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:17 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:18.459866 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1b9ead93-1b85-47ee-baa7-cb4148165a50 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:18.460472 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1b9ead93-1b85-47ee-baa7-cb4148165a50 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:18.462292 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:11:18.467615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b9ead93-1b85-47ee-baa7-cb4148165a50 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:18.468059 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b9ead93-1b85-47ee-baa7-cb4148165a50 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:18.468845 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b9ead93-1b85-47ee-baa7-cb4148165a50 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:18.469828 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b9ead93-1b85-47ee-baa7-cb4148165a50 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:18.598665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1b9ead93-1b85-47ee-baa7-cb4148165a50 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:18.606035 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1b9ead93-1b85-47ee-baa7-cb4148165a50 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.149990 Jul 27 20:11:18.606597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 231/478] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:18 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:19.626970 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a6494168-ba78-49dd-8fc2-523d94fa1c55 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:19.627589 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a6494168-ba78-49dd-8fc2-523d94fa1c55 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:19.634167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6494168-ba78-49dd-8fc2-523d94fa1c55 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:19.634626 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6494168-ba78-49dd-8fc2-523d94fa1c55 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:19.635390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6494168-ba78-49dd-8fc2-523d94fa1c55 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:19.635836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6494168-ba78-49dd-8fc2-523d94fa1c55 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:19.639673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=73 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:11:19.770187 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a6494168-ba78-49dd-8fc2-523d94fa1c55 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:19.777845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a6494168-ba78-49dd-8fc2-523d94fa1c55 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.154937 Jul 27 20:11:19.778413 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 248/479] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:19 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:20.798474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-60b53fbb-6ca7-41a6-a0b1-04791cb235a6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:20.799079 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-60b53fbb-6ca7-41a6-a0b1-04791cb235a6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:20.805357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60b53fbb-6ca7-41a6-a0b1-04791cb235a6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:20.805807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60b53fbb-6ca7-41a6-a0b1-04791cb235a6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:20.806561 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60b53fbb-6ca7-41a6-a0b1-04791cb235a6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:20.806993 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60b53fbb-6ca7-41a6-a0b1-04791cb235a6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:20.940888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-60b53fbb-6ca7-41a6-a0b1-04791cb235a6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:20.948543 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-60b53fbb-6ca7-41a6-a0b1-04791cb235a6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.154071 Jul 27 20:11:20.949540 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 232/480] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:20 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:21.970574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c880a4a7-924d-40ec-90db-6fc289a0cd8d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:21.971190 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c880a4a7-924d-40ec-90db-6fc289a0cd8d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:21.977913 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c880a4a7-924d-40ec-90db-6fc289a0cd8d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:21.978366 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c880a4a7-924d-40ec-90db-6fc289a0cd8d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:21.979126 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c880a4a7-924d-40ec-90db-6fc289a0cd8d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:21.979568 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c880a4a7-924d-40ec-90db-6fc289a0cd8d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:22.107596 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c880a4a7-924d-40ec-90db-6fc289a0cd8d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:22.115505 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c880a4a7-924d-40ec-90db-6fc289a0cd8d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.149078 Jul 27 20:11:22.116062 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 249/481] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:21 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:23.136555 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bf9b9ee4-41f4-4f23-bfdb-4d767e7758c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:23.137194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bf9b9ee4-41f4-4f23-bfdb-4d767e7758c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:23.144205 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf9b9ee4-41f4-4f23-bfdb-4d767e7758c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:23.144648 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf9b9ee4-41f4-4f23-bfdb-4d767e7758c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:23.145436 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf9b9ee4-41f4-4f23-bfdb-4d767e7758c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:23.145880 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf9b9ee4-41f4-4f23-bfdb-4d767e7758c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:23.273261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bf9b9ee4-41f4-4f23-bfdb-4d767e7758c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:23.280564 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bf9b9ee4-41f4-4f23-bfdb-4d767e7758c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.147838 Jul 27 20:11:23.281160 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 233/482] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:23 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:24.302292 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a3700358-28f5-407d-9137-c83958359945 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:24.302944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a3700358-28f5-407d-9137-c83958359945 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:24.309443 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a3700358-28f5-407d-9137-c83958359945 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:24.309900 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a3700358-28f5-407d-9137-c83958359945 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:24.310666 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a3700358-28f5-407d-9137-c83958359945 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:24.311108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a3700358-28f5-407d-9137-c83958359945 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:24.444732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a3700358-28f5-407d-9137-c83958359945 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:24.452173 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a3700358-28f5-407d-9137-c83958359945 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.153901 Jul 27 20:11:24.452739 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 250/483] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:24 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:25.475754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d84c4318-33a0-4f49-8fd3-3c4990a7442a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:25.476369 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d84c4318-33a0-4f49-8fd3-3c4990a7442a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:25.482598 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d84c4318-33a0-4f49-8fd3-3c4990a7442a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:25.483046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d84c4318-33a0-4f49-8fd3-3c4990a7442a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:25.483871 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d84c4318-33a0-4f49-8fd3-3c4990a7442a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:25.484948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d84c4318-33a0-4f49-8fd3-3c4990a7442a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:25.616030 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d84c4318-33a0-4f49-8fd3-3c4990a7442a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:25.623312 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d84c4318-33a0-4f49-8fd3-3c4990a7442a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.151421 Jul 27 20:11:25.623874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 234/484] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:25 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:26.644176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-684c9604-e7d2-48e1-b805-fff2192716d4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:26.644784 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-684c9604-e7d2-48e1-b805-fff2192716d4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:26.651301 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-684c9604-e7d2-48e1-b805-fff2192716d4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:26.651751 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-684c9604-e7d2-48e1-b805-fff2192716d4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:26.652510 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-684c9604-e7d2-48e1-b805-fff2192716d4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:26.652944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-684c9604-e7d2-48e1-b805-fff2192716d4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:26.780561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-684c9604-e7d2-48e1-b805-fff2192716d4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:26.788608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-684c9604-e7d2-48e1-b805-fff2192716d4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.148880 Jul 27 20:11:26.789201 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 251/485] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:26 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:27.809255 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-abd2f733-f327-4054-b4e8-33e38376e2b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:27.809896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-abd2f733-f327-4054-b4e8-33e38376e2b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:27.815959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-abd2f733-f327-4054-b4e8-33e38376e2b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:27.816410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-abd2f733-f327-4054-b4e8-33e38376e2b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:27.817213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-abd2f733-f327-4054-b4e8-33e38376e2b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:27.817907 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-abd2f733-f327-4054-b4e8-33e38376e2b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:27.948005 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-abd2f733-f327-4054-b4e8-33e38376e2b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:27.955394 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-abd2f733-f327-4054-b4e8-33e38376e2b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.150011 Jul 27 20:11:27.955951 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 235/486] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:27 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:28.975605 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a6cd0486-975c-4d32-9331-cb8424e028d1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:28.976226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a6cd0486-975c-4d32-9331-cb8424e028d1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:28.982856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6cd0486-975c-4d32-9331-cb8424e028d1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:28.983313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6cd0486-975c-4d32-9331-cb8424e028d1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:28.984593 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6cd0486-975c-4d32-9331-cb8424e028d1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:28.985076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6cd0486-975c-4d32-9331-cb8424e028d1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:29.112934 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a6cd0486-975c-4d32-9331-cb8424e028d1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:29.120243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a6cd0486-975c-4d32-9331-cb8424e028d1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.148450 Jul 27 20:11:29.120798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 252/487] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:28 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:30.141709 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-02159c06-ad5b-471c-9f3d-8cb043d568a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:30.142352 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-02159c06-ad5b-471c-9f3d-8cb043d568a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:30.148796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02159c06-ad5b-471c-9f3d-8cb043d568a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:30.149283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02159c06-ad5b-471c-9f3d-8cb043d568a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:30.150049 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02159c06-ad5b-471c-9f3d-8cb043d568a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:30.150484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02159c06-ad5b-471c-9f3d-8cb043d568a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:30.282753 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-02159c06-ad5b-471c-9f3d-8cb043d568a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:30.291222 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-02159c06-ad5b-471c-9f3d-8cb043d568a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.154047 Jul 27 20:11:30.291903 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 236/488] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:30 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:31.313781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7a36d1eb-a359-4712-a8c6-fd543122fcd1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:31.314646 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7a36d1eb-a359-4712-a8c6-fd543122fcd1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:31.321009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7a36d1eb-a359-4712-a8c6-fd543122fcd1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:31.321460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7a36d1eb-a359-4712-a8c6-fd543122fcd1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:31.322258 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7a36d1eb-a359-4712-a8c6-fd543122fcd1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:31.322693 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7a36d1eb-a359-4712-a8c6-fd543122fcd1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:31.474792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7a36d1eb-a359-4712-a8c6-fd543122fcd1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:31.483462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7a36d1eb-a359-4712-a8c6-fd543122fcd1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.174109 Jul 27 20:11:31.484069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 253/489] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:31 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:32.505465 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-93e2d8fc-1324-4e99-8c93-66c1fbe83f72 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:32.506467 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-93e2d8fc-1324-4e99-8c93-66c1fbe83f72 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:32.512919 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93e2d8fc-1324-4e99-8c93-66c1fbe83f72 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:32.513391 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93e2d8fc-1324-4e99-8c93-66c1fbe83f72 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:32.514169 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93e2d8fc-1324-4e99-8c93-66c1fbe83f72 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:32.514606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93e2d8fc-1324-4e99-8c93-66c1fbe83f72 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:32.646746 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-93e2d8fc-1324-4e99-8c93-66c1fbe83f72 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:32.654300 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-93e2d8fc-1324-4e99-8c93-66c1fbe83f72 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.153560 Jul 27 20:11:32.654868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 237/490] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:32 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:33.223742 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-7aceca6e-ac64-4f58-a7e5-0ff6055ff1e9 req-47ee74f5-9dbc-49d4-bf69-0a99ca00c957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d634922-ac08-46f6-aa94-44abf09f6bc3", "name": "network-vif-plugged", "status": "completed", "tag": "63624ac2-681a-4488-9360-3a3a6dc129bc"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:11:33.235067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-7aceca6e-ac64-4f58-a7e5-0ff6055ff1e9 req-47ee74f5-9dbc-49d4-bf69-0a99ca00c957 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:33.235529 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-7aceca6e-ac64-4f58-a7e5-0ff6055ff1e9 req-47ee74f5-9dbc-49d4-bf69-0a99ca00c957 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:33.246477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-7aceca6e-ac64-4f58-a7e5-0ff6055ff1e9 req-47ee74f5-9dbc-49d4-bf69-0a99ca00c957 service nova] Creating event network-vif-plugged:63624ac2-681a-4488-9360-3a3a6dc129bc for instance 0d634922-ac08-46f6-aa94-44abf09f6bc3 on hv-cinder-79987 Jul 27 20:11:33.252199 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-7aceca6e-ac64-4f58-a7e5-0ff6055ff1e9 req-47ee74f5-9dbc-49d4-bf69-0a99ca00c957 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032089 Jul 27 20:11:33.252804 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 254/491] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:11:33.674915 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4b6ac14e-35f6-4e99-8ec4-0bbeb41ec527 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:33.675528 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4b6ac14e-35f6-4e99-8ec4-0bbeb41ec527 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:33.681528 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b6ac14e-35f6-4e99-8ec4-0bbeb41ec527 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:33.682012 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b6ac14e-35f6-4e99-8ec4-0bbeb41ec527 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:33.682773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b6ac14e-35f6-4e99-8ec4-0bbeb41ec527 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:33.683213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b6ac14e-35f6-4e99-8ec4-0bbeb41ec527 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:33.817211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4b6ac14e-35f6-4e99-8ec4-0bbeb41ec527 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:33.824757 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4b6ac14e-35f6-4e99-8ec4-0bbeb41ec527 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.154269 Jul 27 20:11:33.825508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 238/492] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:33 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:34.846978 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f95ea201-19d8-46a1-a8df-e39ecc00defb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:34.847703 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f95ea201-19d8-46a1-a8df-e39ecc00defb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:34.853918 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f95ea201-19d8-46a1-a8df-e39ecc00defb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:34.854373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f95ea201-19d8-46a1-a8df-e39ecc00defb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:34.855135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f95ea201-19d8-46a1-a8df-e39ecc00defb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:34.855579 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f95ea201-19d8-46a1-a8df-e39ecc00defb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:34.987427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f95ea201-19d8-46a1-a8df-e39ecc00defb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:34.994727 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f95ea201-19d8-46a1-a8df-e39ecc00defb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.152563 Jul 27 20:11:34.995283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 255/493] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:34 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:36.016353 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6c78f6c6-5bcc-4f4d-87ec-d8ebdb979b8a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:36.017003 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6c78f6c6-5bcc-4f4d-87ec-d8ebdb979b8a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:36.023201 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c78f6c6-5bcc-4f4d-87ec-d8ebdb979b8a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:36.023653 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c78f6c6-5bcc-4f4d-87ec-d8ebdb979b8a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:36.024422 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c78f6c6-5bcc-4f4d-87ec-d8ebdb979b8a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:36.024884 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c78f6c6-5bcc-4f4d-87ec-d8ebdb979b8a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:36.155249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6c78f6c6-5bcc-4f4d-87ec-d8ebdb979b8a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:36.162710 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6c78f6c6-5bcc-4f4d-87ec-d8ebdb979b8a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.150929 Jul 27 20:11:36.163266 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 239/494] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:36 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:37.183121 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5760d1be-9a73-495c-992f-a85b603d15ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:37.183742 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5760d1be-9a73-495c-992f-a85b603d15ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:37.190300 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5760d1be-9a73-495c-992f-a85b603d15ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:37.190759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5760d1be-9a73-495c-992f-a85b603d15ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:37.191564 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5760d1be-9a73-495c-992f-a85b603d15ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:37.192012 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5760d1be-9a73-495c-992f-a85b603d15ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:37.321629 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5760d1be-9a73-495c-992f-a85b603d15ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:37.329632 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5760d1be-9a73-495c-992f-a85b603d15ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.150400 Jul 27 20:11:37.330202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 256/495] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:37 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:38.350256 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-38ca13f6-807e-4027-91cb-0b992592d41c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:38.350793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-38ca13f6-807e-4027-91cb-0b992592d41c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:38.356835 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-38ca13f6-807e-4027-91cb-0b992592d41c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:38.357315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-38ca13f6-807e-4027-91cb-0b992592d41c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:38.358076 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-38ca13f6-807e-4027-91cb-0b992592d41c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:38.358510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-38ca13f6-807e-4027-91cb-0b992592d41c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:38.486459 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-38ca13f6-807e-4027-91cb-0b992592d41c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:38.493775 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-38ca13f6-807e-4027-91cb-0b992592d41c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.147464 Jul 27 20:11:38.494333 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 240/496] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:38 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:39.513725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b3c3f27c-73ef-4ecf-a0ed-7f3da9f82cd9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:39.514318 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b3c3f27c-73ef-4ecf-a0ed-7f3da9f82cd9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:39.520988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b3c3f27c-73ef-4ecf-a0ed-7f3da9f82cd9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:39.521452 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b3c3f27c-73ef-4ecf-a0ed-7f3da9f82cd9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:39.522205 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b3c3f27c-73ef-4ecf-a0ed-7f3da9f82cd9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:39.522667 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b3c3f27c-73ef-4ecf-a0ed-7f3da9f82cd9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:39.649909 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b3c3f27c-73ef-4ecf-a0ed-7f3da9f82cd9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:39.658087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b3c3f27c-73ef-4ecf-a0ed-7f3da9f82cd9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.148228 Jul 27 20:11:39.658734 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 257/497] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:39 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:40.678342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-631e66b6-2bfa-462e-96f5-806e201f3f55 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:40.678955 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-631e66b6-2bfa-462e-96f5-806e201f3f55 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:40.681053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=28 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:11:40.686489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-631e66b6-2bfa-462e-96f5-806e201f3f55 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:40.687458 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-631e66b6-2bfa-462e-96f5-806e201f3f55 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:40.688281 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-631e66b6-2bfa-462e-96f5-806e201f3f55 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:40.688722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-631e66b6-2bfa-462e-96f5-806e201f3f55 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:40.833076 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-631e66b6-2bfa-462e-96f5-806e201f3f55 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:40.840496 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-631e66b6-2bfa-462e-96f5-806e201f3f55 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1369 microversion: 2.1 time: 0.165909 Jul 27 20:11:40.841065 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 241/498] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:40 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1369 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:41.862026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c0bd33ae-9b45-4216-b98f-f6f19ef6436e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:41.862656 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c0bd33ae-9b45-4216-b98f-f6f19ef6436e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:41.869703 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c0bd33ae-9b45-4216-b98f-f6f19ef6436e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:41.870322 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c0bd33ae-9b45-4216-b98f-f6f19ef6436e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:41.871100 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c0bd33ae-9b45-4216-b98f-f6f19ef6436e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:41.871550 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c0bd33ae-9b45-4216-b98f-f6f19ef6436e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:42.017441 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c0bd33ae-9b45-4216-b98f-f6f19ef6436e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:42.029724 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c0bd33ae-9b45-4216-b98f-f6f19ef6436e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1561 microversion: 2.1 time: 0.171488 Jul 27 20:11:42.045566 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 258/499] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:41 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1561 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:42.050058 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9056593b-ce7f-4107-906f-b5078fbd962f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:42.051063 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9056593b-ce7f-4107-906f-b5078fbd962f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:42.057802 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9056593b-ce7f-4107-906f-b5078fbd962f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:42.058246 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9056593b-ce7f-4107-906f-b5078fbd962f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:42.059025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9056593b-ce7f-4107-906f-b5078fbd962f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:42.059495 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9056593b-ce7f-4107-906f-b5078fbd962f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:42.062558 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=84 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:11:42.138215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9056593b-ce7f-4107-906f-b5078fbd962f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092553 Jul 27 20:11:42.138815 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 242/500] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Jul 27 20:11:42 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:11:43.026575 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0b0c620c-8f30-4f41-8b4a-4a37d4f5314b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-928867718", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-684913906", "security_groups": [{"name": "tempest-secgroup-smoke-218242429"}], "networks": [{"uuid": "91c5ac8e-dc60-49f0-ba36-2d0b1cbd8706"}], "block_device_mapping_v2": [{"uuid": "872f023f-7f7d-42c4-9a82-2def2a47de34", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:11:43.154543 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.network.neutron [None req-0b0c620c-8f30-4f41-8b4a-4a37d4f5314b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] validate_networks() for [('91c5ac8e-dc60-49f0-ba36-2d0b1cbd8706', None, None, None, None, None)] {{(pid=117876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:11:43.292484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-c105c61c-5314-4e0a-90a8-a058b4242744 req-c99bc484-abdc-4219-aa5f-4478e5690cac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d634922-ac08-46f6-aa94-44abf09f6bc3", "tag": "63624ac2-681a-4488-9360-3a3a6dc129bc"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:11:43.303830 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-c105c61c-5314-4e0a-90a8-a058b4242744 req-c99bc484-abdc-4219-aa5f-4478e5690cac service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:43.304739 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-c105c61c-5314-4e0a-90a8-a058b4242744 req-c99bc484-abdc-4219-aa5f-4478e5690cac service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:43.317531 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-c105c61c-5314-4e0a-90a8-a058b4242744 req-c99bc484-abdc-4219-aa5f-4478e5690cac service nova] Creating event network-changed:63624ac2-681a-4488-9360-3a3a6dc129bc for instance 0d634922-ac08-46f6-aa94-44abf09f6bc3 on hv-cinder-79987 Jul 27 20:11:43.323361 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-c105c61c-5314-4e0a-90a8-a058b4242744 req-c99bc484-abdc-4219-aa5f-4478e5690cac service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034150 Jul 27 20:11:43.324140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 243/501] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:11:43.539524 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-0b0c620c-8f30-4f41-8b4a-4a37d4f5314b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Flavor limits 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:11:43.540128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-0b0c620c-8f30-4f41-8b4a-4a37d4f5314b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Image limits 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:11:43.540599 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-0b0c620c-8f30-4f41-8b4a-4a37d4f5314b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Flavor pref 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:11:43.541038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-0b0c620c-8f30-4f41-8b4a-4a37d4f5314b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Image pref 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:11:43.541451 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-0b0c620c-8f30-4f41-8b4a-4a37d4f5314b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:11:43.551299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b0c620c-8f30-4f41-8b4a-4a37d4f5314b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:43.551742 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b0c620c-8f30-4f41-8b4a-4a37d4f5314b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:43.552529 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b0c620c-8f30-4f41-8b4a-4a37d4f5314b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:43.552985 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b0c620c-8f30-4f41-8b4a-4a37d4f5314b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:43.570430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-0b0c620c-8f30-4f41-8b4a-4a37d4f5314b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Getting quotas for project 87d5b073df6b48908d97ae613731adc1. Resources: {'cores', 'instances', 'ram'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:11:43.574277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-0b0c620c-8f30-4f41-8b4a-4a37d4f5314b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Getting quotas for user 5f8ecfcb241d468685b22c3f883b6623 and project 87d5b073df6b48908d97ae613731adc1. Resources: {'cores', 'instances', 'ram'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:11:43.630817 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0b0c620c-8f30-4f41-8b4a-4a37d4f5314b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Going to run 1 instances... {{(pid=117876) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:11:43.632908 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0b0c620c-8f30-4f41-8b4a-4a37d4f5314b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='872f023f-7f7d-42c4-9a82-2def2a47de34',volume_size=None,volume_type=None)] {{(pid=117876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:11:43.762629 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0b0c620c-8f30-4f41-8b4a-4a37d4f5314b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.739892 Jul 27 20:11:43.769147 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 259/502] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Jul 27 20:11:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:11:43.774649 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3eff5b8a-0646-497f-8a49-35b439a23940 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:43.775562 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3eff5b8a-0646-497f-8a49-35b439a23940 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:43.834224 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3eff5b8a-0646-497f-8a49-35b439a23940 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:43.841413 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3eff5b8a-0646-497f-8a49-35b439a23940 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1087 microversion: 2.1 time: 0.070876 Jul 27 20:11:43.842263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 244/503] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:43 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1087 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:44.866298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-190b719f-dec3-4236-886a-bb1bb078f21a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:44.866900 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-190b719f-dec3-4236-886a-bb1bb078f21a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:44.877248 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-190b719f-dec3-4236-886a-bb1bb078f21a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:44.877941 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-190b719f-dec3-4236-886a-bb1bb078f21a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:44.878735 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-190b719f-dec3-4236-886a-bb1bb078f21a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:44.879243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-190b719f-dec3-4236-886a-bb1bb078f21a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:44.942577 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-190b719f-dec3-4236-886a-bb1bb078f21a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:44.950038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-190b719f-dec3-4236-886a-bb1bb078f21a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1137 microversion: 2.1 time: 0.087810 Jul 27 20:11:44.950603 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 260/504] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:44 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1137 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:45.970596 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ae133c4e-da84-4097-bc39-4a5fbd017723 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:45.971203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ae133c4e-da84-4097-bc39-4a5fbd017723 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:45.977407 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae133c4e-da84-4097-bc39-4a5fbd017723 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:45.977859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae133c4e-da84-4097-bc39-4a5fbd017723 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:45.978619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae133c4e-da84-4097-bc39-4a5fbd017723 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:45.979060 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae133c4e-da84-4097-bc39-4a5fbd017723 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:46.038724 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ae133c4e-da84-4097-bc39-4a5fbd017723 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:46.046574 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ae133c4e-da84-4097-bc39-4a5fbd017723 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1137 microversion: 2.1 time: 0.079342 Jul 27 20:11:46.047211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 245/505] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:45 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1137 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:47.068258 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a7714887-87f1-4ef2-8ca3-34b4ace88c57 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:47.068863 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a7714887-87f1-4ef2-8ca3-34b4ace88c57 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:47.072486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:11:47.076519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a7714887-87f1-4ef2-8ca3-34b4ace88c57 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:47.078257 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a7714887-87f1-4ef2-8ca3-34b4ace88c57 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:47.078608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a7714887-87f1-4ef2-8ca3-34b4ace88c57 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:47.079052 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a7714887-87f1-4ef2-8ca3-34b4ace88c57 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:47.147174 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a7714887-87f1-4ef2-8ca3-34b4ace88c57 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:47.154575 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a7714887-87f1-4ef2-8ca3-34b4ace88c57 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1193 microversion: 2.1 time: 0.090933 Jul 27 20:11:47.155137 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 261/506] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:47 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1193 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:48.175865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-01c2fcd4-9c5a-47ad-8da2-ff38075ee628 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:48.177035 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-01c2fcd4-9c5a-47ad-8da2-ff38075ee628 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:48.182588 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-01c2fcd4-9c5a-47ad-8da2-ff38075ee628 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:48.183126 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-01c2fcd4-9c5a-47ad-8da2-ff38075ee628 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:48.183952 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-01c2fcd4-9c5a-47ad-8da2-ff38075ee628 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:48.184475 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-01c2fcd4-9c5a-47ad-8da2-ff38075ee628 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:48.413096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-01c2fcd4-9c5a-47ad-8da2-ff38075ee628 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:48.423811 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-01c2fcd4-9c5a-47ad-8da2-ff38075ee628 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1258 microversion: 2.1 time: 0.251723 Jul 27 20:11:48.426847 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 246/507] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:48 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1258 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:48.617741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-211530f7-e7c3-45a9-9e11-acb40d386548 req-8d9294e5-a93a-4c68-9340-c8f8741ff2bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c560ad96-cd64-4d84-86c8-c315f0fa0ab7", "tag": "12f96d47-a8d9-4367-b8bf-0bb05f9ee59b"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:11:48.645385 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-211530f7-e7c3-45a9-9e11-acb40d386548 req-8d9294e5-a93a-4c68-9340-c8f8741ff2bf service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:48.645836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-211530f7-e7c3-45a9-9e11-acb40d386548 req-8d9294e5-a93a-4c68-9340-c8f8741ff2bf service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:48.672083 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-211530f7-e7c3-45a9-9e11-acb40d386548 req-8d9294e5-a93a-4c68-9340-c8f8741ff2bf service nova] Creating event network-changed:12f96d47-a8d9-4367-b8bf-0bb05f9ee59b for instance c560ad96-cd64-4d84-86c8-c315f0fa0ab7 on hv-cinder-79987 Jul 27 20:11:48.678413 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-211530f7-e7c3-45a9-9e11-acb40d386548 req-8d9294e5-a93a-4c68-9340-c8f8741ff2bf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075721 Jul 27 20:11:48.679618 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 262/508] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:11:49.447759 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a7836823-116a-4c32-b836-b1fc5e18a8ff tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:49.448452 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a7836823-116a-4c32-b836-b1fc5e18a8ff tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:49.454947 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7836823-116a-4c32-b836-b1fc5e18a8ff tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:49.455391 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7836823-116a-4c32-b836-b1fc5e18a8ff tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:49.456155 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7836823-116a-4c32-b836-b1fc5e18a8ff tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:49.456594 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7836823-116a-4c32-b836-b1fc5e18a8ff tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:49.614404 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a7836823-116a-4c32-b836-b1fc5e18a8ff tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:49.622535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a7836823-116a-4c32-b836-b1fc5e18a8ff tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1258 microversion: 2.1 time: 0.178425 Jul 27 20:11:49.623243 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 247/509] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:49 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1258 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:50.646518 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-17a3cfe1-adac-47fb-91a5-982aafd66b1e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:50.647758 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-17a3cfe1-adac-47fb-91a5-982aafd66b1e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:50.653931 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-17a3cfe1-adac-47fb-91a5-982aafd66b1e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:50.654373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-17a3cfe1-adac-47fb-91a5-982aafd66b1e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:50.655133 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-17a3cfe1-adac-47fb-91a5-982aafd66b1e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:50.656228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-17a3cfe1-adac-47fb-91a5-982aafd66b1e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:50.658919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=78 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:11:50.790875 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-17a3cfe1-adac-47fb-91a5-982aafd66b1e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:50.799586 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-17a3cfe1-adac-47fb-91a5-982aafd66b1e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1258 microversion: 2.1 time: 0.158729 Jul 27 20:11:50.800164 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 263/510] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:50 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:51.820853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-65f80ef5-706c-48be-9e70-f8bdfd151f15 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:51.821481 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-65f80ef5-706c-48be-9e70-f8bdfd151f15 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:51.827545 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65f80ef5-706c-48be-9e70-f8bdfd151f15 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:51.827984 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65f80ef5-706c-48be-9e70-f8bdfd151f15 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:51.828736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65f80ef5-706c-48be-9e70-f8bdfd151f15 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:51.829306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65f80ef5-706c-48be-9e70-f8bdfd151f15 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:51.958412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-65f80ef5-706c-48be-9e70-f8bdfd151f15 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:51.965865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-65f80ef5-706c-48be-9e70-f8bdfd151f15 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1258 microversion: 2.1 time: 0.149135 Jul 27 20:11:51.966428 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 248/511] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:51 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:52.987940 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a81779af-e738-481e-91db-ab33dce0f152 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:52.988465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a81779af-e738-481e-91db-ab33dce0f152 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:52.994966 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a81779af-e738-481e-91db-ab33dce0f152 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:52.995415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a81779af-e738-481e-91db-ab33dce0f152 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:52.996236 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a81779af-e738-481e-91db-ab33dce0f152 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:52.996675 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a81779af-e738-481e-91db-ab33dce0f152 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:53.140493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a81779af-e738-481e-91db-ab33dce0f152 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:53.148116 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a81779af-e738-481e-91db-ab33dce0f152 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1258 microversion: 2.1 time: 0.165040 Jul 27 20:11:53.148714 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 264/512] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:52 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:54.169397 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f4668dc1-6b6c-4dc8-b066-49c47ea6a143 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:54.170048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f4668dc1-6b6c-4dc8-b066-49c47ea6a143 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:54.172589 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:11:54.177822 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f4668dc1-6b6c-4dc8-b066-49c47ea6a143 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:54.178268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f4668dc1-6b6c-4dc8-b066-49c47ea6a143 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:54.179057 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f4668dc1-6b6c-4dc8-b066-49c47ea6a143 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:54.179488 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f4668dc1-6b6c-4dc8-b066-49c47ea6a143 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:54.319206 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f4668dc1-6b6c-4dc8-b066-49c47ea6a143 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:54.326729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f4668dc1-6b6c-4dc8-b066-49c47ea6a143 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1258 microversion: 2.1 time: 0.161144 Jul 27 20:11:54.327585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 249/513] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:54 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:55.348387 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f25c0430-a87d-462c-9158-927f9813cf51 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:55.349163 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f25c0430-a87d-462c-9158-927f9813cf51 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:55.351162 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=2 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:11:55.351827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=6 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:11:55.359195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f25c0430-a87d-462c-9158-927f9813cf51 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:55.359648 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f25c0430-a87d-462c-9158-927f9813cf51 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:55.360430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f25c0430-a87d-462c-9158-927f9813cf51 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:55.360881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f25c0430-a87d-462c-9158-927f9813cf51 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:55.596168 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f25c0430-a87d-462c-9158-927f9813cf51 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:55.603913 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f25c0430-a87d-462c-9158-927f9813cf51 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1258 microversion: 2.1 time: 0.259430 Jul 27 20:11:55.604213 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 265/514] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:55 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1258 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:11:56.624083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-20d1cbf1-66c7-4f3f-a9d1-e6ec21922fbc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:56.624775 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-20d1cbf1-66c7-4f3f-a9d1-e6ec21922fbc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:56.630949 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-20d1cbf1-66c7-4f3f-a9d1-e6ec21922fbc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:56.631398 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-20d1cbf1-66c7-4f3f-a9d1-e6ec21922fbc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:56.632165 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-20d1cbf1-66c7-4f3f-a9d1-e6ec21922fbc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:56.632602 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-20d1cbf1-66c7-4f3f-a9d1-e6ec21922fbc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:56.773213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-20d1cbf1-66c7-4f3f-a9d1-e6ec21922fbc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:56.781120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-20d1cbf1-66c7-4f3f-a9d1-e6ec21922fbc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1258 microversion: 2.1 time: 0.161051 Jul 27 20:11:56.781679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 250/515] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:56 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:57.805226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-02eb618e-a0b1-4d97-9972-f5f390cb3fbc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:57.805927 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-02eb618e-a0b1-4d97-9972-f5f390cb3fbc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:57.813633 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-02eb618e-a0b1-4d97-9972-f5f390cb3fbc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:57.814096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-02eb618e-a0b1-4d97-9972-f5f390cb3fbc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:57.814925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-02eb618e-a0b1-4d97-9972-f5f390cb3fbc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:57.815366 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-02eb618e-a0b1-4d97-9972-f5f390cb3fbc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:57.947477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-02eb618e-a0b1-4d97-9972-f5f390cb3fbc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:57.955224 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-02eb618e-a0b1-4d97-9972-f5f390cb3fbc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1258 microversion: 2.1 time: 0.156857 Jul 27 20:11:57.955868 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 266/516] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:57 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:11:58.976519 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-af03dea7-32ad-41fb-8c11-fa1521b6957e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:11:58.977276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-af03dea7-32ad-41fb-8c11-fa1521b6957e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:11:58.984014 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af03dea7-32ad-41fb-8c11-fa1521b6957e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:58.984535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af03dea7-32ad-41fb-8c11-fa1521b6957e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:58.985431 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af03dea7-32ad-41fb-8c11-fa1521b6957e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:58.986036 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af03dea7-32ad-41fb-8c11-fa1521b6957e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:59.143875 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-af03dea7-32ad-41fb-8c11-fa1521b6957e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:11:59.151760 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-af03dea7-32ad-41fb-8c11-fa1521b6957e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1258 microversion: 2.1 time: 0.179239 Jul 27 20:11:59.152332 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 251/517] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:11:58 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1258 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:11:59.491909 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-12d64647-922f-4991-bbd5-ecacfe7e52f8 req-3fb8cdc0-ccaa-4cfc-bac7-59a0c988d9fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c560ad96-cd64-4d84-86c8-c315f0fa0ab7", "name": "network-vif-plugged", "status": "completed", "tag": "12f96d47-a8d9-4367-b8bf-0bb05f9ee59b"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:11:59.504831 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-12d64647-922f-4991-bbd5-ecacfe7e52f8 req-3fb8cdc0-ccaa-4cfc-bac7-59a0c988d9fa service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:11:59.505406 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-12d64647-922f-4991-bbd5-ecacfe7e52f8 req-3fb8cdc0-ccaa-4cfc-bac7-59a0c988d9fa service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:11:59.518713 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-12d64647-922f-4991-bbd5-ecacfe7e52f8 req-3fb8cdc0-ccaa-4cfc-bac7-59a0c988d9fa service nova] Creating event network-vif-plugged:12f96d47-a8d9-4367-b8bf-0bb05f9ee59b for instance c560ad96-cd64-4d84-86c8-c315f0fa0ab7 on hv-cinder-79987 Jul 27 20:11:59.524009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-12d64647-922f-4991-bbd5-ecacfe7e52f8 req-3fb8cdc0-ccaa-4cfc-bac7-59a0c988d9fa service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035794 Jul 27 20:11:59.524611 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 267/518] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:12:00.173558 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8d4dfa28-40b9-4a03-9d3c-90dfc2c9b500 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:00.174162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8d4dfa28-40b9-4a03-9d3c-90dfc2c9b500 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:00.180580 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d4dfa28-40b9-4a03-9d3c-90dfc2c9b500 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:00.180681 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d4dfa28-40b9-4a03-9d3c-90dfc2c9b500 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:00.181391 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d4dfa28-40b9-4a03-9d3c-90dfc2c9b500 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:00.181813 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d4dfa28-40b9-4a03-9d3c-90dfc2c9b500 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:00.318909 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8d4dfa28-40b9-4a03-9d3c-90dfc2c9b500 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:00.326499 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8d4dfa28-40b9-4a03-9d3c-90dfc2c9b500 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1258 microversion: 2.1 time: 0.157548 Jul 27 20:12:00.327148 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 252/519] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:00 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:00.942709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f0663bb8-ce8f-4fef-a360-cd9da2102ced tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:00.943296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f0663bb8-ce8f-4fef-a360-cd9da2102ced tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:00.949524 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0663bb8-ce8f-4fef-a360-cd9da2102ced tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:00.949979 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0663bb8-ce8f-4fef-a360-cd9da2102ced tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:00.950753 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0663bb8-ce8f-4fef-a360-cd9da2102ced tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:00.951195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0663bb8-ce8f-4fef-a360-cd9da2102ced tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:00.974723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f0663bb8-ce8f-4fef-a360-cd9da2102ced tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/ips" status: 200 len: 146 microversion: 2.1 time: 0.037013 Jul 27 20:12:00.975264 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 268/520] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Jul 27 20:12:00 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:12:01.347923 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-45df92e8-ad8f-41de-95ee-1cecdff297ce tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:01.348537 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-45df92e8-ad8f-41de-95ee-1cecdff297ce tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:01.354517 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-45df92e8-ad8f-41de-95ee-1cecdff297ce tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:01.354956 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-45df92e8-ad8f-41de-95ee-1cecdff297ce tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:01.355705 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-45df92e8-ad8f-41de-95ee-1cecdff297ce tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:01.356131 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-45df92e8-ad8f-41de-95ee-1cecdff297ce tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:01.496802 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-45df92e8-ad8f-41de-95ee-1cecdff297ce tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:01.504650 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-45df92e8-ad8f-41de-95ee-1cecdff297ce tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1258 microversion: 2.1 time: 0.160715 Jul 27 20:12:01.505436 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 253/521] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:01 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:02.526304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2fdb6912-3f96-4a6f-b9e2-d16855c939c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:02.526944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2fdb6912-3f96-4a6f-b9e2-d16855c939c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:02.533039 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2fdb6912-3f96-4a6f-b9e2-d16855c939c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:02.533498 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2fdb6912-3f96-4a6f-b9e2-d16855c939c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:02.534266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2fdb6912-3f96-4a6f-b9e2-d16855c939c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:02.534706 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2fdb6912-3f96-4a6f-b9e2-d16855c939c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:02.665063 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2fdb6912-3f96-4a6f-b9e2-d16855c939c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:02.673066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2fdb6912-3f96-4a6f-b9e2-d16855c939c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1442 microversion: 2.1 time: 0.150750 Jul 27 20:12:02.673637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 269/522] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:02 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1442 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:02.694255 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a589370f-de02-4897-a7b5-a3710c881262 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:02.694885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a589370f-de02-4897-a7b5-a3710c881262 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:02.700859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a589370f-de02-4897-a7b5-a3710c881262 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:02.701346 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a589370f-de02-4897-a7b5-a3710c881262 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:02.702752 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a589370f-de02-4897-a7b5-a3710c881262 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:02.703191 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a589370f-de02-4897-a7b5-a3710c881262 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:02.847928 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a589370f-de02-4897-a7b5-a3710c881262 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:02.855553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a589370f-de02-4897-a7b5-a3710c881262 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1442 microversion: 2.1 time: 0.165304 Jul 27 20:12:02.856038 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 254/523] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:02 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1442 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:04.802861 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1fc316ee-bb20-46f9-91cd-308dd98f6355 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0033c858-7f59-4422-b141-9a69e348d81c"}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:12:04.805260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1fc316ee-bb20-46f9-91cd-308dd98f6355 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:04.813281 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1fc316ee-bb20-46f9-91cd-308dd98f6355 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:04.813738 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1fc316ee-bb20-46f9-91cd-308dd98f6355 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:04.814712 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1fc316ee-bb20-46f9-91cd-308dd98f6355 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:04.815316 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1fc316ee-bb20-46f9-91cd-308dd98f6355 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:04.821248 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-ac2d5211-e3b5-4e00-8ab1-8e39673fcc73 req-3e21d830-6aeb-4603-8949-34cda2c89ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c560ad96-cd64-4d84-86c8-c315f0fa0ab7", "tag": "12f96d47-a8d9-4367-b8bf-0bb05f9ee59b"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:12:04.834037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-ac2d5211-e3b5-4e00-8ab1-8e39673fcc73 req-3e21d830-6aeb-4603-8949-34cda2c89ae9 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:04.834481 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-ac2d5211-e3b5-4e00-8ab1-8e39673fcc73 req-3e21d830-6aeb-4603-8949-34cda2c89ae9 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:04.846963 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-ac2d5211-e3b5-4e00-8ab1-8e39673fcc73 req-3e21d830-6aeb-4603-8949-34cda2c89ae9 service nova] Creating event network-changed:12f96d47-a8d9-4367-b8bf-0bb05f9ee59b for instance c560ad96-cd64-4d84-86c8-c315f0fa0ab7 on hv-cinder-79987 Jul 27 20:12:04.852400 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-ac2d5211-e3b5-4e00-8ab1-8e39673fcc73 req-3e21d830-6aeb-4603-8949-34cda2c89ae9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037287 Jul 27 20:12:04.853254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 255/524] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:12:05.131108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1fc316ee-bb20-46f9-91cd-308dd98f6355 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "POST /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331845 Jul 27 20:12:05.131474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 270/525] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Jul 27 20:12:04 2022] POST /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:12:09.328937 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c3af04a4-c225-4bd8-92de-f4d1ab290c8c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:09.329548 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c3af04a4-c225-4bd8-92de-f4d1ab290c8c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:09.335654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3af04a4-c225-4bd8-92de-f4d1ab290c8c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:09.336099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3af04a4-c225-4bd8-92de-f4d1ab290c8c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:09.336844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3af04a4-c225-4bd8-92de-f4d1ab290c8c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:09.337311 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3af04a4-c225-4bd8-92de-f4d1ab290c8c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:09.360006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c3af04a4-c225-4bd8-92de-f4d1ab290c8c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/ips" status: 200 len: 151 microversion: 2.20 time: 0.035960 Jul 27 20:12:09.360557 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 256/526] 10.222.0.65 () {60 vars in 1289 bytes} [Wed Jul 27 20:12:09 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:12:11.316755 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-154aa214-5790-4233-99f9-0e20b00e8a16 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:12:11.317662 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-154aa214-5790-4233-99f9-0e20b00e8a16 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:11.326118 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-154aa214-5790-4233-99f9-0e20b00e8a16 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:11.327140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-154aa214-5790-4233-99f9-0e20b00e8a16 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:11.328144 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-154aa214-5790-4233-99f9-0e20b00e8a16 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:11.328577 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-154aa214-5790-4233-99f9-0e20b00e8a16 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:11.354904 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.objects.instance [None req-154aa214-5790-4233-99f9-0e20b00e8a16 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lazy-loading 'flavor' on Instance uuid d725356e-73a3-486b-b590-0324916667ff {{(pid=117876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:12:11.543305 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-154aa214-5790-4233-99f9-0e20b00e8a16 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "POST /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/action" status: 202 len: 0 microversion: 2.20 time: 0.233305 Jul 27 20:12:11.544016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 271/527] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Jul 27 20:12:11 2022] POST /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:11.553009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1287325d-218c-4d3a-9f4a-5f7ab6dc6d19 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:11.554124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1287325d-218c-4d3a-9f4a-5f7ab6dc6d19 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:11.559493 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=34 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:11.561059 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1287325d-218c-4d3a-9f4a-5f7ab6dc6d19 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:11.561837 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1287325d-218c-4d3a-9f4a-5f7ab6dc6d19 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:11.562619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1287325d-218c-4d3a-9f4a-5f7ab6dc6d19 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:11.563055 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1287325d-218c-4d3a-9f4a-5f7ab6dc6d19 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:11.705986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1287325d-218c-4d3a-9f4a-5f7ab6dc6d19 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:11.715931 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1287325d-218c-4d3a-9f4a-5f7ab6dc6d19 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:11.718319 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1287325d-218c-4d3a-9f4a-5f7ab6dc6d19 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:11.720580 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1287325d-218c-4d3a-9f4a-5f7ab6dc6d19 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1723 microversion: 2.20 time: 0.171339 Jul 27 20:12:11.721228 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 257/528] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:11 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:12.749754 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-44c98e20-9c18-46ac-b846-3021f08ec03c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:12.751117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-44c98e20-9c18-46ac-b846-3021f08ec03c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:12.760127 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-44c98e20-9c18-46ac-b846-3021f08ec03c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:12.760591 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-44c98e20-9c18-46ac-b846-3021f08ec03c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:12.761865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-44c98e20-9c18-46ac-b846-3021f08ec03c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:12.762340 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-44c98e20-9c18-46ac-b846-3021f08ec03c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:12.931013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-44c98e20-9c18-46ac-b846-3021f08ec03c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:12.939676 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-44c98e20-9c18-46ac-b846-3021f08ec03c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:12.941509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-44c98e20-9c18-46ac-b846-3021f08ec03c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:12.943050 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-44c98e20-9c18-46ac-b846-3021f08ec03c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1723 microversion: 2.20 time: 0.200254 Jul 27 20:12:12.943716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 272/529] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:12 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:13.734656 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-267e2c6d-135a-4a6c-b689-f0ba3e12300c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:12:13.740941 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-267e2c6d-135a-4a6c-b689-f0ba3e12300c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:13.741416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-267e2c6d-135a-4a6c-b689-f0ba3e12300c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:13.743874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=78 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:13.802490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-267e2c6d-135a-4a6c-b689-f0ba3e12300c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Going to try to stop instance {{(pid=117877) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 27 20:12:13.844595 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-267e2c6d-135a-4a6c-b689-f0ba3e12300c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "POST /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/action" status: 202 len: 0 microversion: 2.1 time: 0.113675 Jul 27 20:12:13.845212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 258/530] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Jul 27 20:12:13 2022] POST /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:12:13.853848 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-84bcf760-5ce9-4360-b76b-4389a9725e38 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:13.854531 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-84bcf760-5ce9-4360-b76b-4389a9725e38 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:13.861622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84bcf760-5ce9-4360-b76b-4389a9725e38 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:13.862061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84bcf760-5ce9-4360-b76b-4389a9725e38 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:13.862838 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84bcf760-5ce9-4360-b76b-4389a9725e38 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:13.863276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84bcf760-5ce9-4360-b76b-4389a9725e38 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:13.976106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-86d11672-fed5-4691-91a5-7e121ace9e94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:13.976106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-86d11672-fed5-4691-91a5-7e121ace9e94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:13.981576 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86d11672-fed5-4691-91a5-7e121ace9e94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:13.982019 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86d11672-fed5-4691-91a5-7e121ace9e94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:13.983348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86d11672-fed5-4691-91a5-7e121ace9e94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:13.983784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86d11672-fed5-4691-91a5-7e121ace9e94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:14.008632 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-84bcf760-5ce9-4360-b76b-4389a9725e38 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:14.017709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-84bcf760-5ce9-4360-b76b-4389a9725e38 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1724 microversion: 2.1 time: 0.167552 Jul 27 20:12:14.018317 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 273/531] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:13 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:14.121022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-86d11672-fed5-4691-91a5-7e121ace9e94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:14.130012 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-86d11672-fed5-4691-91a5-7e121ace9e94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:14.131510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-86d11672-fed5-4691-91a5-7e121ace9e94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:14.132666 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-86d11672-fed5-4691-91a5-7e121ace9e94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1723 microversion: 2.20 time: 0.169785 Jul 27 20:12:14.133261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 259/532] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:13 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:12:15.038915 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2bbf664d-6acf-4723-b75c-2e0b3c58ee37 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:15.039522 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2bbf664d-6acf-4723-b75c-2e0b3c58ee37 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:15.046949 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2bbf664d-6acf-4723-b75c-2e0b3c58ee37 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:15.047401 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2bbf664d-6acf-4723-b75c-2e0b3c58ee37 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:15.048184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2bbf664d-6acf-4723-b75c-2e0b3c58ee37 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:15.048792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2bbf664d-6acf-4723-b75c-2e0b3c58ee37 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:15.156736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-86fc27e4-cb18-46a5-a965-09eee3184d9e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:15.157315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-86fc27e4-cb18-46a5-a965-09eee3184d9e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:15.163308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86fc27e4-cb18-46a5-a965-09eee3184d9e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:15.163751 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86fc27e4-cb18-46a5-a965-09eee3184d9e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:15.164508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86fc27e4-cb18-46a5-a965-09eee3184d9e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:15.164936 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86fc27e4-cb18-46a5-a965-09eee3184d9e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:15.177777 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2bbf664d-6acf-4723-b75c-2e0b3c58ee37 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:15.185824 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2bbf664d-6acf-4723-b75c-2e0b3c58ee37 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1724 microversion: 2.1 time: 0.150675 Jul 27 20:12:15.186401 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 274/533] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:15 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:15.300591 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-86fc27e4-cb18-46a5-a965-09eee3184d9e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:15.308433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-86fc27e4-cb18-46a5-a965-09eee3184d9e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:15.309964 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-86fc27e4-cb18-46a5-a965-09eee3184d9e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:15.311733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-86fc27e4-cb18-46a5-a965-09eee3184d9e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1723 microversion: 2.20 time: 0.159724 Jul 27 20:12:15.312291 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 260/534] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:15 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:12:16.207244 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-25502d8b-d655-418b-82f2-469d103cc58b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:16.207880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-25502d8b-d655-418b-82f2-469d103cc58b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:16.214449 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-25502d8b-d655-418b-82f2-469d103cc58b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:16.214911 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-25502d8b-d655-418b-82f2-469d103cc58b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:16.215683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-25502d8b-d655-418b-82f2-469d103cc58b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:16.216123 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-25502d8b-d655-418b-82f2-469d103cc58b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:16.335885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a0dc1ff9-59fe-480e-be85-28fc3304e8d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:16.336509 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a0dc1ff9-59fe-480e-be85-28fc3304e8d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:16.343890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0dc1ff9-59fe-480e-be85-28fc3304e8d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:16.344370 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0dc1ff9-59fe-480e-be85-28fc3304e8d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:16.345139 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0dc1ff9-59fe-480e-be85-28fc3304e8d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:16.345585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0dc1ff9-59fe-480e-be85-28fc3304e8d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:16.353021 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-25502d8b-d655-418b-82f2-469d103cc58b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:16.361268 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-25502d8b-d655-418b-82f2-469d103cc58b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1724 microversion: 2.1 time: 0.157774 Jul 27 20:12:16.361947 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 275/535] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:16 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:16.482367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a0dc1ff9-59fe-480e-be85-28fc3304e8d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:16.490249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a0dc1ff9-59fe-480e-be85-28fc3304e8d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:16.491752 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a0dc1ff9-59fe-480e-be85-28fc3304e8d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:16.492895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a0dc1ff9-59fe-480e-be85-28fc3304e8d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1723 microversion: 2.20 time: 0.161095 Jul 27 20:12:16.493468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 261/536] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:16 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:12:17.382239 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b2670cbe-59a2-4c4f-a60f-0e0fbf85e95f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:17.382849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b2670cbe-59a2-4c4f-a60f-0e0fbf85e95f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:17.385248 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=30 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:17.391702 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b2670cbe-59a2-4c4f-a60f-0e0fbf85e95f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:17.392160 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b2670cbe-59a2-4c4f-a60f-0e0fbf85e95f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:17.392928 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b2670cbe-59a2-4c4f-a60f-0e0fbf85e95f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:17.393402 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b2670cbe-59a2-4c4f-a60f-0e0fbf85e95f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:17.517260 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c847074d-5f2d-4f27-8bdd-9c5080fdcd91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:17.517981 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c847074d-5f2d-4f27-8bdd-9c5080fdcd91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:17.521745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b2670cbe-59a2-4c4f-a60f-0e0fbf85e95f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:17.523968 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c847074d-5f2d-4f27-8bdd-9c5080fdcd91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:17.524409 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c847074d-5f2d-4f27-8bdd-9c5080fdcd91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:17.525195 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c847074d-5f2d-4f27-8bdd-9c5080fdcd91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:17.525623 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c847074d-5f2d-4f27-8bdd-9c5080fdcd91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:17.529780 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b2670cbe-59a2-4c4f-a60f-0e0fbf85e95f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1724 microversion: 2.1 time: 0.151492 Jul 27 20:12:17.530474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 276/537] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:17 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:17.662887 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c847074d-5f2d-4f27-8bdd-9c5080fdcd91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:17.670815 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c847074d-5f2d-4f27-8bdd-9c5080fdcd91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:17.672820 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c847074d-5f2d-4f27-8bdd-9c5080fdcd91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:17.673987 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c847074d-5f2d-4f27-8bdd-9c5080fdcd91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1723 microversion: 2.20 time: 0.161382 Jul 27 20:12:17.674535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 262/538] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:17 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:12:18.550660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9c3df2e8-d851-4521-a020-b0ff251e799c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:18.551275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9c3df2e8-d851-4521-a020-b0ff251e799c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:18.557801 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9c3df2e8-d851-4521-a020-b0ff251e799c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:18.558257 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9c3df2e8-d851-4521-a020-b0ff251e799c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:18.559046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9c3df2e8-d851-4521-a020-b0ff251e799c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:18.559492 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9c3df2e8-d851-4521-a020-b0ff251e799c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:18.574315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:18.686427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9c3df2e8-d851-4521-a020-b0ff251e799c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:18.697074 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9c3df2e8-d851-4521-a020-b0ff251e799c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1724 microversion: 2.1 time: 0.150054 Jul 27 20:12:18.698063 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 277/539] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:18 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:18.702603 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dcc8f89d-1348-40d5-b9a5-01cfb4b8b5d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:18.703845 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dcc8f89d-1348-40d5-b9a5-01cfb4b8b5d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:18.710733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dcc8f89d-1348-40d5-b9a5-01cfb4b8b5d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:18.711189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dcc8f89d-1348-40d5-b9a5-01cfb4b8b5d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:18.711968 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dcc8f89d-1348-40d5-b9a5-01cfb4b8b5d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:18.712403 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dcc8f89d-1348-40d5-b9a5-01cfb4b8b5d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:18.846417 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dcc8f89d-1348-40d5-b9a5-01cfb4b8b5d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:18.854346 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dcc8f89d-1348-40d5-b9a5-01cfb4b8b5d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:18.855850 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dcc8f89d-1348-40d5-b9a5-01cfb4b8b5d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:18.857027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dcc8f89d-1348-40d5-b9a5-01cfb4b8b5d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1723 microversion: 2.20 time: 0.162417 Jul 27 20:12:18.857584 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 263/540] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:18 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:12:19.719938 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b833a762-f545-4a51-a588-87d9556aa1eb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:19.720584 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b833a762-f545-4a51-a588-87d9556aa1eb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:19.727096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b833a762-f545-4a51-a588-87d9556aa1eb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:19.727534 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b833a762-f545-4a51-a588-87d9556aa1eb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:19.728304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b833a762-f545-4a51-a588-87d9556aa1eb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:19.728747 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b833a762-f545-4a51-a588-87d9556aa1eb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:19.867491 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b833a762-f545-4a51-a588-87d9556aa1eb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:19.875829 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b833a762-f545-4a51-a588-87d9556aa1eb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1724 microversion: 2.1 time: 0.160204 Jul 27 20:12:19.876692 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 278/541] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:19 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:19.882260 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4883209a-bf6e-4fdc-b5ba-6a47e67fcd05 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:19.882891 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4883209a-bf6e-4fdc-b5ba-6a47e67fcd05 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:19.888883 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4883209a-bf6e-4fdc-b5ba-6a47e67fcd05 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:19.889355 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4883209a-bf6e-4fdc-b5ba-6a47e67fcd05 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:19.890603 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4883209a-bf6e-4fdc-b5ba-6a47e67fcd05 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:19.891129 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4883209a-bf6e-4fdc-b5ba-6a47e67fcd05 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:20.021289 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4883209a-bf6e-4fdc-b5ba-6a47e67fcd05 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:20.029027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4883209a-bf6e-4fdc-b5ba-6a47e67fcd05 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:20.031153 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4883209a-bf6e-4fdc-b5ba-6a47e67fcd05 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:20.032822 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4883209a-bf6e-4fdc-b5ba-6a47e67fcd05 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1723 microversion: 2.20 time: 0.154510 Jul 27 20:12:20.033411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 264/542] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:19 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:20.897844 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8c1c8671-b956-45da-b5fa-2be625e99f51 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:20.898468 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8c1c8671-b956-45da-b5fa-2be625e99f51 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:20.905119 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8c1c8671-b956-45da-b5fa-2be625e99f51 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:20.906061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8c1c8671-b956-45da-b5fa-2be625e99f51 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:20.906880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8c1c8671-b956-45da-b5fa-2be625e99f51 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:20.907319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8c1c8671-b956-45da-b5fa-2be625e99f51 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:21.043705 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8c1c8671-b956-45da-b5fa-2be625e99f51 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:21.051953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8c1c8671-b956-45da-b5fa-2be625e99f51 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1724 microversion: 2.1 time: 0.157929 Jul 27 20:12:21.052523 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 279/543] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:20 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:21.056821 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-44ecd0c1-f872-4c19-8fb2-b0918407fbd9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:21.057461 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-44ecd0c1-f872-4c19-8fb2-b0918407fbd9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:21.064086 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44ecd0c1-f872-4c19-8fb2-b0918407fbd9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:21.064534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44ecd0c1-f872-4c19-8fb2-b0918407fbd9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:21.065450 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44ecd0c1-f872-4c19-8fb2-b0918407fbd9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:21.065886 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44ecd0c1-f872-4c19-8fb2-b0918407fbd9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:21.195796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-44ecd0c1-f872-4c19-8fb2-b0918407fbd9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:21.204507 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-44ecd0c1-f872-4c19-8fb2-b0918407fbd9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:21.206007 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-44ecd0c1-f872-4c19-8fb2-b0918407fbd9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:21.207148 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-44ecd0c1-f872-4c19-8fb2-b0918407fbd9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1723 microversion: 2.20 time: 0.154268 Jul 27 20:12:21.207700 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 265/544] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:21 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:12:22.074041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9fe35d7a-0d25-4ca2-a6d1-05ec978442e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:22.074702 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9fe35d7a-0d25-4ca2-a6d1-05ec978442e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:22.082789 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9fe35d7a-0d25-4ca2-a6d1-05ec978442e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:22.083254 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9fe35d7a-0d25-4ca2-a6d1-05ec978442e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:22.084047 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9fe35d7a-0d25-4ca2-a6d1-05ec978442e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:22.084496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9fe35d7a-0d25-4ca2-a6d1-05ec978442e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:22.231714 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b3d72956-f470-4551-ac9a-8b9ebd5d2d02 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:22.232306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b3d72956-f470-4551-ac9a-8b9ebd5d2d02 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:22.238925 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3d72956-f470-4551-ac9a-8b9ebd5d2d02 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:22.239373 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3d72956-f470-4551-ac9a-8b9ebd5d2d02 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:22.240194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3d72956-f470-4551-ac9a-8b9ebd5d2d02 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:22.240811 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3d72956-f470-4551-ac9a-8b9ebd5d2d02 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:22.398269 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b3d72956-f470-4551-ac9a-8b9ebd5d2d02 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:22.407018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b3d72956-f470-4551-ac9a-8b9ebd5d2d02 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:22.408520 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b3d72956-f470-4551-ac9a-8b9ebd5d2d02 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:22.409709 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b3d72956-f470-4551-ac9a-8b9ebd5d2d02 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1723 microversion: 2.20 time: 0.181971 Jul 27 20:12:22.410330 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 266/545] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:22 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:12:22.463118 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9fe35d7a-0d25-4ca2-a6d1-05ec978442e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:22.471994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9fe35d7a-0d25-4ca2-a6d1-05ec978442e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1724 microversion: 2.1 time: 0.402236 Jul 27 20:12:22.472563 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 280/546] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:22 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1724 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:23.433271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-114afe6b-367c-4ab4-851a-dc9ee20e0679 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:23.433882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-114afe6b-367c-4ab4-851a-dc9ee20e0679 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:23.440666 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-114afe6b-367c-4ab4-851a-dc9ee20e0679 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:23.441154 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-114afe6b-367c-4ab4-851a-dc9ee20e0679 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:23.441915 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-114afe6b-367c-4ab4-851a-dc9ee20e0679 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:23.442605 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-114afe6b-367c-4ab4-851a-dc9ee20e0679 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:23.494102 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e5a833fb-997c-48e8-84f8-f0c6a21679aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:23.494720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e5a833fb-997c-48e8-84f8-f0c6a21679aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:23.502203 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e5a833fb-997c-48e8-84f8-f0c6a21679aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:23.502661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e5a833fb-997c-48e8-84f8-f0c6a21679aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:23.503443 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e5a833fb-997c-48e8-84f8-f0c6a21679aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:23.503887 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e5a833fb-997c-48e8-84f8-f0c6a21679aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:23.577410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-114afe6b-367c-4ab4-851a-dc9ee20e0679 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:23.585588 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-114afe6b-367c-4ab4-851a-dc9ee20e0679 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:23.587087 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-114afe6b-367c-4ab4-851a-dc9ee20e0679 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:23.588547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-114afe6b-367c-4ab4-851a-dc9ee20e0679 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1723 microversion: 2.20 time: 0.158870 Jul 27 20:12:23.588788 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 267/547] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:23 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:23.640229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e5a833fb-997c-48e8-84f8-f0c6a21679aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:23.648082 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e5a833fb-997c-48e8-84f8-f0c6a21679aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1724 microversion: 2.1 time: 0.157872 Jul 27 20:12:23.648648 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 281/548] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:23 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:12:24.611763 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-46a2ebb4-1da3-4c6e-aa12-c7656a17ebca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:24.612370 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-46a2ebb4-1da3-4c6e-aa12-c7656a17ebca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:24.618607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-46a2ebb4-1da3-4c6e-aa12-c7656a17ebca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:24.619052 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-46a2ebb4-1da3-4c6e-aa12-c7656a17ebca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:24.619812 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-46a2ebb4-1da3-4c6e-aa12-c7656a17ebca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:24.620538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-46a2ebb4-1da3-4c6e-aa12-c7656a17ebca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:24.669353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-68265d8e-4f5b-433f-9fd1-786232d05734 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:24.669970 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-68265d8e-4f5b-433f-9fd1-786232d05734 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:24.677340 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-68265d8e-4f5b-433f-9fd1-786232d05734 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:24.677791 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-68265d8e-4f5b-433f-9fd1-786232d05734 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:24.678558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-68265d8e-4f5b-433f-9fd1-786232d05734 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:24.678999 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-68265d8e-4f5b-433f-9fd1-786232d05734 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:24.757103 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-46a2ebb4-1da3-4c6e-aa12-c7656a17ebca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:24.765058 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-46a2ebb4-1da3-4c6e-aa12-c7656a17ebca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:24.766601 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-46a2ebb4-1da3-4c6e-aa12-c7656a17ebca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:24.767793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-46a2ebb4-1da3-4c6e-aa12-c7656a17ebca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1723 microversion: 2.20 time: 0.160461 Jul 27 20:12:24.768350 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 268/549] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:24 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:24.812632 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-68265d8e-4f5b-433f-9fd1-786232d05734 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:24.821047 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-68265d8e-4f5b-433f-9fd1-786232d05734 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1724 microversion: 2.1 time: 0.155478 Jul 27 20:12:24.821615 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 282/550] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:24 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:12:25.792178 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-963dc24b-3b1f-4c59-9b4c-364a069d3fdf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:25.792715 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-963dc24b-3b1f-4c59-9b4c-364a069d3fdf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:25.799402 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-963dc24b-3b1f-4c59-9b4c-364a069d3fdf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:25.799850 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-963dc24b-3b1f-4c59-9b4c-364a069d3fdf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:25.800616 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-963dc24b-3b1f-4c59-9b4c-364a069d3fdf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:25.801081 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-963dc24b-3b1f-4c59-9b4c-364a069d3fdf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:25.841870 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bd28a9c4-1c92-4177-a9fb-9dc5d1df44b9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:25.842482 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bd28a9c4-1c92-4177-a9fb-9dc5d1df44b9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:25.849023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bd28a9c4-1c92-4177-a9fb-9dc5d1df44b9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:25.849476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bd28a9c4-1c92-4177-a9fb-9dc5d1df44b9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:25.850242 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bd28a9c4-1c92-4177-a9fb-9dc5d1df44b9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:25.850758 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bd28a9c4-1c92-4177-a9fb-9dc5d1df44b9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:25.932415 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-963dc24b-3b1f-4c59-9b4c-364a069d3fdf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:25.941593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-963dc24b-3b1f-4c59-9b4c-364a069d3fdf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:25.943426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-963dc24b-3b1f-4c59-9b4c-364a069d3fdf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:25.944588 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-963dc24b-3b1f-4c59-9b4c-364a069d3fdf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1723 microversion: 2.20 time: 0.156473 Jul 27 20:12:25.945175 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 269/551] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:25 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:25.978310 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bd28a9c4-1c92-4177-a9fb-9dc5d1df44b9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:25.986703 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bd28a9c4-1c92-4177-a9fb-9dc5d1df44b9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1724 microversion: 2.1 time: 0.148658 Jul 27 20:12:25.987255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 283/552] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:25 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:12:26.967715 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-58dd38b8-0e7a-4111-9c3b-e01bfaa46e9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:26.968678 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-58dd38b8-0e7a-4111-9c3b-e01bfaa46e9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:26.974802 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-58dd38b8-0e7a-4111-9c3b-e01bfaa46e9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:26.975242 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-58dd38b8-0e7a-4111-9c3b-e01bfaa46e9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:26.975995 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-58dd38b8-0e7a-4111-9c3b-e01bfaa46e9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:26.976424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-58dd38b8-0e7a-4111-9c3b-e01bfaa46e9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:27.007581 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-65cf401a-0464-4b15-b8bd-1952459653cd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:27.008297 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-65cf401a-0464-4b15-b8bd-1952459653cd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:27.015027 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-65cf401a-0464-4b15-b8bd-1952459653cd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:27.015480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-65cf401a-0464-4b15-b8bd-1952459653cd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:27.016900 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-65cf401a-0464-4b15-b8bd-1952459653cd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:27.017361 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-65cf401a-0464-4b15-b8bd-1952459653cd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:27.155135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-65cf401a-0464-4b15-b8bd-1952459653cd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:27.163076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-65cf401a-0464-4b15-b8bd-1952459653cd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1724 microversion: 2.1 time: 0.159253 Jul 27 20:12:27.163763 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 284/553] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:27 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:12:27.185278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-58dd38b8-0e7a-4111-9c3b-e01bfaa46e9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:27.194847 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-58dd38b8-0e7a-4111-9c3b-e01bfaa46e9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:27.196329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-58dd38b8-0e7a-4111-9c3b-e01bfaa46e9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:27.197505 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-58dd38b8-0e7a-4111-9c3b-e01bfaa46e9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1723 microversion: 2.20 time: 0.233666 Jul 27 20:12:27.198059 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 270/554] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:26 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:12:28.185582 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-dd87bd55-f4f7-4385-8fde-051d4267d4ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:28.186108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-dd87bd55-f4f7-4385-8fde-051d4267d4ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:28.192846 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dd87bd55-f4f7-4385-8fde-051d4267d4ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:28.193327 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dd87bd55-f4f7-4385-8fde-051d4267d4ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:28.194083 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dd87bd55-f4f7-4385-8fde-051d4267d4ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:28.194526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dd87bd55-f4f7-4385-8fde-051d4267d4ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:28.221998 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-81eb6344-a2ad-4f71-9afe-d51f745f8f3a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:28.222593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-81eb6344-a2ad-4f71-9afe-d51f745f8f3a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:28.228776 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81eb6344-a2ad-4f71-9afe-d51f745f8f3a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:28.229261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81eb6344-a2ad-4f71-9afe-d51f745f8f3a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:28.230036 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81eb6344-a2ad-4f71-9afe-d51f745f8f3a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:28.230471 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81eb6344-a2ad-4f71-9afe-d51f745f8f3a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:28.325202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-dd87bd55-f4f7-4385-8fde-051d4267d4ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:28.333958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-dd87bd55-f4f7-4385-8fde-051d4267d4ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1724 microversion: 2.1 time: 0.152770 Jul 27 20:12:28.334526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 285/555] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:28 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:28.362634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-81eb6344-a2ad-4f71-9afe-d51f745f8f3a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:28.370384 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-81eb6344-a2ad-4f71-9afe-d51f745f8f3a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:28.371879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-81eb6344-a2ad-4f71-9afe-d51f745f8f3a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:28.373059 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-81eb6344-a2ad-4f71-9afe-d51f745f8f3a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1723 microversion: 2.20 time: 0.155549 Jul 27 20:12:28.373608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 271/556] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:28 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:12:29.356256 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-16a0dd75-245f-4f48-8ac4-8f590883c1e1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:29.356792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-16a0dd75-245f-4f48-8ac4-8f590883c1e1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:29.363311 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-16a0dd75-245f-4f48-8ac4-8f590883c1e1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:29.363767 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-16a0dd75-245f-4f48-8ac4-8f590883c1e1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:29.364533 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-16a0dd75-245f-4f48-8ac4-8f590883c1e1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:29.364997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-16a0dd75-245f-4f48-8ac4-8f590883c1e1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:29.397525 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-93584c7f-a65d-44b4-8624-8132a4902cc0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:29.398129 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-93584c7f-a65d-44b4-8624-8132a4902cc0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:29.404273 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93584c7f-a65d-44b4-8624-8132a4902cc0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:29.404709 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93584c7f-a65d-44b4-8624-8132a4902cc0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:29.405503 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93584c7f-a65d-44b4-8624-8132a4902cc0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:29.405933 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93584c7f-a65d-44b4-8624-8132a4902cc0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:29.493778 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-16a0dd75-245f-4f48-8ac4-8f590883c1e1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:29.502519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-16a0dd75-245f-4f48-8ac4-8f590883c1e1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1724 microversion: 2.1 time: 0.150099 Jul 27 20:12:29.503099 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 286/557] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:29 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:29.549814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-93584c7f-a65d-44b4-8624-8132a4902cc0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:29.557877 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-93584c7f-a65d-44b4-8624-8132a4902cc0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:29.559387 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-93584c7f-a65d-44b4-8624-8132a4902cc0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:29.560549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-93584c7f-a65d-44b4-8624-8132a4902cc0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1744 microversion: 2.20 time: 0.166827 Jul 27 20:12:29.561125 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 272/558] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:29 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:12:30.523830 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f314ea3c-d157-4109-93e7-e1a5722ea9fb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:30.524449 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f314ea3c-d157-4109-93e7-e1a5722ea9fb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:30.531216 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f314ea3c-d157-4109-93e7-e1a5722ea9fb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:30.532393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f314ea3c-d157-4109-93e7-e1a5722ea9fb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:30.533222 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f314ea3c-d157-4109-93e7-e1a5722ea9fb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:30.533668 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f314ea3c-d157-4109-93e7-e1a5722ea9fb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:30.585385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-278a01a8-6549-4218-ac39-5d159923ef29 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:30.585960 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-278a01a8-6549-4218-ac39-5d159923ef29 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:30.592086 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-278a01a8-6549-4218-ac39-5d159923ef29 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:30.592536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-278a01a8-6549-4218-ac39-5d159923ef29 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:30.593333 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-278a01a8-6549-4218-ac39-5d159923ef29 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:30.594384 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-278a01a8-6549-4218-ac39-5d159923ef29 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:30.665913 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f314ea3c-d157-4109-93e7-e1a5722ea9fb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:30.673980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f314ea3c-d157-4109-93e7-e1a5722ea9fb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1701 microversion: 2.1 time: 0.154030 Jul 27 20:12:30.674965 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 287/559] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:30 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1701 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:30.694825 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-463cfaa0-8124-4a3d-88d5-54fd11f230f8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:12:30.700919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-463cfaa0-8124-4a3d-88d5-54fd11f230f8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:30.701419 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-463cfaa0-8124-4a3d-88d5-54fd11f230f8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:30.727769 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-278a01a8-6549-4218-ac39-5d159923ef29 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:30.730078 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:30.737523 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-278a01a8-6549-4218-ac39-5d159923ef29 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:30.739005 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-278a01a8-6549-4218-ac39-5d159923ef29 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:30.740142 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-278a01a8-6549-4218-ac39-5d159923ef29 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1744 microversion: 2.20 time: 0.158660 Jul 27 20:12:30.740690 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 273/560] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:30 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:12:30.764766 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-463cfaa0-8124-4a3d-88d5-54fd11f230f8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Going to try to start instance {{(pid=117876) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 27 20:12:30.807743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-463cfaa0-8124-4a3d-88d5-54fd11f230f8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "POST /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/action" status: 202 len: 0 microversion: 2.1 time: 0.116675 Jul 27 20:12:30.808341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 288/561] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Jul 27 20:12:30 2022] POST /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 20:12:30.816790 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bb1939fb-e115-4531-b00f-bdadf95f7587 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:30.817678 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bb1939fb-e115-4531-b00f-bdadf95f7587 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:30.824756 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb1939fb-e115-4531-b00f-bdadf95f7587 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:30.825223 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb1939fb-e115-4531-b00f-bdadf95f7587 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:30.825986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb1939fb-e115-4531-b00f-bdadf95f7587 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:30.826415 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb1939fb-e115-4531-b00f-bdadf95f7587 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:30.968045 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bb1939fb-e115-4531-b00f-bdadf95f7587 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:30.976497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bb1939fb-e115-4531-b00f-bdadf95f7587 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1710 microversion: 2.1 time: 0.163807 Jul 27 20:12:30.977094 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 274/562] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:30 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1710 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:12:31.640554 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-65962f23-dade-456e-9b8e-c765e5240a18 req-89045efe-14bd-480b-bdcc-3fdb4506847a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d725356e-73a3-486b-b590-0324916667ff", "name": "network-vif-plugged", "status": "completed", "tag": "899741ce-2752-45e1-aee9-3a2da333cdf0"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:12:31.651848 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-65962f23-dade-456e-9b8e-c765e5240a18 req-89045efe-14bd-480b-bdcc-3fdb4506847a service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:31.652330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-65962f23-dade-456e-9b8e-c765e5240a18 req-89045efe-14bd-480b-bdcc-3fdb4506847a service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:31.664688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-65962f23-dade-456e-9b8e-c765e5240a18 req-89045efe-14bd-480b-bdcc-3fdb4506847a service nova] Creating event network-vif-plugged:899741ce-2752-45e1-aee9-3a2da333cdf0 for instance d725356e-73a3-486b-b590-0324916667ff on hv-cinder-79987 Jul 27 20:12:31.669808 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-65962f23-dade-456e-9b8e-c765e5240a18 req-89045efe-14bd-480b-bdcc-3fdb4506847a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033426 Jul 27 20:12:31.670542 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 289/563] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:12:31.763300 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-af955156-99b4-40ab-9878-162ee06eca19 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:31.763898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-af955156-99b4-40ab-9878-162ee06eca19 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:31.770590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af955156-99b4-40ab-9878-162ee06eca19 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:31.771028 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af955156-99b4-40ab-9878-162ee06eca19 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:31.771779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af955156-99b4-40ab-9878-162ee06eca19 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:31.772204 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af955156-99b4-40ab-9878-162ee06eca19 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:31.932878 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-af955156-99b4-40ab-9878-162ee06eca19 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:31.941492 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-af955156-99b4-40ab-9878-162ee06eca19 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:31.943286 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-af955156-99b4-40ab-9878-162ee06eca19 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:31.944438 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-af955156-99b4-40ab-9878-162ee06eca19 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1744 microversion: 2.20 time: 0.185094 Jul 27 20:12:31.945048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 275/564] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:31 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1744 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:32.001337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e594cd5e-777a-433c-8956-aee27765fea1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:32.002047 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e594cd5e-777a-433c-8956-aee27765fea1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:32.008872 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e594cd5e-777a-433c-8956-aee27765fea1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:32.009360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e594cd5e-777a-433c-8956-aee27765fea1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:32.010141 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e594cd5e-777a-433c-8956-aee27765fea1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:32.010614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e594cd5e-777a-433c-8956-aee27765fea1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:32.150536 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e594cd5e-777a-433c-8956-aee27765fea1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:32.161836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e594cd5e-777a-433c-8956-aee27765fea1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1710 microversion: 2.1 time: 0.164556 Jul 27 20:12:32.161836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 290/565] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:31 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1710 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:32.967651 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e4708a65-f973-48fa-aa35-7d5bce8b5d71 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:32.968259 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e4708a65-f973-48fa-aa35-7d5bce8b5d71 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:32.975387 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4708a65-f973-48fa-aa35-7d5bce8b5d71 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:32.975836 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4708a65-f973-48fa-aa35-7d5bce8b5d71 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:32.976599 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4708a65-f973-48fa-aa35-7d5bce8b5d71 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:32.977071 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4708a65-f973-48fa-aa35-7d5bce8b5d71 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:33.110188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e4708a65-f973-48fa-aa35-7d5bce8b5d71 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:33.118030 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e4708a65-f973-48fa-aa35-7d5bce8b5d71 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:33.119516 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e4708a65-f973-48fa-aa35-7d5bce8b5d71 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:33.120650 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e4708a65-f973-48fa-aa35-7d5bce8b5d71 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1744 microversion: 2.20 time: 0.156968 Jul 27 20:12:33.121235 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 276/566] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:32 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:33.183483 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e2d173e9-4d3f-4a39-b82f-663f0b61691c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:33.184099 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e2d173e9-4d3f-4a39-b82f-663f0b61691c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:33.191109 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e2d173e9-4d3f-4a39-b82f-663f0b61691c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:33.191585 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e2d173e9-4d3f-4a39-b82f-663f0b61691c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:33.192590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e2d173e9-4d3f-4a39-b82f-663f0b61691c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:33.193135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e2d173e9-4d3f-4a39-b82f-663f0b61691c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:33.322762 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e2d173e9-4d3f-4a39-b82f-663f0b61691c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:33.330662 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e2d173e9-4d3f-4a39-b82f-663f0b61691c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1714 microversion: 2.1 time: 0.151012 Jul 27 20:12:33.331232 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 291/567] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:33 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1714 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:12:34.144897 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e0f319e4-f6bb-406b-86fb-c0fa6bf8901f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:34.145534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e0f319e4-f6bb-406b-86fb-c0fa6bf8901f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:34.151559 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0f319e4-f6bb-406b-86fb-c0fa6bf8901f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:34.152009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0f319e4-f6bb-406b-86fb-c0fa6bf8901f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:34.152808 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0f319e4-f6bb-406b-86fb-c0fa6bf8901f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:34.153344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0f319e4-f6bb-406b-86fb-c0fa6bf8901f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:34.279647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e0f319e4-f6bb-406b-86fb-c0fa6bf8901f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:34.288059 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e0f319e4-f6bb-406b-86fb-c0fa6bf8901f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:34.289606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e0f319e4-f6bb-406b-86fb-c0fa6bf8901f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:34.290762 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e0f319e4-f6bb-406b-86fb-c0fa6bf8901f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1744 microversion: 2.20 time: 0.150339 Jul 27 20:12:34.291319 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 277/568] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:34 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:35.314413 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fb9681d5-ddde-4bb1-9592-a1d84b31700b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:35.314960 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fb9681d5-ddde-4bb1-9592-a1d84b31700b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:35.321708 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fb9681d5-ddde-4bb1-9592-a1d84b31700b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:35.322162 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fb9681d5-ddde-4bb1-9592-a1d84b31700b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:35.322924 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fb9681d5-ddde-4bb1-9592-a1d84b31700b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:35.323360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fb9681d5-ddde-4bb1-9592-a1d84b31700b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:35.449207 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fb9681d5-ddde-4bb1-9592-a1d84b31700b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:35.457328 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fb9681d5-ddde-4bb1-9592-a1d84b31700b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:35.458829 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fb9681d5-ddde-4bb1-9592-a1d84b31700b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:35.460023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fb9681d5-ddde-4bb1-9592-a1d84b31700b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1744 microversion: 2.20 time: 0.150121 Jul 27 20:12:35.460568 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 292/569] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:35 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:36.482826 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b102d356-6820-4403-be5b-dea658a6f398 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:36.483436 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b102d356-6820-4403-be5b-dea658a6f398 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:36.489789 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b102d356-6820-4403-be5b-dea658a6f398 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:36.490243 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b102d356-6820-4403-be5b-dea658a6f398 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:36.491011 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b102d356-6820-4403-be5b-dea658a6f398 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:36.491452 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b102d356-6820-4403-be5b-dea658a6f398 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:36.627412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b102d356-6820-4403-be5b-dea658a6f398 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:36.635247 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b102d356-6820-4403-be5b-dea658a6f398 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:36.636736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b102d356-6820-4403-be5b-dea658a6f398 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:36.637903 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b102d356-6820-4403-be5b-dea658a6f398 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1744 microversion: 2.20 time: 0.158941 Jul 27 20:12:36.638458 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 278/570] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:36 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:37.661522 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-eac9d5a0-244f-425f-b811-a3be58c6f6ee tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:37.662129 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-eac9d5a0-244f-425f-b811-a3be58c6f6ee tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:37.668644 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eac9d5a0-244f-425f-b811-a3be58c6f6ee tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:37.669121 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eac9d5a0-244f-425f-b811-a3be58c6f6ee tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:37.669879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eac9d5a0-244f-425f-b811-a3be58c6f6ee tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:37.670313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eac9d5a0-244f-425f-b811-a3be58c6f6ee tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:37.799893 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-eac9d5a0-244f-425f-b811-a3be58c6f6ee tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:37.802154 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:37.809066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-eac9d5a0-244f-425f-b811-a3be58c6f6ee tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:37.810566 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-eac9d5a0-244f-425f-b811-a3be58c6f6ee tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:37.811713 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-eac9d5a0-244f-425f-b811-a3be58c6f6ee tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1744 microversion: 2.20 time: 0.154411 Jul 27 20:12:37.813029 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 293/571] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:37 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:38.836367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8bdc2ea3-5899-4b7e-8c12-9c133ca3922f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:38.837003 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8bdc2ea3-5899-4b7e-8c12-9c133ca3922f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:38.842996 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8bdc2ea3-5899-4b7e-8c12-9c133ca3922f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:38.843481 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8bdc2ea3-5899-4b7e-8c12-9c133ca3922f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:38.844364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8bdc2ea3-5899-4b7e-8c12-9c133ca3922f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:38.844809 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8bdc2ea3-5899-4b7e-8c12-9c133ca3922f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:38.980417 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8bdc2ea3-5899-4b7e-8c12-9c133ca3922f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:38.989486 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8bdc2ea3-5899-4b7e-8c12-9c133ca3922f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:38.991127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8bdc2ea3-5899-4b7e-8c12-9c133ca3922f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:38.992307 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8bdc2ea3-5899-4b7e-8c12-9c133ca3922f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1744 microversion: 2.20 time: 0.159774 Jul 27 20:12:38.992847 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 279/572] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:38 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:40.068672 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3b4eac9c-835e-422a-9256-8990adba81c2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:40.070153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3b4eac9c-835e-422a-9256-8990adba81c2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:40.079778 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3b4eac9c-835e-422a-9256-8990adba81c2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:40.080344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3b4eac9c-835e-422a-9256-8990adba81c2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:40.081167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3b4eac9c-835e-422a-9256-8990adba81c2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:40.081609 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3b4eac9c-835e-422a-9256-8990adba81c2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:40.236348 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3b4eac9c-835e-422a-9256-8990adba81c2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:40.245644 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3b4eac9c-835e-422a-9256-8990adba81c2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:40.247161 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3b4eac9c-835e-422a-9256-8990adba81c2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:40.248344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3b4eac9c-835e-422a-9256-8990adba81c2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1739 microversion: 2.20 time: 0.233548 Jul 27 20:12:40.249009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 294/573] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:40 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:41.274158 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-195e50f4-b375-48f2-94bb-9df4ded91b31 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:41.274762 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-195e50f4-b375-48f2-94bb-9df4ded91b31 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:41.281883 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-195e50f4-b375-48f2-94bb-9df4ded91b31 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:41.282668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-195e50f4-b375-48f2-94bb-9df4ded91b31 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:41.283555 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-195e50f4-b375-48f2-94bb-9df4ded91b31 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:41.283996 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-195e50f4-b375-48f2-94bb-9df4ded91b31 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:41.455643 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-195e50f4-b375-48f2-94bb-9df4ded91b31 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:41.469108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-195e50f4-b375-48f2-94bb-9df4ded91b31 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:41.469108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-195e50f4-b375-48f2-94bb-9df4ded91b31 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:41.469108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-195e50f4-b375-48f2-94bb-9df4ded91b31 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1739 microversion: 2.20 time: 0.197102 Jul 27 20:12:41.469400 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 280/574] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:41 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:42.491088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3365107d-0189-41f8-84a1-1c4ebeb7c5b9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:42.491900 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3365107d-0189-41f8-84a1-1c4ebeb7c5b9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:42.498579 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3365107d-0189-41f8-84a1-1c4ebeb7c5b9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:42.499321 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3365107d-0189-41f8-84a1-1c4ebeb7c5b9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:42.500870 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3365107d-0189-41f8-84a1-1c4ebeb7c5b9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:42.501414 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3365107d-0189-41f8-84a1-1c4ebeb7c5b9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:42.636620 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3365107d-0189-41f8-84a1-1c4ebeb7c5b9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:42.646630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3365107d-0189-41f8-84a1-1c4ebeb7c5b9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:42.648485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3365107d-0189-41f8-84a1-1c4ebeb7c5b9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:42.649725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3365107d-0189-41f8-84a1-1c4ebeb7c5b9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1739 microversion: 2.20 time: 0.162673 Jul 27 20:12:42.650804 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 295/575] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:42 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:43.676225 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-68cb4976-1bf6-47bf-8b85-0b4a103e424c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:43.677549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-68cb4976-1bf6-47bf-8b85-0b4a103e424c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:43.679885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=48 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:43.687575 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68cb4976-1bf6-47bf-8b85-0b4a103e424c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:43.688386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68cb4976-1bf6-47bf-8b85-0b4a103e424c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:43.689222 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68cb4976-1bf6-47bf-8b85-0b4a103e424c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:43.689671 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68cb4976-1bf6-47bf-8b85-0b4a103e424c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:43.857998 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-68cb4976-1bf6-47bf-8b85-0b4a103e424c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:43.874044 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-68cb4976-1bf6-47bf-8b85-0b4a103e424c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:43.879608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-68cb4976-1bf6-47bf-8b85-0b4a103e424c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:43.880810 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-68cb4976-1bf6-47bf-8b85-0b4a103e424c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1739 microversion: 2.20 time: 0.210106 Jul 27 20:12:43.881400 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 281/576] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:43 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:44.906522 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-383a1f60-5247-4bc4-9177-d4ff727a66d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:44.909578 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-383a1f60-5247-4bc4-9177-d4ff727a66d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:44.917204 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-383a1f60-5247-4bc4-9177-d4ff727a66d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:44.922873 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-383a1f60-5247-4bc4-9177-d4ff727a66d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:44.925280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-383a1f60-5247-4bc4-9177-d4ff727a66d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:44.927314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-383a1f60-5247-4bc4-9177-d4ff727a66d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:45.116350 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-383a1f60-5247-4bc4-9177-d4ff727a66d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:45.125550 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-383a1f60-5247-4bc4-9177-d4ff727a66d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:45.127116 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-383a1f60-5247-4bc4-9177-d4ff727a66d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:45.128532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-383a1f60-5247-4bc4-9177-d4ff727a66d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1739 microversion: 2.20 time: 0.227132 Jul 27 20:12:45.129156 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 296/577] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:44 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1739 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:46.155170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e2bd443f-7c08-497c-8f45-3589eb8fd0f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:46.156606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e2bd443f-7c08-497c-8f45-3589eb8fd0f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:46.163274 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2bd443f-7c08-497c-8f45-3589eb8fd0f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:46.163791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2bd443f-7c08-497c-8f45-3589eb8fd0f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:46.164566 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2bd443f-7c08-497c-8f45-3589eb8fd0f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:46.165026 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2bd443f-7c08-497c-8f45-3589eb8fd0f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:46.306633 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e2bd443f-7c08-497c-8f45-3589eb8fd0f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:46.316125 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e2bd443f-7c08-497c-8f45-3589eb8fd0f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:46.317953 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e2bd443f-7c08-497c-8f45-3589eb8fd0f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:46.328663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e2bd443f-7c08-497c-8f45-3589eb8fd0f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1739 microversion: 2.20 time: 0.177347 Jul 27 20:12:46.329500 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 282/578] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:46 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:47.353792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-333d36ca-0a68-4c6e-bdf6-1ecd40295f5a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:47.354410 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-333d36ca-0a68-4c6e-bdf6-1ecd40295f5a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:47.361602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-333d36ca-0a68-4c6e-bdf6-1ecd40295f5a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:47.362061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-333d36ca-0a68-4c6e-bdf6-1ecd40295f5a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:47.363050 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-333d36ca-0a68-4c6e-bdf6-1ecd40295f5a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:47.363677 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-333d36ca-0a68-4c6e-bdf6-1ecd40295f5a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:47.505867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-333d36ca-0a68-4c6e-bdf6-1ecd40295f5a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:47.515725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-333d36ca-0a68-4c6e-bdf6-1ecd40295f5a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:47.517717 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-333d36ca-0a68-4c6e-bdf6-1ecd40295f5a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:47.519040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-333d36ca-0a68-4c6e-bdf6-1ecd40295f5a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1739 microversion: 2.20 time: 0.169152 Jul 27 20:12:47.529464 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 297/579] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:47 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:48.552300 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7871278b-07ba-4151-9e2b-be324fc59d73 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:48.553768 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7871278b-07ba-4151-9e2b-be324fc59d73 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:48.561209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7871278b-07ba-4151-9e2b-be324fc59d73 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:48.562155 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7871278b-07ba-4151-9e2b-be324fc59d73 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:48.563831 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7871278b-07ba-4151-9e2b-be324fc59d73 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:48.564514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7871278b-07ba-4151-9e2b-be324fc59d73 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:48.753702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7871278b-07ba-4151-9e2b-be324fc59d73 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:48.761855 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7871278b-07ba-4151-9e2b-be324fc59d73 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:48.763263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7871278b-07ba-4151-9e2b-be324fc59d73 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:48.764418 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7871278b-07ba-4151-9e2b-be324fc59d73 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1739 microversion: 2.20 time: 0.221189 Jul 27 20:12:48.775659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 283/580] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:48 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:49.787828 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-93930f44-1986-4470-9175-3b2c254976d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:49.788449 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-93930f44-1986-4470-9175-3b2c254976d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:49.790793 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=44 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:49.796419 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-93930f44-1986-4470-9175-3b2c254976d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:49.796875 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-93930f44-1986-4470-9175-3b2c254976d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:49.797683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-93930f44-1986-4470-9175-3b2c254976d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:49.798134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-93930f44-1986-4470-9175-3b2c254976d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:49.975013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-93930f44-1986-4470-9175-3b2c254976d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:49.984047 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-93930f44-1986-4470-9175-3b2c254976d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:49.985592 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-93930f44-1986-4470-9175-3b2c254976d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:49.986760 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-93930f44-1986-4470-9175-3b2c254976d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1739 microversion: 2.20 time: 0.202911 Jul 27 20:12:49.987326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 298/581] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:49 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:51.012300 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f378e63a-0813-4448-b03a-f9a25f1436fc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:51.013042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f378e63a-0813-4448-b03a-f9a25f1436fc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:51.021370 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f378e63a-0813-4448-b03a-f9a25f1436fc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:51.022108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f378e63a-0813-4448-b03a-f9a25f1436fc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:51.022994 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f378e63a-0813-4448-b03a-f9a25f1436fc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:51.023557 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f378e63a-0813-4448-b03a-f9a25f1436fc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:51.170234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f378e63a-0813-4448-b03a-f9a25f1436fc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:51.178229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f378e63a-0813-4448-b03a-f9a25f1436fc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:51.179735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f378e63a-0813-4448-b03a-f9a25f1436fc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:51.180888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f378e63a-0813-4448-b03a-f9a25f1436fc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1721 microversion: 2.20 time: 0.173203 Jul 27 20:12:51.181478 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 284/582] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:51 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:51.694712 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-e53889b2-1afd-4d0b-a242-6965648613d9 req-f014d0b6-80d2-4bca-8ef7-fb5089040032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d725356e-73a3-486b-b590-0324916667ff", "name": "network-vif-unplugged", "status": "completed", "tag": "899741ce-2752-45e1-aee9-3a2da333cdf0"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:12:51.705681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-e53889b2-1afd-4d0b-a242-6965648613d9 req-f014d0b6-80d2-4bca-8ef7-fb5089040032 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:51.706668 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-e53889b2-1afd-4d0b-a242-6965648613d9 req-f014d0b6-80d2-4bca-8ef7-fb5089040032 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:51.717857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-e53889b2-1afd-4d0b-a242-6965648613d9 req-f014d0b6-80d2-4bca-8ef7-fb5089040032 service nova] Creating event network-vif-unplugged:899741ce-2752-45e1-aee9-3a2da333cdf0 for instance d725356e-73a3-486b-b590-0324916667ff on hv-cinder-79987 Jul 27 20:12:51.722863 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-e53889b2-1afd-4d0b-a242-6965648613d9 req-f014d0b6-80d2-4bca-8ef7-fb5089040032 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032068 Jul 27 20:12:51.723459 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 299/583] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:12:52.167194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c95763e1-890b-4930-9574-017b9fb89834 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1910321849", "imageRef": "fb689bea-534a-4aac-bec3-8f55591dba58", "flavorRef": "452", "networks": [{"uuid": "d100ab0d-6709-4609-92d0-08fa121613a4"}]}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:12:52.205634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7e94cf33-a2bf-4003-a5b6-99d05a255963 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:52.206363 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7e94cf33-a2bf-4003-a5b6-99d05a255963 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:52.212672 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7e94cf33-a2bf-4003-a5b6-99d05a255963 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:52.213178 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7e94cf33-a2bf-4003-a5b6-99d05a255963 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:52.214102 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7e94cf33-a2bf-4003-a5b6-99d05a255963 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:52.214547 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7e94cf33-a2bf-4003-a5b6-99d05a255963 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:52.221291 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-c95763e1-890b-4930-9574-017b9fb89834 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] validate_networks() for [('d100ab0d-6709-4609-92d0-08fa121613a4', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:12:52.356865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7e94cf33-a2bf-4003-a5b6-99d05a255963 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:52.365307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7e94cf33-a2bf-4003-a5b6-99d05a255963 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:52.366830 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7e94cf33-a2bf-4003-a5b6-99d05a255963 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:52.368035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7e94cf33-a2bf-4003-a5b6-99d05a255963 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1721 microversion: 2.20 time: 0.166681 Jul 27 20:12:52.368598 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 300/584] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:52 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:12:52.578009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-c95763e1-890b-4930-9574-017b9fb89834 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:12:52.578499 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-c95763e1-890b-4930-9574-017b9fb89834 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:12:52.578977 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-c95763e1-890b-4930-9574-017b9fb89834 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:12:52.579396 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-c95763e1-890b-4930-9574-017b9fb89834 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:12:52.579814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-c95763e1-890b-4930-9574-017b9fb89834 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:12:52.588555 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c95763e1-890b-4930-9574-017b9fb89834 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:52.589034 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c95763e1-890b-4930-9574-017b9fb89834 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:52.589847 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c95763e1-890b-4930-9574-017b9fb89834 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:52.590286 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c95763e1-890b-4930-9574-017b9fb89834 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:52.606509 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-c95763e1-890b-4930-9574-017b9fb89834 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Getting quotas for project 5acfaf1104da41f8ba35ddbebb79b506. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:12:52.611010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-c95763e1-890b-4930-9574-017b9fb89834 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Getting quotas for user 5cc7b5ba908541cf929eaf10ba24e465 and project 5acfaf1104da41f8ba35ddbebb79b506. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:12:52.621840 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c95763e1-890b-4930-9574-017b9fb89834 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:12:52.624067 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c95763e1-890b-4930-9574-017b9fb89834 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb689bea-534a-4aac-bec3-8f55591dba58',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:12:52.669286 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c95763e1-890b-4930-9574-017b9fb89834 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505740 Jul 27 20:12:52.669929 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 285/585] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Jul 27 20:12:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:12:52.681856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c9438adf-6f22-4dc3-9a13-6396270ba217 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:52.682649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c9438adf-6f22-4dc3-9a13-6396270ba217 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:52.743690 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c9438adf-6f22-4dc3-9a13-6396270ba217 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:52.750965 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c9438adf-6f22-4dc3-9a13-6396270ba217 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1219 microversion: 2.1 time: 0.072998 Jul 27 20:12:52.751629 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 301/586] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:52 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:53.392259 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e9fa8e12-9d17-4ff2-9b3a-7b7f545d1da0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:53.392877 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e9fa8e12-9d17-4ff2-9b3a-7b7f545d1da0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:53.399911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e9fa8e12-9d17-4ff2-9b3a-7b7f545d1da0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:53.400428 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e9fa8e12-9d17-4ff2-9b3a-7b7f545d1da0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:53.401437 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e9fa8e12-9d17-4ff2-9b3a-7b7f545d1da0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:53.401888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e9fa8e12-9d17-4ff2-9b3a-7b7f545d1da0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:53.532115 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e9fa8e12-9d17-4ff2-9b3a-7b7f545d1da0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:53.540000 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e9fa8e12-9d17-4ff2-9b3a-7b7f545d1da0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:53.541524 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e9fa8e12-9d17-4ff2-9b3a-7b7f545d1da0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:53.542668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e9fa8e12-9d17-4ff2-9b3a-7b7f545d1da0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1664 microversion: 2.20 time: 0.155231 Jul 27 20:12:53.543217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 286/587] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:53 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:53.566343 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1fa787d8-1ae0-4b26-8250-50a48e91fdc1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f4bb420-948b-4be6-9672-a9051968dcea"}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:12:53.569023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1fa787d8-1ae0-4b26-8250-50a48e91fdc1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:53.577467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1fa787d8-1ae0-4b26-8250-50a48e91fdc1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:53.577976 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1fa787d8-1ae0-4b26-8250-50a48e91fdc1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:53.578856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1fa787d8-1ae0-4b26-8250-50a48e91fdc1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:53.579305 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1fa787d8-1ae0-4b26-8250-50a48e91fdc1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:53.772325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-17aba2f3-9a9e-4a4d-9814-6badc4749252 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:53.772937 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-17aba2f3-9a9e-4a4d-9814-6badc4749252 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:53.779531 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-17aba2f3-9a9e-4a4d-9814-6badc4749252 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:53.780187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-17aba2f3-9a9e-4a4d-9814-6badc4749252 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:53.782110 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-17aba2f3-9a9e-4a4d-9814-6badc4749252 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:53.782556 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-17aba2f3-9a9e-4a4d-9814-6badc4749252 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:53.852694 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-17aba2f3-9a9e-4a4d-9814-6badc4749252 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:53.861194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-17aba2f3-9a9e-4a4d-9814-6badc4749252 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1271 microversion: 2.1 time: 0.092704 Jul 27 20:12:53.862184 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 287/588] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:53 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:12:53.898651 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1fa787d8-1ae0-4b26-8250-50a48e91fdc1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "POST /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.336785 Jul 27 20:12:53.900271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 302/589] 10.222.0.65 () {62 vars in 1364 bytes} [Wed Jul 27 20:12:53 2022] POST /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 188 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:12:54.034640 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2508755b-2c3a-4aea-90ca-2a795a471e0a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:12:54.035160 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2508755b-2c3a-4aea-90ca-2a795a471e0a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:54.041185 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2508755b-2c3a-4aea-90ca-2a795a471e0a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:54.041632 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2508755b-2c3a-4aea-90ca-2a795a471e0a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:54.042429 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2508755b-2c3a-4aea-90ca-2a795a471e0a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:54.042866 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2508755b-2c3a-4aea-90ca-2a795a471e0a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:54.115404 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2508755b-2c3a-4aea-90ca-2a795a471e0a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117877) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 27 20:12:54.182772 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2508755b-2c3a-4aea-90ca-2a795a471e0a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "POST /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/action" status: 202 len: 0 microversion: 2.20 time: 0.152180 Jul 27 20:12:54.183897 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 288/590] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Jul 27 20:12:54 2022] POST /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:12:54.193427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-11772057-23ff-4723-bd94-95831dc8460e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:54.194377 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-11772057-23ff-4723-bd94-95831dc8460e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:54.200492 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-11772057-23ff-4723-bd94-95831dc8460e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:54.200951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-11772057-23ff-4723-bd94-95831dc8460e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:54.201751 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-11772057-23ff-4723-bd94-95831dc8460e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:54.202193 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-11772057-23ff-4723-bd94-95831dc8460e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:54.344311 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-11772057-23ff-4723-bd94-95831dc8460e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:54.353510 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-11772057-23ff-4723-bd94-95831dc8460e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:54.355336 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-11772057-23ff-4723-bd94-95831dc8460e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:54.356523 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-11772057-23ff-4723-bd94-95831dc8460e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1750 microversion: 2.20 time: 0.168694 Jul 27 20:12:54.357098 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 303/591] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:54 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1750 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:54.882938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0d69213d-5670-4147-bc5e-1b5fe5b7ad19 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:54.883759 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0d69213d-5670-4147-bc5e-1b5fe5b7ad19 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:54.890680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d69213d-5670-4147-bc5e-1b5fe5b7ad19 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:54.891416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d69213d-5670-4147-bc5e-1b5fe5b7ad19 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:54.892261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d69213d-5670-4147-bc5e-1b5fe5b7ad19 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:54.892739 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d69213d-5670-4147-bc5e-1b5fe5b7ad19 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:55.095548 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0d69213d-5670-4147-bc5e-1b5fe5b7ad19 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:55.103683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0d69213d-5670-4147-bc5e-1b5fe5b7ad19 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1319 microversion: 2.1 time: 0.224589 Jul 27 20:12:55.104418 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 289/592] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:54 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:55.380161 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-737ed03e-80b8-4bfe-be46-914f2c9a171d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:55.380754 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-737ed03e-80b8-4bfe-be46-914f2c9a171d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:55.387061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-737ed03e-80b8-4bfe-be46-914f2c9a171d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:55.387514 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-737ed03e-80b8-4bfe-be46-914f2c9a171d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:55.388726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-737ed03e-80b8-4bfe-be46-914f2c9a171d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:55.389397 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-737ed03e-80b8-4bfe-be46-914f2c9a171d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:55.395395 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-385034a2-cfcf-43cc-866d-5f83a01ab910 req-5264eb2a-1a16-4e38-9f64-9324cb7eddde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1fe489c-2f01-4942-ad86-cf5193eaac25", "tag": "0b60938e-7325-48a4-ae3d-78799fa3951c"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:12:55.413816 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-385034a2-cfcf-43cc-866d-5f83a01ab910 req-5264eb2a-1a16-4e38-9f64-9324cb7eddde service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:55.414303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-385034a2-cfcf-43cc-866d-5f83a01ab910 req-5264eb2a-1a16-4e38-9f64-9324cb7eddde service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:55.418378 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:12:55.430058 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-385034a2-cfcf-43cc-866d-5f83a01ab910 req-5264eb2a-1a16-4e38-9f64-9324cb7eddde service nova] Creating event network-changed:0b60938e-7325-48a4-ae3d-78799fa3951c for instance e1fe489c-2f01-4942-ad86-cf5193eaac25 on hv-cinder-79987 Jul 27 20:12:55.435930 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-385034a2-cfcf-43cc-866d-5f83a01ab910 req-5264eb2a-1a16-4e38-9f64-9324cb7eddde service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046715 Jul 27 20:12:55.436521 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 290/593] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:12:55.529654 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-737ed03e-80b8-4bfe-be46-914f2c9a171d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:55.538758 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-737ed03e-80b8-4bfe-be46-914f2c9a171d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:55.540262 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-737ed03e-80b8-4bfe-be46-914f2c9a171d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:55.541456 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-737ed03e-80b8-4bfe-be46-914f2c9a171d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1752 microversion: 2.20 time: 0.165223 Jul 27 20:12:55.542013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 304/594] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:55 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:56.130379 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b7a26a65-628a-451c-bb0d-a7056d919b16 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:56.131263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b7a26a65-628a-451c-bb0d-a7056d919b16 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:56.138699 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7a26a65-628a-451c-bb0d-a7056d919b16 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:56.139244 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7a26a65-628a-451c-bb0d-a7056d919b16 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:56.140125 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7a26a65-628a-451c-bb0d-a7056d919b16 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:56.140785 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7a26a65-628a-451c-bb0d-a7056d919b16 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:56.275339 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b7a26a65-628a-451c-bb0d-a7056d919b16 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:56.283279 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b7a26a65-628a-451c-bb0d-a7056d919b16 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1319 microversion: 2.1 time: 0.158601 Jul 27 20:12:56.283847 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 291/595] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:56 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:56.566123 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-aa351010-efc4-497f-8207-ab1f7e103cb9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:56.566637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-aa351010-efc4-497f-8207-ab1f7e103cb9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:56.573618 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aa351010-efc4-497f-8207-ab1f7e103cb9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:56.574073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aa351010-efc4-497f-8207-ab1f7e103cb9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:56.574840 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aa351010-efc4-497f-8207-ab1f7e103cb9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:56.575279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aa351010-efc4-497f-8207-ab1f7e103cb9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:56.707681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-aa351010-efc4-497f-8207-ab1f7e103cb9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:56.715989 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-aa351010-efc4-497f-8207-ab1f7e103cb9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:56.717531 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-aa351010-efc4-497f-8207-ab1f7e103cb9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:56.718837 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-aa351010-efc4-497f-8207-ab1f7e103cb9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1752 microversion: 2.20 time: 0.157174 Jul 27 20:12:56.719408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 305/596] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:56 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:57.303771 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a88f94c3-5e38-496d-aa6a-73e7445cdbb6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:57.304313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a88f94c3-5e38-496d-aa6a-73e7445cdbb6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:57.310531 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a88f94c3-5e38-496d-aa6a-73e7445cdbb6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:57.310984 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a88f94c3-5e38-496d-aa6a-73e7445cdbb6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:57.311756 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a88f94c3-5e38-496d-aa6a-73e7445cdbb6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:57.312835 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a88f94c3-5e38-496d-aa6a-73e7445cdbb6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:57.444515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a88f94c3-5e38-496d-aa6a-73e7445cdbb6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:57.451838 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a88f94c3-5e38-496d-aa6a-73e7445cdbb6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1319 microversion: 2.1 time: 0.151996 Jul 27 20:12:57.452389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 292/597] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:57 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:57.741940 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-367b275a-f4e5-4486-819b-53e6354befb4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:57.742557 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-367b275a-f4e5-4486-819b-53e6354befb4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:57.749025 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-367b275a-f4e5-4486-819b-53e6354befb4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:57.749486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-367b275a-f4e5-4486-819b-53e6354befb4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:57.750256 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-367b275a-f4e5-4486-819b-53e6354befb4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:57.750700 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-367b275a-f4e5-4486-819b-53e6354befb4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:57.882540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-367b275a-f4e5-4486-819b-53e6354befb4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:57.892028 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-367b275a-f4e5-4486-819b-53e6354befb4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:57.893541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-367b275a-f4e5-4486-819b-53e6354befb4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:57.894687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-367b275a-f4e5-4486-819b-53e6354befb4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1752 microversion: 2.20 time: 0.156660 Jul 27 20:12:57.895234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 306/598] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:57 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:58.472889 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cdfe7452-794b-44a9-a126-2d17311cc90a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:58.473545 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cdfe7452-794b-44a9-a126-2d17311cc90a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:58.480407 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdfe7452-794b-44a9-a126-2d17311cc90a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:58.480853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdfe7452-794b-44a9-a126-2d17311cc90a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:58.481664 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdfe7452-794b-44a9-a126-2d17311cc90a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:58.482122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdfe7452-794b-44a9-a126-2d17311cc90a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:58.608286 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cdfe7452-794b-44a9-a126-2d17311cc90a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:58.616120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cdfe7452-794b-44a9-a126-2d17311cc90a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1319 microversion: 2.1 time: 0.148205 Jul 27 20:12:58.616681 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 293/599] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:58 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:12:58.919392 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2ef39af3-c169-435a-b74c-9b44b3ae9132 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:58.920011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2ef39af3-c169-435a-b74c-9b44b3ae9132 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:58.927396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ef39af3-c169-435a-b74c-9b44b3ae9132 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:58.928130 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ef39af3-c169-435a-b74c-9b44b3ae9132 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:58.929052 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ef39af3-c169-435a-b74c-9b44b3ae9132 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:58.929569 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ef39af3-c169-435a-b74c-9b44b3ae9132 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:59.070463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2ef39af3-c169-435a-b74c-9b44b3ae9132 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:59.081267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2ef39af3-c169-435a-b74c-9b44b3ae9132 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:59.082939 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2ef39af3-c169-435a-b74c-9b44b3ae9132 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:12:59.084452 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2ef39af3-c169-435a-b74c-9b44b3ae9132 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1752 microversion: 2.20 time: 0.169161 Jul 27 20:12:59.085124 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 307/600] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:12:58 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:12:59.637338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-82a71808-a0db-43d9-851e-ea6cb000ad64 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:12:59.638085 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-82a71808-a0db-43d9-851e-ea6cb000ad64 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:12:59.644818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82a71808-a0db-43d9-851e-ea6cb000ad64 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:59.645362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82a71808-a0db-43d9-851e-ea6cb000ad64 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:12:59.646164 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82a71808-a0db-43d9-851e-ea6cb000ad64 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:12:59.646596 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82a71808-a0db-43d9-851e-ea6cb000ad64 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:00.112813 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8e6b819a-ae65-45e0-b058-6d49354b424b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:00.114447 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8e6b819a-ae65-45e0-b058-6d49354b424b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:00.121215 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8e6b819a-ae65-45e0-b058-6d49354b424b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:00.121910 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8e6b819a-ae65-45e0-b058-6d49354b424b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:00.122575 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8e6b819a-ae65-45e0-b058-6d49354b424b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:00.123076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8e6b819a-ae65-45e0-b058-6d49354b424b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:00.140156 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-82a71808-a0db-43d9-851e-ea6cb000ad64 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:00.148743 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-82a71808-a0db-43d9-851e-ea6cb000ad64 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1319 microversion: 2.1 time: 0.515133 Jul 27 20:13:00.149894 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 294/601] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:12:59 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1319 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:00.267880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8e6b819a-ae65-45e0-b058-6d49354b424b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:00.276414 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8e6b819a-ae65-45e0-b058-6d49354b424b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:00.277940 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8e6b819a-ae65-45e0-b058-6d49354b424b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:00.279085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8e6b819a-ae65-45e0-b058-6d49354b424b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.171309 Jul 27 20:13:00.279640 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 308/602] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:00 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:13:01.171710 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-73a5c00f-cc4b-46b7-beea-febc336a1ecd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:01.173131 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-73a5c00f-cc4b-46b7-beea-febc336a1ecd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:01.179634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73a5c00f-cc4b-46b7-beea-febc336a1ecd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:01.180302 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73a5c00f-cc4b-46b7-beea-febc336a1ecd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:01.181347 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73a5c00f-cc4b-46b7-beea-febc336a1ecd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:01.181944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73a5c00f-cc4b-46b7-beea-febc336a1ecd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:01.303233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3fb39205-2704-4fa2-bc00-59aa91a7fa6c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:01.303851 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3fb39205-2704-4fa2-bc00-59aa91a7fa6c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:01.310310 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3fb39205-2704-4fa2-bc00-59aa91a7fa6c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:01.310776 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3fb39205-2704-4fa2-bc00-59aa91a7fa6c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:01.311559 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3fb39205-2704-4fa2-bc00-59aa91a7fa6c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:01.312872 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3fb39205-2704-4fa2-bc00-59aa91a7fa6c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:01.330058 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:01.330733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-73a5c00f-cc4b-46b7-beea-febc336a1ecd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:01.338568 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-73a5c00f-cc4b-46b7-beea-febc336a1ecd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1319 microversion: 2.1 time: 0.170691 Jul 27 20:13:01.339418 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 295/603] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:01 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:01.456368 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3fb39205-2704-4fa2-bc00-59aa91a7fa6c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:01.465813 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3fb39205-2704-4fa2-bc00-59aa91a7fa6c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:01.467337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3fb39205-2704-4fa2-bc00-59aa91a7fa6c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:01.468548 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3fb39205-2704-4fa2-bc00-59aa91a7fa6c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.169162 Jul 27 20:13:01.469313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 309/604] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:01 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:13:01.855674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-19a3aeab-684c-449c-ba7c-dfde374a2766 req-56c64176-dc64-44be-9666-af4399da990b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1fe489c-2f01-4942-ad86-cf5193eaac25", "name": "network-vif-plugged", "status": "completed", "tag": "0b60938e-7325-48a4-ae3d-78799fa3951c"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:13:01.867299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-19a3aeab-684c-449c-ba7c-dfde374a2766 req-56c64176-dc64-44be-9666-af4399da990b service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:01.867736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-19a3aeab-684c-449c-ba7c-dfde374a2766 req-56c64176-dc64-44be-9666-af4399da990b service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:01.881748 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-19a3aeab-684c-449c-ba7c-dfde374a2766 req-56c64176-dc64-44be-9666-af4399da990b service nova] Creating event network-vif-plugged:0b60938e-7325-48a4-ae3d-78799fa3951c for instance e1fe489c-2f01-4942-ad86-cf5193eaac25 on hv-cinder-79987 Jul 27 20:13:01.887303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-19a3aeab-684c-449c-ba7c-dfde374a2766 req-56c64176-dc64-44be-9666-af4399da990b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035225 Jul 27 20:13:01.888302 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 296/605] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:13:02.360426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a9e53db7-b598-4173-b949-883abbd15327 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:02.361308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a9e53db7-b598-4173-b949-883abbd15327 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:02.367818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a9e53db7-b598-4173-b949-883abbd15327 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:02.368362 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a9e53db7-b598-4173-b949-883abbd15327 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:02.369267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a9e53db7-b598-4173-b949-883abbd15327 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:02.369789 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a9e53db7-b598-4173-b949-883abbd15327 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:02.493450 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b6eaa154-4537-4740-8dc5-80ead5a55dc6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:02.495697 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b6eaa154-4537-4740-8dc5-80ead5a55dc6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:02.503534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6eaa154-4537-4740-8dc5-80ead5a55dc6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:02.504356 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6eaa154-4537-4740-8dc5-80ead5a55dc6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:02.505189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6eaa154-4537-4740-8dc5-80ead5a55dc6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:02.505792 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6eaa154-4537-4740-8dc5-80ead5a55dc6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:02.514011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a9e53db7-b598-4173-b949-883abbd15327 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:02.521579 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a9e53db7-b598-4173-b949-883abbd15327 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1319 microversion: 2.1 time: 0.165733 Jul 27 20:13:02.522154 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 310/606] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:02 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:02.597264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:02.617428 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=6 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:02.642900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b6eaa154-4537-4740-8dc5-80ead5a55dc6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:02.651393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b6eaa154-4537-4740-8dc5-80ead5a55dc6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:02.652928 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b6eaa154-4537-4740-8dc5-80ead5a55dc6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:02.654107 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b6eaa154-4537-4740-8dc5-80ead5a55dc6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.165408 Jul 27 20:13:02.654658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 297/607] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:02 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:13:03.542152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f4881371-5a70-46ac-8bca-a3da7431f692 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:03.542899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f4881371-5a70-46ac-8bca-a3da7431f692 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:03.544877 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=2 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:03.552642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f4881371-5a70-46ac-8bca-a3da7431f692 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:03.553129 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f4881371-5a70-46ac-8bca-a3da7431f692 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:03.553921 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f4881371-5a70-46ac-8bca-a3da7431f692 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:03.554365 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f4881371-5a70-46ac-8bca-a3da7431f692 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:03.678677 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0916aefa-0035-4656-a6af-ade139fbbe82 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:03.679321 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0916aefa-0035-4656-a6af-ade139fbbe82 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:03.685180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0916aefa-0035-4656-a6af-ade139fbbe82 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:03.685621 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0916aefa-0035-4656-a6af-ade139fbbe82 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:03.686378 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0916aefa-0035-4656-a6af-ade139fbbe82 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:03.686812 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0916aefa-0035-4656-a6af-ade139fbbe82 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:03.691096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f4881371-5a70-46ac-8bca-a3da7431f692 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:03.698982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f4881371-5a70-46ac-8bca-a3da7431f692 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1319 microversion: 2.1 time: 0.160717 Jul 27 20:13:03.699648 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 311/608] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:03 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:03.833697 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0916aefa-0035-4656-a6af-ade139fbbe82 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:03.841863 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0916aefa-0035-4656-a6af-ade139fbbe82 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:03.843478 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0916aefa-0035-4656-a6af-ade139fbbe82 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:03.844621 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0916aefa-0035-4656-a6af-ade139fbbe82 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.169991 Jul 27 20:13:03.845216 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 298/609] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:03 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:13:04.721106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-140e0ff8-afd3-431e-8667-5072fb8cacf6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:04.721739 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-140e0ff8-afd3-431e-8667-5072fb8cacf6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:04.728501 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-140e0ff8-afd3-431e-8667-5072fb8cacf6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:04.728995 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-140e0ff8-afd3-431e-8667-5072fb8cacf6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:04.729751 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-140e0ff8-afd3-431e-8667-5072fb8cacf6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:04.730197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-140e0ff8-afd3-431e-8667-5072fb8cacf6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:04.867784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fdeeba2d-d416-4846-ba27-ea60553f984c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:04.868527 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fdeeba2d-d416-4846-ba27-ea60553f984c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:04.875616 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-140e0ff8-afd3-431e-8667-5072fb8cacf6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:04.876708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fdeeba2d-d416-4846-ba27-ea60553f984c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:04.877319 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fdeeba2d-d416-4846-ba27-ea60553f984c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:04.878185 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fdeeba2d-d416-4846-ba27-ea60553f984c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:04.878888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fdeeba2d-d416-4846-ba27-ea60553f984c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:04.899060 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-140e0ff8-afd3-431e-8667-5072fb8cacf6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1319 microversion: 2.1 time: 0.167534 Jul 27 20:13:04.899060 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 312/610] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:04 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:05.035666 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fdeeba2d-d416-4846-ba27-ea60553f984c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:05.044377 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fdeeba2d-d416-4846-ba27-ea60553f984c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:05.045897 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fdeeba2d-d416-4846-ba27-ea60553f984c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:05.047969 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fdeeba2d-d416-4846-ba27-ea60553f984c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.184224 Jul 27 20:13:05.048722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 299/611] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:04 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:13:05.907452 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3fa73544-8744-4a48-827b-be7bf6384d26 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:05.908247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3fa73544-8744-4a48-827b-be7bf6384d26 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:05.915117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3fa73544-8744-4a48-827b-be7bf6384d26 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:05.915573 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3fa73544-8744-4a48-827b-be7bf6384d26 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:05.916360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3fa73544-8744-4a48-827b-be7bf6384d26 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:05.916802 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3fa73544-8744-4a48-827b-be7bf6384d26 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:06.057057 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3fa73544-8744-4a48-827b-be7bf6384d26 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:06.065180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3fa73544-8744-4a48-827b-be7bf6384d26 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1319 microversion: 2.1 time: 0.161632 Jul 27 20:13:06.065959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 313/612] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:05 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:06.072362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-97931198-7b53-4c0c-82d6-35a7911ec441 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:06.073734 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-97931198-7b53-4c0c-82d6-35a7911ec441 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:06.081799 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97931198-7b53-4c0c-82d6-35a7911ec441 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:06.082311 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97931198-7b53-4c0c-82d6-35a7911ec441 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:06.083147 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97931198-7b53-4c0c-82d6-35a7911ec441 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:06.083646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97931198-7b53-4c0c-82d6-35a7911ec441 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:06.224197 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-97931198-7b53-4c0c-82d6-35a7911ec441 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:06.233105 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-97931198-7b53-4c0c-82d6-35a7911ec441 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:06.235115 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-97931198-7b53-4c0c-82d6-35a7911ec441 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:06.236383 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-97931198-7b53-4c0c-82d6-35a7911ec441 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.168475 Jul 27 20:13:06.241271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 300/613] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:06 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:13:06.491986 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3334f19b-8907-4947-856e-ad138f1be021 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:13:06.494389 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3334f19b-8907-4947-856e-ad138f1be021 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:06.502060 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3334f19b-8907-4947-856e-ad138f1be021 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:06.502508 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3334f19b-8907-4947-856e-ad138f1be021 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:06.503276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3334f19b-8907-4947-856e-ad138f1be021 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:06.503708 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3334f19b-8907-4947-856e-ad138f1be021 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:06.584097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3334f19b-8907-4947-856e-ad138f1be021 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "POST /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/action" status: 202 len: 0 microversion: 2.1 time: 0.095857 Jul 27 20:13:06.585671 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 314/614] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Jul 27 20:13:06 2022] POST /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:13:06.593191 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2d0b49d9-21b0-407d-815f-00b6dac28dbd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:06.593895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2d0b49d9-21b0-407d-815f-00b6dac28dbd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:06.599878 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d0b49d9-21b0-407d-815f-00b6dac28dbd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:06.600325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d0b49d9-21b0-407d-815f-00b6dac28dbd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:06.601181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d0b49d9-21b0-407d-815f-00b6dac28dbd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:06.601621 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d0b49d9-21b0-407d-815f-00b6dac28dbd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:06.756786 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2d0b49d9-21b0-407d-815f-00b6dac28dbd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:06.765280 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2d0b49d9-21b0-407d-815f-00b6dac28dbd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1754 microversion: 2.1 time: 0.175885 Jul 27 20:13:06.765864 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 301/615] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:06 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:07.087148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-72b0dbd0-5f29-4a7d-a851-0ecc6fbc0286 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:07.088004 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-72b0dbd0-5f29-4a7d-a851-0ecc6fbc0286 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:07.095463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-72b0dbd0-5f29-4a7d-a851-0ecc6fbc0286 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:07.095924 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-72b0dbd0-5f29-4a7d-a851-0ecc6fbc0286 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:07.096722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-72b0dbd0-5f29-4a7d-a851-0ecc6fbc0286 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:07.097197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-72b0dbd0-5f29-4a7d-a851-0ecc6fbc0286 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:07.249817 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-72b0dbd0-5f29-4a7d-a851-0ecc6fbc0286 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:07.258126 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-72b0dbd0-5f29-4a7d-a851-0ecc6fbc0286 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1319 microversion: 2.1 time: 0.175216 Jul 27 20:13:07.272526 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-47bc42ce-55d4-4ad3-9202-ed0d2ff1d3e7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:07.273124 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 315/616] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:07 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:07.273244 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-47bc42ce-55d4-4ad3-9202-ed0d2ff1d3e7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:07.273244 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-47bc42ce-55d4-4ad3-9202-ed0d2ff1d3e7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:07.273244 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-47bc42ce-55d4-4ad3-9202-ed0d2ff1d3e7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:07.273244 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-47bc42ce-55d4-4ad3-9202-ed0d2ff1d3e7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:07.273596 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-47bc42ce-55d4-4ad3-9202-ed0d2ff1d3e7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:07.407098 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-47bc42ce-55d4-4ad3-9202-ed0d2ff1d3e7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:07.415952 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-47bc42ce-55d4-4ad3-9202-ed0d2ff1d3e7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:07.417578 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-47bc42ce-55d4-4ad3-9202-ed0d2ff1d3e7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:07.418850 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-47bc42ce-55d4-4ad3-9202-ed0d2ff1d3e7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.162899 Jul 27 20:13:07.432990 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 302/617] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:07 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:13:07.788117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bcefc171-3716-4a88-abc0-192841e25a20 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:07.788730 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bcefc171-3716-4a88-abc0-192841e25a20 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:07.794822 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bcefc171-3716-4a88-abc0-192841e25a20 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:07.795273 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bcefc171-3716-4a88-abc0-192841e25a20 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:07.796037 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bcefc171-3716-4a88-abc0-192841e25a20 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:07.797102 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bcefc171-3716-4a88-abc0-192841e25a20 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:07.944003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bcefc171-3716-4a88-abc0-192841e25a20 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:07.953363 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bcefc171-3716-4a88-abc0-192841e25a20 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1754 microversion: 2.1 time: 0.169176 Jul 27 20:13:07.953852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 316/618] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:07 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:08.280829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-92f61450-4038-42f7-bca4-0e754264bfa9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:08.282478 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-92f61450-4038-42f7-bca4-0e754264bfa9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:08.302706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-92f61450-4038-42f7-bca4-0e754264bfa9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:08.303159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-92f61450-4038-42f7-bca4-0e754264bfa9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:08.303945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-92f61450-4038-42f7-bca4-0e754264bfa9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:08.304569 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-92f61450-4038-42f7-bca4-0e754264bfa9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:08.445219 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-109d526a-421c-4ad2-a3a7-a77f0087ecb6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:08.446015 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-109d526a-421c-4ad2-a3a7-a77f0087ecb6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:08.452306 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-109d526a-421c-4ad2-a3a7-a77f0087ecb6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:08.452835 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-109d526a-421c-4ad2-a3a7-a77f0087ecb6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:08.453781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-109d526a-421c-4ad2-a3a7-a77f0087ecb6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:08.454235 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-109d526a-421c-4ad2-a3a7-a77f0087ecb6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:08.516495 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-92f61450-4038-42f7-bca4-0e754264bfa9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:08.523962 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-92f61450-4038-42f7-bca4-0e754264bfa9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1319 microversion: 2.1 time: 0.247941 Jul 27 20:13:08.524658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 303/619] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:08 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:08.655076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-109d526a-421c-4ad2-a3a7-a77f0087ecb6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:08.664686 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-109d526a-421c-4ad2-a3a7-a77f0087ecb6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:08.666236 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-109d526a-421c-4ad2-a3a7-a77f0087ecb6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:08.667409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-109d526a-421c-4ad2-a3a7-a77f0087ecb6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.227122 Jul 27 20:13:08.667972 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 317/620] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:08 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:13:08.975842 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bd850f04-eebe-4bb1-904b-dbdaa621636f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:08.976488 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bd850f04-eebe-4bb1-904b-dbdaa621636f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:08.982609 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bd850f04-eebe-4bb1-904b-dbdaa621636f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:08.983062 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bd850f04-eebe-4bb1-904b-dbdaa621636f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:08.983843 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bd850f04-eebe-4bb1-904b-dbdaa621636f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:08.984278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bd850f04-eebe-4bb1-904b-dbdaa621636f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:09.131933 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bd850f04-eebe-4bb1-904b-dbdaa621636f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:09.150166 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bd850f04-eebe-4bb1-904b-dbdaa621636f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1754 microversion: 2.1 time: 0.178336 Jul 27 20:13:09.150668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 304/621] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:08 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:09.544608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-940f56d0-6b14-4949-b44a-a82829329814 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:09.545478 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-940f56d0-6b14-4949-b44a-a82829329814 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:09.552053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-940f56d0-6b14-4949-b44a-a82829329814 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:09.552509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-940f56d0-6b14-4949-b44a-a82829329814 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:09.553324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-940f56d0-6b14-4949-b44a-a82829329814 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:09.553774 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-940f56d0-6b14-4949-b44a-a82829329814 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:09.696257 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7810fe75-fc25-4a90-8e08-ea203e129fdb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:09.696857 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7810fe75-fc25-4a90-8e08-ea203e129fdb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:09.703396 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7810fe75-fc25-4a90-8e08-ea203e129fdb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:09.704137 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7810fe75-fc25-4a90-8e08-ea203e129fdb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:09.705176 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7810fe75-fc25-4a90-8e08-ea203e129fdb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:09.705883 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7810fe75-fc25-4a90-8e08-ea203e129fdb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:09.728788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-940f56d0-6b14-4949-b44a-a82829329814 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:09.739047 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-940f56d0-6b14-4949-b44a-a82829329814 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1319 microversion: 2.1 time: 0.198160 Jul 27 20:13:09.740403 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 318/622] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:09 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:09.868290 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7810fe75-fc25-4a90-8e08-ea203e129fdb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:09.878879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7810fe75-fc25-4a90-8e08-ea203e129fdb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:09.880666 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7810fe75-fc25-4a90-8e08-ea203e129fdb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:09.881954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7810fe75-fc25-4a90-8e08-ea203e129fdb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.193523 Jul 27 20:13:09.882622 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 305/623] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:09 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:13:10.171969 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6ca3ff57-58d8-4552-a154-5742c3e9a1a9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:10.172595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6ca3ff57-58d8-4552-a154-5742c3e9a1a9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:10.178635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ca3ff57-58d8-4552-a154-5742c3e9a1a9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:10.179089 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ca3ff57-58d8-4552-a154-5742c3e9a1a9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:10.179853 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ca3ff57-58d8-4552-a154-5742c3e9a1a9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:10.180296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ca3ff57-58d8-4552-a154-5742c3e9a1a9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:10.324983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6ca3ff57-58d8-4552-a154-5742c3e9a1a9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:10.334381 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6ca3ff57-58d8-4552-a154-5742c3e9a1a9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1754 microversion: 2.1 time: 0.166745 Jul 27 20:13:10.342494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 319/624] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:10 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:10.761773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d1b10ec1-197f-4ce2-94c3-fb23213b3a3a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:10.762389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d1b10ec1-197f-4ce2-94c3-fb23213b3a3a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:10.768469 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d1b10ec1-197f-4ce2-94c3-fb23213b3a3a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:10.768914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d1b10ec1-197f-4ce2-94c3-fb23213b3a3a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:10.769722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d1b10ec1-197f-4ce2-94c3-fb23213b3a3a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:10.770159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d1b10ec1-197f-4ce2-94c3-fb23213b3a3a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:10.906348 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f5fb24e2-232c-4168-8be2-99ce2889d12b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:10.907558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f5fb24e2-232c-4168-8be2-99ce2889d12b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:10.907880 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d1b10ec1-197f-4ce2-94c3-fb23213b3a3a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:10.914044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f5fb24e2-232c-4168-8be2-99ce2889d12b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:10.914493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f5fb24e2-232c-4168-8be2-99ce2889d12b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:10.915443 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f5fb24e2-232c-4168-8be2-99ce2889d12b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:10.915568 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d1b10ec1-197f-4ce2-94c3-fb23213b3a3a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1319 microversion: 2.1 time: 0.157535 Jul 27 20:13:10.916255 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 306/625] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:10 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:10.916925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f5fb24e2-232c-4168-8be2-99ce2889d12b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:11.063639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f5fb24e2-232c-4168-8be2-99ce2889d12b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:11.076753 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f5fb24e2-232c-4168-8be2-99ce2889d12b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:11.078941 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f5fb24e2-232c-4168-8be2-99ce2889d12b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:11.080176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f5fb24e2-232c-4168-8be2-99ce2889d12b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.178279 Jul 27 20:13:11.080749 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 320/626] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:10 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:13:11.356232 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6b97a4e7-8d8d-4f64-8fab-5a123264ab9b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:11.356877 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6b97a4e7-8d8d-4f64-8fab-5a123264ab9b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:11.363450 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b97a4e7-8d8d-4f64-8fab-5a123264ab9b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:11.363895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b97a4e7-8d8d-4f64-8fab-5a123264ab9b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:11.364662 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b97a4e7-8d8d-4f64-8fab-5a123264ab9b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:11.365125 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b97a4e7-8d8d-4f64-8fab-5a123264ab9b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:11.511804 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6b97a4e7-8d8d-4f64-8fab-5a123264ab9b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:11.520942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6b97a4e7-8d8d-4f64-8fab-5a123264ab9b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1754 microversion: 2.1 time: 0.169098 Jul 27 20:13:11.521571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 307/627] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:11 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:11.936392 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7938f554-c941-4b80-b38f-395130baed43 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:11.937041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7938f554-c941-4b80-b38f-395130baed43 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:11.949641 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7938f554-c941-4b80-b38f-395130baed43 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:11.950111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7938f554-c941-4b80-b38f-395130baed43 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:11.951043 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7938f554-c941-4b80-b38f-395130baed43 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:11.951494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7938f554-c941-4b80-b38f-395130baed43 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:12.100353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7938f554-c941-4b80-b38f-395130baed43 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:12.103754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b5eaad5c-6283-4f4c-8537-80ad696eaafa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:12.104370 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b5eaad5c-6283-4f4c-8537-80ad696eaafa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:12.108207 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7938f554-c941-4b80-b38f-395130baed43 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1319 microversion: 2.1 time: 0.175566 Jul 27 20:13:12.108794 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 321/628] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:11 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:12.112892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b5eaad5c-6283-4f4c-8537-80ad696eaafa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:12.113424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b5eaad5c-6283-4f4c-8537-80ad696eaafa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:12.114211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b5eaad5c-6283-4f4c-8537-80ad696eaafa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:12.114652 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b5eaad5c-6283-4f4c-8537-80ad696eaafa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:12.121964 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:12.270573 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b5eaad5c-6283-4f4c-8537-80ad696eaafa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:12.280887 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b5eaad5c-6283-4f4c-8537-80ad696eaafa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:12.282762 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b5eaad5c-6283-4f4c-8537-80ad696eaafa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:12.284106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b5eaad5c-6283-4f4c-8537-80ad696eaafa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.184339 Jul 27 20:13:12.284667 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 308/629] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:12 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:13:12.543289 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e8b6d96e-f637-4c4f-a3e3-7589af1b494a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:12.543925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e8b6d96e-f637-4c4f-a3e3-7589af1b494a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:12.550466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8b6d96e-f637-4c4f-a3e3-7589af1b494a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:12.550904 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8b6d96e-f637-4c4f-a3e3-7589af1b494a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:12.551686 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8b6d96e-f637-4c4f-a3e3-7589af1b494a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:12.552121 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8b6d96e-f637-4c4f-a3e3-7589af1b494a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:12.700483 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e8b6d96e-f637-4c4f-a3e3-7589af1b494a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:12.709029 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e8b6d96e-f637-4c4f-a3e3-7589af1b494a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1754 microversion: 2.1 time: 0.169695 Jul 27 20:13:12.709599 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 322/630] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:12 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:13.130261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a4017346-4551-49a5-aa1c-badcb4be839d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:13.130870 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a4017346-4551-49a5-aa1c-badcb4be839d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:13.137077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a4017346-4551-49a5-aa1c-badcb4be839d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:13.137530 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a4017346-4551-49a5-aa1c-badcb4be839d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:13.138296 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a4017346-4551-49a5-aa1c-badcb4be839d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:13.138735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a4017346-4551-49a5-aa1c-badcb4be839d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:13.278101 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a4017346-4551-49a5-aa1c-badcb4be839d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:13.286303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a4017346-4551-49a5-aa1c-badcb4be839d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1319 microversion: 2.1 time: 0.159949 Jul 27 20:13:13.286877 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 309/631] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:13 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:13.307357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-42fb3782-733e-4b47-9bbf-1168f2cc1734 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:13.308067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-42fb3782-733e-4b47-9bbf-1168f2cc1734 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:13.315122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-42fb3782-733e-4b47-9bbf-1168f2cc1734 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:13.315576 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-42fb3782-733e-4b47-9bbf-1168f2cc1734 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:13.316354 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-42fb3782-733e-4b47-9bbf-1168f2cc1734 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:13.317099 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-42fb3782-733e-4b47-9bbf-1168f2cc1734 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:13.450247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-42fb3782-733e-4b47-9bbf-1168f2cc1734 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:13.459016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-42fb3782-733e-4b47-9bbf-1168f2cc1734 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:13.460512 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-42fb3782-733e-4b47-9bbf-1168f2cc1734 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:13.461708 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-42fb3782-733e-4b47-9bbf-1168f2cc1734 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.158859 Jul 27 20:13:13.462246 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 323/632] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:13 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:13:13.731759 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-074d42cf-278c-479d-ae15-8c331eae94ce tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:13.732284 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-074d42cf-278c-479d-ae15-8c331eae94ce tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:13.734147 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:13.740779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-074d42cf-278c-479d-ae15-8c331eae94ce tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:13.741252 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-074d42cf-278c-479d-ae15-8c331eae94ce tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:13.742019 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-074d42cf-278c-479d-ae15-8c331eae94ce tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:13.742456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-074d42cf-278c-479d-ae15-8c331eae94ce tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:13.882779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-074d42cf-278c-479d-ae15-8c331eae94ce tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:13.890805 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-074d42cf-278c-479d-ae15-8c331eae94ce tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1754 microversion: 2.1 time: 0.163010 Jul 27 20:13:13.891477 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 310/633] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:13 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:14.311994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-30c4aa8c-65df-449c-8459-8c81513203e4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:14.312609 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-30c4aa8c-65df-449c-8459-8c81513203e4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:14.319629 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-30c4aa8c-65df-449c-8459-8c81513203e4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:14.320088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-30c4aa8c-65df-449c-8459-8c81513203e4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:14.320860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-30c4aa8c-65df-449c-8459-8c81513203e4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:14.321331 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-30c4aa8c-65df-449c-8459-8c81513203e4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:14.447883 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-30c4aa8c-65df-449c-8459-8c81513203e4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:14.455899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-30c4aa8c-65df-449c-8459-8c81513203e4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1319 microversion: 2.1 time: 0.147782 Jul 27 20:13:14.456461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 324/634] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:14 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:14.485345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-60f79f81-77ef-458c-be97-c14597052b29 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:14.486145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-60f79f81-77ef-458c-be97-c14597052b29 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:14.492432 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60f79f81-77ef-458c-be97-c14597052b29 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:14.492904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60f79f81-77ef-458c-be97-c14597052b29 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:14.493716 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60f79f81-77ef-458c-be97-c14597052b29 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:14.494150 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60f79f81-77ef-458c-be97-c14597052b29 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:14.636316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-60f79f81-77ef-458c-be97-c14597052b29 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:14.645585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-60f79f81-77ef-458c-be97-c14597052b29 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:14.647133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-60f79f81-77ef-458c-be97-c14597052b29 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:14.648238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-60f79f81-77ef-458c-be97-c14597052b29 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.166808 Jul 27 20:13:14.648797 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 311/635] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:14 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:13:14.911732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c93bfbea-8e03-498c-9735-6f92821bd8cb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:14.912262 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c93bfbea-8e03-498c-9735-6f92821bd8cb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:14.918420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c93bfbea-8e03-498c-9735-6f92821bd8cb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:14.919346 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c93bfbea-8e03-498c-9735-6f92821bd8cb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:14.919653 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c93bfbea-8e03-498c-9735-6f92821bd8cb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:14.920097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c93bfbea-8e03-498c-9735-6f92821bd8cb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:14.925148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:15.069027 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c93bfbea-8e03-498c-9735-6f92821bd8cb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:15.077063 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c93bfbea-8e03-498c-9735-6f92821bd8cb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1754 microversion: 2.1 time: 0.169253 Jul 27 20:13:15.077641 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 325/636] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:14 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:15.475591 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d76138af-2cae-423e-b200-947267dc766f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:15.476193 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d76138af-2cae-423e-b200-947267dc766f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:15.482123 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d76138af-2cae-423e-b200-947267dc766f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:15.482559 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d76138af-2cae-423e-b200-947267dc766f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:15.483312 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d76138af-2cae-423e-b200-947267dc766f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:15.483738 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d76138af-2cae-423e-b200-947267dc766f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:15.611954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d76138af-2cae-423e-b200-947267dc766f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:15.619314 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d76138af-2cae-423e-b200-947267dc766f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1319 microversion: 2.1 time: 0.147496 Jul 27 20:13:15.619871 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 312/637] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:15 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:15.671092 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0c0bd401-56df-4f10-b6b5-6353feb783f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:15.671705 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0c0bd401-56df-4f10-b6b5-6353feb783f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:15.678868 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0c0bd401-56df-4f10-b6b5-6353feb783f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:15.679323 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0c0bd401-56df-4f10-b6b5-6353feb783f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:15.680091 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0c0bd401-56df-4f10-b6b5-6353feb783f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:15.680534 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0c0bd401-56df-4f10-b6b5-6353feb783f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:15.812686 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0c0bd401-56df-4f10-b6b5-6353feb783f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:15.821867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0c0bd401-56df-4f10-b6b5-6353feb783f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:15.823368 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0c0bd401-56df-4f10-b6b5-6353feb783f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:15.824527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0c0bd401-56df-4f10-b6b5-6353feb783f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.157385 Jul 27 20:13:15.825117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 326/638] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:15 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:13:16.099259 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-45b4bff5-dfa1-45f6-bf8e-0c8dad3c3d77 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:16.099871 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-45b4bff5-dfa1-45f6-bf8e-0c8dad3c3d77 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:16.106194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-45b4bff5-dfa1-45f6-bf8e-0c8dad3c3d77 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:16.106643 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-45b4bff5-dfa1-45f6-bf8e-0c8dad3c3d77 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:16.107409 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-45b4bff5-dfa1-45f6-bf8e-0c8dad3c3d77 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:16.107847 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-45b4bff5-dfa1-45f6-bf8e-0c8dad3c3d77 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:16.251060 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-45b4bff5-dfa1-45f6-bf8e-0c8dad3c3d77 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:16.258933 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-45b4bff5-dfa1-45f6-bf8e-0c8dad3c3d77 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1754 microversion: 2.1 time: 0.163616 Jul 27 20:13:16.259499 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 313/639] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:16 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:16.639616 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3cd2118e-e99c-4179-9486-521d567659ec tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:16.640260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3cd2118e-e99c-4179-9486-521d567659ec tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:16.646828 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3cd2118e-e99c-4179-9486-521d567659ec tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:16.647286 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3cd2118e-e99c-4179-9486-521d567659ec tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:16.648053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3cd2118e-e99c-4179-9486-521d567659ec tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:16.648499 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3cd2118e-e99c-4179-9486-521d567659ec tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:16.777769 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3cd2118e-e99c-4179-9486-521d567659ec tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:16.785222 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3cd2118e-e99c-4179-9486-521d567659ec tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1319 microversion: 2.1 time: 0.149452 Jul 27 20:13:16.785782 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 327/640] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:16 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:16.848004 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-abfb56b0-3e2c-482d-9e5f-0af36cc990ca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:16.848614 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-abfb56b0-3e2c-482d-9e5f-0af36cc990ca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:16.854550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-abfb56b0-3e2c-482d-9e5f-0af36cc990ca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:16.854999 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-abfb56b0-3e2c-482d-9e5f-0af36cc990ca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:16.855795 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-abfb56b0-3e2c-482d-9e5f-0af36cc990ca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:16.856240 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-abfb56b0-3e2c-482d-9e5f-0af36cc990ca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:16.984355 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-abfb56b0-3e2c-482d-9e5f-0af36cc990ca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:16.992882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-abfb56b0-3e2c-482d-9e5f-0af36cc990ca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:16.994392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-abfb56b0-3e2c-482d-9e5f-0af36cc990ca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:16.995778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-abfb56b0-3e2c-482d-9e5f-0af36cc990ca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.152047 Jul 27 20:13:16.996489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 314/641] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:16 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:13:17.280798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bc696569-c878-4ac0-8048-c1c5ce344b15 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:17.281440 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bc696569-c878-4ac0-8048-c1c5ce344b15 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:17.290651 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bc696569-c878-4ac0-8048-c1c5ce344b15 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:17.291110 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bc696569-c878-4ac0-8048-c1c5ce344b15 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:17.291880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bc696569-c878-4ac0-8048-c1c5ce344b15 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:17.292327 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bc696569-c878-4ac0-8048-c1c5ce344b15 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:17.441541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bc696569-c878-4ac0-8048-c1c5ce344b15 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:17.449682 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bc696569-c878-4ac0-8048-c1c5ce344b15 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1754 microversion: 2.1 time: 0.172775 Jul 27 20:13:17.450251 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 328/642] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:17 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:17.805737 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b3b79707-a661-496e-a159-68b8eda2012f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:17.806384 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b3b79707-a661-496e-a159-68b8eda2012f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:17.812369 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3b79707-a661-496e-a159-68b8eda2012f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:17.812818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3b79707-a661-496e-a159-68b8eda2012f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:17.813626 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3b79707-a661-496e-a159-68b8eda2012f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:17.814063 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3b79707-a661-496e-a159-68b8eda2012f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:17.944904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b3b79707-a661-496e-a159-68b8eda2012f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:17.952387 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b3b79707-a661-496e-a159-68b8eda2012f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1319 microversion: 2.1 time: 0.150469 Jul 27 20:13:17.952943 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 315/643] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:17 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:18.019313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8add9d36-25af-4286-b1ff-d09a89846a3c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:18.019928 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8add9d36-25af-4286-b1ff-d09a89846a3c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:18.026689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8add9d36-25af-4286-b1ff-d09a89846a3c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:18.027138 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8add9d36-25af-4286-b1ff-d09a89846a3c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:18.027906 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8add9d36-25af-4286-b1ff-d09a89846a3c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:18.028347 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8add9d36-25af-4286-b1ff-d09a89846a3c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:18.164857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8add9d36-25af-4286-b1ff-d09a89846a3c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:18.174015 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8add9d36-25af-4286-b1ff-d09a89846a3c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:18.175548 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8add9d36-25af-4286-b1ff-d09a89846a3c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:18.176743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8add9d36-25af-4286-b1ff-d09a89846a3c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.161951 Jul 27 20:13:18.177330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 329/644] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:18 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:13:18.471879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-356d1ee1-6547-4016-a059-8babc070fd09 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:18.472427 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-356d1ee1-6547-4016-a059-8babc070fd09 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:18.478497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-356d1ee1-6547-4016-a059-8babc070fd09 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:18.478948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-356d1ee1-6547-4016-a059-8babc070fd09 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:18.479711 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-356d1ee1-6547-4016-a059-8babc070fd09 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:18.480150 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-356d1ee1-6547-4016-a059-8babc070fd09 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:18.623238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-356d1ee1-6547-4016-a059-8babc070fd09 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:18.631144 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-356d1ee1-6547-4016-a059-8babc070fd09 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1754 microversion: 2.1 time: 0.163922 Jul 27 20:13:18.631703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 316/645] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:18 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:13:18.974044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c47cb1ca-40d8-4f15-a456-36faf3832663 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:18.974661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c47cb1ca-40d8-4f15-a456-36faf3832663 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:18.980905 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c47cb1ca-40d8-4f15-a456-36faf3832663 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:18.981388 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c47cb1ca-40d8-4f15-a456-36faf3832663 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:18.982154 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c47cb1ca-40d8-4f15-a456-36faf3832663 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:18.982592 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c47cb1ca-40d8-4f15-a456-36faf3832663 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:19.115376 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c47cb1ca-40d8-4f15-a456-36faf3832663 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:19.122707 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c47cb1ca-40d8-4f15-a456-36faf3832663 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1319 microversion: 2.1 time: 0.153104 Jul 27 20:13:19.123265 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 330/646] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:18 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:19.306818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1763254d-83f5-4fe5-bd12-b59231e6c9f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:19.307434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1763254d-83f5-4fe5-bd12-b59231e6c9f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:19.313868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1763254d-83f5-4fe5-bd12-b59231e6c9f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:19.314569 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1763254d-83f5-4fe5-bd12-b59231e6c9f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:19.315353 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1763254d-83f5-4fe5-bd12-b59231e6c9f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:19.315785 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1763254d-83f5-4fe5-bd12-b59231e6c9f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:19.446755 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1763254d-83f5-4fe5-bd12-b59231e6c9f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:19.455733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1763254d-83f5-4fe5-bd12-b59231e6c9f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:19.457402 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1763254d-83f5-4fe5-bd12-b59231e6c9f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:19.458568 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1763254d-83f5-4fe5-bd12-b59231e6c9f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.261622 Jul 27 20:13:19.459135 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 317/647] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:19 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:13:19.653294 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f63eca33-4289-42b0-aee5-dfe5b059d80d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:19.653916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f63eca33-4289-42b0-aee5-dfe5b059d80d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:19.660877 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f63eca33-4289-42b0-aee5-dfe5b059d80d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:19.661353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f63eca33-4289-42b0-aee5-dfe5b059d80d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:19.662124 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f63eca33-4289-42b0-aee5-dfe5b059d80d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:19.662564 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f63eca33-4289-42b0-aee5-dfe5b059d80d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:19.806642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f63eca33-4289-42b0-aee5-dfe5b059d80d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:19.815695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f63eca33-4289-42b0-aee5-dfe5b059d80d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1754 microversion: 2.1 time: 0.166154 Jul 27 20:13:19.816505 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 331/648] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:19 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:20.143342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a22cb4ae-5054-4ab2-9b74-2d1eaba68324 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:20.143949 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a22cb4ae-5054-4ab2-9b74-2d1eaba68324 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:20.150112 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a22cb4ae-5054-4ab2-9b74-2d1eaba68324 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:20.150561 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a22cb4ae-5054-4ab2-9b74-2d1eaba68324 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:20.151357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a22cb4ae-5054-4ab2-9b74-2d1eaba68324 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:20.151793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a22cb4ae-5054-4ab2-9b74-2d1eaba68324 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:20.278003 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a22cb4ae-5054-4ab2-9b74-2d1eaba68324 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:20.285458 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a22cb4ae-5054-4ab2-9b74-2d1eaba68324 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1319 microversion: 2.1 time: 0.146134 Jul 27 20:13:20.286023 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 318/649] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:20 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:20.483339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ffd6b5b5-baab-4357-a213-7b6e02ce1100 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:20.484039 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ffd6b5b5-baab-4357-a213-7b6e02ce1100 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:20.487194 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=70 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:20.492634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ffd6b5b5-baab-4357-a213-7b6e02ce1100 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:20.493117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ffd6b5b5-baab-4357-a213-7b6e02ce1100 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:20.493899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ffd6b5b5-baab-4357-a213-7b6e02ce1100 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:20.494343 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ffd6b5b5-baab-4357-a213-7b6e02ce1100 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:20.626224 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ffd6b5b5-baab-4357-a213-7b6e02ce1100 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:20.634626 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ffd6b5b5-baab-4357-a213-7b6e02ce1100 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:20.636136 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ffd6b5b5-baab-4357-a213-7b6e02ce1100 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:20.637326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ffd6b5b5-baab-4357-a213-7b6e02ce1100 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.158338 Jul 27 20:13:20.637900 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 332/650] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:20 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:13:20.693889 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:13:20.694111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:13:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:13:20.838518 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d5906a3d-1171-4452-a813-7cffe4905e73 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:20.839080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d5906a3d-1171-4452-a813-7cffe4905e73 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:20.845094 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5906a3d-1171-4452-a813-7cffe4905e73 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:20.846089 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5906a3d-1171-4452-a813-7cffe4905e73 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:20.846938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5906a3d-1171-4452-a813-7cffe4905e73 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:20.847391 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5906a3d-1171-4452-a813-7cffe4905e73 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:20.993612 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d5906a3d-1171-4452-a813-7cffe4905e73 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:21.001497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d5906a3d-1171-4452-a813-7cffe4905e73 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1759 microversion: 2.1 time: 0.166921 Jul 27 20:13:21.002099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 319/651] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:20 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:21.306145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-dcf42628-abd4-425b-902b-594b4aa1fa46 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:21.306789 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-dcf42628-abd4-425b-902b-594b4aa1fa46 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:21.312893 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dcf42628-abd4-425b-902b-594b4aa1fa46 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:21.313375 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dcf42628-abd4-425b-902b-594b4aa1fa46 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:21.314845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dcf42628-abd4-425b-902b-594b4aa1fa46 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:21.318522 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dcf42628-abd4-425b-902b-594b4aa1fa46 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:21.453777 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-dcf42628-abd4-425b-902b-594b4aa1fa46 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:21.461921 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-dcf42628-abd4-425b-902b-594b4aa1fa46 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1507 microversion: 2.1 time: 0.159679 Jul 27 20:13:21.462474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 333/652] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:21 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:13:21.661131 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4fa03780-7311-419d-a36f-2aaaf38d6ab3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:21.661853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4fa03780-7311-419d-a36f-2aaaf38d6ab3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:21.667793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4fa03780-7311-419d-a36f-2aaaf38d6ab3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:21.668241 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4fa03780-7311-419d-a36f-2aaaf38d6ab3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:21.669012 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4fa03780-7311-419d-a36f-2aaaf38d6ab3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:21.669445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4fa03780-7311-419d-a36f-2aaaf38d6ab3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:21.807245 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4fa03780-7311-419d-a36f-2aaaf38d6ab3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:21.827742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4fa03780-7311-419d-a36f-2aaaf38d6ab3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:21.827742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4fa03780-7311-419d-a36f-2aaaf38d6ab3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:21.827742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4fa03780-7311-419d-a36f-2aaaf38d6ab3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.164437 Jul 27 20:13:21.828102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 320/653] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:21 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:13:22.022925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-432372ac-2f41-40c0-bfbe-1be4b1655066 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:22.023537 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-432372ac-2f41-40c0-bfbe-1be4b1655066 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:22.029964 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-432372ac-2f41-40c0-bfbe-1be4b1655066 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:22.030413 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-432372ac-2f41-40c0-bfbe-1be4b1655066 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:22.031167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-432372ac-2f41-40c0-bfbe-1be4b1655066 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:22.031601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-432372ac-2f41-40c0-bfbe-1be4b1655066 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:22.176880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-432372ac-2f41-40c0-bfbe-1be4b1655066 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:22.184759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-432372ac-2f41-40c0-bfbe-1be4b1655066 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1759 microversion: 2.1 time: 0.165864 Jul 27 20:13:22.185417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 334/654] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:22 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:22.848435 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3e10aee1-9a09-4cac-9ddb-6757958ab424 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:22.849531 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3e10aee1-9a09-4cac-9ddb-6757958ab424 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:22.856053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e10aee1-9a09-4cac-9ddb-6757958ab424 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:22.856500 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e10aee1-9a09-4cac-9ddb-6757958ab424 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:22.857308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e10aee1-9a09-4cac-9ddb-6757958ab424 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:22.857737 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e10aee1-9a09-4cac-9ddb-6757958ab424 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:22.996423 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3e10aee1-9a09-4cac-9ddb-6757958ab424 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:23.007982 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3e10aee1-9a09-4cac-9ddb-6757958ab424 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:23.009509 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3e10aee1-9a09-4cac-9ddb-6757958ab424 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:23.010722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3e10aee1-9a09-4cac-9ddb-6757958ab424 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.167722 Jul 27 20:13:23.011290 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 321/655] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:22 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:13:23.206849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d1ab96b1-09ef-4023-a5eb-49e790d42099 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:23.207445 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d1ab96b1-09ef-4023-a5eb-49e790d42099 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:23.213941 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d1ab96b1-09ef-4023-a5eb-49e790d42099 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:23.214388 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d1ab96b1-09ef-4023-a5eb-49e790d42099 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:23.215143 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d1ab96b1-09ef-4023-a5eb-49e790d42099 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:23.215581 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d1ab96b1-09ef-4023-a5eb-49e790d42099 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:23.366563 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d1ab96b1-09ef-4023-a5eb-49e790d42099 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:23.374820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d1ab96b1-09ef-4023-a5eb-49e790d42099 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1759 microversion: 2.1 time: 0.171976 Jul 27 20:13:23.375369 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 335/656] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:23 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1759 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:24.034811 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b98bc720-1231-4e6c-927b-81d7b52871bb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:24.036036 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b98bc720-1231-4e6c-927b-81d7b52871bb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:24.042112 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b98bc720-1231-4e6c-927b-81d7b52871bb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:24.042562 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b98bc720-1231-4e6c-927b-81d7b52871bb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:24.043357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b98bc720-1231-4e6c-927b-81d7b52871bb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:24.043791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b98bc720-1231-4e6c-927b-81d7b52871bb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:24.178397 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b98bc720-1231-4e6c-927b-81d7b52871bb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:24.187126 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b98bc720-1231-4e6c-927b-81d7b52871bb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:24.188651 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b98bc720-1231-4e6c-927b-81d7b52871bb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:24.189841 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b98bc720-1231-4e6c-927b-81d7b52871bb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.158925 Jul 27 20:13:24.190414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 322/657] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:24 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:13:24.398027 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-227b01c9-081a-4243-89c1-834bbd78ec62 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:24.398646 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-227b01c9-081a-4243-89c1-834bbd78ec62 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:24.405234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-227b01c9-081a-4243-89c1-834bbd78ec62 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:24.405754 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-227b01c9-081a-4243-89c1-834bbd78ec62 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:24.406532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-227b01c9-081a-4243-89c1-834bbd78ec62 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:24.406980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-227b01c9-081a-4243-89c1-834bbd78ec62 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:24.553688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-227b01c9-081a-4243-89c1-834bbd78ec62 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:24.561632 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-227b01c9-081a-4243-89c1-834bbd78ec62 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1759 microversion: 2.1 time: 0.168838 Jul 27 20:13:24.562189 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 336/658] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:24 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:25.214213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-82249bfb-f8a2-40d9-a13c-60fe0a6eeca1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:25.214806 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-82249bfb-f8a2-40d9-a13c-60fe0a6eeca1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:25.220838 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82249bfb-f8a2-40d9-a13c-60fe0a6eeca1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:25.221321 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82249bfb-f8a2-40d9-a13c-60fe0a6eeca1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:25.222078 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82249bfb-f8a2-40d9-a13c-60fe0a6eeca1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:25.222514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82249bfb-f8a2-40d9-a13c-60fe0a6eeca1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:25.352910 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-82249bfb-f8a2-40d9-a13c-60fe0a6eeca1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:25.362217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-82249bfb-f8a2-40d9-a13c-60fe0a6eeca1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:25.364429 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-82249bfb-f8a2-40d9-a13c-60fe0a6eeca1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:25.365637 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-82249bfb-f8a2-40d9-a13c-60fe0a6eeca1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.155437 Jul 27 20:13:25.366196 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 323/659] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:25 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:13:25.583993 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f110983e-4039-485d-a166-a004b4b1d983 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:25.584531 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f110983e-4039-485d-a166-a004b4b1d983 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:25.591038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f110983e-4039-485d-a166-a004b4b1d983 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:25.591493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f110983e-4039-485d-a166-a004b4b1d983 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:25.592255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f110983e-4039-485d-a166-a004b4b1d983 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:25.592700 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f110983e-4039-485d-a166-a004b4b1d983 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:25.739704 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f110983e-4039-485d-a166-a004b4b1d983 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:25.747881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f110983e-4039-485d-a166-a004b4b1d983 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1759 microversion: 2.1 time: 0.168031 Jul 27 20:13:25.748455 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 337/660] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:25 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:26.391436 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8db71b5d-ddf6-4f8f-84be-1197442decfb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:26.392221 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8db71b5d-ddf6-4f8f-84be-1197442decfb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:26.398423 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8db71b5d-ddf6-4f8f-84be-1197442decfb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:26.398869 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8db71b5d-ddf6-4f8f-84be-1197442decfb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:26.399628 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8db71b5d-ddf6-4f8f-84be-1197442decfb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:26.400064 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8db71b5d-ddf6-4f8f-84be-1197442decfb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:26.533504 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8db71b5d-ddf6-4f8f-84be-1197442decfb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:26.536252 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:26.543687 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8db71b5d-ddf6-4f8f-84be-1197442decfb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:26.545220 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8db71b5d-ddf6-4f8f-84be-1197442decfb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:26.546382 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8db71b5d-ddf6-4f8f-84be-1197442decfb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.159165 Jul 27 20:13:26.546942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 324/661] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:26 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:13:26.770276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3691e5b4-45ba-4ed5-9a27-213b9ebe2b1a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:26.770891 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3691e5b4-45ba-4ed5-9a27-213b9ebe2b1a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:26.777518 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3691e5b4-45ba-4ed5-9a27-213b9ebe2b1a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:26.777973 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3691e5b4-45ba-4ed5-9a27-213b9ebe2b1a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:26.778754 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3691e5b4-45ba-4ed5-9a27-213b9ebe2b1a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:26.779195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3691e5b4-45ba-4ed5-9a27-213b9ebe2b1a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:26.930340 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3691e5b4-45ba-4ed5-9a27-213b9ebe2b1a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:26.938888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3691e5b4-45ba-4ed5-9a27-213b9ebe2b1a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1759 microversion: 2.1 time: 0.172494 Jul 27 20:13:26.939461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 338/662] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:26 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:27.570349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8833fe01-9d3c-4a48-ba6f-328257611bbd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:27.571009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8833fe01-9d3c-4a48-ba6f-328257611bbd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:27.576994 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8833fe01-9d3c-4a48-ba6f-328257611bbd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:27.577456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8833fe01-9d3c-4a48-ba6f-328257611bbd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:27.578220 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8833fe01-9d3c-4a48-ba6f-328257611bbd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:27.578662 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8833fe01-9d3c-4a48-ba6f-328257611bbd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:27.712467 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8833fe01-9d3c-4a48-ba6f-328257611bbd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:27.720986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8833fe01-9d3c-4a48-ba6f-328257611bbd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:27.723212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8833fe01-9d3c-4a48-ba6f-328257611bbd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:27.724536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8833fe01-9d3c-4a48-ba6f-328257611bbd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.158839 Jul 27 20:13:27.725286 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 325/663] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:27 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:13:27.961969 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-17b8f096-0498-4951-ade1-d0c23d9c6f46 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:27.962625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-17b8f096-0498-4951-ade1-d0c23d9c6f46 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:27.969161 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-17b8f096-0498-4951-ade1-d0c23d9c6f46 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:27.969612 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-17b8f096-0498-4951-ade1-d0c23d9c6f46 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:27.970375 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-17b8f096-0498-4951-ade1-d0c23d9c6f46 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:27.970812 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-17b8f096-0498-4951-ade1-d0c23d9c6f46 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:28.117618 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-17b8f096-0498-4951-ade1-d0c23d9c6f46 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:28.125643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-17b8f096-0498-4951-ade1-d0c23d9c6f46 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1759 microversion: 2.1 time: 0.168471 Jul 27 20:13:28.126221 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 339/664] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:27 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:28.259762 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-1a9e34f9-d7c6-4f33-9dcf-4dc897ad9751 req-059f36d5-4e3b-411f-b357-7886ca2d403f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d725356e-73a3-486b-b590-0324916667ff", "name": "network-vif-plugged", "status": "completed", "tag": "899741ce-2752-45e1-aee9-3a2da333cdf0"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:13:28.270421 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-1a9e34f9-d7c6-4f33-9dcf-4dc897ad9751 req-059f36d5-4e3b-411f-b357-7886ca2d403f service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:28.270874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-1a9e34f9-d7c6-4f33-9dcf-4dc897ad9751 req-059f36d5-4e3b-411f-b357-7886ca2d403f service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:28.282913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-1a9e34f9-d7c6-4f33-9dcf-4dc897ad9751 req-059f36d5-4e3b-411f-b357-7886ca2d403f service nova] Creating event network-vif-plugged:899741ce-2752-45e1-aee9-3a2da333cdf0 for instance d725356e-73a3-486b-b590-0324916667ff on hv-cinder-79987 Jul 27 20:13:28.288358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-1a9e34f9-d7c6-4f33-9dcf-4dc897ad9751 req-059f36d5-4e3b-411f-b357-7886ca2d403f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032521 Jul 27 20:13:28.288958 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 326/665] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:13:28.747550 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b4e96ab6-699b-466f-ab50-7eaf9d845cc1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:28.748180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b4e96ab6-699b-466f-ab50-7eaf9d845cc1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:28.754540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4e96ab6-699b-466f-ab50-7eaf9d845cc1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:28.755116 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4e96ab6-699b-466f-ab50-7eaf9d845cc1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:28.755884 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4e96ab6-699b-466f-ab50-7eaf9d845cc1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:28.756326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4e96ab6-699b-466f-ab50-7eaf9d845cc1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:28.908117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b4e96ab6-699b-466f-ab50-7eaf9d845cc1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:28.917274 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b4e96ab6-699b-466f-ab50-7eaf9d845cc1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:28.919137 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b4e96ab6-699b-466f-ab50-7eaf9d845cc1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:28.920312 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b4e96ab6-699b-466f-ab50-7eaf9d845cc1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.176723 Jul 27 20:13:28.920909 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 340/666] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:28 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:13:29.149344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-395e1369-6327-4531-b883-dd08169d0aa5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:29.150170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-395e1369-6327-4531-b883-dd08169d0aa5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:29.156449 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-395e1369-6327-4531-b883-dd08169d0aa5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:29.156898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-395e1369-6327-4531-b883-dd08169d0aa5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:29.157686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-395e1369-6327-4531-b883-dd08169d0aa5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:29.158123 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-395e1369-6327-4531-b883-dd08169d0aa5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:29.308092 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-395e1369-6327-4531-b883-dd08169d0aa5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:29.316018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-395e1369-6327-4531-b883-dd08169d0aa5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1759 microversion: 2.1 time: 0.172216 Jul 27 20:13:29.317151 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 327/667] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:29 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:29.387327 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-54986857-a716-46be-ad0e-dfcef4daf768 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4fe68b5-3007-45a2-91be-ff65008cfbc3"}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:13:29.389778 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-54986857-a716-46be-ad0e-dfcef4daf768 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:29.396725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-54986857-a716-46be-ad0e-dfcef4daf768 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:29.397212 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-54986857-a716-46be-ad0e-dfcef4daf768 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:29.398188 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-54986857-a716-46be-ad0e-dfcef4daf768 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:29.398786 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-54986857-a716-46be-ad0e-dfcef4daf768 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:29.471087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:29.697116 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-54986857-a716-46be-ad0e-dfcef4daf768 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "POST /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.425723 Jul 27 20:13:29.697733 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 341/668] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Jul 27 20:13:29 2022] POST /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 194 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:13:29.946238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-622f8351-110a-45ae-a834-d9ef40b01368 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:29.946966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-622f8351-110a-45ae-a834-d9ef40b01368 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:29.952988 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-622f8351-110a-45ae-a834-d9ef40b01368 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:29.953449 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-622f8351-110a-45ae-a834-d9ef40b01368 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:29.954205 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-622f8351-110a-45ae-a834-d9ef40b01368 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:29.954641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-622f8351-110a-45ae-a834-d9ef40b01368 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:30.093389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-622f8351-110a-45ae-a834-d9ef40b01368 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:30.102301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-622f8351-110a-45ae-a834-d9ef40b01368 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:30.103785 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-622f8351-110a-45ae-a834-d9ef40b01368 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:30.104936 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-622f8351-110a-45ae-a834-d9ef40b01368 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.163785 Jul 27 20:13:30.105510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 328/669] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:29 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:13:30.339873 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-02229b41-7c96-48dd-9edb-0c24c5373af8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:30.340704 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-02229b41-7c96-48dd-9edb-0c24c5373af8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:30.350880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-02229b41-7c96-48dd-9edb-0c24c5373af8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:30.351346 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-02229b41-7c96-48dd-9edb-0c24c5373af8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:30.352156 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-02229b41-7c96-48dd-9edb-0c24c5373af8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:30.352605 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-02229b41-7c96-48dd-9edb-0c24c5373af8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:30.506756 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-02229b41-7c96-48dd-9edb-0c24c5373af8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:30.514827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-02229b41-7c96-48dd-9edb-0c24c5373af8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1759 microversion: 2.1 time: 0.179961 Jul 27 20:13:30.515430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 342/670] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:30 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1759 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:31.131574 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fe97ef6f-3ed7-4887-afa9-dab8a29cef93 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:31.136866 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fe97ef6f-3ed7-4887-afa9-dab8a29cef93 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:31.143605 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe97ef6f-3ed7-4887-afa9-dab8a29cef93 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:31.145287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe97ef6f-3ed7-4887-afa9-dab8a29cef93 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:31.145803 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe97ef6f-3ed7-4887-afa9-dab8a29cef93 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:31.146369 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe97ef6f-3ed7-4887-afa9-dab8a29cef93 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:31.287419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fe97ef6f-3ed7-4887-afa9-dab8a29cef93 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:31.295869 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fe97ef6f-3ed7-4887-afa9-dab8a29cef93 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:31.297404 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fe97ef6f-3ed7-4887-afa9-dab8a29cef93 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:31.298571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fe97ef6f-3ed7-4887-afa9-dab8a29cef93 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1808 microversion: 2.20 time: 0.172574 Jul 27 20:13:31.299133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 329/671] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:31 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:13:31.536950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9cba999e-3336-49b5-827b-d7579447072b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:31.537584 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9cba999e-3336-49b5-827b-d7579447072b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:31.544055 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9cba999e-3336-49b5-827b-d7579447072b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:31.544501 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9cba999e-3336-49b5-827b-d7579447072b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:31.545318 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9cba999e-3336-49b5-827b-d7579447072b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:31.545751 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9cba999e-3336-49b5-827b-d7579447072b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:31.695911 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9cba999e-3336-49b5-827b-d7579447072b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:31.703866 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9cba999e-3336-49b5-827b-d7579447072b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1759 microversion: 2.1 time: 0.170851 Jul 27 20:13:31.704426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 343/672] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:31 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:32.325279 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b677de2b-34dc-40c9-88eb-76bdf534d221 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:32.325889 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b677de2b-34dc-40c9-88eb-76bdf534d221 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:32.332403 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b677de2b-34dc-40c9-88eb-76bdf534d221 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:32.332852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b677de2b-34dc-40c9-88eb-76bdf534d221 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:32.333639 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b677de2b-34dc-40c9-88eb-76bdf534d221 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:32.334076 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b677de2b-34dc-40c9-88eb-76bdf534d221 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:32.470766 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b677de2b-34dc-40c9-88eb-76bdf534d221 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:32.479352 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b677de2b-34dc-40c9-88eb-76bdf534d221 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:32.480854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b677de2b-34dc-40c9-88eb-76bdf534d221 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:32.482183 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b677de2b-34dc-40c9-88eb-76bdf534d221 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1795 microversion: 2.20 time: 0.160664 Jul 27 20:13:32.482738 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 330/673] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:13:32 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1795 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:13:32.725129 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1c14d374-0e06-4bd3-a707-4425fbbf193c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:32.725723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1c14d374-0e06-4bd3-a707-4425fbbf193c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:32.732186 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1c14d374-0e06-4bd3-a707-4425fbbf193c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:32.732637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1c14d374-0e06-4bd3-a707-4425fbbf193c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:32.733429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1c14d374-0e06-4bd3-a707-4425fbbf193c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:32.733870 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1c14d374-0e06-4bd3-a707-4425fbbf193c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:32.881667 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1c14d374-0e06-4bd3-a707-4425fbbf193c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:32.893369 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1c14d374-0e06-4bd3-a707-4425fbbf193c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1759 microversion: 2.1 time: 0.171821 Jul 27 20:13:32.893961 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 344/674] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:32 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1759 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:33.916777 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4b65644b-d2c9-48b7-8747-446768a343df tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:33.917408 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4b65644b-d2c9-48b7-8747-446768a343df tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:33.925479 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b65644b-d2c9-48b7-8747-446768a343df tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:33.926243 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b65644b-d2c9-48b7-8747-446768a343df tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:33.927204 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b65644b-d2c9-48b7-8747-446768a343df tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:33.928152 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b65644b-d2c9-48b7-8747-446768a343df tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:34.107833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4b65644b-d2c9-48b7-8747-446768a343df tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:34.116302 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4b65644b-d2c9-48b7-8747-446768a343df tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1759 microversion: 2.1 time: 0.204243 Jul 27 20:13:34.116995 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 331/675] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:33 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1759 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:13:35.139099 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-abd48d4a-56f7-4a63-8183-65e1fa07b387 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:35.139744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-abd48d4a-56f7-4a63-8183-65e1fa07b387 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:35.146810 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-abd48d4a-56f7-4a63-8183-65e1fa07b387 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:35.147261 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-abd48d4a-56f7-4a63-8183-65e1fa07b387 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:35.148025 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-abd48d4a-56f7-4a63-8183-65e1fa07b387 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:35.148465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-abd48d4a-56f7-4a63-8183-65e1fa07b387 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:35.288676 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-abd48d4a-56f7-4a63-8183-65e1fa07b387 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:35.296548 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-abd48d4a-56f7-4a63-8183-65e1fa07b387 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1759 microversion: 2.1 time: 0.161315 Jul 27 20:13:35.297160 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 345/676] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:35 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1759 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:36.318224 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4affc204-f173-4396-8e97-218937ff347b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:36.318767 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4affc204-f173-4396-8e97-218937ff347b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:36.324710 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4affc204-f173-4396-8e97-218937ff347b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:36.325202 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4affc204-f173-4396-8e97-218937ff347b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:36.325962 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4affc204-f173-4396-8e97-218937ff347b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:36.326399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4affc204-f173-4396-8e97-218937ff347b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:36.466356 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4affc204-f173-4396-8e97-218937ff347b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:36.474187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4affc204-f173-4396-8e97-218937ff347b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1759 microversion: 2.1 time: 0.160129 Jul 27 20:13:36.474754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 332/677] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:36 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1759 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:37.496417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-12d3d300-aaab-457c-9487-f43e37c46b36 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:37.497063 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-12d3d300-aaab-457c-9487-f43e37c46b36 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:37.503562 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-12d3d300-aaab-457c-9487-f43e37c46b36 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:37.504002 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-12d3d300-aaab-457c-9487-f43e37c46b36 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:37.504755 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-12d3d300-aaab-457c-9487-f43e37c46b36 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:37.505225 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-12d3d300-aaab-457c-9487-f43e37c46b36 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:37.649093 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-12d3d300-aaab-457c-9487-f43e37c46b36 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:37.657357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-12d3d300-aaab-457c-9487-f43e37c46b36 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1762 microversion: 2.1 time: 0.164686 Jul 27 20:13:37.657935 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 346/678] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:37 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1762 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:39.338613 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-94caef82-a551-49a7-a27d-2443b76808d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:13:39.340840 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-94caef82-a551-49a7-a27d-2443b76808d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:39.346922 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-94caef82-a551-49a7-a27d-2443b76808d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:39.347368 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-94caef82-a551-49a7-a27d-2443b76808d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:39.348133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-94caef82-a551-49a7-a27d-2443b76808d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:39.348569 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-94caef82-a551-49a7-a27d-2443b76808d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:39.370824 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-94caef82-a551-49a7-a27d-2443b76808d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lazy-loading 'flavor' on Instance uuid 0d634922-ac08-46f6-aa94-44abf09f6bc3 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:13:39.494040 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-94caef82-a551-49a7-a27d-2443b76808d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "POST /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/action" status: 200 len: 32 microversion: 2.1 time: 0.159898 Jul 27 20:13:39.494644 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 333/679] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Jul 27 20:13:39 2022] POST /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 20:13:39.505374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4ceb888e-8e2e-4d5d-bdf8-c5c531cadb1c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:39.506577 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4ceb888e-8e2e-4d5d-bdf8-c5c531cadb1c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:39.515069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4ceb888e-8e2e-4d5d-bdf8-c5c531cadb1c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:39.515623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4ceb888e-8e2e-4d5d-bdf8-c5c531cadb1c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:39.517527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4ceb888e-8e2e-4d5d-bdf8-c5c531cadb1c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:39.518054 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4ceb888e-8e2e-4d5d-bdf8-c5c531cadb1c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:39.664519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4ceb888e-8e2e-4d5d-bdf8-c5c531cadb1c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:39.672519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4ceb888e-8e2e-4d5d-bdf8-c5c531cadb1c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.170906 Jul 27 20:13:39.673110 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 347/680] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:39 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:13:40.696510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8bc29b17-f79a-4fbc-82d5-77cb0d64a0f8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:40.697240 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8bc29b17-f79a-4fbc-82d5-77cb0d64a0f8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:40.703749 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8bc29b17-f79a-4fbc-82d5-77cb0d64a0f8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:40.704200 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8bc29b17-f79a-4fbc-82d5-77cb0d64a0f8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:40.705062 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8bc29b17-f79a-4fbc-82d5-77cb0d64a0f8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:40.705503 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8bc29b17-f79a-4fbc-82d5-77cb0d64a0f8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:40.837581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8bc29b17-f79a-4fbc-82d5-77cb0d64a0f8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:40.845625 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8bc29b17-f79a-4fbc-82d5-77cb0d64a0f8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.154513 Jul 27 20:13:40.846838 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 334/681] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:40 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:41.867761 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d1067984-e88f-44f2-bf1b-149e33ef4ef8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:41.868405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d1067984-e88f-44f2-bf1b-149e33ef4ef8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:41.874868 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d1067984-e88f-44f2-bf1b-149e33ef4ef8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:41.875318 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d1067984-e88f-44f2-bf1b-149e33ef4ef8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:41.876085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d1067984-e88f-44f2-bf1b-149e33ef4ef8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:41.876527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d1067984-e88f-44f2-bf1b-149e33ef4ef8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:42.007905 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d1067984-e88f-44f2-bf1b-149e33ef4ef8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:42.015857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d1067984-e88f-44f2-bf1b-149e33ef4ef8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151946 Jul 27 20:13:42.016421 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 348/682] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:41 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:43.037447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e70aee89-6b80-4bbf-ae82-bf2e774e48fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:43.038547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e70aee89-6b80-4bbf-ae82-bf2e774e48fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:43.044598 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e70aee89-6b80-4bbf-ae82-bf2e774e48fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:43.045096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e70aee89-6b80-4bbf-ae82-bf2e774e48fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:43.045865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e70aee89-6b80-4bbf-ae82-bf2e774e48fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:43.046303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e70aee89-6b80-4bbf-ae82-bf2e774e48fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:43.175157 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e70aee89-6b80-4bbf-ae82-bf2e774e48fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:43.183581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e70aee89-6b80-4bbf-ae82-bf2e774e48fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149941 Jul 27 20:13:43.184138 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 335/683] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:43 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:44.204583 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cc220489-ea33-4149-954a-57bcb1226114 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:44.205260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cc220489-ea33-4149-954a-57bcb1226114 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:44.211711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc220489-ea33-4149-954a-57bcb1226114 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:44.212166 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc220489-ea33-4149-954a-57bcb1226114 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:44.212931 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc220489-ea33-4149-954a-57bcb1226114 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:44.213443 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc220489-ea33-4149-954a-57bcb1226114 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:44.340710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cc220489-ea33-4149-954a-57bcb1226114 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:44.348751 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cc220489-ea33-4149-954a-57bcb1226114 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148070 Jul 27 20:13:44.349360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 349/684] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:44 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:45.371284 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-27c685c1-d692-4a1c-90df-01899f2c6100 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:45.371810 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-27c685c1-d692-4a1c-90df-01899f2c6100 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:45.373914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=52 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:45.379114 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-27c685c1-d692-4a1c-90df-01899f2c6100 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:45.379562 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-27c685c1-d692-4a1c-90df-01899f2c6100 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:45.380315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-27c685c1-d692-4a1c-90df-01899f2c6100 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:45.380741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-27c685c1-d692-4a1c-90df-01899f2c6100 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:45.514387 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-27c685c1-d692-4a1c-90df-01899f2c6100 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:45.522736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-27c685c1-d692-4a1c-90df-01899f2c6100 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.155593 Jul 27 20:13:45.523456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 336/685] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:45 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:46.543973 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-98fc620a-7134-43f9-8cff-ebe13493c96d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:46.544610 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-98fc620a-7134-43f9-8cff-ebe13493c96d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:46.551251 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-98fc620a-7134-43f9-8cff-ebe13493c96d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:46.551706 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-98fc620a-7134-43f9-8cff-ebe13493c96d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:46.552476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-98fc620a-7134-43f9-8cff-ebe13493c96d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:46.552919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-98fc620a-7134-43f9-8cff-ebe13493c96d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:46.681369 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-98fc620a-7134-43f9-8cff-ebe13493c96d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:46.689401 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-98fc620a-7134-43f9-8cff-ebe13493c96d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149139 Jul 27 20:13:46.689977 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 350/686] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:46 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:47.182540 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ff8e1b82-e30f-4be5-80d4-7712a2967d95 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b32b8226-ea5d-421f-97d5-90f6f0dcaff5", "device": "/dev/sdb"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:13:47.185469 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ff8e1b82-e30f-4be5-80d4-7712a2967d95 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:47.191727 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff8e1b82-e30f-4be5-80d4-7712a2967d95 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:47.192129 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff8e1b82-e30f-4be5-80d4-7712a2967d95 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:47.192897 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff8e1b82-e30f-4be5-80d4-7712a2967d95 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:47.193358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff8e1b82-e30f-4be5-80d4-7712a2967d95 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:47.463220 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ff8e1b82-e30f-4be5-80d4-7712a2967d95 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "POST /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284373 Jul 27 20:13:47.463787 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 337/687] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Jul 27 20:13:47 2022] POST /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:13:47.712171 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-851cc3d1-9ad9-458b-8a81-2da1cfc030cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:47.712839 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-851cc3d1-9ad9-458b-8a81-2da1cfc030cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:47.719795 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-851cc3d1-9ad9-458b-8a81-2da1cfc030cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:47.720188 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-851cc3d1-9ad9-458b-8a81-2da1cfc030cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:47.720943 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-851cc3d1-9ad9-458b-8a81-2da1cfc030cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:47.721402 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-851cc3d1-9ad9-458b-8a81-2da1cfc030cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:47.852015 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-851cc3d1-9ad9-458b-8a81-2da1cfc030cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:47.859790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-851cc3d1-9ad9-458b-8a81-2da1cfc030cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152502 Jul 27 20:13:47.860353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 351/688] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:47 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:48.882831 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a2ef8592-7a95-4608-9f60-aa3477a63923 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:48.883524 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a2ef8592-7a95-4608-9f60-aa3477a63923 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:48.890653 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a2ef8592-7a95-4608-9f60-aa3477a63923 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:48.891144 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a2ef8592-7a95-4608-9f60-aa3477a63923 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:48.891921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a2ef8592-7a95-4608-9f60-aa3477a63923 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:48.892364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a2ef8592-7a95-4608-9f60-aa3477a63923 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:49.024028 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a2ef8592-7a95-4608-9f60-aa3477a63923 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:49.026336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:49.033982 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a2ef8592-7a95-4608-9f60-aa3477a63923 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.156425 Jul 27 20:13:49.034580 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 338/689] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:48 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:13:50.057594 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5d9952cc-315b-4a62-980a-04d24ae2e263 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:50.058207 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5d9952cc-315b-4a62-980a-04d24ae2e263 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:50.064692 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5d9952cc-315b-4a62-980a-04d24ae2e263 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:50.065289 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5d9952cc-315b-4a62-980a-04d24ae2e263 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:50.066057 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5d9952cc-315b-4a62-980a-04d24ae2e263 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:50.066757 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5d9952cc-315b-4a62-980a-04d24ae2e263 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:50.195185 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5d9952cc-315b-4a62-980a-04d24ae2e263 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:50.203084 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5d9952cc-315b-4a62-980a-04d24ae2e263 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149816 Jul 27 20:13:50.203645 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 352/690] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:50 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:51.224140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fda8cb88-b8d5-4204-a063-5bd90dcbec3e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:51.224666 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fda8cb88-b8d5-4204-a063-5bd90dcbec3e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:51.232505 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fda8cb88-b8d5-4204-a063-5bd90dcbec3e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:51.232952 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fda8cb88-b8d5-4204-a063-5bd90dcbec3e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:51.233743 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fda8cb88-b8d5-4204-a063-5bd90dcbec3e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:51.234183 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fda8cb88-b8d5-4204-a063-5bd90dcbec3e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:51.361594 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fda8cb88-b8d5-4204-a063-5bd90dcbec3e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:51.369760 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fda8cb88-b8d5-4204-a063-5bd90dcbec3e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149599 Jul 27 20:13:51.370316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 339/691] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:51 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:52.391682 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-193cf07b-49c9-4dd5-9d37-918a00cb8457 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:52.392335 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-193cf07b-49c9-4dd5-9d37-918a00cb8457 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:52.395865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=42 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:52.400726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-193cf07b-49c9-4dd5-9d37-918a00cb8457 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:52.401212 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-193cf07b-49c9-4dd5-9d37-918a00cb8457 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:52.402020 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-193cf07b-49c9-4dd5-9d37-918a00cb8457 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:52.402467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-193cf07b-49c9-4dd5-9d37-918a00cb8457 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:52.532609 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-193cf07b-49c9-4dd5-9d37-918a00cb8457 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:52.541361 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-193cf07b-49c9-4dd5-9d37-918a00cb8457 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153575 Jul 27 20:13:52.541922 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 353/692] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:52 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:53.562625 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-721cf61c-91f0-43ff-bbb9-dc6068f596ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:53.563229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-721cf61c-91f0-43ff-bbb9-dc6068f596ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:53.569960 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-721cf61c-91f0-43ff-bbb9-dc6068f596ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:53.570401 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-721cf61c-91f0-43ff-bbb9-dc6068f596ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:53.571153 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-721cf61c-91f0-43ff-bbb9-dc6068f596ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:53.571585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-721cf61c-91f0-43ff-bbb9-dc6068f596ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:53.936636 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-721cf61c-91f0-43ff-bbb9-dc6068f596ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:53.944854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-721cf61c-91f0-43ff-bbb9-dc6068f596ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.386071 Jul 27 20:13:53.945436 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 340/693] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:53 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:54.965857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4e4ac0c4-6a80-4444-9172-498bde2ed9c3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:54.966477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4e4ac0c4-6a80-4444-9172-498bde2ed9c3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:54.973013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4e4ac0c4-6a80-4444-9172-498bde2ed9c3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:54.973476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4e4ac0c4-6a80-4444-9172-498bde2ed9c3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:54.974271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4e4ac0c4-6a80-4444-9172-498bde2ed9c3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:54.975228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4e4ac0c4-6a80-4444-9172-498bde2ed9c3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:55.108718 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4e4ac0c4-6a80-4444-9172-498bde2ed9c3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:55.117527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4e4ac0c4-6a80-4444-9172-498bde2ed9c3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.155503 Jul 27 20:13:55.118096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 354/694] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:54 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:56.138895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e0b0b9e1-dcd2-4328-b437-473729c9c9fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:56.139509 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e0b0b9e1-dcd2-4328-b437-473729c9c9fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:56.146038 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0b0b9e1-dcd2-4328-b437-473729c9c9fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:56.146483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0b0b9e1-dcd2-4328-b437-473729c9c9fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:56.147253 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0b0b9e1-dcd2-4328-b437-473729c9c9fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:56.147692 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0b0b9e1-dcd2-4328-b437-473729c9c9fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:56.286997 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e0b0b9e1-dcd2-4328-b437-473729c9c9fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:56.294974 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e0b0b9e1-dcd2-4328-b437-473729c9c9fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.159966 Jul 27 20:13:56.295707 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 341/695] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:56 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:57.316901 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-948b3c3c-cfd0-4952-84f4-fde2f8f0a3e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:57.317548 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-948b3c3c-cfd0-4952-84f4-fde2f8f0a3e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:57.324160 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-948b3c3c-cfd0-4952-84f4-fde2f8f0a3e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:57.324613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-948b3c3c-cfd0-4952-84f4-fde2f8f0a3e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:57.325404 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-948b3c3c-cfd0-4952-84f4-fde2f8f0a3e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:57.325847 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-948b3c3c-cfd0-4952-84f4-fde2f8f0a3e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:57.455088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-948b3c3c-cfd0-4952-84f4-fde2f8f0a3e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:57.463733 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-948b3c3c-cfd0-4952-84f4-fde2f8f0a3e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150834 Jul 27 20:13:57.464557 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 355/696] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:57 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:58.485674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-42e69e27-456e-4220-a525-dd9469098104 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:58.486290 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-42e69e27-456e-4220-a525-dd9469098104 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:58.493152 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-42e69e27-456e-4220-a525-dd9469098104 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:58.493604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-42e69e27-456e-4220-a525-dd9469098104 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:58.494376 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-42e69e27-456e-4220-a525-dd9469098104 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:58.494817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-42e69e27-456e-4220-a525-dd9469098104 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:58.623652 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-42e69e27-456e-4220-a525-dd9469098104 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:58.632145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-42e69e27-456e-4220-a525-dd9469098104 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150289 Jul 27 20:13:58.632706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 342/697] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:58 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:13:59.653846 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ddb9ae7c-e17d-4ff6-9088-726ec0404b21 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:13:59.654457 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ddb9ae7c-e17d-4ff6-9088-726ec0404b21 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:13:59.662029 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddb9ae7c-e17d-4ff6-9088-726ec0404b21 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:59.662560 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddb9ae7c-e17d-4ff6-9088-726ec0404b21 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:59.663390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddb9ae7c-e17d-4ff6-9088-726ec0404b21 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:13:59.663827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddb9ae7c-e17d-4ff6-9088-726ec0404b21 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:13:59.666471 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:13:59.792715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ddb9ae7c-e17d-4ff6-9088-726ec0404b21 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:13:59.800537 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ddb9ae7c-e17d-4ff6-9088-726ec0404b21 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150507 Jul 27 20:13:59.801128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 356/698] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:13:59 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:00.824003 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d22b0b03-7812-47a4-99f6-46bfec00536c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:00.824645 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d22b0b03-7812-47a4-99f6-46bfec00536c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:00.831163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d22b0b03-7812-47a4-99f6-46bfec00536c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:00.831631 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d22b0b03-7812-47a4-99f6-46bfec00536c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:00.832379 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d22b0b03-7812-47a4-99f6-46bfec00536c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:00.832816 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d22b0b03-7812-47a4-99f6-46bfec00536c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:00.964697 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d22b0b03-7812-47a4-99f6-46bfec00536c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:00.972838 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d22b0b03-7812-47a4-99f6-46bfec00536c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152598 Jul 27 20:14:00.973421 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 343/699] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:00 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:01.995743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-75b1d1d4-4a8c-48cd-9b57-8c6917627f85 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:01.996301 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-75b1d1d4-4a8c-48cd-9b57-8c6917627f85 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:02.002744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-75b1d1d4-4a8c-48cd-9b57-8c6917627f85 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:02.003188 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-75b1d1d4-4a8c-48cd-9b57-8c6917627f85 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:02.003946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-75b1d1d4-4a8c-48cd-9b57-8c6917627f85 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:02.004381 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-75b1d1d4-4a8c-48cd-9b57-8c6917627f85 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:02.133394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-75b1d1d4-4a8c-48cd-9b57-8c6917627f85 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:02.141197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-75b1d1d4-4a8c-48cd-9b57-8c6917627f85 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149458 Jul 27 20:14:02.141757 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 357/700] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:01 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:03.163001 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e5421fe0-38a2-4dea-bc61-39a5548819c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:03.163625 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e5421fe0-38a2-4dea-bc61-39a5548819c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:03.170282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e5421fe0-38a2-4dea-bc61-39a5548819c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:03.170757 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e5421fe0-38a2-4dea-bc61-39a5548819c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:03.171519 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e5421fe0-38a2-4dea-bc61-39a5548819c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:03.171937 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e5421fe0-38a2-4dea-bc61-39a5548819c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:03.298821 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e5421fe0-38a2-4dea-bc61-39a5548819c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:03.307863 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e5421fe0-38a2-4dea-bc61-39a5548819c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149159 Jul 27 20:14:03.308454 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 344/701] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:03 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:04.329041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fff189f6-7c92-4678-9bae-855faa793425 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:04.329619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fff189f6-7c92-4678-9bae-855faa793425 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:04.336318 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fff189f6-7c92-4678-9bae-855faa793425 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:04.336770 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fff189f6-7c92-4678-9bae-855faa793425 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:04.337559 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fff189f6-7c92-4678-9bae-855faa793425 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:04.338001 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fff189f6-7c92-4678-9bae-855faa793425 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:04.468683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fff189f6-7c92-4678-9bae-855faa793425 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:04.477220 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fff189f6-7c92-4678-9bae-855faa793425 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152252 Jul 27 20:14:04.477795 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 358/702] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:04 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:05.498448 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2e65bc06-eb5e-4137-917b-02d4c118cf7b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:05.499059 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2e65bc06-eb5e-4137-917b-02d4c118cf7b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:05.505565 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e65bc06-eb5e-4137-917b-02d4c118cf7b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:05.506032 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e65bc06-eb5e-4137-917b-02d4c118cf7b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:05.506780 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e65bc06-eb5e-4137-917b-02d4c118cf7b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:05.507214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e65bc06-eb5e-4137-917b-02d4c118cf7b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:05.636574 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2e65bc06-eb5e-4137-917b-02d4c118cf7b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:05.644518 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2e65bc06-eb5e-4137-917b-02d4c118cf7b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149951 Jul 27 20:14:05.645104 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 345/703] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:05 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:06.665498 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-baf12f04-49a7-487a-b501-77a3ffcf475c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:06.666105 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-baf12f04-49a7-487a-b501-77a3ffcf475c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:06.672426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-baf12f04-49a7-487a-b501-77a3ffcf475c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:06.672852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-baf12f04-49a7-487a-b501-77a3ffcf475c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:06.673642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-baf12f04-49a7-487a-b501-77a3ffcf475c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:06.674057 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-baf12f04-49a7-487a-b501-77a3ffcf475c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:06.800922 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-baf12f04-49a7-487a-b501-77a3ffcf475c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:06.809474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-baf12f04-49a7-487a-b501-77a3ffcf475c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.147748 Jul 27 20:14:06.810037 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 359/704] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:06 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:07.055523 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-44b598fe-04be-4d0b-8c7c-8f6c57ea24c5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:07.056007 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-44b598fe-04be-4d0b-8c7c-8f6c57ea24c5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:07.062033 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44b598fe-04be-4d0b-8c7c-8f6c57ea24c5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:07.062485 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44b598fe-04be-4d0b-8c7c-8f6c57ea24c5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:07.063240 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44b598fe-04be-4d0b-8c7c-8f6c57ea24c5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:07.063671 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44b598fe-04be-4d0b-8c7c-8f6c57ea24c5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:07.184571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-44b598fe-04be-4d0b-8c7c-8f6c57ea24c5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lazy-loading 'services' on Instance uuid 8779e897-ecd4-43b8-9f87-a8e0c524c94a {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:14:07.296390 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-44b598fe-04be-4d0b-8c7c-8f6c57ea24c5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments/0033c858-7f59-4422-b141-9a69e348d81c" status: 202 len: 0 microversion: 2.1 time: 0.341897 Jul 27 20:14:07.296998 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 346/705] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Jul 27 20:14:06 2022] DELETE /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments/0033c858-7f59-4422-b141-9a69e348d81c => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:14:07.830728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-78a1c165-3c4c-4087-b1d1-fcbad6ed27cf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:07.831346 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-78a1c165-3c4c-4087-b1d1-fcbad6ed27cf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:07.838328 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-78a1c165-3c4c-4087-b1d1-fcbad6ed27cf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:07.838780 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-78a1c165-3c4c-4087-b1d1-fcbad6ed27cf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:07.839541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-78a1c165-3c4c-4087-b1d1-fcbad6ed27cf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:07.839981 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-78a1c165-3c4c-4087-b1d1-fcbad6ed27cf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:07.969871 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-78a1c165-3c4c-4087-b1d1-fcbad6ed27cf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:07.978705 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-78a1c165-3c4c-4087-b1d1-fcbad6ed27cf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151822 Jul 27 20:14:07.979280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 360/706] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:07 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:14:09.001659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-815c16bb-ba61-45c4-825b-23ca26a56e27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:09.002267 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-815c16bb-ba61-45c4-825b-23ca26a56e27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:09.012589 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-815c16bb-ba61-45c4-825b-23ca26a56e27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:09.013072 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-815c16bb-ba61-45c4-825b-23ca26a56e27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:09.013845 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-815c16bb-ba61-45c4-825b-23ca26a56e27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:09.014278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-815c16bb-ba61-45c4-825b-23ca26a56e27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:09.146352 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-815c16bb-ba61-45c4-825b-23ca26a56e27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:09.154255 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-815c16bb-ba61-45c4-825b-23ca26a56e27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.157432 Jul 27 20:14:09.154820 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 347/707] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:08 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:10.176050 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c81a60e3-be5a-4e16-a9c4-c67d0576f6db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:10.176603 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c81a60e3-be5a-4e16-a9c4-c67d0576f6db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:10.183447 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c81a60e3-be5a-4e16-a9c4-c67d0576f6db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:10.183908 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c81a60e3-be5a-4e16-a9c4-c67d0576f6db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:10.184692 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c81a60e3-be5a-4e16-a9c4-c67d0576f6db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:10.185186 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c81a60e3-be5a-4e16-a9c4-c67d0576f6db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:10.313661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c81a60e3-be5a-4e16-a9c4-c67d0576f6db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:10.322534 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c81a60e3-be5a-4e16-a9c4-c67d0576f6db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150418 Jul 27 20:14:10.323099 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 361/708] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:10 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:11.343581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6d03ebdb-d287-4583-927e-a8159bf428c6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:11.344211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6d03ebdb-d287-4583-927e-a8159bf428c6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:11.351371 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6d03ebdb-d287-4583-927e-a8159bf428c6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:11.351823 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6d03ebdb-d287-4583-927e-a8159bf428c6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:11.352584 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6d03ebdb-d287-4583-927e-a8159bf428c6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:11.353053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6d03ebdb-d287-4583-927e-a8159bf428c6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:11.483036 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6d03ebdb-d287-4583-927e-a8159bf428c6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:11.491234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6d03ebdb-d287-4583-927e-a8159bf428c6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151585 Jul 27 20:14:11.491806 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 348/709] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:11 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:12.512550 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fe14ff4e-d082-4113-9f6e-9aac186502c4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:12.513198 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fe14ff4e-d082-4113-9f6e-9aac186502c4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:12.519687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fe14ff4e-d082-4113-9f6e-9aac186502c4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:12.520140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fe14ff4e-d082-4113-9f6e-9aac186502c4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:12.520951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fe14ff4e-d082-4113-9f6e-9aac186502c4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:12.521607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fe14ff4e-d082-4113-9f6e-9aac186502c4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:12.650075 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fe14ff4e-d082-4113-9f6e-9aac186502c4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:12.657936 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fe14ff4e-d082-4113-9f6e-9aac186502c4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149277 Jul 27 20:14:12.658503 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 362/710] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:12 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:13.679507 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-37c3c216-250c-48eb-b2eb-f6a9a549d414 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:13.680115 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-37c3c216-250c-48eb-b2eb-f6a9a549d414 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:13.686594 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37c3c216-250c-48eb-b2eb-f6a9a549d414 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:13.686934 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37c3c216-250c-48eb-b2eb-f6a9a549d414 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:13.687698 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37c3c216-250c-48eb-b2eb-f6a9a549d414 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:13.688131 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37c3c216-250c-48eb-b2eb-f6a9a549d414 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:13.821867 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-37c3c216-250c-48eb-b2eb-f6a9a549d414 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:13.829731 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-37c3c216-250c-48eb-b2eb-f6a9a549d414 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.154326 Jul 27 20:14:13.830289 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 349/711] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:13 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:14.851344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b0cfefc2-2874-4ec1-8177-0dbb64ef6269 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:14.851957 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b0cfefc2-2874-4ec1-8177-0dbb64ef6269 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:14.858489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b0cfefc2-2874-4ec1-8177-0dbb64ef6269 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:14.858942 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b0cfefc2-2874-4ec1-8177-0dbb64ef6269 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:14.859707 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b0cfefc2-2874-4ec1-8177-0dbb64ef6269 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:14.860151 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b0cfefc2-2874-4ec1-8177-0dbb64ef6269 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:14.993227 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b0cfefc2-2874-4ec1-8177-0dbb64ef6269 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:15.001185 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b0cfefc2-2874-4ec1-8177-0dbb64ef6269 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.154204 Jul 27 20:14:15.001760 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 363/712] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:14 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:16.021966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3d65a2b0-3f76-4e6f-8240-2aa527a67e75 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:16.022555 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3d65a2b0-3f76-4e6f-8240-2aa527a67e75 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:16.024882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=28 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:16.030386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d65a2b0-3f76-4e6f-8240-2aa527a67e75 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:16.030832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d65a2b0-3f76-4e6f-8240-2aa527a67e75 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:16.031586 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d65a2b0-3f76-4e6f-8240-2aa527a67e75 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:16.032016 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d65a2b0-3f76-4e6f-8240-2aa527a67e75 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:16.159266 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3d65a2b0-3f76-4e6f-8240-2aa527a67e75 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:16.167569 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3d65a2b0-3f76-4e6f-8240-2aa527a67e75 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149517 Jul 27 20:14:16.168135 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 350/713] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:16 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:17.189196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f3a8a552-9d61-4596-84e7-60998a9130c4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:17.189846 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f3a8a552-9d61-4596-84e7-60998a9130c4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:17.197293 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f3a8a552-9d61-4596-84e7-60998a9130c4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:17.197750 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f3a8a552-9d61-4596-84e7-60998a9130c4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:17.198532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f3a8a552-9d61-4596-84e7-60998a9130c4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:17.198969 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f3a8a552-9d61-4596-84e7-60998a9130c4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:17.329609 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f3a8a552-9d61-4596-84e7-60998a9130c4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:17.337526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f3a8a552-9d61-4596-84e7-60998a9130c4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152128 Jul 27 20:14:17.338101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 364/714] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:17 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:18.359226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-174f5f4d-26ea-4410-9bef-d2cb0c978804 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:18.359836 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-174f5f4d-26ea-4410-9bef-d2cb0c978804 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:18.366320 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-174f5f4d-26ea-4410-9bef-d2cb0c978804 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:18.366770 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-174f5f4d-26ea-4410-9bef-d2cb0c978804 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:18.367590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-174f5f4d-26ea-4410-9bef-d2cb0c978804 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:18.368025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-174f5f4d-26ea-4410-9bef-d2cb0c978804 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:18.495510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-174f5f4d-26ea-4410-9bef-d2cb0c978804 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:18.503394 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-174f5f4d-26ea-4410-9bef-d2cb0c978804 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.147963 Jul 27 20:14:18.503960 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 351/715] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:18 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:19.525293 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-447b220e-0638-41ff-b928-eddcd5efc282 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:19.525859 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-447b220e-0638-41ff-b928-eddcd5efc282 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:19.532397 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-447b220e-0638-41ff-b928-eddcd5efc282 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:19.532859 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-447b220e-0638-41ff-b928-eddcd5efc282 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:19.533661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-447b220e-0638-41ff-b928-eddcd5efc282 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:19.534105 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-447b220e-0638-41ff-b928-eddcd5efc282 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:19.667722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-447b220e-0638-41ff-b928-eddcd5efc282 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:19.675703 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-447b220e-0638-41ff-b928-eddcd5efc282 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.154633 Jul 27 20:14:19.676271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 365/716] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:19 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:20.698391 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-22e335d7-f765-4cbc-a693-a728d42204b5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:20.699000 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-22e335d7-f765-4cbc-a693-a728d42204b5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:20.705551 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-22e335d7-f765-4cbc-a693-a728d42204b5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:20.705998 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-22e335d7-f765-4cbc-a693-a728d42204b5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:20.706758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-22e335d7-f765-4cbc-a693-a728d42204b5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:20.707193 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-22e335d7-f765-4cbc-a693-a728d42204b5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:20.846892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-22e335d7-f765-4cbc-a693-a728d42204b5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:20.854801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-22e335d7-f765-4cbc-a693-a728d42204b5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.160264 Jul 27 20:14:20.855367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 352/717] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:20 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:21.875567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-43ebee15-0a72-4401-be24-4f5256994c8b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:21.876180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-43ebee15-0a72-4401-be24-4f5256994c8b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:21.882787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-43ebee15-0a72-4401-be24-4f5256994c8b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:21.883232 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-43ebee15-0a72-4401-be24-4f5256994c8b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:21.883985 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-43ebee15-0a72-4401-be24-4f5256994c8b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:21.884418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-43ebee15-0a72-4401-be24-4f5256994c8b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:22.009474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-43ebee15-0a72-4401-be24-4f5256994c8b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:22.017251 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-43ebee15-0a72-4401-be24-4f5256994c8b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.145478 Jul 27 20:14:22.017812 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 366/718] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:21 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:23.038142 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2983d99f-a79a-42d9-9ac0-a0e606e0f939 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:23.038747 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2983d99f-a79a-42d9-9ac0-a0e606e0f939 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:23.045223 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2983d99f-a79a-42d9-9ac0-a0e606e0f939 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:23.045662 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2983d99f-a79a-42d9-9ac0-a0e606e0f939 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:23.046421 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2983d99f-a79a-42d9-9ac0-a0e606e0f939 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:23.046850 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2983d99f-a79a-42d9-9ac0-a0e606e0f939 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:23.049357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:23.181862 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2983d99f-a79a-42d9-9ac0-a0e606e0f939 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:23.189895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2983d99f-a79a-42d9-9ac0-a0e606e0f939 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.156287 Jul 27 20:14:23.190470 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 353/719] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:23 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:24.213040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f7bba0f0-6b5a-4c54-8627-2b616e9cc588 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:24.213756 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f7bba0f0-6b5a-4c54-8627-2b616e9cc588 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:24.215996 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=28 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:24.221544 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f7bba0f0-6b5a-4c54-8627-2b616e9cc588 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:24.221998 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f7bba0f0-6b5a-4c54-8627-2b616e9cc588 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:24.222761 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f7bba0f0-6b5a-4c54-8627-2b616e9cc588 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:24.223196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f7bba0f0-6b5a-4c54-8627-2b616e9cc588 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:24.354891 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f7bba0f0-6b5a-4c54-8627-2b616e9cc588 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:24.362831 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f7bba0f0-6b5a-4c54-8627-2b616e9cc588 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.155313 Jul 27 20:14:24.363393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 367/720] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:24 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:25.383615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9d7b8ab7-22a8-4cdf-8861-50ff910b6ce8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:25.384219 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9d7b8ab7-22a8-4cdf-8861-50ff910b6ce8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:25.390646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9d7b8ab7-22a8-4cdf-8861-50ff910b6ce8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:25.391092 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9d7b8ab7-22a8-4cdf-8861-50ff910b6ce8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:25.391849 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9d7b8ab7-22a8-4cdf-8861-50ff910b6ce8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:25.392325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9d7b8ab7-22a8-4cdf-8861-50ff910b6ce8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:25.523684 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9d7b8ab7-22a8-4cdf-8861-50ff910b6ce8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:25.531441 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9d7b8ab7-22a8-4cdf-8861-50ff910b6ce8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151590 Jul 27 20:14:25.532010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 354/721] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:25 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:26.553947 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5da6dadf-f697-4ac7-999c-bd949048bc73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:26.554474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5da6dadf-f697-4ac7-999c-bd949048bc73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:26.561011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5da6dadf-f697-4ac7-999c-bd949048bc73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:26.561467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5da6dadf-f697-4ac7-999c-bd949048bc73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:26.562231 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5da6dadf-f697-4ac7-999c-bd949048bc73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:26.562701 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5da6dadf-f697-4ac7-999c-bd949048bc73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:26.693992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5da6dadf-f697-4ac7-999c-bd949048bc73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:26.701814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5da6dadf-f697-4ac7-999c-bd949048bc73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152276 Jul 27 20:14:26.702373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 368/722] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:26 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:27.723651 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-16402d6c-bea1-496d-845d-4f0e2ebbc7f5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:27.724403 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-16402d6c-bea1-496d-845d-4f0e2ebbc7f5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:27.730675 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16402d6c-bea1-496d-845d-4f0e2ebbc7f5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:27.731121 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16402d6c-bea1-496d-845d-4f0e2ebbc7f5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:27.731869 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16402d6c-bea1-496d-845d-4f0e2ebbc7f5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:27.732299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16402d6c-bea1-496d-845d-4f0e2ebbc7f5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:27.859407 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-16402d6c-bea1-496d-845d-4f0e2ebbc7f5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:27.867995 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-16402d6c-bea1-496d-845d-4f0e2ebbc7f5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148238 Jul 27 20:14:27.868561 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 355/723] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:27 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:28.888970 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cc1c3d28-3d5f-47aa-a4c5-91fee911313d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:28.889605 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cc1c3d28-3d5f-47aa-a4c5-91fee911313d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:28.897081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc1c3d28-3d5f-47aa-a4c5-91fee911313d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:28.897529 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc1c3d28-3d5f-47aa-a4c5-91fee911313d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:28.898287 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc1c3d28-3d5f-47aa-a4c5-91fee911313d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:28.898722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc1c3d28-3d5f-47aa-a4c5-91fee911313d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:29.027354 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cc1c3d28-3d5f-47aa-a4c5-91fee911313d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:29.035221 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cc1c3d28-3d5f-47aa-a4c5-91fee911313d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150097 Jul 27 20:14:29.035791 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 369/724] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:28 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:30.057653 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-75cb7138-e7d2-4e3a-a819-67912c54f183 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:30.058259 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-75cb7138-e7d2-4e3a-a819-67912c54f183 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:30.064864 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-75cb7138-e7d2-4e3a-a819-67912c54f183 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:30.065351 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-75cb7138-e7d2-4e3a-a819-67912c54f183 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:30.066108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-75cb7138-e7d2-4e3a-a819-67912c54f183 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:30.066806 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-75cb7138-e7d2-4e3a-a819-67912c54f183 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:30.199120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-75cb7138-e7d2-4e3a-a819-67912c54f183 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:30.206992 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-75cb7138-e7d2-4e3a-a819-67912c54f183 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153444 Jul 27 20:14:30.207569 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 356/725] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:30 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:31.227827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-52b442d6-ea2d-4d52-9c25-ec1e4f0df688 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:31.228361 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-52b442d6-ea2d-4d52-9c25-ec1e4f0df688 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:31.235110 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-52b442d6-ea2d-4d52-9c25-ec1e4f0df688 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:31.235570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-52b442d6-ea2d-4d52-9c25-ec1e4f0df688 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:31.236342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-52b442d6-ea2d-4d52-9c25-ec1e4f0df688 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:31.236789 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-52b442d6-ea2d-4d52-9c25-ec1e4f0df688 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:31.239823 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=84 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:31.369526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-52b442d6-ea2d-4d52-9c25-ec1e4f0df688 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:31.377576 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-52b442d6-ea2d-4d52-9c25-ec1e4f0df688 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153874 Jul 27 20:14:31.378145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 370/726] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:31 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:32.399211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b1eb5ef3-dd82-48f3-adee-ce1c1b8f90c3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:32.400584 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b1eb5ef3-dd82-48f3-adee-ce1c1b8f90c3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:32.407055 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1eb5ef3-dd82-48f3-adee-ce1c1b8f90c3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:32.407497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1eb5ef3-dd82-48f3-adee-ce1c1b8f90c3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:32.408252 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1eb5ef3-dd82-48f3-adee-ce1c1b8f90c3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:32.408680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1eb5ef3-dd82-48f3-adee-ce1c1b8f90c3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:32.535618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b1eb5ef3-dd82-48f3-adee-ce1c1b8f90c3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:32.544107 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b1eb5ef3-dd82-48f3-adee-ce1c1b8f90c3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148768 Jul 27 20:14:32.544675 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 357/727] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:32 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:33.566447 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6520167d-1862-4e2a-95dd-508854e7f18d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:33.567746 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6520167d-1862-4e2a-95dd-508854e7f18d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:33.574319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6520167d-1862-4e2a-95dd-508854e7f18d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:33.574628 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6520167d-1862-4e2a-95dd-508854e7f18d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:33.575391 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6520167d-1862-4e2a-95dd-508854e7f18d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:33.575829 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6520167d-1862-4e2a-95dd-508854e7f18d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:33.707658 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6520167d-1862-4e2a-95dd-508854e7f18d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:33.715719 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6520167d-1862-4e2a-95dd-508854e7f18d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153448 Jul 27 20:14:33.716296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 371/728] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:33 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:34.737555 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-74f14068-cf90-40c8-b576-8e642f9cc888 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:34.738138 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-74f14068-cf90-40c8-b576-8e642f9cc888 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:34.745151 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74f14068-cf90-40c8-b576-8e642f9cc888 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:34.745594 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74f14068-cf90-40c8-b576-8e642f9cc888 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:34.746380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74f14068-cf90-40c8-b576-8e642f9cc888 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:34.746807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74f14068-cf90-40c8-b576-8e642f9cc888 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:34.881579 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-74f14068-cf90-40c8-b576-8e642f9cc888 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:34.889682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-74f14068-cf90-40c8-b576-8e642f9cc888 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.156620 Jul 27 20:14:34.890372 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 358/729] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:34 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:35.914013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-26c30ea3-0d68-4d83-8172-582013bb4adf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:35.915031 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-26c30ea3-0d68-4d83-8172-582013bb4adf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:35.923057 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-26c30ea3-0d68-4d83-8172-582013bb4adf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:35.923515 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-26c30ea3-0d68-4d83-8172-582013bb4adf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:35.924389 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-26c30ea3-0d68-4d83-8172-582013bb4adf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:35.924840 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-26c30ea3-0d68-4d83-8172-582013bb4adf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:36.078226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-26c30ea3-0d68-4d83-8172-582013bb4adf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:36.087006 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-26c30ea3-0d68-4d83-8172-582013bb4adf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.179136 Jul 27 20:14:36.087594 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 372/730] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:35 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:37.109196 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-883c53e9-c6e4-4183-9bd9-b6e370e300a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:37.109801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-883c53e9-c6e4-4183-9bd9-b6e370e300a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:37.116821 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-883c53e9-c6e4-4183-9bd9-b6e370e300a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:37.117293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-883c53e9-c6e4-4183-9bd9-b6e370e300a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:37.118043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-883c53e9-c6e4-4183-9bd9-b6e370e300a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:37.118468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-883c53e9-c6e4-4183-9bd9-b6e370e300a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:37.249609 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-883c53e9-c6e4-4183-9bd9-b6e370e300a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:37.257744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-883c53e9-c6e4-4183-9bd9-b6e370e300a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152392 Jul 27 20:14:37.258312 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 359/731] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:37 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:38.279774 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-54591a33-aac6-4020-aed8-0ba342567656 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:38.280293 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-54591a33-aac6-4020-aed8-0ba342567656 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:38.287416 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-54591a33-aac6-4020-aed8-0ba342567656 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:38.287860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-54591a33-aac6-4020-aed8-0ba342567656 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:38.288615 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-54591a33-aac6-4020-aed8-0ba342567656 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:38.289080 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-54591a33-aac6-4020-aed8-0ba342567656 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:38.414314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-54591a33-aac6-4020-aed8-0ba342567656 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:38.422151 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-54591a33-aac6-4020-aed8-0ba342567656 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.146329 Jul 27 20:14:38.422712 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 373/732] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:38 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:39.443950 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a144cc5b-face-45a4-a9ed-895699ad771a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:39.444561 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a144cc5b-face-45a4-a9ed-895699ad771a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:39.451062 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a144cc5b-face-45a4-a9ed-895699ad771a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:39.451514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a144cc5b-face-45a4-a9ed-895699ad771a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:39.452280 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a144cc5b-face-45a4-a9ed-895699ad771a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:39.452718 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a144cc5b-face-45a4-a9ed-895699ad771a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:39.578135 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a144cc5b-face-45a4-a9ed-895699ad771a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:39.586567 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a144cc5b-face-45a4-a9ed-895699ad771a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.146858 Jul 27 20:14:39.587134 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 360/733] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:39 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:40.608025 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-416f93f6-b6c8-493d-8b52-3dd07002ea07 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:40.608632 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-416f93f6-b6c8-493d-8b52-3dd07002ea07 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:40.615126 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-416f93f6-b6c8-493d-8b52-3dd07002ea07 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:40.616086 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-416f93f6-b6c8-493d-8b52-3dd07002ea07 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:40.616841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-416f93f6-b6c8-493d-8b52-3dd07002ea07 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:40.617305 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-416f93f6-b6c8-493d-8b52-3dd07002ea07 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:40.742413 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-416f93f6-b6c8-493d-8b52-3dd07002ea07 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:40.750357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-416f93f6-b6c8-493d-8b52-3dd07002ea07 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.146153 Jul 27 20:14:40.750912 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 374/734] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:40 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:41.771511 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cbf519d5-e018-4125-acd0-531ff859efd9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:41.772266 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cbf519d5-e018-4125-acd0-531ff859efd9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:41.779088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cbf519d5-e018-4125-acd0-531ff859efd9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:41.779545 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cbf519d5-e018-4125-acd0-531ff859efd9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:41.780315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cbf519d5-e018-4125-acd0-531ff859efd9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:41.780784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cbf519d5-e018-4125-acd0-531ff859efd9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:41.915991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cbf519d5-e018-4125-acd0-531ff859efd9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:41.923863 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cbf519d5-e018-4125-acd0-531ff859efd9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.156266 Jul 27 20:14:41.924436 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 361/735] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:41 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:42.945804 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-581d1857-987a-48a3-8606-1eef59aec253 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:42.946422 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-581d1857-987a-48a3-8606-1eef59aec253 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:42.953099 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-581d1857-987a-48a3-8606-1eef59aec253 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:42.953558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-581d1857-987a-48a3-8606-1eef59aec253 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:42.954320 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-581d1857-987a-48a3-8606-1eef59aec253 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:42.954769 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-581d1857-987a-48a3-8606-1eef59aec253 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:43.085247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-581d1857-987a-48a3-8606-1eef59aec253 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:43.093146 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-581d1857-987a-48a3-8606-1eef59aec253 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151270 Jul 27 20:14:43.093704 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 375/736] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:42 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:44.115707 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8881a6ef-7221-4e79-a828-a821f65bbae7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:44.116400 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8881a6ef-7221-4e79-a828-a821f65bbae7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:44.123495 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8881a6ef-7221-4e79-a828-a821f65bbae7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:44.123947 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8881a6ef-7221-4e79-a828-a821f65bbae7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:44.124717 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8881a6ef-7221-4e79-a828-a821f65bbae7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:44.125181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8881a6ef-7221-4e79-a828-a821f65bbae7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:44.252893 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8881a6ef-7221-4e79-a828-a821f65bbae7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:44.260811 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8881a6ef-7221-4e79-a828-a821f65bbae7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149381 Jul 27 20:14:44.261577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 362/737] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:44 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:45.282641 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d7244fd1-d4ca-4bff-8877-7fe1efdf1883 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:45.283258 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d7244fd1-d4ca-4bff-8877-7fe1efdf1883 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:45.290071 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d7244fd1-d4ca-4bff-8877-7fe1efdf1883 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:45.290525 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d7244fd1-d4ca-4bff-8877-7fe1efdf1883 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:45.291299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d7244fd1-d4ca-4bff-8877-7fe1efdf1883 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:45.291746 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d7244fd1-d4ca-4bff-8877-7fe1efdf1883 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:45.427059 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d7244fd1-d4ca-4bff-8877-7fe1efdf1883 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:45.435579 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d7244fd1-d4ca-4bff-8877-7fe1efdf1883 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.156789 Jul 27 20:14:45.436140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 376/738] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:45 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:46.459963 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-96691437-1a36-4266-a625-ce3b3ea6d603 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:46.460562 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-96691437-1a36-4266-a625-ce3b3ea6d603 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:46.462826 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=26 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:46.468458 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96691437-1a36-4266-a625-ce3b3ea6d603 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:46.468903 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96691437-1a36-4266-a625-ce3b3ea6d603 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:46.469751 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96691437-1a36-4266-a625-ce3b3ea6d603 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:46.470212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96691437-1a36-4266-a625-ce3b3ea6d603 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:46.598702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-96691437-1a36-4266-a625-ce3b3ea6d603 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:46.606625 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-96691437-1a36-4266-a625-ce3b3ea6d603 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151272 Jul 27 20:14:46.607189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 363/739] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:46 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:47.627648 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d8b58114-175e-4fb6-8a01-2dfdfcc901fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:47.628266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d8b58114-175e-4fb6-8a01-2dfdfcc901fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:47.635286 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d8b58114-175e-4fb6-8a01-2dfdfcc901fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:47.635741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d8b58114-175e-4fb6-8a01-2dfdfcc901fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:47.636511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d8b58114-175e-4fb6-8a01-2dfdfcc901fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:47.636955 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d8b58114-175e-4fb6-8a01-2dfdfcc901fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:47.772618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-df7cbdab-2d5b-4d59-b6b7-8e7d1b9a902a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:14:47.773229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-df7cbdab-2d5b-4d59-b6b7-8e7d1b9a902a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:47.775009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d8b58114-175e-4fb6-8a01-2dfdfcc901fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:47.779675 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-df7cbdab-2d5b-4d59-b6b7-8e7d1b9a902a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:47.780147 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-df7cbdab-2d5b-4d59-b6b7-8e7d1b9a902a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:47.780908 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-df7cbdab-2d5b-4d59-b6b7-8e7d1b9a902a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:47.781415 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-df7cbdab-2d5b-4d59-b6b7-8e7d1b9a902a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:47.785508 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d8b58114-175e-4fb6-8a01-2dfdfcc901fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.161186 Jul 27 20:14:47.786370 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 377/740] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:47 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:47.807875 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-df7cbdab-2d5b-4d59-b6b7-8e7d1b9a902a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lazy-loading 'flavor' on Instance uuid c560ad96-cd64-4d84-86c8-c315f0fa0ab7 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:14:47.879620 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-df7cbdab-2d5b-4d59-b6b7-8e7d1b9a902a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "POST /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7/action" status: 202 len: 0 microversion: 2.1 time: 0.111392 Jul 27 20:14:47.880199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 364/741] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Jul 27 20:14:47 2022] POST /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:14:47.888750 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3e83f81b-8c67-4199-8621-233122dbf86f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:47.889393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3e83f81b-8c67-4199-8621-233122dbf86f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:47.895814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3e83f81b-8c67-4199-8621-233122dbf86f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:47.896859 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3e83f81b-8c67-4199-8621-233122dbf86f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:47.897750 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3e83f81b-8c67-4199-8621-233122dbf86f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:47.898192 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3e83f81b-8c67-4199-8621-233122dbf86f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:48.025389 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3e83f81b-8c67-4199-8621-233122dbf86f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:48.032883 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3e83f81b-8c67-4199-8621-233122dbf86f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.147845 Jul 27 20:14:48.033485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 378/742] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:47 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:48.812412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-05c8d46b-727d-45d5-822a-e688520883a9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:48.813117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-05c8d46b-727d-45d5-822a-e688520883a9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:48.820451 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05c8d46b-727d-45d5-822a-e688520883a9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:48.820898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05c8d46b-727d-45d5-822a-e688520883a9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:48.821686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05c8d46b-727d-45d5-822a-e688520883a9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:48.822122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05c8d46b-727d-45d5-822a-e688520883a9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:48.954007 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-05c8d46b-727d-45d5-822a-e688520883a9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:48.962072 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-05c8d46b-727d-45d5-822a-e688520883a9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.154474 Jul 27 20:14:48.962662 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 365/743] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:48 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:49.056012 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8175f70b-67a5-4605-bc19-b7c11148bab0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:49.056615 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8175f70b-67a5-4605-bc19-b7c11148bab0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:49.063142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8175f70b-67a5-4605-bc19-b7c11148bab0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:49.063560 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8175f70b-67a5-4605-bc19-b7c11148bab0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:49.064320 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8175f70b-67a5-4605-bc19-b7c11148bab0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:49.064758 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8175f70b-67a5-4605-bc19-b7c11148bab0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:49.197152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8175f70b-67a5-4605-bc19-b7c11148bab0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:49.204616 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8175f70b-67a5-4605-bc19-b7c11148bab0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.153157 Jul 27 20:14:49.205209 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 379/744] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:49 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:49.983463 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bcf6010d-2320-4db1-a5e8-13da3ac3ea22 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:49.984074 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bcf6010d-2320-4db1-a5e8-13da3ac3ea22 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:49.991163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bcf6010d-2320-4db1-a5e8-13da3ac3ea22 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:49.991646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bcf6010d-2320-4db1-a5e8-13da3ac3ea22 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:49.992406 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bcf6010d-2320-4db1-a5e8-13da3ac3ea22 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:49.992837 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bcf6010d-2320-4db1-a5e8-13da3ac3ea22 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:50.126431 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bcf6010d-2320-4db1-a5e8-13da3ac3ea22 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:50.134358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bcf6010d-2320-4db1-a5e8-13da3ac3ea22 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.154677 Jul 27 20:14:50.134917 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 366/745] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:49 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:50.227585 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-89e3bd08-6ad0-49cb-9c98-6609f93daf50 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:50.228204 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-89e3bd08-6ad0-49cb-9c98-6609f93daf50 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:50.234677 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-89e3bd08-6ad0-49cb-9c98-6609f93daf50 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:50.235134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-89e3bd08-6ad0-49cb-9c98-6609f93daf50 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:50.235902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-89e3bd08-6ad0-49cb-9c98-6609f93daf50 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:50.236358 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-89e3bd08-6ad0-49cb-9c98-6609f93daf50 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:50.364533 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-89e3bd08-6ad0-49cb-9c98-6609f93daf50 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:50.372184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-89e3bd08-6ad0-49cb-9c98-6609f93daf50 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.149185 Jul 27 20:14:50.372755 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 380/746] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:50 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:51.156280 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9aa3d85b-a6f8-4170-a1b2-71623a3c8e20 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:51.156891 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9aa3d85b-a6f8-4170-a1b2-71623a3c8e20 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:51.164072 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9aa3d85b-a6f8-4170-a1b2-71623a3c8e20 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:51.164519 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9aa3d85b-a6f8-4170-a1b2-71623a3c8e20 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:51.165312 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9aa3d85b-a6f8-4170-a1b2-71623a3c8e20 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:51.165750 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9aa3d85b-a6f8-4170-a1b2-71623a3c8e20 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:51.297975 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9aa3d85b-a6f8-4170-a1b2-71623a3c8e20 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:51.300208 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:51.307605 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9aa3d85b-a6f8-4170-a1b2-71623a3c8e20 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.155257 Jul 27 20:14:51.308167 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 367/747] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:51 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:51.393926 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6463bf9d-818d-4496-ae7c-1e2788c53945 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:51.394569 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6463bf9d-818d-4496-ae7c-1e2788c53945 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:51.401678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6463bf9d-818d-4496-ae7c-1e2788c53945 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:51.402136 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6463bf9d-818d-4496-ae7c-1e2788c53945 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:51.402904 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6463bf9d-818d-4496-ae7c-1e2788c53945 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:51.403354 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6463bf9d-818d-4496-ae7c-1e2788c53945 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:51.531877 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6463bf9d-818d-4496-ae7c-1e2788c53945 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:51.539412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6463bf9d-818d-4496-ae7c-1e2788c53945 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.149271 Jul 27 20:14:51.539982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 381/748] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:51 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:52.329530 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1efdb560-4341-4d08-902b-8cef36f45eeb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:52.330145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1efdb560-4341-4d08-902b-8cef36f45eeb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:52.338928 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1efdb560-4341-4d08-902b-8cef36f45eeb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:52.339380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1efdb560-4341-4d08-902b-8cef36f45eeb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:52.340146 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1efdb560-4341-4d08-902b-8cef36f45eeb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:52.340584 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1efdb560-4341-4d08-902b-8cef36f45eeb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:52.468450 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1efdb560-4341-4d08-902b-8cef36f45eeb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:52.476463 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1efdb560-4341-4d08-902b-8cef36f45eeb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150845 Jul 27 20:14:52.477035 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 368/749] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:52 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:52.560630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d50fa1fa-1ccb-48ff-bb0f-37894b6171b3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:52.561267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d50fa1fa-1ccb-48ff-bb0f-37894b6171b3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:52.568573 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d50fa1fa-1ccb-48ff-bb0f-37894b6171b3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:52.569041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d50fa1fa-1ccb-48ff-bb0f-37894b6171b3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:52.569797 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d50fa1fa-1ccb-48ff-bb0f-37894b6171b3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:52.570241 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d50fa1fa-1ccb-48ff-bb0f-37894b6171b3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:52.701577 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d50fa1fa-1ccb-48ff-bb0f-37894b6171b3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:52.708978 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d50fa1fa-1ccb-48ff-bb0f-37894b6171b3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.152150 Jul 27 20:14:52.709539 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 382/750] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:52 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:53.498009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7b9b44b6-fbec-4330-ab28-bf2fb4808506 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:53.498612 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7b9b44b6-fbec-4330-ab28-bf2fb4808506 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:53.504995 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b9b44b6-fbec-4330-ab28-bf2fb4808506 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:53.506067 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b9b44b6-fbec-4330-ab28-bf2fb4808506 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:53.506818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b9b44b6-fbec-4330-ab28-bf2fb4808506 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:53.507248 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b9b44b6-fbec-4330-ab28-bf2fb4808506 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:53.637669 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7b9b44b6-fbec-4330-ab28-bf2fb4808506 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:53.645825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7b9b44b6-fbec-4330-ab28-bf2fb4808506 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151671 Jul 27 20:14:53.646688 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 369/751] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:53 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:53.730130 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-aea4c9bf-bccc-4ac0-a244-b6c38dbc5054 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:53.730737 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-aea4c9bf-bccc-4ac0-a244-b6c38dbc5054 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:53.737286 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aea4c9bf-bccc-4ac0-a244-b6c38dbc5054 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:53.737730 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aea4c9bf-bccc-4ac0-a244-b6c38dbc5054 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:53.738486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aea4c9bf-bccc-4ac0-a244-b6c38dbc5054 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:53.738917 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aea4c9bf-bccc-4ac0-a244-b6c38dbc5054 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:53.870102 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-aea4c9bf-bccc-4ac0-a244-b6c38dbc5054 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:53.877638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-aea4c9bf-bccc-4ac0-a244-b6c38dbc5054 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.151311 Jul 27 20:14:53.878215 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 383/752] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:53 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:54.667424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e8a4b650-57e4-499a-9ba1-587bb946c97c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:54.668017 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e8a4b650-57e4-499a-9ba1-587bb946c97c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:54.674436 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e8a4b650-57e4-499a-9ba1-587bb946c97c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:54.674892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e8a4b650-57e4-499a-9ba1-587bb946c97c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:54.675651 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e8a4b650-57e4-499a-9ba1-587bb946c97c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:54.676085 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e8a4b650-57e4-499a-9ba1-587bb946c97c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:54.807183 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e8a4b650-57e4-499a-9ba1-587bb946c97c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:54.814926 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e8a4b650-57e4-499a-9ba1-587bb946c97c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151348 Jul 27 20:14:54.815514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 370/753] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:54 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:54.898773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d1b99ce5-fffe-49e6-998b-9d640dc2c821 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:54.899385 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d1b99ce5-fffe-49e6-998b-9d640dc2c821 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:54.901647 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=34 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:54.906859 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d1b99ce5-fffe-49e6-998b-9d640dc2c821 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:54.907302 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d1b99ce5-fffe-49e6-998b-9d640dc2c821 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:54.908059 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d1b99ce5-fffe-49e6-998b-9d640dc2c821 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:54.908492 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d1b99ce5-fffe-49e6-998b-9d640dc2c821 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:55.042479 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d1b99ce5-fffe-49e6-998b-9d640dc2c821 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:55.050021 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d1b99ce5-fffe-49e6-998b-9d640dc2c821 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.155284 Jul 27 20:14:55.050592 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 384/754] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:54 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:55.838710 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2a1f1e3d-2a10-4058-adda-91c3020b5148 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:55.839323 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2a1f1e3d-2a10-4058-adda-91c3020b5148 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:55.845785 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a1f1e3d-2a10-4058-adda-91c3020b5148 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:55.846233 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a1f1e3d-2a10-4058-adda-91c3020b5148 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:55.846996 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a1f1e3d-2a10-4058-adda-91c3020b5148 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:55.847431 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a1f1e3d-2a10-4058-adda-91c3020b5148 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:55.985410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2a1f1e3d-2a10-4058-adda-91c3020b5148 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:55.994256 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2a1f1e3d-2a10-4058-adda-91c3020b5148 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.159794 Jul 27 20:14:55.994825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 371/755] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:55 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:56.072423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-129a8850-7afe-4146-9395-4b885cbc34aa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:56.073069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-129a8850-7afe-4146-9395-4b885cbc34aa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:56.079632 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-129a8850-7afe-4146-9395-4b885cbc34aa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:56.080085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-129a8850-7afe-4146-9395-4b885cbc34aa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:56.080855 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-129a8850-7afe-4146-9395-4b885cbc34aa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:56.081335 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-129a8850-7afe-4146-9395-4b885cbc34aa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:56.212993 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-129a8850-7afe-4146-9395-4b885cbc34aa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:56.220402 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-129a8850-7afe-4146-9395-4b885cbc34aa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.152657 Jul 27 20:14:56.220972 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 385/756] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:56 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:57.015476 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-acdeebea-1a69-491b-9cff-d43bde28ce20 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:57.016085 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-acdeebea-1a69-491b-9cff-d43bde28ce20 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:57.022917 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-acdeebea-1a69-491b-9cff-d43bde28ce20 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:57.023362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-acdeebea-1a69-491b-9cff-d43bde28ce20 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:57.024120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-acdeebea-1a69-491b-9cff-d43bde28ce20 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:57.024567 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-acdeebea-1a69-491b-9cff-d43bde28ce20 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:57.159336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-acdeebea-1a69-491b-9cff-d43bde28ce20 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:57.167940 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-acdeebea-1a69-491b-9cff-d43bde28ce20 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.156215 Jul 27 20:14:57.168502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 372/757] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:57 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:57.242072 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8f9dcfde-8343-4286-bdd7-b69631c98e65 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:57.242688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8f9dcfde-8343-4286-bdd7-b69631c98e65 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:57.249078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8f9dcfde-8343-4286-bdd7-b69631c98e65 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:57.249535 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8f9dcfde-8343-4286-bdd7-b69631c98e65 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:57.250296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8f9dcfde-8343-4286-bdd7-b69631c98e65 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:57.250737 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8f9dcfde-8343-4286-bdd7-b69631c98e65 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:57.377855 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8f9dcfde-8343-4286-bdd7-b69631c98e65 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:57.379989 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:14:57.386217 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8f9dcfde-8343-4286-bdd7-b69631c98e65 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.148703 Jul 27 20:14:57.386778 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 386/758] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:57 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:58.189864 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8b05d342-38ff-4a30-adab-4e41b56f7238 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:58.190476 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8b05d342-38ff-4a30-adab-4e41b56f7238 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:58.197304 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b05d342-38ff-4a30-adab-4e41b56f7238 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:58.197758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b05d342-38ff-4a30-adab-4e41b56f7238 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:58.198523 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b05d342-38ff-4a30-adab-4e41b56f7238 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:58.198961 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b05d342-38ff-4a30-adab-4e41b56f7238 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:58.354105 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8b05d342-38ff-4a30-adab-4e41b56f7238 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:58.363822 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8b05d342-38ff-4a30-adab-4e41b56f7238 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.177718 Jul 27 20:14:58.364441 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 373/759] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:58 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:58.407152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1e65d9eb-d384-4709-98a3-29544807af56 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:58.407765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1e65d9eb-d384-4709-98a3-29544807af56 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:58.415018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1e65d9eb-d384-4709-98a3-29544807af56 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:58.415474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1e65d9eb-d384-4709-98a3-29544807af56 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:58.416239 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1e65d9eb-d384-4709-98a3-29544807af56 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:58.416677 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1e65d9eb-d384-4709-98a3-29544807af56 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:58.546698 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1e65d9eb-d384-4709-98a3-29544807af56 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:58.554928 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1e65d9eb-d384-4709-98a3-29544807af56 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.151833 Jul 27 20:14:58.555497 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 387/760] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:58 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:59.385486 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-93305a4a-5ec2-4cad-a8b0-19d19f3aabcc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:59.386090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-93305a4a-5ec2-4cad-a8b0-19d19f3aabcc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:59.392439 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93305a4a-5ec2-4cad-a8b0-19d19f3aabcc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:59.392876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93305a4a-5ec2-4cad-a8b0-19d19f3aabcc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:59.393654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93305a4a-5ec2-4cad-a8b0-19d19f3aabcc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:59.394082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93305a4a-5ec2-4cad-a8b0-19d19f3aabcc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:59.526225 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-93305a4a-5ec2-4cad-a8b0-19d19f3aabcc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:59.535360 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-93305a4a-5ec2-4cad-a8b0-19d19f3aabcc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1711 microversion: 2.1 time: 0.153566 Jul 27 20:14:59.536801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 374/761] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:59 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1711 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:59.576819 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5531c318-9ba5-4439-9e93-5b54afe7f653 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:59.577483 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5531c318-9ba5-4439-9e93-5b54afe7f653 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:59.584014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5531c318-9ba5-4439-9e93-5b54afe7f653 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:59.584462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5531c318-9ba5-4439-9e93-5b54afe7f653 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:59.585307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5531c318-9ba5-4439-9e93-5b54afe7f653 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:59.585804 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5531c318-9ba5-4439-9e93-5b54afe7f653 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:59.598111 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-02a0a2af-963d-4ea1-b2c1-e7380d1b1f2b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:59.599275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-02a0a2af-963d-4ea1-b2c1-e7380d1b1f2b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:59.605262 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02a0a2af-963d-4ea1-b2c1-e7380d1b1f2b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:59.605711 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02a0a2af-963d-4ea1-b2c1-e7380d1b1f2b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:59.606479 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02a0a2af-963d-4ea1-b2c1-e7380d1b1f2b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:59.606915 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02a0a2af-963d-4ea1-b2c1-e7380d1b1f2b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:59.726443 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-02a0a2af-963d-4ea1-b2c1-e7380d1b1f2b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] HTTP exception thrown: Cannot 'detach_volume' instance 0d634922-ac08-46f6-aa94-44abf09f6bc3 while it is in vm_state rescued Jul 27 20:14:59.728214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-02a0a2af-963d-4ea1-b2c1-e7380d1b1f2b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Request method failure captured: Jul 27 20:14:59.728214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3 HTTP/1.1 Jul 27 20:14:59.728214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:14:59.728214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:14:59.728214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:14:59.728214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:14:59.728214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:14:59.728214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:14:59.728214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:14:59.728214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:14:59.728214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4Zs1w1g_5EBOAJHGXZvQfsbeerbcd37lKRD5mUkafMdHZAX3P44SwOy9NISSA8Lh2nFLwJ2io24pgRqnG4EvPMR-HJKAS2sxbES-VziDHtkha7CtqVpqP38PRAt1Y6btPfnsUjV-NLhIZjiSnTrYjlnZs4PaFMjmKlQulWMSRQRQQCg Jul 27 20:14:59.728214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:14:59.728214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:14:59.728214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:14:59.728214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:14:59.728214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:14:59.728214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:14:59.728214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: 1626b826d47a47429a947fa36ace64e4 Jul 27 20:14:59.728214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:14:59.728214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:14:59.728214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:14:59.729719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1626b826d47a47429a947fa36ace64e4", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:14:59.729719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:14:59.729719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 1626b826d47a47429a947fa36ace64e4 Jul 27 20:14:59.729719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:14:59.729719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-ServerRescueNegativeTestJSON-2064775453-project Jul 27 20:14:59.729719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:14:59.729719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:14:59.729719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: a48eaef4d70b4116bd307374d819bca6 Jul 27 20:14:59.729719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2064775453-project Jul 27 20:14:59.729719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:14:59.729719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Cannot 'detach_volume' instance 0d634922-ac08-46f6-aa94-44abf09f6bc3 while it is in vm_state rescued Jul 27 20:14:59.730508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'server_id': '0d634922-ac08-46f6-aa94-44abf09f6bc3', 'id': 'd4fe68b5-3007-45a2-91be-ff65008cfbc3'} Jul 27 20:14:59.730508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:14:59.730508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:14:59.730508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:14:59.730508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:14:59.730508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:14:59.730508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:14:59.730508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 27 20:14:59.730508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 27 20:14:59.730508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0d634922-ac08-46f6-aa94-44abf09f6bc3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 27 20:14:59.730508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:14:59.730508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:14:59.730508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:14:59.730508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:14:59.730508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:14:59.730508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:14:59.730508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:14:59.730508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:14:59.730508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:14:59.730508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:14:59.731733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 27 20:14:59.731733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 27 20:14:59.731733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 27 20:14:59.731733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 27 20:14:59.731733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0d634922-ac08-46f6-aa94-44abf09f6bc3 while it is in vm_state rescued Jul 27 20:14:59.731733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:14:59.731733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:14:59.731733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:14:59.731733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:14:59.731733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:14:59.731733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:14:59.731733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:14:59.731733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:14:59.731733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0d634922-ac08-46f6-aa94-44abf09f6bc3 while it is in vm_state rescued Jul 27 20:14:59.731733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:14:59.731733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-02a0a2af-963d-4ea1-b2c1-e7380d1b1f2b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Returning 409 to user: Cannot 'detach_volume' instance 0d634922-ac08-46f6-aa94-44abf09f6bc3 while it is in vm_state rescued {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:14:59.732659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-02a0a2af-963d-4ea1-b2c1-e7380d1b1f2b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3" status: 409 len: 152 microversion: 2.1 time: 0.135643 Jul 27 20:14:59.732659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 375/762] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Jul 27 20:14:59 2022] DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3 => generated 152 bytes in 137 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 27 20:14:59.739269 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-021bd182-4422-4f8b-b23f-29d4ab0a8a05 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:14:59.740093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-021bd182-4422-4f8b-b23f-29d4ab0a8a05 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:59.746549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5531c318-9ba5-4439-9e93-5b54afe7f653 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:59.747706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-021bd182-4422-4f8b-b23f-29d4ab0a8a05 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:59.748148 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-021bd182-4422-4f8b-b23f-29d4ab0a8a05 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:59.748919 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-021bd182-4422-4f8b-b23f-29d4ab0a8a05 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:59.749379 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-021bd182-4422-4f8b-b23f-29d4ab0a8a05 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:59.754649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5531c318-9ba5-4439-9e93-5b54afe7f653 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.181555 Jul 27 20:14:59.755823 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 388/763] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:59 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:14:59.819434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-021bd182-4422-4f8b-b23f-29d4ab0a8a05 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "POST /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/action" status: 202 len: 0 microversion: 2.1 time: 0.083741 Jul 27 20:14:59.820342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 376/764] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Jul 27 20:14:59 2022] POST /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:14:59.829874 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-32aee5a3-eeb3-4297-97bf-12a4bef6163c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:14:59.830849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-32aee5a3-eeb3-4297-97bf-12a4bef6163c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:14:59.840742 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-32aee5a3-eeb3-4297-97bf-12a4bef6163c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:59.841316 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-32aee5a3-eeb3-4297-97bf-12a4bef6163c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:59.842173 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-32aee5a3-eeb3-4297-97bf-12a4bef6163c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:14:59.842712 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-32aee5a3-eeb3-4297-97bf-12a4bef6163c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:14:59.977564 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-32aee5a3-eeb3-4297-97bf-12a4bef6163c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:14:59.985675 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-32aee5a3-eeb3-4297-97bf-12a4bef6163c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1719 microversion: 2.1 time: 0.159744 Jul 27 20:14:59.986267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 389/765] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:14:59 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:00.776912 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9e8e4648-71df-4e2d-9aee-868a9691cebc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:00.777654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9e8e4648-71df-4e2d-9aee-868a9691cebc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:00.783817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9e8e4648-71df-4e2d-9aee-868a9691cebc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:00.784257 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9e8e4648-71df-4e2d-9aee-868a9691cebc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:00.785027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9e8e4648-71df-4e2d-9aee-868a9691cebc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:00.785455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9e8e4648-71df-4e2d-9aee-868a9691cebc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:00.915790 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9e8e4648-71df-4e2d-9aee-868a9691cebc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:00.923098 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9e8e4648-71df-4e2d-9aee-868a9691cebc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.150809 Jul 27 20:15:00.923647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 377/766] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:00 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:15:01.007256 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-32f07581-6024-459a-a19c-24e4a8cca80b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:01.007873 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-32f07581-6024-459a-a19c-24e4a8cca80b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:01.014342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-32f07581-6024-459a-a19c-24e4a8cca80b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:01.014796 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-32f07581-6024-459a-a19c-24e4a8cca80b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:01.015572 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-32f07581-6024-459a-a19c-24e4a8cca80b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:01.016011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-32f07581-6024-459a-a19c-24e4a8cca80b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:01.149848 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-32f07581-6024-459a-a19c-24e4a8cca80b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:01.158071 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-32f07581-6024-459a-a19c-24e4a8cca80b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1719 microversion: 2.1 time: 0.155032 Jul 27 20:15:01.158631 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 390/767] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:01 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:01.945284 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-832ffb47-6f6f-4344-a30d-e20cf9db2af3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:01.945896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-832ffb47-6f6f-4344-a30d-e20cf9db2af3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:01.952384 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-832ffb47-6f6f-4344-a30d-e20cf9db2af3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:01.952840 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-832ffb47-6f6f-4344-a30d-e20cf9db2af3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:01.953644 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-832ffb47-6f6f-4344-a30d-e20cf9db2af3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:01.954082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-832ffb47-6f6f-4344-a30d-e20cf9db2af3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:02.088270 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-832ffb47-6f6f-4344-a30d-e20cf9db2af3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:02.095801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-832ffb47-6f6f-4344-a30d-e20cf9db2af3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.155427 Jul 27 20:15:02.096348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 378/768] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:01 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:02.180349 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9a4acd43-41ae-471f-925a-01fb060de584 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:02.180957 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9a4acd43-41ae-471f-925a-01fb060de584 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:02.187375 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9a4acd43-41ae-471f-925a-01fb060de584 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:02.187819 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9a4acd43-41ae-471f-925a-01fb060de584 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:02.188573 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9a4acd43-41ae-471f-925a-01fb060de584 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:02.189032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9a4acd43-41ae-471f-925a-01fb060de584 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:02.323247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9a4acd43-41ae-471f-925a-01fb060de584 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:02.331156 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9a4acd43-41ae-471f-925a-01fb060de584 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1719 microversion: 2.1 time: 0.155566 Jul 27 20:15:02.331730 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 391/769] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:02 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:03.017585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:15:03.018020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:15:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:15:03.116566 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-37ac9140-a208-4305-a23c-3d7fed0960f3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:03.117208 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-37ac9140-a208-4305-a23c-3d7fed0960f3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:03.123787 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37ac9140-a208-4305-a23c-3d7fed0960f3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:03.124236 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37ac9140-a208-4305-a23c-3d7fed0960f3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:03.125030 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37ac9140-a208-4305-a23c-3d7fed0960f3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:03.125468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37ac9140-a208-4305-a23c-3d7fed0960f3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:03.264240 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-37ac9140-a208-4305-a23c-3d7fed0960f3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:03.272354 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-37ac9140-a208-4305-a23c-3d7fed0960f3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.159894 Jul 27 20:15:03.272919 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 379/770] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:03 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:03.352442 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6558e157-f878-490b-b7d6-8f83b267d9b1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:03.353126 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6558e157-f878-490b-b7d6-8f83b267d9b1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:03.359496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6558e157-f878-490b-b7d6-8f83b267d9b1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:03.359951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6558e157-f878-490b-b7d6-8f83b267d9b1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:03.360721 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6558e157-f878-490b-b7d6-8f83b267d9b1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:03.361193 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6558e157-f878-490b-b7d6-8f83b267d9b1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:03.487703 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6558e157-f878-490b-b7d6-8f83b267d9b1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:03.496465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6558e157-f878-490b-b7d6-8f83b267d9b1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1719 microversion: 2.1 time: 0.147995 Jul 27 20:15:03.497051 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 392/771] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:03 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1719 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:04.293575 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0b51c02f-a401-47c3-aa1a-a72e83ee402f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:04.294186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0b51c02f-a401-47c3-aa1a-a72e83ee402f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:04.300721 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b51c02f-a401-47c3-aa1a-a72e83ee402f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:04.301437 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b51c02f-a401-47c3-aa1a-a72e83ee402f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:04.302774 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b51c02f-a401-47c3-aa1a-a72e83ee402f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:04.303222 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b51c02f-a401-47c3-aa1a-a72e83ee402f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:04.438640 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0b51c02f-a401-47c3-aa1a-a72e83ee402f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:04.446805 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0b51c02f-a401-47c3-aa1a-a72e83ee402f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.157236 Jul 27 20:15:04.447363 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 380/772] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:04 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:04.518201 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cb622698-3b15-4bab-bbe1-813fc75e0d2e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:04.518822 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cb622698-3b15-4bab-bbe1-813fc75e0d2e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:04.525855 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb622698-3b15-4bab-bbe1-813fc75e0d2e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:04.526310 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb622698-3b15-4bab-bbe1-813fc75e0d2e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:04.527081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb622698-3b15-4bab-bbe1-813fc75e0d2e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:04.527525 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb622698-3b15-4bab-bbe1-813fc75e0d2e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:04.657333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cb622698-3b15-4bab-bbe1-813fc75e0d2e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:04.665454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cb622698-3b15-4bab-bbe1-813fc75e0d2e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1719 microversion: 2.1 time: 0.151041 Jul 27 20:15:04.666029 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 393/773] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:04 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:15:05.467441 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5937735b-d04d-438a-8bd2-55765edfb74d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:05.468056 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5937735b-d04d-438a-8bd2-55765edfb74d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:05.476249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5937735b-d04d-438a-8bd2-55765edfb74d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:05.476695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5937735b-d04d-438a-8bd2-55765edfb74d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:05.477487 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5937735b-d04d-438a-8bd2-55765edfb74d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:05.477920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5937735b-d04d-438a-8bd2-55765edfb74d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:05.611116 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5937735b-d04d-438a-8bd2-55765edfb74d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:05.619482 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5937735b-d04d-438a-8bd2-55765edfb74d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.155802 Jul 27 20:15:05.620046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 381/774] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:05 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:05.685768 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-372fb1a5-b714-47bd-a20c-03bc69117077 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:05.686331 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-372fb1a5-b714-47bd-a20c-03bc69117077 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:05.693227 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-372fb1a5-b714-47bd-a20c-03bc69117077 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:05.693787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-372fb1a5-b714-47bd-a20c-03bc69117077 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:05.694558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-372fb1a5-b714-47bd-a20c-03bc69117077 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:05.695002 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-372fb1a5-b714-47bd-a20c-03bc69117077 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:06.059101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-372fb1a5-b714-47bd-a20c-03bc69117077 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:06.067933 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-372fb1a5-b714-47bd-a20c-03bc69117077 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1725 microversion: 2.1 time: 0.385402 Jul 27 20:15:06.068508 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 394/775] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:05 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1725 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:06.089106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5a88cada-025d-4f9e-afbc-b22a91826cf2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:06.089599 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5a88cada-025d-4f9e-afbc-b22a91826cf2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:06.095652 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a88cada-025d-4f9e-afbc-b22a91826cf2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:06.096096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a88cada-025d-4f9e-afbc-b22a91826cf2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:06.096866 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a88cada-025d-4f9e-afbc-b22a91826cf2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:06.097335 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a88cada-025d-4f9e-afbc-b22a91826cf2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:06.171742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5a88cada-025d-4f9e-afbc-b22a91826cf2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086480 Jul 27 20:15:06.172338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 382/776] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Jul 27 20:15:06 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:15:06.640412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-76693ef9-53b8-4ca8-b3c8-1478fe53eb10 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:06.641058 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-76693ef9-53b8-4ca8-b3c8-1478fe53eb10 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:06.647080 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-76693ef9-53b8-4ca8-b3c8-1478fe53eb10 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:06.647533 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-76693ef9-53b8-4ca8-b3c8-1478fe53eb10 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:06.648309 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-76693ef9-53b8-4ca8-b3c8-1478fe53eb10 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:06.648752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-76693ef9-53b8-4ca8-b3c8-1478fe53eb10 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:06.898629 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-76693ef9-53b8-4ca8-b3c8-1478fe53eb10 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:06.906456 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-76693ef9-53b8-4ca8-b3c8-1478fe53eb10 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.269785 Jul 27 20:15:06.906881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 395/777] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:06 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:07.226116 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-5d8e6a26-4893-4d2d-a609-41dd350ee244 req-c63ef41d-2c89-4a09-9a6a-6f8a0514b75e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d634922-ac08-46f6-aa94-44abf09f6bc3", "tag": "63624ac2-681a-4488-9360-3a3a6dc129bc"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:15:07.235583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-5d8e6a26-4893-4d2d-a609-41dd350ee244 req-c63ef41d-2c89-4a09-9a6a-6f8a0514b75e service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:07.236030 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-5d8e6a26-4893-4d2d-a609-41dd350ee244 req-c63ef41d-2c89-4a09-9a6a-6f8a0514b75e service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:07.247596 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-5d8e6a26-4893-4d2d-a609-41dd350ee244 req-c63ef41d-2c89-4a09-9a6a-6f8a0514b75e service nova] Creating event network-changed:63624ac2-681a-4488-9360-3a3a6dc129bc for instance 0d634922-ac08-46f6-aa94-44abf09f6bc3 on hv-cinder-79987 Jul 27 20:15:07.252587 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-5d8e6a26-4893-4d2d-a609-41dd350ee244 req-c63ef41d-2c89-4a09-9a6a-6f8a0514b75e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085595 Jul 27 20:15:07.253407 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 383/778] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:07.929613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e1784fbc-364f-4387-8e0c-c0624e61b427 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:07.930233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e1784fbc-364f-4387-8e0c-c0624e61b427 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:07.937058 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1784fbc-364f-4387-8e0c-c0624e61b427 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:07.937589 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1784fbc-364f-4387-8e0c-c0624e61b427 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:07.938430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1784fbc-364f-4387-8e0c-c0624e61b427 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:07.938939 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1784fbc-364f-4387-8e0c-c0624e61b427 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:08.079770 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e1784fbc-364f-4387-8e0c-c0624e61b427 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:08.088204 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e1784fbc-364f-4387-8e0c-c0624e61b427 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.163244 Jul 27 20:15:08.088773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 396/779] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:07 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:08.281553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cded8724-266a-4b3c-ace0-566ec315921a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2037569023"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:15:08.282174 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cded8724-266a-4b3c-ace0-566ec315921a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:08.288887 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cded8724-266a-4b3c-ace0-566ec315921a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:08.289362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cded8724-266a-4b3c-ace0-566ec315921a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:08.290123 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cded8724-266a-4b3c-ace0-566ec315921a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:08.290557 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cded8724-266a-4b3c-ace0-566ec315921a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:08.304021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:08.425254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.network.security_group_api [None req-cded8724-266a-4b3c-ace0-566ec315921a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Removing security group 5deb60a0-12cb-4d16-a057-409f38ac5263 from port f9060715-d759-4b5a-9395-c2ef1b01d78e Jul 27 20:15:08.822494 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cded8724-266a-4b3c-ace0-566ec315921a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "POST /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/action" status: 202 len: 0 microversion: 2.1 time: 0.647013 Jul 27 20:15:08.823831 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 384/780] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Jul 27 20:15:08 2022] POST /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/action => generated 0 bytes in 649 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:15:08.938262 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-f27d49e4-8010-4e04-8762-49b2b970f091 req-1cff750c-8459-4844-8ae5-c9feb3cedc62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a92495d-74f4-4470-b9a4-919eb729c2a7", "tag": "f9060715-d759-4b5a-9395-c2ef1b01d78e"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:15:08.951597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-f27d49e4-8010-4e04-8762-49b2b970f091 req-1cff750c-8459-4844-8ae5-c9feb3cedc62 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:08.952304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-f27d49e4-8010-4e04-8762-49b2b970f091 req-1cff750c-8459-4844-8ae5-c9feb3cedc62 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:08.965196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-f27d49e4-8010-4e04-8762-49b2b970f091 req-1cff750c-8459-4844-8ae5-c9feb3cedc62 service nova] Creating event network-changed:f9060715-d759-4b5a-9395-c2ef1b01d78e for instance 8a92495d-74f4-4470-b9a4-919eb729c2a7 on hv-cinder-79987 Jul 27 20:15:08.970979 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-f27d49e4-8010-4e04-8762-49b2b970f091 req-1cff750c-8459-4844-8ae5-c9feb3cedc62 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128143 Jul 27 20:15:08.975930 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 397/781] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:09.112888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-950f9c98-2402-446e-8f67-921c6479efb0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:09.114130 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-950f9c98-2402-446e-8f67-921c6479efb0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:09.121671 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-950f9c98-2402-446e-8f67-921c6479efb0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:09.122296 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-950f9c98-2402-446e-8f67-921c6479efb0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:09.123243 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-950f9c98-2402-446e-8f67-921c6479efb0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:09.125268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-950f9c98-2402-446e-8f67-921c6479efb0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:09.269095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-95c2abb7-b322-4d3e-9f96-5dfa17c9d314 req-11231dd8-7573-4b96-8ae5-e1684c1132c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d634922-ac08-46f6-aa94-44abf09f6bc3", "tag": "63624ac2-681a-4488-9360-3a3a6dc129bc"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:15:09.280999 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-95c2abb7-b322-4d3e-9f96-5dfa17c9d314 req-11231dd8-7573-4b96-8ae5-e1684c1132c2 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:09.281636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-95c2abb7-b322-4d3e-9f96-5dfa17c9d314 req-11231dd8-7573-4b96-8ae5-e1684c1132c2 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:09.293688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-95c2abb7-b322-4d3e-9f96-5dfa17c9d314 req-11231dd8-7573-4b96-8ae5-e1684c1132c2 service nova] Creating event network-changed:63624ac2-681a-4488-9360-3a3a6dc129bc for instance 0d634922-ac08-46f6-aa94-44abf09f6bc3 on hv-cinder-79987 Jul 27 20:15:09.299932 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-95c2abb7-b322-4d3e-9f96-5dfa17c9d314 req-11231dd8-7573-4b96-8ae5-e1684c1132c2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034559 Jul 27 20:15:09.300553 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 398/782] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:15:09.611059 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-950f9c98-2402-446e-8f67-921c6479efb0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:09.619337 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-950f9c98-2402-446e-8f67-921c6479efb0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.511478 Jul 27 20:15:09.619910 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 385/783] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:09 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:10.641293 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d1d45222-5650-4275-8efa-5023a445fb9b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:10.642007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d1d45222-5650-4275-8efa-5023a445fb9b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:10.649276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d1d45222-5650-4275-8efa-5023a445fb9b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:10.649727 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d1d45222-5650-4275-8efa-5023a445fb9b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:10.650492 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d1d45222-5650-4275-8efa-5023a445fb9b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:10.650932 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d1d45222-5650-4275-8efa-5023a445fb9b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:10.750534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1ff77d60-7c3e-4ce6-93b7-d62d6382e006 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:10.750902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1ff77d60-7c3e-4ce6-93b7-d62d6382e006 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:10.758897 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1ff77d60-7c3e-4ce6-93b7-d62d6382e006 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:10.759344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1ff77d60-7c3e-4ce6-93b7-d62d6382e006 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:10.760247 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1ff77d60-7c3e-4ce6-93b7-d62d6382e006 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:10.760684 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1ff77d60-7c3e-4ce6-93b7-d62d6382e006 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:10.803363 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d1d45222-5650-4275-8efa-5023a445fb9b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:10.812792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d1d45222-5650-4275-8efa-5023a445fb9b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.175983 Jul 27 20:15:10.816275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 399/784] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:10 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:10.873088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-1ff77d60-7c3e-4ce6-93b7-d62d6382e006 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lazy-loading 'services' on Instance uuid 8a92495d-74f4-4470-b9a4-919eb729c2a7 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:15:10.947880 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1ff77d60-7c3e-4ce6-93b7-d62d6382e006 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments/2d1afb1c-74a8-4609-bb99-2a7c6a98a47a" status: 202 len: 0 microversion: 2.1 time: 0.201429 Jul 27 20:15:10.948462 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 386/785] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Jul 27 20:15:10 2022] DELETE /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments/2d1afb1c-74a8-4609-bb99-2a7c6a98a47a => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:15:10.956856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-13431b97-e7e2-400c-aee7-21d7cada07f4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:10.959863 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-13431b97-e7e2-400c-aee7-21d7cada07f4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:10.965803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-13431b97-e7e2-400c-aee7-21d7cada07f4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:10.966260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-13431b97-e7e2-400c-aee7-21d7cada07f4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:10.967032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-13431b97-e7e2-400c-aee7-21d7cada07f4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:10.967471 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-13431b97-e7e2-400c-aee7-21d7cada07f4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:10.988643 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-3e7a1075-4c37-4dda-981f-0b7bc59d0992 req-815de3dd-ba84-45c6-b82a-d6d1a04982e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a92495d-74f4-4470-b9a4-919eb729c2a7", "tag": "f9060715-d759-4b5a-9395-c2ef1b01d78e"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:15:10.999154 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-13431b97-e7e2-400c-aee7-21d7cada07f4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046279 Jul 27 20:15:10.999807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 400/786] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:10 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:11.003891 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-3e7a1075-4c37-4dda-981f-0b7bc59d0992 req-815de3dd-ba84-45c6-b82a-d6d1a04982e5 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:11.003891 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-3e7a1075-4c37-4dda-981f-0b7bc59d0992 req-815de3dd-ba84-45c6-b82a-d6d1a04982e5 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:11.013671 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-3e7a1075-4c37-4dda-981f-0b7bc59d0992 req-815de3dd-ba84-45c6-b82a-d6d1a04982e5 service nova] Creating event network-changed:f9060715-d759-4b5a-9395-c2ef1b01d78e for instance 8a92495d-74f4-4470-b9a4-919eb729c2a7 on hv-cinder-79987 Jul 27 20:15:11.018531 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-3e7a1075-4c37-4dda-981f-0b7bc59d0992 req-815de3dd-ba84-45c6-b82a-d6d1a04982e5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034698 Jul 27 20:15:11.019112 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 387/787] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:15:11.840314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b4708d9a-fe89-49a6-b78d-ac1419e5f745 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:11.840922 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b4708d9a-fe89-49a6-b78d-ac1419e5f745 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:11.847353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4708d9a-fe89-49a6-b78d-ac1419e5f745 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:11.847798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4708d9a-fe89-49a6-b78d-ac1419e5f745 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:11.849268 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4708d9a-fe89-49a6-b78d-ac1419e5f745 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:11.849708 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4708d9a-fe89-49a6-b78d-ac1419e5f745 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:11.986559 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b4708d9a-fe89-49a6-b78d-ac1419e5f745 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:11.994266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b4708d9a-fe89-49a6-b78d-ac1419e5f745 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.157653 Jul 27 20:15:11.994835 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 401/788] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:11 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:12.012608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7ddc7f57-4b3a-4a5e-9492-dc45bfae38e9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:12.015487 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7ddc7f57-4b3a-4a5e-9492-dc45bfae38e9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:12.023188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ddc7f57-4b3a-4a5e-9492-dc45bfae38e9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:12.023641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ddc7f57-4b3a-4a5e-9492-dc45bfae38e9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:12.024416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ddc7f57-4b3a-4a5e-9492-dc45bfae38e9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:12.025046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ddc7f57-4b3a-4a5e-9492-dc45bfae38e9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:12.056092 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7ddc7f57-4b3a-4a5e-9492-dc45bfae38e9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048152 Jul 27 20:15:12.056665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 388/789] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:12 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:13.015643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1434c76d-474e-4058-89ea-2c43aa2ba1b0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:13.016259 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1434c76d-474e-4058-89ea-2c43aa2ba1b0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:13.023899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1434c76d-474e-4058-89ea-2c43aa2ba1b0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:13.024354 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1434c76d-474e-4058-89ea-2c43aa2ba1b0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:13.025147 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1434c76d-474e-4058-89ea-2c43aa2ba1b0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:13.025591 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1434c76d-474e-4058-89ea-2c43aa2ba1b0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:13.068696 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d8de01cc-4d0e-4447-adcc-fda293ef2393 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:13.070885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d8de01cc-4d0e-4447-adcc-fda293ef2393 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:13.077823 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8de01cc-4d0e-4447-adcc-fda293ef2393 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:13.078270 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8de01cc-4d0e-4447-adcc-fda293ef2393 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:13.079124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8de01cc-4d0e-4447-adcc-fda293ef2393 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:13.079560 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8de01cc-4d0e-4447-adcc-fda293ef2393 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:13.110193 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d8de01cc-4d0e-4447-adcc-fda293ef2393 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046321 Jul 27 20:15:13.110773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 389/790] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:13 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:15:13.163197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1434c76d-474e-4058-89ea-2c43aa2ba1b0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:13.170785 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1434c76d-474e-4058-89ea-2c43aa2ba1b0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.159139 Jul 27 20:15:13.171355 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 402/791] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:13 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:14.123542 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b106e8fe-9e56-474d-b329-19613436ae2e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:14.125723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b106e8fe-9e56-474d-b329-19613436ae2e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:14.132369 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b106e8fe-9e56-474d-b329-19613436ae2e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:14.132817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b106e8fe-9e56-474d-b329-19613436ae2e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:14.133620 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b106e8fe-9e56-474d-b329-19613436ae2e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:14.134057 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b106e8fe-9e56-474d-b329-19613436ae2e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:14.163254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b106e8fe-9e56-474d-b329-19613436ae2e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043672 Jul 27 20:15:14.163800 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 390/792] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:14 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:14.192783 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7694134a-27d2-498f-8554-7737bd1f009e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:14.193432 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7694134a-27d2-498f-8554-7737bd1f009e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:14.199866 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7694134a-27d2-498f-8554-7737bd1f009e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:14.200314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7694134a-27d2-498f-8554-7737bd1f009e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:14.201088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7694134a-27d2-498f-8554-7737bd1f009e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:14.201524 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7694134a-27d2-498f-8554-7737bd1f009e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:14.332020 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7694134a-27d2-498f-8554-7737bd1f009e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:14.340406 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7694134a-27d2-498f-8554-7737bd1f009e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.151837 Jul 27 20:15:14.340988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 403/793] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:14 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:14.617101 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-c8586761-53ac-48ec-b31a-f801b0b2c2d0 req-2b7bf43c-5faa-4721-a3c6-61a057118cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c560ad96-cd64-4d84-86c8-c315f0fa0ab7", "name": "network-vif-unplugged", "status": "completed", "tag": "12f96d47-a8d9-4367-b8bf-0bb05f9ee59b"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:15:14.626502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-c8586761-53ac-48ec-b31a-f801b0b2c2d0 req-2b7bf43c-5faa-4721-a3c6-61a057118cf1 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:14.626912 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-c8586761-53ac-48ec-b31a-f801b0b2c2d0 req-2b7bf43c-5faa-4721-a3c6-61a057118cf1 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:14.643516 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-c8586761-53ac-48ec-b31a-f801b0b2c2d0 req-2b7bf43c-5faa-4721-a3c6-61a057118cf1 service nova] Creating event network-vif-unplugged:12f96d47-a8d9-4367-b8bf-0bb05f9ee59b for instance c560ad96-cd64-4d84-86c8-c315f0fa0ab7 on hv-cinder-79987 Jul 27 20:15:14.648951 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-c8586761-53ac-48ec-b31a-f801b0b2c2d0 req-2b7bf43c-5faa-4721-a3c6-61a057118cf1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090984 Jul 27 20:15:14.649569 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 391/794] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:15.075425 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-dc21c4ee-c482-4a03-a126-514e490c3581 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:15.075923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-dc21c4ee-c482-4a03-a126-514e490c3581 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:15.083143 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc21c4ee-c482-4a03-a126-514e490c3581 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:15.083918 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc21c4ee-c482-4a03-a126-514e490c3581 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:15.084724 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc21c4ee-c482-4a03-a126-514e490c3581 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:15.085205 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc21c4ee-c482-4a03-a126-514e490c3581 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:15.111392 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:15.116406 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-dc21c4ee-c482-4a03-a126-514e490c3581 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea" status: 200 len: 194 microversion: 2.20 time: 0.044982 Jul 27 20:15:15.117000 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 404/795] 10.222.0.65 () {60 vars in 1454 bytes} [Wed Jul 27 20:15:15 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:15:15.176563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-88ab5d9b-27e8-4edd-8904-7f13a4e1620b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:15.178852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-88ab5d9b-27e8-4edd-8904-7f13a4e1620b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:15.185022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-88ab5d9b-27e8-4edd-8904-7f13a4e1620b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:15.185469 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-88ab5d9b-27e8-4edd-8904-7f13a4e1620b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:15.186221 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-88ab5d9b-27e8-4edd-8904-7f13a4e1620b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:15.186654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-88ab5d9b-27e8-4edd-8904-7f13a4e1620b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:15.215388 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-88ab5d9b-27e8-4edd-8904-7f13a4e1620b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043582 Jul 27 20:15:15.215922 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 392/796] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:15 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:15.361895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-90a99501-cf6f-4c4d-96dc-e25496c78180 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:15.362438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-90a99501-cf6f-4c4d-96dc-e25496c78180 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:15.369143 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90a99501-cf6f-4c4d-96dc-e25496c78180 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:15.369597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90a99501-cf6f-4c4d-96dc-e25496c78180 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:15.370359 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90a99501-cf6f-4c4d-96dc-e25496c78180 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:15.370800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90a99501-cf6f-4c4d-96dc-e25496c78180 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:15.499754 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-90a99501-cf6f-4c4d-96dc-e25496c78180 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:15.508240 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-90a99501-cf6f-4c4d-96dc-e25496c78180 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.150261 Jul 27 20:15:15.508813 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 405/797] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:15 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:16.227751 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-11ff8ea9-8c7c-43ea-bfca-7d5d9345aa17 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:16.229874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-11ff8ea9-8c7c-43ea-bfca-7d5d9345aa17 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:16.236286 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11ff8ea9-8c7c-43ea-bfca-7d5d9345aa17 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:16.236730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11ff8ea9-8c7c-43ea-bfca-7d5d9345aa17 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:16.237512 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11ff8ea9-8c7c-43ea-bfca-7d5d9345aa17 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:16.237942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11ff8ea9-8c7c-43ea-bfca-7d5d9345aa17 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:16.266193 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-11ff8ea9-8c7c-43ea-bfca-7d5d9345aa17 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042487 Jul 27 20:15:16.266736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 393/798] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:16 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:16.529495 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ece3a9bf-c16b-4b67-95cb-5a5cdfcdde72 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:16.530114 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ece3a9bf-c16b-4b67-95cb-5a5cdfcdde72 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:16.536665 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ece3a9bf-c16b-4b67-95cb-5a5cdfcdde72 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:16.537146 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ece3a9bf-c16b-4b67-95cb-5a5cdfcdde72 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:16.537914 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ece3a9bf-c16b-4b67-95cb-5a5cdfcdde72 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:16.538371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ece3a9bf-c16b-4b67-95cb-5a5cdfcdde72 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:16.674795 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ece3a9bf-c16b-4b67-95cb-5a5cdfcdde72 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:16.683064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ece3a9bf-c16b-4b67-95cb-5a5cdfcdde72 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.157449 Jul 27 20:15:16.683683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 406/799] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:16 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:17.278870 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-94ee5942-b914-4df5-bb39-c60a42d12123 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:17.280982 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-94ee5942-b914-4df5-bb39-c60a42d12123 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:17.283397 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=62 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:17.289509 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-94ee5942-b914-4df5-bb39-c60a42d12123 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:17.289959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-94ee5942-b914-4df5-bb39-c60a42d12123 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:17.290731 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-94ee5942-b914-4df5-bb39-c60a42d12123 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:17.291168 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-94ee5942-b914-4df5-bb39-c60a42d12123 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:17.320162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-94ee5942-b914-4df5-bb39-c60a42d12123 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045315 Jul 27 20:15:17.320706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 394/800] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:17 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:17.707757 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a6163863-844d-4de7-ac48-ff2d1c306b59 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:17.708574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a6163863-844d-4de7-ac48-ff2d1c306b59 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:17.714729 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6163863-844d-4de7-ac48-ff2d1c306b59 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:17.715180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6163863-844d-4de7-ac48-ff2d1c306b59 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:17.715932 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6163863-844d-4de7-ac48-ff2d1c306b59 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:17.716367 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6163863-844d-4de7-ac48-ff2d1c306b59 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:17.844166 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a6163863-844d-4de7-ac48-ff2d1c306b59 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:17.852135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a6163863-844d-4de7-ac48-ff2d1c306b59 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.148176 Jul 27 20:15:17.852707 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 407/801] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:17 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:18.334205 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b6a3074d-8962-48f4-97ea-ac1a2e9c9929 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:18.338022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b6a3074d-8962-48f4-97ea-ac1a2e9c9929 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:18.344582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6a3074d-8962-48f4-97ea-ac1a2e9c9929 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:18.345065 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6a3074d-8962-48f4-97ea-ac1a2e9c9929 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:18.345839 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6a3074d-8962-48f4-97ea-ac1a2e9c9929 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:18.346279 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6a3074d-8962-48f4-97ea-ac1a2e9c9929 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:18.380056 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b6a3074d-8962-48f4-97ea-ac1a2e9c9929 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051551 Jul 27 20:15:18.380703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 395/802] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:18 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:18.874016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a1ef7788-8f54-40d3-ade0-ab1814309bda tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:18.874622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a1ef7788-8f54-40d3-ade0-ab1814309bda tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:18.881617 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a1ef7788-8f54-40d3-ade0-ab1814309bda tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:18.882063 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a1ef7788-8f54-40d3-ade0-ab1814309bda tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:18.882816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a1ef7788-8f54-40d3-ade0-ab1814309bda tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:18.883253 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a1ef7788-8f54-40d3-ade0-ab1814309bda tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:19.017010 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a1ef7788-8f54-40d3-ade0-ab1814309bda tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:19.025408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a1ef7788-8f54-40d3-ade0-ab1814309bda tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.155181 Jul 27 20:15:19.025978 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 408/803] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:18 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:19.392415 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-831bfde1-effb-427c-9f43-a0b0e24fbbbc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:19.394578 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-831bfde1-effb-427c-9f43-a0b0e24fbbbc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:19.401694 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-831bfde1-effb-427c-9f43-a0b0e24fbbbc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:19.402148 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-831bfde1-effb-427c-9f43-a0b0e24fbbbc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:19.402897 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-831bfde1-effb-427c-9f43-a0b0e24fbbbc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:19.403330 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-831bfde1-effb-427c-9f43-a0b0e24fbbbc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:19.431868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-831bfde1-effb-427c-9f43-a0b0e24fbbbc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043398 Jul 27 20:15:19.432410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 396/804] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:19 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:20.049152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e4052108-9aa8-4233-bbc8-57a86410e835 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:20.049773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e4052108-9aa8-4233-bbc8-57a86410e835 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:20.057026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4052108-9aa8-4233-bbc8-57a86410e835 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:20.057491 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4052108-9aa8-4233-bbc8-57a86410e835 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:20.058263 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4052108-9aa8-4233-bbc8-57a86410e835 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:20.058708 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4052108-9aa8-4233-bbc8-57a86410e835 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:20.189801 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e4052108-9aa8-4233-bbc8-57a86410e835 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:20.198152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e4052108-9aa8-4233-bbc8-57a86410e835 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.154000 Jul 27 20:15:20.198714 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 409/805] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:20 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:20.444528 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d1730059-1670-4462-b135-4f1744d9162f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:20.446729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d1730059-1670-4462-b135-4f1744d9162f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:20.453156 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d1730059-1670-4462-b135-4f1744d9162f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:20.453609 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d1730059-1670-4462-b135-4f1744d9162f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:20.454375 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d1730059-1670-4462-b135-4f1744d9162f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:20.454816 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d1730059-1670-4462-b135-4f1744d9162f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:20.484433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d1730059-1670-4462-b135-4f1744d9162f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044261 Jul 27 20:15:20.484994 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 397/806] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:20 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:21.218861 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e18fb783-53b5-492f-a1c2-c38560175ff5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:21.219478 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e18fb783-53b5-492f-a1c2-c38560175ff5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:21.226308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e18fb783-53b5-492f-a1c2-c38560175ff5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:21.226758 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e18fb783-53b5-492f-a1c2-c38560175ff5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:21.227529 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e18fb783-53b5-492f-a1c2-c38560175ff5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:21.227974 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e18fb783-53b5-492f-a1c2-c38560175ff5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:21.356608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e18fb783-53b5-492f-a1c2-c38560175ff5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:21.364095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e18fb783-53b5-492f-a1c2-c38560175ff5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.149118 Jul 27 20:15:21.364656 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 410/807] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:21 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:21.496714 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2b562de9-3492-458b-9500-77d1db13347e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:21.498886 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2b562de9-3492-458b-9500-77d1db13347e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:21.505392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b562de9-3492-458b-9500-77d1db13347e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:21.505966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b562de9-3492-458b-9500-77d1db13347e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:21.507438 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b562de9-3492-458b-9500-77d1db13347e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:21.507908 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b562de9-3492-458b-9500-77d1db13347e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:21.535993 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2b562de9-3492-458b-9500-77d1db13347e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043231 Jul 27 20:15:21.536548 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 398/808] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:21 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:22.386069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-649ddcd6-dcac-4d49-a640-c8b829cbbaa2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:22.386725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-649ddcd6-dcac-4d49-a640-c8b829cbbaa2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:22.393250 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-649ddcd6-dcac-4d49-a640-c8b829cbbaa2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:22.393710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-649ddcd6-dcac-4d49-a640-c8b829cbbaa2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:22.394474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-649ddcd6-dcac-4d49-a640-c8b829cbbaa2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:22.394922 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-649ddcd6-dcac-4d49-a640-c8b829cbbaa2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:22.530048 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-649ddcd6-dcac-4d49-a640-c8b829cbbaa2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:22.537590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-649ddcd6-dcac-4d49-a640-c8b829cbbaa2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.155380 Jul 27 20:15:22.538297 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 411/809] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:22 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:22.547695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8757cb5a-3b8b-4054-ac8e-82633baa7913 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:22.549809 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8757cb5a-3b8b-4054-ac8e-82633baa7913 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:22.556720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8757cb5a-3b8b-4054-ac8e-82633baa7913 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:22.557192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8757cb5a-3b8b-4054-ac8e-82633baa7913 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:22.557947 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8757cb5a-3b8b-4054-ac8e-82633baa7913 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:22.558373 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8757cb5a-3b8b-4054-ac8e-82633baa7913 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:22.587324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8757cb5a-3b8b-4054-ac8e-82633baa7913 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043628 Jul 27 20:15:22.587858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 399/810] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:22 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:23.559265 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-560405f3-86ef-4cad-b9d3-51af1c9a036f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:23.559859 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-560405f3-86ef-4cad-b9d3-51af1c9a036f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:23.566589 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-560405f3-86ef-4cad-b9d3-51af1c9a036f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:23.567035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-560405f3-86ef-4cad-b9d3-51af1c9a036f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:23.567791 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-560405f3-86ef-4cad-b9d3-51af1c9a036f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:23.568221 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-560405f3-86ef-4cad-b9d3-51af1c9a036f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:23.598572 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-db938320-64ec-4cd4-9885-3c857bddd20f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:23.601832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-db938320-64ec-4cd4-9885-3c857bddd20f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:23.608495 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db938320-64ec-4cd4-9885-3c857bddd20f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:23.608945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db938320-64ec-4cd4-9885-3c857bddd20f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:23.609757 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db938320-64ec-4cd4-9885-3c857bddd20f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:23.610196 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db938320-64ec-4cd4-9885-3c857bddd20f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:23.640133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-db938320-64ec-4cd4-9885-3c857bddd20f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045455 Jul 27 20:15:23.640686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 400/811] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:23 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:15:23.697794 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-560405f3-86ef-4cad-b9d3-51af1c9a036f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:23.705288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-560405f3-86ef-4cad-b9d3-51af1c9a036f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.149860 Jul 27 20:15:23.705845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 412/812] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:23 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:24.653281 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fb82f095-3f7b-4fec-8dad-aa146433df20 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:24.655671 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fb82f095-3f7b-4fec-8dad-aa146433df20 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:24.662594 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fb82f095-3f7b-4fec-8dad-aa146433df20 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:24.663622 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fb82f095-3f7b-4fec-8dad-aa146433df20 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:24.664387 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fb82f095-3f7b-4fec-8dad-aa146433df20 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:24.664827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fb82f095-3f7b-4fec-8dad-aa146433df20 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:24.694032 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fb82f095-3f7b-4fec-8dad-aa146433df20 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044822 Jul 27 20:15:24.694870 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 401/813] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:24 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:24.727473 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2364749d-50e7-4c05-b597-0718d31f9bd6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:24.728094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2364749d-50e7-4c05-b597-0718d31f9bd6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:24.734547 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2364749d-50e7-4c05-b597-0718d31f9bd6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:24.735005 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2364749d-50e7-4c05-b597-0718d31f9bd6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:24.735773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2364749d-50e7-4c05-b597-0718d31f9bd6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:24.736220 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2364749d-50e7-4c05-b597-0718d31f9bd6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:24.875363 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2364749d-50e7-4c05-b597-0718d31f9bd6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:24.883244 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2364749d-50e7-4c05-b597-0718d31f9bd6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.160030 Jul 27 20:15:24.883819 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 413/814] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:24 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:25.706850 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-faf7b6d8-4409-43d8-9463-7aedacd8c39a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:25.708980 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-faf7b6d8-4409-43d8-9463-7aedacd8c39a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:25.716097 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-faf7b6d8-4409-43d8-9463-7aedacd8c39a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:25.716546 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-faf7b6d8-4409-43d8-9463-7aedacd8c39a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:25.717355 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-faf7b6d8-4409-43d8-9463-7aedacd8c39a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:25.717794 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-faf7b6d8-4409-43d8-9463-7aedacd8c39a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:25.720112 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:25.747648 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-faf7b6d8-4409-43d8-9463-7aedacd8c39a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044821 Jul 27 20:15:25.748208 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 402/815] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:25 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:25.904188 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b143c5e9-3f80-4883-bf61-922b7338973f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:25.904829 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b143c5e9-3f80-4883-bf61-922b7338973f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:25.907270 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=60 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:25.913048 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b143c5e9-3f80-4883-bf61-922b7338973f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:25.913739 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b143c5e9-3f80-4883-bf61-922b7338973f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:25.914508 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b143c5e9-3f80-4883-bf61-922b7338973f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:25.914948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b143c5e9-3f80-4883-bf61-922b7338973f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:26.199349 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b143c5e9-3f80-4883-bf61-922b7338973f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:26.206682 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b143c5e9-3f80-4883-bf61-922b7338973f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.306306 Jul 27 20:15:26.207233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 414/816] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:25 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:26.760502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bbb32461-a0d1-4595-a346-a040adeb015a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:26.762685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bbb32461-a0d1-4595-a346-a040adeb015a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:26.769177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bbb32461-a0d1-4595-a346-a040adeb015a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:26.769630 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bbb32461-a0d1-4595-a346-a040adeb015a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:26.770396 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bbb32461-a0d1-4595-a346-a040adeb015a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:26.770834 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bbb32461-a0d1-4595-a346-a040adeb015a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:26.798807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bbb32461-a0d1-4595-a346-a040adeb015a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042966 Jul 27 20:15:26.799361 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 403/817] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:26 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:27.228781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-97e45451-f62a-4f1d-bbaf-8a1a33b20be3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:27.229412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-97e45451-f62a-4f1d-bbaf-8a1a33b20be3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:27.235789 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-97e45451-f62a-4f1d-bbaf-8a1a33b20be3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:27.236234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-97e45451-f62a-4f1d-bbaf-8a1a33b20be3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:27.237004 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-97e45451-f62a-4f1d-bbaf-8a1a33b20be3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:27.237441 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-97e45451-f62a-4f1d-bbaf-8a1a33b20be3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:27.368777 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-97e45451-f62a-4f1d-bbaf-8a1a33b20be3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:27.376252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-97e45451-f62a-4f1d-bbaf-8a1a33b20be3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.151789 Jul 27 20:15:27.376815 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 415/818] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:27 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:27.811346 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3b9e1bce-3fcb-4189-9c48-1caf1e3d731f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:27.813535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3b9e1bce-3fcb-4189-9c48-1caf1e3d731f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:27.820826 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b9e1bce-3fcb-4189-9c48-1caf1e3d731f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:27.821306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b9e1bce-3fcb-4189-9c48-1caf1e3d731f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:27.822102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b9e1bce-3fcb-4189-9c48-1caf1e3d731f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:27.822546 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b9e1bce-3fcb-4189-9c48-1caf1e3d731f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:27.850743 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3b9e1bce-3fcb-4189-9c48-1caf1e3d731f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043384 Jul 27 20:15:27.851764 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 404/819] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:27 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:28.397721 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-52d4e0f3-e41e-4c33-8ff3-68e166c3eb72 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:28.398940 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-52d4e0f3-e41e-4c33-8ff3-68e166c3eb72 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:28.405434 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-52d4e0f3-e41e-4c33-8ff3-68e166c3eb72 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:28.405885 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-52d4e0f3-e41e-4c33-8ff3-68e166c3eb72 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:28.406648 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-52d4e0f3-e41e-4c33-8ff3-68e166c3eb72 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:28.407093 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-52d4e0f3-e41e-4c33-8ff3-68e166c3eb72 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:28.535978 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-52d4e0f3-e41e-4c33-8ff3-68e166c3eb72 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:28.543532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-52d4e0f3-e41e-4c33-8ff3-68e166c3eb72 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.149722 Jul 27 20:15:28.544096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 416/820] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:28 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:28.863329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-036d2030-4544-4516-9be2-a02f98499c9f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:28.865608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-036d2030-4544-4516-9be2-a02f98499c9f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:28.873316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-036d2030-4544-4516-9be2-a02f98499c9f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:28.873765 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-036d2030-4544-4516-9be2-a02f98499c9f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:28.874530 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-036d2030-4544-4516-9be2-a02f98499c9f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:28.874973 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-036d2030-4544-4516-9be2-a02f98499c9f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:28.904513 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-036d2030-4544-4516-9be2-a02f98499c9f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045194 Jul 27 20:15:28.905292 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 405/821] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:28 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:29.565164 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-644f63b7-c1af-487c-8348-aefe55260827 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:29.566024 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-644f63b7-c1af-487c-8348-aefe55260827 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:29.573024 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-644f63b7-c1af-487c-8348-aefe55260827 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:29.573473 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-644f63b7-c1af-487c-8348-aefe55260827 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:29.574231 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-644f63b7-c1af-487c-8348-aefe55260827 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:29.574661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-644f63b7-c1af-487c-8348-aefe55260827 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:29.703989 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-644f63b7-c1af-487c-8348-aefe55260827 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:29.711459 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-644f63b7-c1af-487c-8348-aefe55260827 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.150206 Jul 27 20:15:29.712008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 417/822] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:29 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:29.917392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3da55b38-9e55-4b86-9613-122174906414 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:29.919541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3da55b38-9e55-4b86-9613-122174906414 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:29.925958 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3da55b38-9e55-4b86-9613-122174906414 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:29.926405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3da55b38-9e55-4b86-9613-122174906414 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:29.927170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3da55b38-9e55-4b86-9613-122174906414 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:29.927604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3da55b38-9e55-4b86-9613-122174906414 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:29.956311 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3da55b38-9e55-4b86-9613-122174906414 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043412 Jul 27 20:15:29.956857 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 406/823] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:29 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:30.731735 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a3085ee1-f2a9-46c5-b16e-6b4b81654757 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:30.732371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a3085ee1-f2a9-46c5-b16e-6b4b81654757 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:30.738777 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a3085ee1-f2a9-46c5-b16e-6b4b81654757 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:30.739222 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a3085ee1-f2a9-46c5-b16e-6b4b81654757 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:30.739987 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a3085ee1-f2a9-46c5-b16e-6b4b81654757 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:30.740424 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a3085ee1-f2a9-46c5-b16e-6b4b81654757 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:30.871330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a3085ee1-f2a9-46c5-b16e-6b4b81654757 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:30.878709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a3085ee1-f2a9-46c5-b16e-6b4b81654757 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.150794 Jul 27 20:15:30.879273 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 418/824] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:30 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:30.968654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-99065998-c7d5-469f-9fc5-b821e1381405 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:30.970818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-99065998-c7d5-469f-9fc5-b821e1381405 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:30.977235 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99065998-c7d5-469f-9fc5-b821e1381405 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:30.977678 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99065998-c7d5-469f-9fc5-b821e1381405 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:30.978430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99065998-c7d5-469f-9fc5-b821e1381405 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:30.978855 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99065998-c7d5-469f-9fc5-b821e1381405 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:31.008656 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-99065998-c7d5-469f-9fc5-b821e1381405 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043732 Jul 27 20:15:31.009255 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 407/825] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:30 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:31.901247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0487b1f4-2118-49f0-8e1b-15a58dea12c0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:31.901850 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0487b1f4-2118-49f0-8e1b-15a58dea12c0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:31.908204 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0487b1f4-2118-49f0-8e1b-15a58dea12c0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:31.908660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0487b1f4-2118-49f0-8e1b-15a58dea12c0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:31.909445 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0487b1f4-2118-49f0-8e1b-15a58dea12c0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:31.909885 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0487b1f4-2118-49f0-8e1b-15a58dea12c0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:32.020907 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3856b40f-a172-4a93-83ec-06659aa4aa6e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:32.023649 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3856b40f-a172-4a93-83ec-06659aa4aa6e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:32.030103 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3856b40f-a172-4a93-83ec-06659aa4aa6e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:32.030545 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3856b40f-a172-4a93-83ec-06659aa4aa6e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:32.031306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3856b40f-a172-4a93-83ec-06659aa4aa6e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:32.031733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3856b40f-a172-4a93-83ec-06659aa4aa6e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:32.048021 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0487b1f4-2118-49f0-8e1b-15a58dea12c0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:32.055688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0487b1f4-2118-49f0-8e1b-15a58dea12c0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.159117 Jul 27 20:15:32.056269 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 419/826] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:31 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:32.062928 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3856b40f-a172-4a93-83ec-06659aa4aa6e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045970 Jul 27 20:15:32.063473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 408/827] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:32 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:15:33.075921 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-90f3105a-ff27-425e-aa77-ccc1925b546e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:33.076377 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1f2dd60f-70e4-4136-9fac-342a8fed41f2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:33.076755 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1f2dd60f-70e4-4136-9fac-342a8fed41f2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:33.077921 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-90f3105a-ff27-425e-aa77-ccc1925b546e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:33.082919 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1f2dd60f-70e4-4136-9fac-342a8fed41f2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:33.083367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1f2dd60f-70e4-4136-9fac-342a8fed41f2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:33.083956 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90f3105a-ff27-425e-aa77-ccc1925b546e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:33.084127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1f2dd60f-70e4-4136-9fac-342a8fed41f2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:33.084438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90f3105a-ff27-425e-aa77-ccc1925b546e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:33.084560 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1f2dd60f-70e4-4136-9fac-342a8fed41f2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:33.085760 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90f3105a-ff27-425e-aa77-ccc1925b546e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:33.086176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90f3105a-ff27-425e-aa77-ccc1925b546e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:33.119286 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-90f3105a-ff27-425e-aa77-ccc1925b546e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047532 Jul 27 20:15:33.119896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 420/828] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:33 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:33.219249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1f2dd60f-70e4-4136-9fac-342a8fed41f2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:33.227601 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1f2dd60f-70e4-4136-9fac-342a8fed41f2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.155444 Jul 27 20:15:33.228177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 409/829] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:33 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:15:34.131573 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b5167bb9-89b5-4b41-b8a5-7e9178b06db6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:34.134412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b5167bb9-89b5-4b41-b8a5-7e9178b06db6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:34.140819 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b5167bb9-89b5-4b41-b8a5-7e9178b06db6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:34.141301 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b5167bb9-89b5-4b41-b8a5-7e9178b06db6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:34.142050 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b5167bb9-89b5-4b41-b8a5-7e9178b06db6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:34.142481 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b5167bb9-89b5-4b41-b8a5-7e9178b06db6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:34.156504 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:34.171251 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b5167bb9-89b5-4b41-b8a5-7e9178b06db6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043684 Jul 27 20:15:34.171783 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 421/830] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:34 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:34.248249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-911bc47f-0129-4888-aa73-9021ae664c8d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:34.248849 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-911bc47f-0129-4888-aa73-9021ae664c8d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:34.255291 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-911bc47f-0129-4888-aa73-9021ae664c8d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:34.255737 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-911bc47f-0129-4888-aa73-9021ae664c8d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:34.256498 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-911bc47f-0129-4888-aa73-9021ae664c8d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:34.257729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-911bc47f-0129-4888-aa73-9021ae664c8d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:34.614650 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-911bc47f-0129-4888-aa73-9021ae664c8d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:34.622202 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-911bc47f-0129-4888-aa73-9021ae664c8d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.377761 Jul 27 20:15:34.622758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 410/831] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:34 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:35.184209 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-18ad6788-ae68-41cd-810a-026a1c8ed216 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:35.186340 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-18ad6788-ae68-41cd-810a-026a1c8ed216 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:35.193067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-18ad6788-ae68-41cd-810a-026a1c8ed216 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:35.193523 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-18ad6788-ae68-41cd-810a-026a1c8ed216 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:35.194295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-18ad6788-ae68-41cd-810a-026a1c8ed216 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:35.194744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-18ad6788-ae68-41cd-810a-026a1c8ed216 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:35.222241 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-18ad6788-ae68-41cd-810a-026a1c8ed216 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042084 Jul 27 20:15:35.222781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 422/832] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:35 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:35.643093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7cf8c192-c6a6-41d0-a3ee-f6207efdedcc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:35.643696 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7cf8c192-c6a6-41d0-a3ee-f6207efdedcc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:35.650461 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7cf8c192-c6a6-41d0-a3ee-f6207efdedcc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:35.650898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7cf8c192-c6a6-41d0-a3ee-f6207efdedcc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:35.651646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7cf8c192-c6a6-41d0-a3ee-f6207efdedcc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:35.652066 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7cf8c192-c6a6-41d0-a3ee-f6207efdedcc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:35.782148 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7cf8c192-c6a6-41d0-a3ee-f6207efdedcc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:35.790190 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7cf8c192-c6a6-41d0-a3ee-f6207efdedcc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.150961 Jul 27 20:15:35.790810 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 411/833] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:35 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:36.234898 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-19049ed5-dda1-4c7d-9e6e-46eb05b0c1c7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:36.237035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-19049ed5-dda1-4c7d-9e6e-46eb05b0c1c7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:36.243593 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19049ed5-dda1-4c7d-9e6e-46eb05b0c1c7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:36.244066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19049ed5-dda1-4c7d-9e6e-46eb05b0c1c7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:36.244818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19049ed5-dda1-4c7d-9e6e-46eb05b0c1c7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:36.245276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19049ed5-dda1-4c7d-9e6e-46eb05b0c1c7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:36.273062 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-19049ed5-dda1-4c7d-9e6e-46eb05b0c1c7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041558 Jul 27 20:15:36.273634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 423/834] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:36 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:36.811025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-980f215f-8a0c-4279-a8db-79ec42bc8771 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:36.811605 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-980f215f-8a0c-4279-a8db-79ec42bc8771 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:36.818260 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-980f215f-8a0c-4279-a8db-79ec42bc8771 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:36.818700 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-980f215f-8a0c-4279-a8db-79ec42bc8771 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:36.819443 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-980f215f-8a0c-4279-a8db-79ec42bc8771 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:36.820472 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-980f215f-8a0c-4279-a8db-79ec42bc8771 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:36.954092 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-980f215f-8a0c-4279-a8db-79ec42bc8771 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:36.961504 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-980f215f-8a0c-4279-a8db-79ec42bc8771 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.154348 Jul 27 20:15:36.962069 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 412/835] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:36 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:37.285723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d48eaae0-746e-4998-bb52-9533b15ab544 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:37.288688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d48eaae0-746e-4998-bb52-9533b15ab544 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:37.295416 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d48eaae0-746e-4998-bb52-9533b15ab544 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:37.295869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d48eaae0-746e-4998-bb52-9533b15ab544 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:37.296627 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d48eaae0-746e-4998-bb52-9533b15ab544 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:37.297105 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d48eaae0-746e-4998-bb52-9533b15ab544 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:37.325557 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d48eaae0-746e-4998-bb52-9533b15ab544 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043843 Jul 27 20:15:37.326099 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 424/836] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:37 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:37.983334 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fb6a05b4-d578-4d0a-80eb-1fbb64e9d275 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:37.983959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fb6a05b4-d578-4d0a-80eb-1fbb64e9d275 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:37.990495 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fb6a05b4-d578-4d0a-80eb-1fbb64e9d275 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:37.990932 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fb6a05b4-d578-4d0a-80eb-1fbb64e9d275 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:37.991831 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fb6a05b4-d578-4d0a-80eb-1fbb64e9d275 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:37.992260 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fb6a05b4-d578-4d0a-80eb-1fbb64e9d275 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:38.133933 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fb6a05b4-d578-4d0a-80eb-1fbb64e9d275 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:38.144684 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fb6a05b4-d578-4d0a-80eb-1fbb64e9d275 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.165275 Jul 27 20:15:38.145682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 413/837] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:37 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:38.339624 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-44e4579a-feab-47d3-ac01-f21c4ac9afe2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:38.343114 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-44e4579a-feab-47d3-ac01-f21c4ac9afe2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:38.354299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-44e4579a-feab-47d3-ac01-f21c4ac9afe2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:38.354755 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-44e4579a-feab-47d3-ac01-f21c4ac9afe2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:38.355536 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-44e4579a-feab-47d3-ac01-f21c4ac9afe2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:38.355980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-44e4579a-feab-47d3-ac01-f21c4ac9afe2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:38.387384 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-44e4579a-feab-47d3-ac01-f21c4ac9afe2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053398 Jul 27 20:15:38.387954 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 425/838] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:38 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:39.166561 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fde0f57a-f623-4a8b-9bfd-318168277a40 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:39.167170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fde0f57a-f623-4a8b-9bfd-318168277a40 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:39.173626 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fde0f57a-f623-4a8b-9bfd-318168277a40 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:39.174072 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fde0f57a-f623-4a8b-9bfd-318168277a40 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:39.174830 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fde0f57a-f623-4a8b-9bfd-318168277a40 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:39.175260 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fde0f57a-f623-4a8b-9bfd-318168277a40 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:39.307997 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fde0f57a-f623-4a8b-9bfd-318168277a40 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:39.315912 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fde0f57a-f623-4a8b-9bfd-318168277a40 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.153079 Jul 27 20:15:39.316491 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 414/839] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:39 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:39.399872 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f14f397d-fea7-4d53-93da-0f4df35c484a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:39.402093 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f14f397d-fea7-4d53-93da-0f4df35c484a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:39.409175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f14f397d-fea7-4d53-93da-0f4df35c484a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:39.409995 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f14f397d-fea7-4d53-93da-0f4df35c484a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:39.411365 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f14f397d-fea7-4d53-93da-0f4df35c484a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:39.411817 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f14f397d-fea7-4d53-93da-0f4df35c484a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:39.446932 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f14f397d-fea7-4d53-93da-0f4df35c484a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051007 Jul 27 20:15:39.447522 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 426/840] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:39 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:40.338303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-75c3c669-a9c2-427b-b231-1b69251d42f1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:40.338845 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-75c3c669-a9c2-427b-b231-1b69251d42f1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:40.345300 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-75c3c669-a9c2-427b-b231-1b69251d42f1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:40.345745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-75c3c669-a9c2-427b-b231-1b69251d42f1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:40.346525 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-75c3c669-a9c2-427b-b231-1b69251d42f1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:40.346958 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-75c3c669-a9c2-427b-b231-1b69251d42f1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:40.462064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7dab620e-dbbf-49ad-80f5-c08e29252f3e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:40.464290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7dab620e-dbbf-49ad-80f5-c08e29252f3e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:40.470783 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7dab620e-dbbf-49ad-80f5-c08e29252f3e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:40.471233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7dab620e-dbbf-49ad-80f5-c08e29252f3e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:40.471991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7dab620e-dbbf-49ad-80f5-c08e29252f3e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:40.472424 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7dab620e-dbbf-49ad-80f5-c08e29252f3e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:40.479140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-75c3c669-a9c2-427b-b231-1b69251d42f1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:40.486556 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-75c3c669-a9c2-427b-b231-1b69251d42f1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.152691 Jul 27 20:15:40.487262 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 415/841] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:40 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:40.501209 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7dab620e-dbbf-49ad-80f5-c08e29252f3e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045792 Jul 27 20:15:40.501768 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 427/842] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:40 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:15:41.508116 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e4c05c0b-8d1c-4146-9735-9416cac9d6fb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:41.509322 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e4c05c0b-8d1c-4146-9735-9416cac9d6fb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:41.513925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fd21ce87-4794-4bd1-90a5-fba7377571f7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:41.515715 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4c05c0b-8d1c-4146-9735-9416cac9d6fb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:41.516080 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fd21ce87-4794-4bd1-90a5-fba7377571f7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:41.516192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4c05c0b-8d1c-4146-9735-9416cac9d6fb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:41.516892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4c05c0b-8d1c-4146-9735-9416cac9d6fb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:41.517344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4c05c0b-8d1c-4146-9735-9416cac9d6fb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:41.522678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fd21ce87-4794-4bd1-90a5-fba7377571f7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:41.523126 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fd21ce87-4794-4bd1-90a5-fba7377571f7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:41.523892 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fd21ce87-4794-4bd1-90a5-fba7377571f7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:41.524330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fd21ce87-4794-4bd1-90a5-fba7377571f7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:41.552588 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fd21ce87-4794-4bd1-90a5-fba7377571f7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042531 Jul 27 20:15:41.553181 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 428/843] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:41 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:41.647954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e4c05c0b-8d1c-4146-9735-9416cac9d6fb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:41.655434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e4c05c0b-8d1c-4146-9735-9416cac9d6fb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.151209 Jul 27 20:15:41.655995 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 416/844] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:41 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:42.566206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e8565b2e-aa6b-429a-be6c-19d9fb07dd72 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:42.568325 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e8565b2e-aa6b-429a-be6c-19d9fb07dd72 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:42.574711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8565b2e-aa6b-429a-be6c-19d9fb07dd72 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:42.575158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8565b2e-aa6b-429a-be6c-19d9fb07dd72 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:42.575914 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8565b2e-aa6b-429a-be6c-19d9fb07dd72 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:42.576346 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8565b2e-aa6b-429a-be6c-19d9fb07dd72 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:42.605159 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e8565b2e-aa6b-429a-be6c-19d9fb07dd72 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043111 Jul 27 20:15:42.605707 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 429/845] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:42 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:42.676935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-55d1c5f5-8763-43a3-bb4b-7c4e6aea625f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:42.677564 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-55d1c5f5-8763-43a3-bb4b-7c4e6aea625f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:42.684565 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55d1c5f5-8763-43a3-bb4b-7c4e6aea625f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:42.685041 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55d1c5f5-8763-43a3-bb4b-7c4e6aea625f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:42.685807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55d1c5f5-8763-43a3-bb4b-7c4e6aea625f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:42.686237 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55d1c5f5-8763-43a3-bb4b-7c4e6aea625f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:42.819275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-55d1c5f5-8763-43a3-bb4b-7c4e6aea625f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:42.826719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-55d1c5f5-8763-43a3-bb4b-7c4e6aea625f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.153870 Jul 27 20:15:42.827289 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 417/846] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:42 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:43.618280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b9efcbde-733a-488e-b046-ba263da74634 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:43.620414 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b9efcbde-733a-488e-b046-ba263da74634 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:43.626882 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b9efcbde-733a-488e-b046-ba263da74634 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:43.627343 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b9efcbde-733a-488e-b046-ba263da74634 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:43.628099 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b9efcbde-733a-488e-b046-ba263da74634 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:43.628534 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b9efcbde-733a-488e-b046-ba263da74634 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:43.656953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b9efcbde-733a-488e-b046-ba263da74634 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043230 Jul 27 20:15:43.657513 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 430/847] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:43 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:43.848004 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-beea2481-e8d6-49ed-8ea8-d419f0d5579b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:43.848599 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-beea2481-e8d6-49ed-8ea8-d419f0d5579b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:43.855514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-beea2481-e8d6-49ed-8ea8-d419f0d5579b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:43.855954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-beea2481-e8d6-49ed-8ea8-d419f0d5579b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:43.856699 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-beea2481-e8d6-49ed-8ea8-d419f0d5579b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:43.857158 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-beea2481-e8d6-49ed-8ea8-d419f0d5579b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:43.987188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-beea2481-e8d6-49ed-8ea8-d419f0d5579b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:43.989339 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:43.996430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-beea2481-e8d6-49ed-8ea8-d419f0d5579b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.152188 Jul 27 20:15:43.997008 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 418/848] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:43 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:44.668529 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-520693cc-6565-4c56-8dd8-160c88f945d8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:44.670735 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-520693cc-6565-4c56-8dd8-160c88f945d8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:44.677134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-520693cc-6565-4c56-8dd8-160c88f945d8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:44.677583 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-520693cc-6565-4c56-8dd8-160c88f945d8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:44.678337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-520693cc-6565-4c56-8dd8-160c88f945d8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:44.678770 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-520693cc-6565-4c56-8dd8-160c88f945d8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:44.708211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-520693cc-6565-4c56-8dd8-160c88f945d8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043572 Jul 27 20:15:44.708764 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 431/849] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:44 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:45.017558 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-be24900a-15e0-412e-a5e5-f5a02d4cbdb8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:45.018162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-be24900a-15e0-412e-a5e5-f5a02d4cbdb8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:45.024651 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-be24900a-15e0-412e-a5e5-f5a02d4cbdb8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:45.025128 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-be24900a-15e0-412e-a5e5-f5a02d4cbdb8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:45.025887 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-be24900a-15e0-412e-a5e5-f5a02d4cbdb8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:45.026339 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-be24900a-15e0-412e-a5e5-f5a02d4cbdb8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:45.159728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-be24900a-15e0-412e-a5e5-f5a02d4cbdb8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:45.167268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-be24900a-15e0-412e-a5e5-f5a02d4cbdb8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.153782 Jul 27 20:15:45.167833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 419/850] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:45 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:45.721189 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4100f4d9-6f2a-458d-a471-b44234df9d3e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:45.723335 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4100f4d9-6f2a-458d-a471-b44234df9d3e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:45.730422 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4100f4d9-6f2a-458d-a471-b44234df9d3e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:45.730875 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4100f4d9-6f2a-458d-a471-b44234df9d3e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:45.731643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4100f4d9-6f2a-458d-a471-b44234df9d3e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:45.732090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4100f4d9-6f2a-458d-a471-b44234df9d3e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:45.760476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4100f4d9-6f2a-458d-a471-b44234df9d3e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043244 Jul 27 20:15:45.761066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 432/851] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:45 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:46.188173 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-072eeb87-a310-4d4b-b808-da1266644758 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:46.188782 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-072eeb87-a310-4d4b-b808-da1266644758 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:46.196400 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-072eeb87-a310-4d4b-b808-da1266644758 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:46.196850 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-072eeb87-a310-4d4b-b808-da1266644758 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:46.197646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-072eeb87-a310-4d4b-b808-da1266644758 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:46.198087 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-072eeb87-a310-4d4b-b808-da1266644758 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:46.327838 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-072eeb87-a310-4d4b-b808-da1266644758 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:46.335088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-072eeb87-a310-4d4b-b808-da1266644758 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.150791 Jul 27 20:15:46.335736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 420/852] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:46 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:46.775360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2de1d335-51e1-4380-9b39-a63c7a0c1f4b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:46.777567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2de1d335-51e1-4380-9b39-a63c7a0c1f4b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:46.784195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2de1d335-51e1-4380-9b39-a63c7a0c1f4b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:46.784652 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2de1d335-51e1-4380-9b39-a63c7a0c1f4b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:46.785450 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2de1d335-51e1-4380-9b39-a63c7a0c1f4b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:46.785895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2de1d335-51e1-4380-9b39-a63c7a0c1f4b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:46.815123 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2de1d335-51e1-4380-9b39-a63c7a0c1f4b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043560 Jul 27 20:15:46.816325 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 433/853] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:46 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:47.357438 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a4c51399-3581-4a22-99bb-58f06a94ebce tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:47.357966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a4c51399-3581-4a22-99bb-58f06a94ebce tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:47.359951 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=54 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:47.365273 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a4c51399-3581-4a22-99bb-58f06a94ebce tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:47.365722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a4c51399-3581-4a22-99bb-58f06a94ebce tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:47.366481 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a4c51399-3581-4a22-99bb-58f06a94ebce tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:47.366915 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a4c51399-3581-4a22-99bb-58f06a94ebce tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:47.502713 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a4c51399-3581-4a22-99bb-58f06a94ebce tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:47.510131 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a4c51399-3581-4a22-99bb-58f06a94ebce tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.156630 Jul 27 20:15:47.510681 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 421/854] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:47 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:47.829130 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-12e5c85e-3baa-4d0e-9245-5a26570ed601 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:47.831269 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-12e5c85e-3baa-4d0e-9245-5a26570ed601 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:47.838345 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-12e5c85e-3baa-4d0e-9245-5a26570ed601 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:47.838797 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-12e5c85e-3baa-4d0e-9245-5a26570ed601 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:47.839557 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-12e5c85e-3baa-4d0e-9245-5a26570ed601 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:47.839993 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-12e5c85e-3baa-4d0e-9245-5a26570ed601 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:47.867518 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-12e5c85e-3baa-4d0e-9245-5a26570ed601 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042388 Jul 27 20:15:47.868053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 434/855] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:47 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:48.531457 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e42ed1a9-98d8-4fad-87e7-9d3cab24d438 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:48.532097 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e42ed1a9-98d8-4fad-87e7-9d3cab24d438 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:48.538617 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e42ed1a9-98d8-4fad-87e7-9d3cab24d438 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:48.539667 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e42ed1a9-98d8-4fad-87e7-9d3cab24d438 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:48.540614 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e42ed1a9-98d8-4fad-87e7-9d3cab24d438 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:48.541085 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e42ed1a9-98d8-4fad-87e7-9d3cab24d438 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:48.671381 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e42ed1a9-98d8-4fad-87e7-9d3cab24d438 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:48.678773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e42ed1a9-98d8-4fad-87e7-9d3cab24d438 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.151206 Jul 27 20:15:48.679970 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 422/856] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:48 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:48.879815 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8e89a094-d75b-4d05-accf-6e3ce68151d8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:48.882276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8e89a094-d75b-4d05-accf-6e3ce68151d8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:48.889595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8e89a094-d75b-4d05-accf-6e3ce68151d8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:48.890039 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8e89a094-d75b-4d05-accf-6e3ce68151d8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:48.890797 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8e89a094-d75b-4d05-accf-6e3ce68151d8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:48.891238 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8e89a094-d75b-4d05-accf-6e3ce68151d8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:48.921642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8e89a094-d75b-4d05-accf-6e3ce68151d8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045815 Jul 27 20:15:48.922204 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 435/857] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:48 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:49.700542 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4bd3cbf8-9a98-4e37-91cb-71c7127b834c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:49.701179 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4bd3cbf8-9a98-4e37-91cb-71c7127b834c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:49.707572 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4bd3cbf8-9a98-4e37-91cb-71c7127b834c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:49.708019 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4bd3cbf8-9a98-4e37-91cb-71c7127b834c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:49.708777 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4bd3cbf8-9a98-4e37-91cb-71c7127b834c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:49.709238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4bd3cbf8-9a98-4e37-91cb-71c7127b834c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:49.841231 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4bd3cbf8-9a98-4e37-91cb-71c7127b834c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:49.848718 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4bd3cbf8-9a98-4e37-91cb-71c7127b834c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.152073 Jul 27 20:15:49.849338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 423/858] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:49 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:49.933835 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9ef00d60-374d-494d-8290-8e6c0dca2b99 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:49.935991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9ef00d60-374d-494d-8290-8e6c0dca2b99 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:49.942755 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ef00d60-374d-494d-8290-8e6c0dca2b99 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:49.943205 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ef00d60-374d-494d-8290-8e6c0dca2b99 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:49.943974 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ef00d60-374d-494d-8290-8e6c0dca2b99 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:49.944424 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ef00d60-374d-494d-8290-8e6c0dca2b99 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:49.972485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9ef00d60-374d-494d-8290-8e6c0dca2b99 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043238 Jul 27 20:15:49.972954 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 436/859] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:49 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:50.870165 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3432794a-b80c-450a-98c3-d05835370df7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:50.870778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3432794a-b80c-450a-98c3-d05835370df7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:50.877676 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3432794a-b80c-450a-98c3-d05835370df7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:50.878129 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3432794a-b80c-450a-98c3-d05835370df7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:50.878892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3432794a-b80c-450a-98c3-d05835370df7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:50.879338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3432794a-b80c-450a-98c3-d05835370df7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:50.984520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a6957ba8-a1aa-4fa4-b227-958bf7c4dcde tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:50.986792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a6957ba8-a1aa-4fa4-b227-958bf7c4dcde tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:50.993527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6957ba8-a1aa-4fa4-b227-958bf7c4dcde tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:50.993982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6957ba8-a1aa-4fa4-b227-958bf7c4dcde tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:50.994763 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6957ba8-a1aa-4fa4-b227-958bf7c4dcde tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:50.995211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6957ba8-a1aa-4fa4-b227-958bf7c4dcde tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:51.015979 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3432794a-b80c-450a-98c3-d05835370df7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:51.024106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3432794a-b80c-450a-98c3-d05835370df7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.157753 Jul 27 20:15:51.024692 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 424/860] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:50 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:51.025362 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a6957ba8-a1aa-4fa4-b227-958bf7c4dcde tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044686 Jul 27 20:15:51.025933 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 437/861] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:50 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:15:52.037113 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d862fa9a-afd2-4966-974b-769bb6ccbab2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:52.039337 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d862fa9a-afd2-4966-974b-769bb6ccbab2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:52.044881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-247ac3c7-db9f-4ea8-95d6-2a8891d129ca tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:52.045530 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-247ac3c7-db9f-4ea8-95d6-2a8891d129ca tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:52.046245 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d862fa9a-afd2-4966-974b-769bb6ccbab2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:52.046801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d862fa9a-afd2-4966-974b-769bb6ccbab2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:52.047629 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d862fa9a-afd2-4966-974b-769bb6ccbab2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:52.048076 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d862fa9a-afd2-4966-974b-769bb6ccbab2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:52.051910 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-247ac3c7-db9f-4ea8-95d6-2a8891d129ca tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:52.052359 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-247ac3c7-db9f-4ea8-95d6-2a8891d129ca tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:52.053154 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-247ac3c7-db9f-4ea8-95d6-2a8891d129ca tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:52.053648 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-247ac3c7-db9f-4ea8-95d6-2a8891d129ca tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:52.056940 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:52.078572 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d862fa9a-afd2-4966-974b-769bb6ccbab2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045555 Jul 27 20:15:52.079338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 425/862] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:52 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:52.197381 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-247ac3c7-db9f-4ea8-95d6-2a8891d129ca tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:52.204831 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-247ac3c7-db9f-4ea8-95d6-2a8891d129ca tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.163799 Jul 27 20:15:52.205412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 438/863] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:52 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:15:53.091121 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c76f815e-c497-45ac-91ee-76d0ed3aef07 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:53.093380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c76f815e-c497-45ac-91ee-76d0ed3aef07 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:53.099828 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c76f815e-c497-45ac-91ee-76d0ed3aef07 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:53.100275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c76f815e-c497-45ac-91ee-76d0ed3aef07 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:53.101668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c76f815e-c497-45ac-91ee-76d0ed3aef07 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:53.102181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c76f815e-c497-45ac-91ee-76d0ed3aef07 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:53.131912 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c76f815e-c497-45ac-91ee-76d0ed3aef07 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044746 Jul 27 20:15:53.132506 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 426/864] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:53 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:53.226706 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4bcc9e59-decc-4d41-adc2-864e5afd932f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:53.227342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4bcc9e59-decc-4d41-adc2-864e5afd932f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:53.233812 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4bcc9e59-decc-4d41-adc2-864e5afd932f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:53.234261 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4bcc9e59-decc-4d41-adc2-864e5afd932f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:53.235020 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4bcc9e59-decc-4d41-adc2-864e5afd932f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:53.235456 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4bcc9e59-decc-4d41-adc2-864e5afd932f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:53.367213 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4bcc9e59-decc-4d41-adc2-864e5afd932f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:53.374796 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4bcc9e59-decc-4d41-adc2-864e5afd932f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.152570 Jul 27 20:15:53.375357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 439/865] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:53 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:15:54.143671 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4d9566ac-7bd7-402b-a6e0-07dc6a8c7772 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:54.145860 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4d9566ac-7bd7-402b-a6e0-07dc6a8c7772 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:54.154947 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4d9566ac-7bd7-402b-a6e0-07dc6a8c7772 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:54.155398 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4d9566ac-7bd7-402b-a6e0-07dc6a8c7772 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:54.156171 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4d9566ac-7bd7-402b-a6e0-07dc6a8c7772 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:54.156610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4d9566ac-7bd7-402b-a6e0-07dc6a8c7772 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:54.185641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4d9566ac-7bd7-402b-a6e0-07dc6a8c7772 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045975 Jul 27 20:15:54.186203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 427/866] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:54 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:54.395619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-68a638e4-e6bc-49fc-afc9-03380bf42427 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:54.396228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-68a638e4-e6bc-49fc-afc9-03380bf42427 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:54.402950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-68a638e4-e6bc-49fc-afc9-03380bf42427 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:54.403483 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-68a638e4-e6bc-49fc-afc9-03380bf42427 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:54.404241 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-68a638e4-e6bc-49fc-afc9-03380bf42427 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:54.404685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-68a638e4-e6bc-49fc-afc9-03380bf42427 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:54.532190 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-68a638e4-e6bc-49fc-afc9-03380bf42427 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:54.540435 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-68a638e4-e6bc-49fc-afc9-03380bf42427 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.148700 Jul 27 20:15:54.541016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 440/867] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:54 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:55.198147 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a2901dd4-f8de-4d47-801d-4993ae331e79 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:55.200283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a2901dd4-f8de-4d47-801d-4993ae331e79 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:55.206826 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a2901dd4-f8de-4d47-801d-4993ae331e79 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:55.207275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a2901dd4-f8de-4d47-801d-4993ae331e79 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:55.208036 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a2901dd4-f8de-4d47-801d-4993ae331e79 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:55.208473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a2901dd4-f8de-4d47-801d-4993ae331e79 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:55.236610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a2901dd4-f8de-4d47-801d-4993ae331e79 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042908 Jul 27 20:15:55.237175 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 428/868] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:55 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:55.561436 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2ef89128-58f6-4ebc-b386-af176886b02f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:55.562058 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2ef89128-58f6-4ebc-b386-af176886b02f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:55.568786 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ef89128-58f6-4ebc-b386-af176886b02f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:55.569277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ef89128-58f6-4ebc-b386-af176886b02f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:55.570613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ef89128-58f6-4ebc-b386-af176886b02f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:55.571053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ef89128-58f6-4ebc-b386-af176886b02f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:55.703307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2ef89128-58f6-4ebc-b386-af176886b02f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:55.711032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2ef89128-58f6-4ebc-b386-af176886b02f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.153370 Jul 27 20:15:55.711600 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 441/869] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:55 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:56.248863 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c1f2ad3f-b272-407a-a73a-e4f5246c5b1b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:56.250997 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c1f2ad3f-b272-407a-a73a-e4f5246c5b1b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:56.257496 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1f2ad3f-b272-407a-a73a-e4f5246c5b1b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:56.258013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1f2ad3f-b272-407a-a73a-e4f5246c5b1b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:56.258764 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1f2ad3f-b272-407a-a73a-e4f5246c5b1b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:56.259192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1f2ad3f-b272-407a-a73a-e4f5246c5b1b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:56.286966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c1f2ad3f-b272-407a-a73a-e4f5246c5b1b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042015 Jul 27 20:15:56.287512 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 429/870] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:56 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:56.828777 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1641480f-2ed9-47f9-ba28-5bd215bf8f94 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:56.829427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1641480f-2ed9-47f9-ba28-5bd215bf8f94 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:56.831311 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=56 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:15:56.837534 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1641480f-2ed9-47f9-ba28-5bd215bf8f94 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:56.837992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1641480f-2ed9-47f9-ba28-5bd215bf8f94 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:56.838762 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1641480f-2ed9-47f9-ba28-5bd215bf8f94 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:56.839206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1641480f-2ed9-47f9-ba28-5bd215bf8f94 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:56.966033 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1641480f-2ed9-47f9-ba28-5bd215bf8f94 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:56.973803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1641480f-2ed9-47f9-ba28-5bd215bf8f94 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.245685 Jul 27 20:15:56.974396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 442/871] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:56 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:57.299853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7bb8d48b-6fcc-46a1-9ea2-27a1bcc6a191 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:57.301994 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7bb8d48b-6fcc-46a1-9ea2-27a1bcc6a191 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:57.309167 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7bb8d48b-6fcc-46a1-9ea2-27a1bcc6a191 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:57.309619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7bb8d48b-6fcc-46a1-9ea2-27a1bcc6a191 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:57.310456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7bb8d48b-6fcc-46a1-9ea2-27a1bcc6a191 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:57.310895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7bb8d48b-6fcc-46a1-9ea2-27a1bcc6a191 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:57.340001 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7bb8d48b-6fcc-46a1-9ea2-27a1bcc6a191 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044235 Jul 27 20:15:57.340552 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 430/872] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:57 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:57.995004 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bc98d1a3-f698-4766-917c-3184855f9f63 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:57.995599 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bc98d1a3-f698-4766-917c-3184855f9f63 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:58.002080 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bc98d1a3-f698-4766-917c-3184855f9f63 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:58.002524 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bc98d1a3-f698-4766-917c-3184855f9f63 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:58.003278 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bc98d1a3-f698-4766-917c-3184855f9f63 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:58.003708 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bc98d1a3-f698-4766-917c-3184855f9f63 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:58.137049 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bc98d1a3-f698-4766-917c-3184855f9f63 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:58.144437 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bc98d1a3-f698-4766-917c-3184855f9f63 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.153517 Jul 27 20:15:58.145009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 443/873] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:57 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:58.352130 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b3e5955b-8593-4ee2-af95-b93e94d4e5f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:58.354279 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b3e5955b-8593-4ee2-af95-b93e94d4e5f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:58.360806 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3e5955b-8593-4ee2-af95-b93e94d4e5f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:58.361275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3e5955b-8593-4ee2-af95-b93e94d4e5f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:58.362035 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3e5955b-8593-4ee2-af95-b93e94d4e5f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:58.362463 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3e5955b-8593-4ee2-af95-b93e94d4e5f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:58.390593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b3e5955b-8593-4ee2-af95-b93e94d4e5f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042784 Jul 27 20:15:58.391133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 431/874] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:58 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:15:59.166455 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f3f0cff8-216d-4b55-8977-21e1ebe7445e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:59.167000 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f3f0cff8-216d-4b55-8977-21e1ebe7445e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:59.173615 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f3f0cff8-216d-4b55-8977-21e1ebe7445e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:59.174071 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f3f0cff8-216d-4b55-8977-21e1ebe7445e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:59.174876 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f3f0cff8-216d-4b55-8977-21e1ebe7445e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:59.175321 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f3f0cff8-216d-4b55-8977-21e1ebe7445e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:59.304704 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f3f0cff8-216d-4b55-8977-21e1ebe7445e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:15:59.312101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f3f0cff8-216d-4b55-8977-21e1ebe7445e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.150157 Jul 27 20:15:59.312663 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 444/875] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:15:59 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:15:59.402588 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1d360129-107f-4943-9654-5b015c916a6e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:15:59.404784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1d360129-107f-4943-9654-5b015c916a6e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:15:59.411509 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d360129-107f-4943-9654-5b015c916a6e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:59.411960 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d360129-107f-4943-9654-5b015c916a6e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:59.412756 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d360129-107f-4943-9654-5b015c916a6e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:15:59.413228 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d360129-107f-4943-9654-5b015c916a6e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:15:59.443248 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1d360129-107f-4943-9654-5b015c916a6e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045099 Jul 27 20:15:59.443744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 432/876] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:15:59 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:00.333626 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f8fa1355-90e7-4cdc-a83c-b90ee878e168 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:00.334193 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f8fa1355-90e7-4cdc-a83c-b90ee878e168 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:00.340751 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f8fa1355-90e7-4cdc-a83c-b90ee878e168 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:00.341243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f8fa1355-90e7-4cdc-a83c-b90ee878e168 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:00.342018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f8fa1355-90e7-4cdc-a83c-b90ee878e168 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:00.342463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f8fa1355-90e7-4cdc-a83c-b90ee878e168 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:00.455517 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-263c1702-5a91-4912-b750-2fabdd6af505 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:00.457761 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-263c1702-5a91-4912-b750-2fabdd6af505 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:00.464202 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-263c1702-5a91-4912-b750-2fabdd6af505 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:00.464661 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-263c1702-5a91-4912-b750-2fabdd6af505 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:00.465459 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-263c1702-5a91-4912-b750-2fabdd6af505 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:00.465898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-263c1702-5a91-4912-b750-2fabdd6af505 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:00.473676 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f8fa1355-90e7-4cdc-a83c-b90ee878e168 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:00.482109 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f8fa1355-90e7-4cdc-a83c-b90ee878e168 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.152387 Jul 27 20:16:00.482678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 445/877] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:00 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:00.495344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-263c1702-5a91-4912-b750-2fabdd6af505 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043786 Jul 27 20:16:00.495901 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 433/878] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:00 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:16:01.503708 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-093f87a1-b4d8-44bc-bfcb-3ffbb302d3f2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:01.504401 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-093f87a1-b4d8-44bc-bfcb-3ffbb302d3f2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:01.506557 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0c2c4152-4756-4d11-8763-dea2e03b8e6a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:01.509315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0c2c4152-4756-4d11-8763-dea2e03b8e6a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:01.511670 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-093f87a1-b4d8-44bc-bfcb-3ffbb302d3f2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:01.512128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-093f87a1-b4d8-44bc-bfcb-3ffbb302d3f2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:01.512908 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-093f87a1-b4d8-44bc-bfcb-3ffbb302d3f2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:01.513389 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-093f87a1-b4d8-44bc-bfcb-3ffbb302d3f2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:01.515747 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c2c4152-4756-4d11-8763-dea2e03b8e6a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:01.516201 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c2c4152-4756-4d11-8763-dea2e03b8e6a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:01.516982 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c2c4152-4756-4d11-8763-dea2e03b8e6a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:01.517436 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c2c4152-4756-4d11-8763-dea2e03b8e6a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:01.545629 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0c2c4152-4756-4d11-8763-dea2e03b8e6a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042915 Jul 27 20:16:01.546190 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 434/879] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:01 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:16:01.642648 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-093f87a1-b4d8-44bc-bfcb-3ffbb302d3f2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:01.650356 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-093f87a1-b4d8-44bc-bfcb-3ffbb302d3f2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.150533 Jul 27 20:16:01.650921 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 446/880] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:01 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:02.557874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3f9465bf-1d0c-418e-8b5d-886a9a75509c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:02.560057 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3f9465bf-1d0c-418e-8b5d-886a9a75509c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:02.567012 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3f9465bf-1d0c-418e-8b5d-886a9a75509c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:02.567465 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3f9465bf-1d0c-418e-8b5d-886a9a75509c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:02.568234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3f9465bf-1d0c-418e-8b5d-886a9a75509c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:02.568674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3f9465bf-1d0c-418e-8b5d-886a9a75509c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:02.586830 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:02.603018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3f9465bf-1d0c-418e-8b5d-886a9a75509c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049248 Jul 27 20:16:02.603574 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 435/881] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:02 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:02.671432 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0451e49a-be95-4104-8a73-5a2dbe3de7e7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:02.672041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0451e49a-be95-4104-8a73-5a2dbe3de7e7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:02.678016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0451e49a-be95-4104-8a73-5a2dbe3de7e7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:02.678461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0451e49a-be95-4104-8a73-5a2dbe3de7e7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:02.679390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0451e49a-be95-4104-8a73-5a2dbe3de7e7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:02.679825 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0451e49a-be95-4104-8a73-5a2dbe3de7e7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:02.809422 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0451e49a-be95-4104-8a73-5a2dbe3de7e7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:02.817081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0451e49a-be95-4104-8a73-5a2dbe3de7e7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.149612 Jul 27 20:16:02.817648 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 447/882] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:02 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:03.615313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5c1e9b80-ff8f-4880-9aaf-dec8b55cd8da tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:03.618076 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5c1e9b80-ff8f-4880-9aaf-dec8b55cd8da tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:03.624474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c1e9b80-ff8f-4880-9aaf-dec8b55cd8da tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:03.624930 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c1e9b80-ff8f-4880-9aaf-dec8b55cd8da tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:03.625722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c1e9b80-ff8f-4880-9aaf-dec8b55cd8da tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:03.626159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c1e9b80-ff8f-4880-9aaf-dec8b55cd8da tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:03.654116 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5c1e9b80-ff8f-4880-9aaf-dec8b55cd8da tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042892 Jul 27 20:16:03.654659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 436/883] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:03 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:03.838955 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1a1d4351-3bf1-4686-8eda-c02f774646c1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:03.839584 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1a1d4351-3bf1-4686-8eda-c02f774646c1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:03.845990 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1a1d4351-3bf1-4686-8eda-c02f774646c1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:03.846444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1a1d4351-3bf1-4686-8eda-c02f774646c1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:03.847202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1a1d4351-3bf1-4686-8eda-c02f774646c1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:03.847634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1a1d4351-3bf1-4686-8eda-c02f774646c1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:03.983885 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1a1d4351-3bf1-4686-8eda-c02f774646c1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:03.991490 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1a1d4351-3bf1-4686-8eda-c02f774646c1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.156841 Jul 27 20:16:03.992055 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 448/884] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:03 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:16:04.666559 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8a612bc7-f05f-4303-9c75-fdec066ffa12 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:04.668697 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8a612bc7-f05f-4303-9c75-fdec066ffa12 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:04.675153 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8a612bc7-f05f-4303-9c75-fdec066ffa12 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:04.675600 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8a612bc7-f05f-4303-9c75-fdec066ffa12 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:04.676352 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8a612bc7-f05f-4303-9c75-fdec066ffa12 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:04.676782 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8a612bc7-f05f-4303-9c75-fdec066ffa12 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:04.704703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8a612bc7-f05f-4303-9c75-fdec066ffa12 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042642 Jul 27 20:16:04.705663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 437/885] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:04 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:05.012521 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3e456018-4a77-4da0-bdf4-a0076ce7f1a5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:05.013171 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3e456018-4a77-4da0-bdf4-a0076ce7f1a5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:05.019680 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3e456018-4a77-4da0-bdf4-a0076ce7f1a5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:05.020134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3e456018-4a77-4da0-bdf4-a0076ce7f1a5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:05.020902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3e456018-4a77-4da0-bdf4-a0076ce7f1a5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:05.021373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3e456018-4a77-4da0-bdf4-a0076ce7f1a5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:05.153095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3e456018-4a77-4da0-bdf4-a0076ce7f1a5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:05.160867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3e456018-4a77-4da0-bdf4-a0076ce7f1a5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.152438 Jul 27 20:16:05.161459 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 449/886] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:05 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:05.716895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2ca5a59a-a855-4f2a-9985-8a65b60b18a1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:05.719046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2ca5a59a-a855-4f2a-9985-8a65b60b18a1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:05.725517 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ca5a59a-a855-4f2a-9985-8a65b60b18a1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:05.725969 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ca5a59a-a855-4f2a-9985-8a65b60b18a1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:05.726726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ca5a59a-a855-4f2a-9985-8a65b60b18a1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:05.727632 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ca5a59a-a855-4f2a-9985-8a65b60b18a1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:05.755696 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2ca5a59a-a855-4f2a-9985-8a65b60b18a1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042717 Jul 27 20:16:05.756243 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 438/887] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:05 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:06.183407 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-36ce6244-df34-42a6-810f-70e1b48b0709 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:06.184053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-36ce6244-df34-42a6-810f-70e1b48b0709 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:06.190822 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-36ce6244-df34-42a6-810f-70e1b48b0709 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:06.191274 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-36ce6244-df34-42a6-810f-70e1b48b0709 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:06.192039 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-36ce6244-df34-42a6-810f-70e1b48b0709 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:06.192477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-36ce6244-df34-42a6-810f-70e1b48b0709 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:06.329652 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-36ce6244-df34-42a6-810f-70e1b48b0709 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:06.337074 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-36ce6244-df34-42a6-810f-70e1b48b0709 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.158120 Jul 27 20:16:06.337626 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 450/888] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:06 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:06.767832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2c0a6247-4bdb-48eb-b6ad-ea02c3eae788 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:06.769995 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2c0a6247-4bdb-48eb-b6ad-ea02c3eae788 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:06.777157 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c0a6247-4bdb-48eb-b6ad-ea02c3eae788 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:06.777609 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c0a6247-4bdb-48eb-b6ad-ea02c3eae788 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:06.778372 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c0a6247-4bdb-48eb-b6ad-ea02c3eae788 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:06.778807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c0a6247-4bdb-48eb-b6ad-ea02c3eae788 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:06.807547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2c0a6247-4bdb-48eb-b6ad-ea02c3eae788 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043705 Jul 27 20:16:06.808106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 439/889] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:06 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:07.358286 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3c066f5a-ff78-4921-93fe-ed939d7f6fea tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:07.358814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3c066f5a-ff78-4921-93fe-ed939d7f6fea tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:07.365423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c066f5a-ff78-4921-93fe-ed939d7f6fea tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:07.365881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c066f5a-ff78-4921-93fe-ed939d7f6fea tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:07.366646 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c066f5a-ff78-4921-93fe-ed939d7f6fea tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:07.367084 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c066f5a-ff78-4921-93fe-ed939d7f6fea tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:07.494468 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3c066f5a-ff78-4921-93fe-ed939d7f6fea tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:07.501895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3c066f5a-ff78-4921-93fe-ed939d7f6fea tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.147573 Jul 27 20:16:07.502467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 451/890] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:07 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:07.820701 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-723b9941-ffac-44a8-a6db-3610b17a556c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:07.822841 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-723b9941-ffac-44a8-a6db-3610b17a556c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:07.829265 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-723b9941-ffac-44a8-a6db-3610b17a556c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:07.829715 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-723b9941-ffac-44a8-a6db-3610b17a556c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:07.830478 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-723b9941-ffac-44a8-a6db-3610b17a556c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:07.830910 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-723b9941-ffac-44a8-a6db-3610b17a556c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:07.858726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-723b9941-ffac-44a8-a6db-3610b17a556c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042861 Jul 27 20:16:07.859268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 440/891] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:07 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:08.524369 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d80dae21-ca3c-40b0-b9b7-1705edde1b78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:08.525005 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d80dae21-ca3c-40b0-b9b7-1705edde1b78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:08.531463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d80dae21-ca3c-40b0-b9b7-1705edde1b78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:08.531919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d80dae21-ca3c-40b0-b9b7-1705edde1b78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:08.532683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d80dae21-ca3c-40b0-b9b7-1705edde1b78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:08.533160 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d80dae21-ca3c-40b0-b9b7-1705edde1b78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:08.661057 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d80dae21-ca3c-40b0-b9b7-1705edde1b78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:08.668687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d80dae21-ca3c-40b0-b9b7-1705edde1b78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.148822 Jul 27 20:16:08.669283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 452/892] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:08 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:08.870933 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-381e84c4-54ab-40a7-bee6-876dd8facfd1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:08.873054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-381e84c4-54ab-40a7-bee6-876dd8facfd1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:08.880200 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-381e84c4-54ab-40a7-bee6-876dd8facfd1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:08.880650 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-381e84c4-54ab-40a7-bee6-876dd8facfd1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:08.881464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-381e84c4-54ab-40a7-bee6-876dd8facfd1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:08.882401 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-381e84c4-54ab-40a7-bee6-876dd8facfd1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:08.914402 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-381e84c4-54ab-40a7-bee6-876dd8facfd1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046712 Jul 27 20:16:08.914999 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 441/893] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:08 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:09.689170 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-270a9b82-0e85-43c2-8cd3-b29baa9fb42e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:09.689781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-270a9b82-0e85-43c2-8cd3-b29baa9fb42e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:09.696500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-270a9b82-0e85-43c2-8cd3-b29baa9fb42e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:09.696947 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-270a9b82-0e85-43c2-8cd3-b29baa9fb42e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:09.697727 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-270a9b82-0e85-43c2-8cd3-b29baa9fb42e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:09.698162 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-270a9b82-0e85-43c2-8cd3-b29baa9fb42e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:09.831358 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-270a9b82-0e85-43c2-8cd3-b29baa9fb42e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:09.839616 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-270a9b82-0e85-43c2-8cd3-b29baa9fb42e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.154293 Jul 27 20:16:09.840191 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 453/894] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:09 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:09.927078 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-316a3613-cf05-4990-b2ba-e5a9dccd25b8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:09.929313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-316a3613-cf05-4990-b2ba-e5a9dccd25b8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:09.935782 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-316a3613-cf05-4990-b2ba-e5a9dccd25b8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:09.936230 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-316a3613-cf05-4990-b2ba-e5a9dccd25b8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:09.937011 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-316a3613-cf05-4990-b2ba-e5a9dccd25b8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:09.937451 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-316a3613-cf05-4990-b2ba-e5a9dccd25b8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:09.966508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-316a3613-cf05-4990-b2ba-e5a9dccd25b8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043335 Jul 27 20:16:09.966991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 442/895] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:09 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:10.861796 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bbce1c5e-b41f-4f19-89d9-a1b3ac1bfa74 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:10.862412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bbce1c5e-b41f-4f19-89d9-a1b3ac1bfa74 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:10.869470 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bbce1c5e-b41f-4f19-89d9-a1b3ac1bfa74 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:10.869921 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bbce1c5e-b41f-4f19-89d9-a1b3ac1bfa74 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:10.870689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bbce1c5e-b41f-4f19-89d9-a1b3ac1bfa74 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:10.871124 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bbce1c5e-b41f-4f19-89d9-a1b3ac1bfa74 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:10.979956 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b11ec8f0-e875-4273-afe3-c0c2b62142ae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:10.982140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b11ec8f0-e875-4273-afe3-c0c2b62142ae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:10.988834 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b11ec8f0-e875-4273-afe3-c0c2b62142ae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:10.989338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b11ec8f0-e875-4273-afe3-c0c2b62142ae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:10.990183 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b11ec8f0-e875-4273-afe3-c0c2b62142ae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:10.990625 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b11ec8f0-e875-4273-afe3-c0c2b62142ae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:11.000195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bbce1c5e-b41f-4f19-89d9-a1b3ac1bfa74 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:11.002424 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:11.009371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bbce1c5e-b41f-4f19-89d9-a1b3ac1bfa74 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.151252 Jul 27 20:16:11.018353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 454/896] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:10 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:11.021009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b11ec8f0-e875-4273-afe3-c0c2b62142ae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045837 Jul 27 20:16:11.021561 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 443/897] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:10 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:16:12.030032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d4cc85da-50cb-4e54-b53e-626e64b00e3b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:12.030643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d4cc85da-50cb-4e54-b53e-626e64b00e3b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:12.033327 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-aa7014ea-be9b-4a01-90d3-3ff829cdcb15 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:12.035489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-aa7014ea-be9b-4a01-90d3-3ff829cdcb15 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:12.037267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d4cc85da-50cb-4e54-b53e-626e64b00e3b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:12.037715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d4cc85da-50cb-4e54-b53e-626e64b00e3b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:12.039281 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d4cc85da-50cb-4e54-b53e-626e64b00e3b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:12.039726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d4cc85da-50cb-4e54-b53e-626e64b00e3b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:12.042700 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa7014ea-be9b-4a01-90d3-3ff829cdcb15 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:12.043156 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa7014ea-be9b-4a01-90d3-3ff829cdcb15 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:12.043930 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa7014ea-be9b-4a01-90d3-3ff829cdcb15 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:12.044367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa7014ea-be9b-4a01-90d3-3ff829cdcb15 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:12.073735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-aa7014ea-be9b-4a01-90d3-3ff829cdcb15 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044395 Jul 27 20:16:12.074328 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 444/898] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:12 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:16:12.175379 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d4cc85da-50cb-4e54-b53e-626e64b00e3b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:12.183045 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d4cc85da-50cb-4e54-b53e-626e64b00e3b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.157211 Jul 27 20:16:12.183614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 455/899] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:12 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:13.085455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d40d7576-3005-4319-be4d-c85d5daa4449 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:13.087589 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d40d7576-3005-4319-be4d-c85d5daa4449 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:13.094116 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d40d7576-3005-4319-be4d-c85d5daa4449 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:13.094559 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d40d7576-3005-4319-be4d-c85d5daa4449 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:13.095319 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d40d7576-3005-4319-be4d-c85d5daa4449 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:13.095747 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d40d7576-3005-4319-be4d-c85d5daa4449 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:13.125482 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d40d7576-3005-4319-be4d-c85d5daa4449 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043918 Jul 27 20:16:13.126062 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 445/900] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:13 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:16:13.203597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-901bc55d-d518-49c5-bd2a-3f784aeafe19 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:13.204215 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-901bc55d-d518-49c5-bd2a-3f784aeafe19 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:13.210897 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-901bc55d-d518-49c5-bd2a-3f784aeafe19 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:13.211353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-901bc55d-d518-49c5-bd2a-3f784aeafe19 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:13.212120 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-901bc55d-d518-49c5-bd2a-3f784aeafe19 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:13.212565 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-901bc55d-d518-49c5-bd2a-3f784aeafe19 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:13.339836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-901bc55d-d518-49c5-bd2a-3f784aeafe19 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:13.347393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-901bc55d-d518-49c5-bd2a-3f784aeafe19 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.147579 Jul 27 20:16:13.347962 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 456/901] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:13 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:14.138811 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1984834f-9e5a-4d19-9118-ff5df17882b3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:14.140997 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1984834f-9e5a-4d19-9118-ff5df17882b3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:14.148184 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1984834f-9e5a-4d19-9118-ff5df17882b3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:14.148640 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1984834f-9e5a-4d19-9118-ff5df17882b3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:14.149443 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1984834f-9e5a-4d19-9118-ff5df17882b3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:14.149901 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1984834f-9e5a-4d19-9118-ff5df17882b3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:14.177900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1984834f-9e5a-4d19-9118-ff5df17882b3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043216 Jul 27 20:16:14.178458 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 446/902] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:14 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:16:14.369869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-354feabf-a9f3-4b4e-b8de-b5210bcc0a39 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:14.370551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-354feabf-a9f3-4b4e-b8de-b5210bcc0a39 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:14.377821 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-354feabf-a9f3-4b4e-b8de-b5210bcc0a39 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:14.378245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-354feabf-a9f3-4b4e-b8de-b5210bcc0a39 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:14.379013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-354feabf-a9f3-4b4e-b8de-b5210bcc0a39 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:14.379450 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-354feabf-a9f3-4b4e-b8de-b5210bcc0a39 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:14.518796 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-354feabf-a9f3-4b4e-b8de-b5210bcc0a39 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:14.527164 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-354feabf-a9f3-4b4e-b8de-b5210bcc0a39 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.161999 Jul 27 20:16:14.527755 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 457/903] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:14 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:15.189341 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-39995a3f-5ea8-4f8e-a27b-2ca92a11b0b7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:15.191852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-39995a3f-5ea8-4f8e-a27b-2ca92a11b0b7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:15.198353 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39995a3f-5ea8-4f8e-a27b-2ca92a11b0b7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:15.198794 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39995a3f-5ea8-4f8e-a27b-2ca92a11b0b7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:15.199544 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39995a3f-5ea8-4f8e-a27b-2ca92a11b0b7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:15.199973 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39995a3f-5ea8-4f8e-a27b-2ca92a11b0b7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:15.228632 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-39995a3f-5ea8-4f8e-a27b-2ca92a11b0b7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043212 Jul 27 20:16:15.229200 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 447/904] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:15 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:15.549139 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-22b91a0d-6452-47e2-b088-56b513d737db tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:15.549721 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-22b91a0d-6452-47e2-b088-56b513d737db tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:15.556170 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-22b91a0d-6452-47e2-b088-56b513d737db tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:15.556677 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-22b91a0d-6452-47e2-b088-56b513d737db tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:15.557478 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-22b91a0d-6452-47e2-b088-56b513d737db tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:15.557917 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-22b91a0d-6452-47e2-b088-56b513d737db tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:15.687154 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-22b91a0d-6452-47e2-b088-56b513d737db tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:15.695502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-22b91a0d-6452-47e2-b088-56b513d737db tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.150288 Jul 27 20:16:15.696061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 458/905] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:15 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:16.241764 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-477fff74-4f13-4293-87a1-45ad9db66bf7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:16.244090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-477fff74-4f13-4293-87a1-45ad9db66bf7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:16.250570 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-477fff74-4f13-4293-87a1-45ad9db66bf7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:16.251017 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-477fff74-4f13-4293-87a1-45ad9db66bf7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:16.251817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-477fff74-4f13-4293-87a1-45ad9db66bf7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:16.252253 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-477fff74-4f13-4293-87a1-45ad9db66bf7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:16.280142 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-477fff74-4f13-4293-87a1-45ad9db66bf7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043087 Jul 27 20:16:16.280688 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 448/906] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:16 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:16.716338 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c0ad4357-28f4-428f-88eb-ffaaf9a7aead tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:16.716978 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c0ad4357-28f4-428f-88eb-ffaaf9a7aead tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:16.723515 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c0ad4357-28f4-428f-88eb-ffaaf9a7aead tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:16.723971 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c0ad4357-28f4-428f-88eb-ffaaf9a7aead tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:16.724743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c0ad4357-28f4-428f-88eb-ffaaf9a7aead tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:16.726021 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c0ad4357-28f4-428f-88eb-ffaaf9a7aead tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:16.855756 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c0ad4357-28f4-428f-88eb-ffaaf9a7aead tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:16.863189 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c0ad4357-28f4-428f-88eb-ffaaf9a7aead tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.150847 Jul 27 20:16:16.863740 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 459/907] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:16 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:17.292898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7212930f-d1e5-4bfd-b0bf-853b6af03060 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:17.294955 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7212930f-d1e5-4bfd-b0bf-853b6af03060 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:17.301206 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7212930f-d1e5-4bfd-b0bf-853b6af03060 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:17.301652 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7212930f-d1e5-4bfd-b0bf-853b6af03060 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:17.302410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7212930f-d1e5-4bfd-b0bf-853b6af03060 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:17.302840 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7212930f-d1e5-4bfd-b0bf-853b6af03060 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:17.330982 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7212930f-d1e5-4bfd-b0bf-853b6af03060 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042109 Jul 27 20:16:17.331525 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 449/908] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:17 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:17.884663 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-82da5c23-94e4-4081-a621-14c4c7fa6517 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:17.885302 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-82da5c23-94e4-4081-a621-14c4c7fa6517 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:17.891762 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-82da5c23-94e4-4081-a621-14c4c7fa6517 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:17.892208 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-82da5c23-94e4-4081-a621-14c4c7fa6517 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:17.892987 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-82da5c23-94e4-4081-a621-14c4c7fa6517 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:17.893428 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-82da5c23-94e4-4081-a621-14c4c7fa6517 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:18.030607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-82da5c23-94e4-4081-a621-14c4c7fa6517 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:18.038596 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-82da5c23-94e4-4081-a621-14c4c7fa6517 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.158481 Jul 27 20:16:18.039165 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 460/909] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:17 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:18.343597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3b7c331d-e515-436f-9b49-d681ecc3bf0a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:18.345702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3b7c331d-e515-436f-9b49-d681ecc3bf0a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:18.347940 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=58 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:18.354146 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b7c331d-e515-436f-9b49-d681ecc3bf0a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:18.354589 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b7c331d-e515-436f-9b49-d681ecc3bf0a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:18.355346 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b7c331d-e515-436f-9b49-d681ecc3bf0a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:18.355775 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b7c331d-e515-436f-9b49-d681ecc3bf0a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:18.384271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3b7c331d-e515-436f-9b49-d681ecc3bf0a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044738 Jul 27 20:16:18.384813 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 450/910] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:18 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:19.060523 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-20688e6d-0b6c-44fe-8cff-d116e1a0bb3b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:19.061164 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-20688e6d-0b6c-44fe-8cff-d116e1a0bb3b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:19.067485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-20688e6d-0b6c-44fe-8cff-d116e1a0bb3b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:19.067968 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-20688e6d-0b6c-44fe-8cff-d116e1a0bb3b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:19.068728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-20688e6d-0b6c-44fe-8cff-d116e1a0bb3b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:19.069207 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-20688e6d-0b6c-44fe-8cff-d116e1a0bb3b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:19.196641 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-20688e6d-0b6c-44fe-8cff-d116e1a0bb3b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:19.204399 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-20688e6d-0b6c-44fe-8cff-d116e1a0bb3b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.148307 Jul 27 20:16:19.204956 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 461/911] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:19 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:19.396325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f679b287-70b8-41f0-b6f4-d052c5639aff tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:19.399028 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f679b287-70b8-41f0-b6f4-d052c5639aff tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:19.405396 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f679b287-70b8-41f0-b6f4-d052c5639aff tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:19.405834 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f679b287-70b8-41f0-b6f4-d052c5639aff tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:19.406583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f679b287-70b8-41f0-b6f4-d052c5639aff tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:19.407011 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f679b287-70b8-41f0-b6f4-d052c5639aff tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:19.434558 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f679b287-70b8-41f0-b6f4-d052c5639aff tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042156 Jul 27 20:16:19.435102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 451/912] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:19 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:20.225831 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-90961b74-26cf-4a19-be41-760aad336baa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:20.226432 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-90961b74-26cf-4a19-be41-760aad336baa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:20.232846 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90961b74-26cf-4a19-be41-760aad336baa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:20.233329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90961b74-26cf-4a19-be41-760aad336baa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:20.234088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90961b74-26cf-4a19-be41-760aad336baa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:20.234523 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90961b74-26cf-4a19-be41-760aad336baa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:20.365205 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-90961b74-26cf-4a19-be41-760aad336baa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:20.373047 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-90961b74-26cf-4a19-be41-760aad336baa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.151230 Jul 27 20:16:20.373599 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 462/913] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:20 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:20.448143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2fce4720-0fa1-4215-aec8-97734b036792 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:20.451456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2fce4720-0fa1-4215-aec8-97734b036792 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:20.459187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fce4720-0fa1-4215-aec8-97734b036792 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:20.459696 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fce4720-0fa1-4215-aec8-97734b036792 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:20.460464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fce4720-0fa1-4215-aec8-97734b036792 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:20.460900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fce4720-0fa1-4215-aec8-97734b036792 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:20.463319 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:20.489537 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2fce4720-0fa1-4215-aec8-97734b036792 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046867 Jul 27 20:16:20.490091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 452/914] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:20 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:21.394316 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f0fbdc8f-50df-4c3d-9bc5-c41d06a2c5de tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:21.394968 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f0fbdc8f-50df-4c3d-9bc5-c41d06a2c5de tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:21.402270 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0fbdc8f-50df-4c3d-9bc5-c41d06a2c5de tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:21.402753 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0fbdc8f-50df-4c3d-9bc5-c41d06a2c5de tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:21.403525 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0fbdc8f-50df-4c3d-9bc5-c41d06a2c5de tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:21.403965 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0fbdc8f-50df-4c3d-9bc5-c41d06a2c5de tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:21.502362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-148c9f48-6c2e-4108-b7c3-0591ca73ba0b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:21.504549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-148c9f48-6c2e-4108-b7c3-0591ca73ba0b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:21.511361 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-148c9f48-6c2e-4108-b7c3-0591ca73ba0b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:21.511804 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-148c9f48-6c2e-4108-b7c3-0591ca73ba0b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:21.512561 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-148c9f48-6c2e-4108-b7c3-0591ca73ba0b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:21.513014 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-148c9f48-6c2e-4108-b7c3-0591ca73ba0b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:21.532852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f0fbdc8f-50df-4c3d-9bc5-c41d06a2c5de tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:21.540744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f0fbdc8f-50df-4c3d-9bc5-c41d06a2c5de tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.150310 Jul 27 20:16:21.541480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 463/915] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:21 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:21.541856 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-148c9f48-6c2e-4108-b7c3-0591ca73ba0b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043339 Jul 27 20:16:21.542410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 453/916] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:21 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:16:22.553286 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d1873101-d7de-482b-b575-8db958a8446d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:22.555606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d1873101-d7de-482b-b575-8db958a8446d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:22.562993 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d1873101-d7de-482b-b575-8db958a8446d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:22.563453 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d1873101-d7de-482b-b575-8db958a8446d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:22.563741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8a5b28be-653c-421d-a2b4-b036d0993c2b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:22.564264 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d1873101-d7de-482b-b575-8db958a8446d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:22.564369 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8a5b28be-653c-421d-a2b4-b036d0993c2b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:22.564710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d1873101-d7de-482b-b575-8db958a8446d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:22.571080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8a5b28be-653c-421d-a2b4-b036d0993c2b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:22.571525 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8a5b28be-653c-421d-a2b4-b036d0993c2b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:22.572294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8a5b28be-653c-421d-a2b4-b036d0993c2b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:22.572728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8a5b28be-653c-421d-a2b4-b036d0993c2b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:22.593995 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d1873101-d7de-482b-b575-8db958a8446d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044744 Jul 27 20:16:22.594560 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 464/917] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:22 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:22.703892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8a5b28be-653c-421d-a2b4-b036d0993c2b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:22.712077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8a5b28be-653c-421d-a2b4-b036d0993c2b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.152156 Jul 27 20:16:22.712641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 454/918] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:22 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:16:23.607148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-752e662f-b485-4ffc-9b3a-fcb220d750c3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:23.609366 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-752e662f-b485-4ffc-9b3a-fcb220d750c3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:23.616618 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-752e662f-b485-4ffc-9b3a-fcb220d750c3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:23.617094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-752e662f-b485-4ffc-9b3a-fcb220d750c3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:23.617864 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-752e662f-b485-4ffc-9b3a-fcb220d750c3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:23.618303 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-752e662f-b485-4ffc-9b3a-fcb220d750c3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:23.645996 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-752e662f-b485-4ffc-9b3a-fcb220d750c3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042874 Jul 27 20:16:23.646545 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 465/919] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:23 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:16:23.733437 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3de9a818-69cc-4691-a913-94d868e4ff08 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:23.734076 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3de9a818-69cc-4691-a913-94d868e4ff08 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:23.740484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3de9a818-69cc-4691-a913-94d868e4ff08 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:23.741584 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3de9a818-69cc-4691-a913-94d868e4ff08 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:23.742349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3de9a818-69cc-4691-a913-94d868e4ff08 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:23.742781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3de9a818-69cc-4691-a913-94d868e4ff08 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:23.871556 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3de9a818-69cc-4691-a913-94d868e4ff08 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:23.878911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3de9a818-69cc-4691-a913-94d868e4ff08 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.149355 Jul 27 20:16:23.879468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 455/920] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:23 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:24.658582 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f0a232fc-e0a1-4de9-9c85-ca2b8ac25ace tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:24.660715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f0a232fc-e0a1-4de9-9c85-ca2b8ac25ace tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:24.667800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0a232fc-e0a1-4de9-9c85-ca2b8ac25ace tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:24.668247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0a232fc-e0a1-4de9-9c85-ca2b8ac25ace tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:24.669027 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0a232fc-e0a1-4de9-9c85-ca2b8ac25ace tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:24.669465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0a232fc-e0a1-4de9-9c85-ca2b8ac25ace tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:24.698070 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f0a232fc-e0a1-4de9-9c85-ca2b8ac25ace tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043709 Jul 27 20:16:24.698615 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 466/921] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:24 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:24.900886 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-eebded8b-ded3-4089-98fb-9b5aff6b60c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:24.901733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-eebded8b-ded3-4089-98fb-9b5aff6b60c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:24.908868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eebded8b-ded3-4089-98fb-9b5aff6b60c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:24.909302 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eebded8b-ded3-4089-98fb-9b5aff6b60c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:24.910072 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eebded8b-ded3-4089-98fb-9b5aff6b60c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:24.910515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eebded8b-ded3-4089-98fb-9b5aff6b60c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:25.050701 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eebded8b-ded3-4089-98fb-9b5aff6b60c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:25.058316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-eebded8b-ded3-4089-98fb-9b5aff6b60c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.161976 Jul 27 20:16:25.058879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 456/922] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:24 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:25.710532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-60f5b06a-a9b4-485d-b7fe-60d2cfefe54f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:25.712707 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-60f5b06a-a9b4-485d-b7fe-60d2cfefe54f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:25.719418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-60f5b06a-a9b4-485d-b7fe-60d2cfefe54f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:25.719876 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-60f5b06a-a9b4-485d-b7fe-60d2cfefe54f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:25.720636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-60f5b06a-a9b4-485d-b7fe-60d2cfefe54f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:25.721113 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-60f5b06a-a9b4-485d-b7fe-60d2cfefe54f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:25.749595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-60f5b06a-a9b4-485d-b7fe-60d2cfefe54f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043205 Jul 27 20:16:25.750144 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 467/923] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:25 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:26.080470 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-150f4f5d-3d74-466b-98ed-197e5ac4bc82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:26.081146 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-150f4f5d-3d74-466b-98ed-197e5ac4bc82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:26.087975 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-150f4f5d-3d74-466b-98ed-197e5ac4bc82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:26.088428 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-150f4f5d-3d74-466b-98ed-197e5ac4bc82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:26.089227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-150f4f5d-3d74-466b-98ed-197e5ac4bc82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:26.089665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-150f4f5d-3d74-466b-98ed-197e5ac4bc82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:26.224606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-150f4f5d-3d74-466b-98ed-197e5ac4bc82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:26.232729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-150f4f5d-3d74-466b-98ed-197e5ac4bc82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.156072 Jul 27 20:16:26.233315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 457/924] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:26 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:26.762107 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-75778c0f-20b8-4bc8-86bb-3b19018fb3bd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:26.764304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-75778c0f-20b8-4bc8-86bb-3b19018fb3bd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:26.770847 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-75778c0f-20b8-4bc8-86bb-3b19018fb3bd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:26.771302 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-75778c0f-20b8-4bc8-86bb-3b19018fb3bd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:26.772124 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-75778c0f-20b8-4bc8-86bb-3b19018fb3bd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:26.772591 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-75778c0f-20b8-4bc8-86bb-3b19018fb3bd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:26.801244 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-75778c0f-20b8-4bc8-86bb-3b19018fb3bd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043081 Jul 27 20:16:26.801795 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 468/925] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:26 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:27.253877 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-830032bd-c35d-44ff-93dc-acad996bf90f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:27.254504 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-830032bd-c35d-44ff-93dc-acad996bf90f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:27.261094 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-830032bd-c35d-44ff-93dc-acad996bf90f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:27.261548 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-830032bd-c35d-44ff-93dc-acad996bf90f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:27.262313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-830032bd-c35d-44ff-93dc-acad996bf90f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:27.262768 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-830032bd-c35d-44ff-93dc-acad996bf90f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:27.391029 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-830032bd-c35d-44ff-93dc-acad996bf90f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:27.399082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-830032bd-c35d-44ff-93dc-acad996bf90f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.149026 Jul 27 20:16:27.399653 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 458/926] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:27 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:27.814523 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4e1ae929-b54d-4f98-ab96-3b6d513ebe6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:27.816931 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4e1ae929-b54d-4f98-ab96-3b6d513ebe6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:27.819790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=54 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:27.825254 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4e1ae929-b54d-4f98-ab96-3b6d513ebe6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:27.825711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4e1ae929-b54d-4f98-ab96-3b6d513ebe6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:27.826472 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4e1ae929-b54d-4f98-ab96-3b6d513ebe6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:27.826911 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4e1ae929-b54d-4f98-ab96-3b6d513ebe6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:27.854733 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4e1ae929-b54d-4f98-ab96-3b6d513ebe6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044241 Jul 27 20:16:27.855286 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 469/927] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:27 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:28.419391 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c337a2cb-b28f-49fe-82c7-8a3896acd39e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:28.419994 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c337a2cb-b28f-49fe-82c7-8a3896acd39e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:28.426390 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c337a2cb-b28f-49fe-82c7-8a3896acd39e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:28.426858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c337a2cb-b28f-49fe-82c7-8a3896acd39e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:28.427602 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c337a2cb-b28f-49fe-82c7-8a3896acd39e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:28.428720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c337a2cb-b28f-49fe-82c7-8a3896acd39e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:28.562327 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c337a2cb-b28f-49fe-82c7-8a3896acd39e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:28.570086 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c337a2cb-b28f-49fe-82c7-8a3896acd39e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.154438 Jul 27 20:16:28.570629 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 459/928] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:28 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:28.868114 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-67682b08-db04-4095-b0bd-fac0b46fe164 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:28.870245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-67682b08-db04-4095-b0bd-fac0b46fe164 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:28.877074 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-67682b08-db04-4095-b0bd-fac0b46fe164 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:28.877534 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-67682b08-db04-4095-b0bd-fac0b46fe164 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:28.878310 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-67682b08-db04-4095-b0bd-fac0b46fe164 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:28.878754 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-67682b08-db04-4095-b0bd-fac0b46fe164 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:28.912109 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-67682b08-db04-4095-b0bd-fac0b46fe164 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048876 Jul 27 20:16:28.912910 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 470/929] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:28 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:29.591133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2ce2e385-6d94-49e7-a77a-8fed1f72cf83 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:29.591746 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2ce2e385-6d94-49e7-a77a-8fed1f72cf83 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:29.598239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ce2e385-6d94-49e7-a77a-8fed1f72cf83 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:29.598693 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ce2e385-6d94-49e7-a77a-8fed1f72cf83 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:29.599452 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ce2e385-6d94-49e7-a77a-8fed1f72cf83 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:29.600552 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ce2e385-6d94-49e7-a77a-8fed1f72cf83 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:29.732610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2ce2e385-6d94-49e7-a77a-8fed1f72cf83 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:29.740241 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2ce2e385-6d94-49e7-a77a-8fed1f72cf83 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.152925 Jul 27 20:16:29.741467 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 460/930] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:29 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:29.924504 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2bf7d6cf-9e01-427d-aa05-bb07b22945f7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:29.926688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2bf7d6cf-9e01-427d-aa05-bb07b22945f7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:29.934255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2bf7d6cf-9e01-427d-aa05-bb07b22945f7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:29.934705 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2bf7d6cf-9e01-427d-aa05-bb07b22945f7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:29.935467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2bf7d6cf-9e01-427d-aa05-bb07b22945f7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:29.935905 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2bf7d6cf-9e01-427d-aa05-bb07b22945f7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:29.950487 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:29.966183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2bf7d6cf-9e01-427d-aa05-bb07b22945f7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045620 Jul 27 20:16:29.966742 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 471/931] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:29 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:30.762486 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-19f2c5ee-ece2-445c-9216-f7f7e4eb8597 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:30.763092 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-19f2c5ee-ece2-445c-9216-f7f7e4eb8597 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:30.769484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19f2c5ee-ece2-445c-9216-f7f7e4eb8597 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:30.769925 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19f2c5ee-ece2-445c-9216-f7f7e4eb8597 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:30.770688 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19f2c5ee-ece2-445c-9216-f7f7e4eb8597 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:30.771121 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19f2c5ee-ece2-445c-9216-f7f7e4eb8597 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:30.903619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-19f2c5ee-ece2-445c-9216-f7f7e4eb8597 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:30.910978 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-19f2c5ee-ece2-445c-9216-f7f7e4eb8597 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.152343 Jul 27 20:16:30.911544 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 461/932] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:30 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:30.978606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b9f3d844-e580-4de4-b912-2db6e3223152 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:30.980801 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b9f3d844-e580-4de4-b912-2db6e3223152 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:30.987350 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b9f3d844-e580-4de4-b912-2db6e3223152 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:30.987805 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b9f3d844-e580-4de4-b912-2db6e3223152 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:30.988573 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b9f3d844-e580-4de4-b912-2db6e3223152 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:30.989048 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b9f3d844-e580-4de4-b912-2db6e3223152 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:31.018337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b9f3d844-e580-4de4-b912-2db6e3223152 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043269 Jul 27 20:16:31.018450 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 472/933] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:30 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:31.932429 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-aa9b69c2-a78c-4f4d-80d6-53398c511dae tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:31.933155 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-aa9b69c2-a78c-4f4d-80d6-53398c511dae tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:31.939556 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa9b69c2-a78c-4f4d-80d6-53398c511dae tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:31.940003 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa9b69c2-a78c-4f4d-80d6-53398c511dae tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:31.941016 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa9b69c2-a78c-4f4d-80d6-53398c511dae tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:31.941446 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa9b69c2-a78c-4f4d-80d6-53398c511dae tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:32.030619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fbd3203a-5e14-4e3d-9336-dcb25e518438 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:32.032814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fbd3203a-5e14-4e3d-9336-dcb25e518438 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:32.039567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fbd3203a-5e14-4e3d-9336-dcb25e518438 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:32.040019 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fbd3203a-5e14-4e3d-9336-dcb25e518438 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:32.040796 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fbd3203a-5e14-4e3d-9336-dcb25e518438 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:32.041256 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fbd3203a-5e14-4e3d-9336-dcb25e518438 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:32.070760 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fbd3203a-5e14-4e3d-9336-dcb25e518438 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044021 Jul 27 20:16:32.071713 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 473/934] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:32 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:16:32.073189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aa9b69c2-a78c-4f4d-80d6-53398c511dae tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:32.080749 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-aa9b69c2-a78c-4f4d-80d6-53398c511dae tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.152157 Jul 27 20:16:32.081336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 462/935] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:31 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:33.083120 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8ad9bd1e-3ef5-4416-a3a6-6e81dfacc32f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:33.085875 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8ad9bd1e-3ef5-4416-a3a6-6e81dfacc32f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:33.091983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8ad9bd1e-3ef5-4416-a3a6-6e81dfacc32f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:33.092435 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8ad9bd1e-3ef5-4416-a3a6-6e81dfacc32f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:33.093241 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8ad9bd1e-3ef5-4416-a3a6-6e81dfacc32f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:33.093683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8ad9bd1e-3ef5-4416-a3a6-6e81dfacc32f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:33.102830 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-82aaeac4-eb51-43c5-8b79-72aa0d6cb8d4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:33.103445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-82aaeac4-eb51-43c5-8b79-72aa0d6cb8d4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:33.110465 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82aaeac4-eb51-43c5-8b79-72aa0d6cb8d4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:33.110924 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82aaeac4-eb51-43c5-8b79-72aa0d6cb8d4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:33.112232 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82aaeac4-eb51-43c5-8b79-72aa0d6cb8d4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:33.112735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82aaeac4-eb51-43c5-8b79-72aa0d6cb8d4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:33.126009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8ad9bd1e-3ef5-4416-a3a6-6e81dfacc32f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046948 Jul 27 20:16:33.126726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 474/936] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:33 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:33.245814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-82aaeac4-eb51-43c5-8b79-72aa0d6cb8d4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:33.253295 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-82aaeac4-eb51-43c5-8b79-72aa0d6cb8d4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.154883 Jul 27 20:16:33.253899 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 463/937] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:33 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:16:34.138539 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3eb871f5-b4e1-43c4-81f3-2b832c7214ae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:34.140702 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3eb871f5-b4e1-43c4-81f3-2b832c7214ae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:34.147264 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3eb871f5-b4e1-43c4-81f3-2b832c7214ae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:34.147717 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3eb871f5-b4e1-43c4-81f3-2b832c7214ae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:34.148475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3eb871f5-b4e1-43c4-81f3-2b832c7214ae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:34.148914 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3eb871f5-b4e1-43c4-81f3-2b832c7214ae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:34.177232 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3eb871f5-b4e1-43c4-81f3-2b832c7214ae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042677 Jul 27 20:16:34.178437 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 475/938] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:34 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:16:34.277574 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d31ae0af-2f76-4210-aff9-cad569692dc1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:34.278190 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d31ae0af-2f76-4210-aff9-cad569692dc1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:34.284624 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d31ae0af-2f76-4210-aff9-cad569692dc1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:34.285104 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d31ae0af-2f76-4210-aff9-cad569692dc1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:34.285901 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d31ae0af-2f76-4210-aff9-cad569692dc1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:34.286339 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d31ae0af-2f76-4210-aff9-cad569692dc1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:34.417855 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d31ae0af-2f76-4210-aff9-cad569692dc1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:34.425192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d31ae0af-2f76-4210-aff9-cad569692dc1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.151438 Jul 27 20:16:34.425780 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 464/939] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:34 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:35.190473 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-95d50c5a-a0d8-4e72-b831-393d66ce4c41 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:35.192640 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-95d50c5a-a0d8-4e72-b831-393d66ce4c41 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:35.199837 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-95d50c5a-a0d8-4e72-b831-393d66ce4c41 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:35.200286 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-95d50c5a-a0d8-4e72-b831-393d66ce4c41 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:35.201075 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-95d50c5a-a0d8-4e72-b831-393d66ce4c41 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:35.201520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-95d50c5a-a0d8-4e72-b831-393d66ce4c41 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:35.230084 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-95d50c5a-a0d8-4e72-b831-393d66ce4c41 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043823 Jul 27 20:16:35.230646 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 476/940] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:35 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:16:35.447239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1dac0da7-4aa6-41b8-a176-dffc67aa679e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:35.447843 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1dac0da7-4aa6-41b8-a176-dffc67aa679e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:35.454324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1dac0da7-4aa6-41b8-a176-dffc67aa679e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:35.454758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1dac0da7-4aa6-41b8-a176-dffc67aa679e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:35.455510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1dac0da7-4aa6-41b8-a176-dffc67aa679e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:35.455937 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1dac0da7-4aa6-41b8-a176-dffc67aa679e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:35.583399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1dac0da7-4aa6-41b8-a176-dffc67aa679e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:35.591741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1dac0da7-4aa6-41b8-a176-dffc67aa679e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.148731 Jul 27 20:16:35.592305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 465/941] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:35 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:36.243661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e73e6b0c-737d-4220-8338-685fb24bd6c9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:36.245863 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e73e6b0c-737d-4220-8338-685fb24bd6c9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:36.252255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e73e6b0c-737d-4220-8338-685fb24bd6c9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:36.252708 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e73e6b0c-737d-4220-8338-685fb24bd6c9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:36.253511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e73e6b0c-737d-4220-8338-685fb24bd6c9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:36.253947 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e73e6b0c-737d-4220-8338-685fb24bd6c9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:36.283936 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e73e6b0c-737d-4220-8338-685fb24bd6c9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045554 Jul 27 20:16:36.284485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 477/942] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:36 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:36.613848 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7c93edde-ac95-4af9-bf25-c4f1f7819ea1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:36.614467 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7c93edde-ac95-4af9-bf25-c4f1f7819ea1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:36.621595 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c93edde-ac95-4af9-bf25-c4f1f7819ea1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:36.622051 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c93edde-ac95-4af9-bf25-c4f1f7819ea1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:36.622817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c93edde-ac95-4af9-bf25-c4f1f7819ea1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:36.623256 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c93edde-ac95-4af9-bf25-c4f1f7819ea1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:36.758154 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7c93edde-ac95-4af9-bf25-c4f1f7819ea1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:36.765641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7c93edde-ac95-4af9-bf25-c4f1f7819ea1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.155718 Jul 27 20:16:36.766207 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 466/943] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:36 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:37.296504 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fa03c8da-3bf8-4150-b22c-3891bb01dabe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:37.298787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fa03c8da-3bf8-4150-b22c-3891bb01dabe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:37.306106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa03c8da-3bf8-4150-b22c-3891bb01dabe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:37.306799 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa03c8da-3bf8-4150-b22c-3891bb01dabe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:37.307599 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa03c8da-3bf8-4150-b22c-3891bb01dabe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:37.308032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa03c8da-3bf8-4150-b22c-3891bb01dabe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:37.337350 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fa03c8da-3bf8-4150-b22c-3891bb01dabe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045045 Jul 27 20:16:37.337904 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 478/944] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:37 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:37.787098 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f1408938-18a7-4908-a814-4c4784c6965b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:37.787707 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f1408938-18a7-4908-a814-4c4784c6965b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:37.794304 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1408938-18a7-4908-a814-4c4784c6965b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:37.794755 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1408938-18a7-4908-a814-4c4784c6965b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:37.795518 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1408938-18a7-4908-a814-4c4784c6965b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:37.795959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1408938-18a7-4908-a814-4c4784c6965b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:37.928091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f1408938-18a7-4908-a814-4c4784c6965b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:37.935851 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f1408938-18a7-4908-a814-4c4784c6965b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.152625 Jul 27 20:16:37.936493 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 467/945] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:37 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:38.349747 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1e40c650-fd5b-4f73-ae69-6de8b18708de tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:38.351832 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1e40c650-fd5b-4f73-ae69-6de8b18708de tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:38.358299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1e40c650-fd5b-4f73-ae69-6de8b18708de tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:38.358743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1e40c650-fd5b-4f73-ae69-6de8b18708de tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:38.359503 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1e40c650-fd5b-4f73-ae69-6de8b18708de tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:38.359937 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1e40c650-fd5b-4f73-ae69-6de8b18708de tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:38.388787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1e40c650-fd5b-4f73-ae69-6de8b18708de tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043121 Jul 27 20:16:38.389352 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 479/946] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:38 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:16:38.957791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-32633c1f-79eb-41a4-979d-5db55bd0b89a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:38.958549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-32633c1f-79eb-41a4-979d-5db55bd0b89a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:38.966172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-32633c1f-79eb-41a4-979d-5db55bd0b89a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:38.966619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-32633c1f-79eb-41a4-979d-5db55bd0b89a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:38.967377 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-32633c1f-79eb-41a4-979d-5db55bd0b89a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:38.967828 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-32633c1f-79eb-41a4-979d-5db55bd0b89a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:39.105837 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-32633c1f-79eb-41a4-979d-5db55bd0b89a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:39.108019 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:39.114712 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-32633c1f-79eb-41a4-979d-5db55bd0b89a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.160789 Jul 27 20:16:39.115345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 468/947] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:38 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:39.401662 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1dd92dcb-2245-43e4-a267-2ed8128fc9df tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:39.403807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1dd92dcb-2245-43e4-a267-2ed8128fc9df tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:39.410314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1dd92dcb-2245-43e4-a267-2ed8128fc9df tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:39.410784 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1dd92dcb-2245-43e4-a267-2ed8128fc9df tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:39.411534 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1dd92dcb-2245-43e4-a267-2ed8128fc9df tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:39.411975 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1dd92dcb-2245-43e4-a267-2ed8128fc9df tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:39.440533 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1dd92dcb-2245-43e4-a267-2ed8128fc9df tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042517 Jul 27 20:16:39.441134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 480/948] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:39 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:40.135748 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-23b26fa3-b166-4c58-9dc5-357e42f9fb9c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:40.136349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-23b26fa3-b166-4c58-9dc5-357e42f9fb9c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:40.142831 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-23b26fa3-b166-4c58-9dc5-357e42f9fb9c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:40.143269 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-23b26fa3-b166-4c58-9dc5-357e42f9fb9c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:40.144017 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-23b26fa3-b166-4c58-9dc5-357e42f9fb9c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:40.144446 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-23b26fa3-b166-4c58-9dc5-357e42f9fb9c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:40.301128 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-23b26fa3-b166-4c58-9dc5-357e42f9fb9c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:40.309693 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-23b26fa3-b166-4c58-9dc5-357e42f9fb9c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.177627 Jul 27 20:16:40.310275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 469/949] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:40 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:40.454081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-01f18248-9e71-493c-8a32-f9bac81f4986 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:40.456898 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-01f18248-9e71-493c-8a32-f9bac81f4986 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:40.464162 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-01f18248-9e71-493c-8a32-f9bac81f4986 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:40.464791 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-01f18248-9e71-493c-8a32-f9bac81f4986 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:40.466194 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-01f18248-9e71-493c-8a32-f9bac81f4986 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:40.466941 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-01f18248-9e71-493c-8a32-f9bac81f4986 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:40.500103 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-01f18248-9e71-493c-8a32-f9bac81f4986 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050441 Jul 27 20:16:40.500671 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 481/950] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:40 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:40.701868 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:16:40.702128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:16:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:16:41.331525 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-00d805cf-3380-4ca2-9a7b-84ec7620522a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:41.332060 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-00d805cf-3380-4ca2-9a7b-84ec7620522a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:41.340535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00d805cf-3380-4ca2-9a7b-84ec7620522a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:41.341054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00d805cf-3380-4ca2-9a7b-84ec7620522a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:41.341856 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00d805cf-3380-4ca2-9a7b-84ec7620522a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:41.342295 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00d805cf-3380-4ca2-9a7b-84ec7620522a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:41.474028 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-00d805cf-3380-4ca2-9a7b-84ec7620522a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:41.481457 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-00d805cf-3380-4ca2-9a7b-84ec7620522a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.153768 Jul 27 20:16:41.482011 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 470/951] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:41 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:41.512817 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-02e42d44-4ef9-41d2-8579-de815f23ae35 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:41.515089 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-02e42d44-4ef9-41d2-8579-de815f23ae35 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:41.521547 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-02e42d44-4ef9-41d2-8579-de815f23ae35 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:41.522003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-02e42d44-4ef9-41d2-8579-de815f23ae35 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:41.522773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-02e42d44-4ef9-41d2-8579-de815f23ae35 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:41.523226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-02e42d44-4ef9-41d2-8579-de815f23ae35 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:41.552076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-02e42d44-4ef9-41d2-8579-de815f23ae35 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043186 Jul 27 20:16:41.553210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 482/952] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:41 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:42.502030 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-60cb6f6b-179a-441c-9383-b99b6a5adb86 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:42.502690 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-60cb6f6b-179a-441c-9383-b99b6a5adb86 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:42.511004 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60cb6f6b-179a-441c-9383-b99b6a5adb86 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:42.513564 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60cb6f6b-179a-441c-9383-b99b6a5adb86 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:42.514358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60cb6f6b-179a-441c-9383-b99b6a5adb86 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:42.514804 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60cb6f6b-179a-441c-9383-b99b6a5adb86 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:42.564983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3c042391-9afe-492a-a5c4-1aed14cb310f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:42.567445 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3c042391-9afe-492a-a5c4-1aed14cb310f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:42.574521 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c042391-9afe-492a-a5c4-1aed14cb310f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:42.574971 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c042391-9afe-492a-a5c4-1aed14cb310f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:42.575749 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c042391-9afe-492a-a5c4-1aed14cb310f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:42.576191 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c042391-9afe-492a-a5c4-1aed14cb310f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:42.605616 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3c042391-9afe-492a-a5c4-1aed14cb310f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044547 Jul 27 20:16:42.606183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 483/953] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:42 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:16:42.649278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-60cb6f6b-179a-441c-9383-b99b6a5adb86 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:42.659597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-60cb6f6b-179a-441c-9383-b99b6a5adb86 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.161422 Jul 27 20:16:42.660191 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 471/954] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:42 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:16:43.618530 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ca3f3253-a419-46e9-aa58-33d70eb975a6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:43.620779 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ca3f3253-a419-46e9-aa58-33d70eb975a6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:43.627223 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ca3f3253-a419-46e9-aa58-33d70eb975a6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:43.627666 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ca3f3253-a419-46e9-aa58-33d70eb975a6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:43.628414 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ca3f3253-a419-46e9-aa58-33d70eb975a6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:43.628847 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ca3f3253-a419-46e9-aa58-33d70eb975a6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:43.657108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ca3f3253-a419-46e9-aa58-33d70eb975a6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042996 Jul 27 20:16:43.657642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 484/955] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:43 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:43.683202 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bb8a09fc-6141-47ef-ac01-d6c7eb6e9cac tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:43.683801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bb8a09fc-6141-47ef-ac01-d6c7eb6e9cac tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:43.690420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb8a09fc-6141-47ef-ac01-d6c7eb6e9cac tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:43.690863 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb8a09fc-6141-47ef-ac01-d6c7eb6e9cac tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:43.691638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb8a09fc-6141-47ef-ac01-d6c7eb6e9cac tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:43.692066 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb8a09fc-6141-47ef-ac01-d6c7eb6e9cac tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:43.820181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bb8a09fc-6141-47ef-ac01-d6c7eb6e9cac tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:43.827529 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bb8a09fc-6141-47ef-ac01-d6c7eb6e9cac tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.148084 Jul 27 20:16:43.828086 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 472/956] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:43 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:44.669904 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-683ed44b-f9fa-428c-8a7c-f8f3308947df tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:44.672097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-683ed44b-f9fa-428c-8a7c-f8f3308947df tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:44.679170 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-683ed44b-f9fa-428c-8a7c-f8f3308947df tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:44.679626 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-683ed44b-f9fa-428c-8a7c-f8f3308947df tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:44.680391 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-683ed44b-f9fa-428c-8a7c-f8f3308947df tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:44.680835 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-683ed44b-f9fa-428c-8a7c-f8f3308947df tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:44.708776 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-683ed44b-f9fa-428c-8a7c-f8f3308947df tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042809 Jul 27 20:16:44.709411 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 485/957] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:44 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:44.847540 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-db26f1ce-fdc9-487f-bc98-a5a8a41aa2be tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:44.848151 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-db26f1ce-fdc9-487f-bc98-a5a8a41aa2be tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:44.855297 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db26f1ce-fdc9-487f-bc98-a5a8a41aa2be tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:44.855746 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db26f1ce-fdc9-487f-bc98-a5a8a41aa2be tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:44.856513 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db26f1ce-fdc9-487f-bc98-a5a8a41aa2be tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:44.856973 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db26f1ce-fdc9-487f-bc98-a5a8a41aa2be tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:44.990283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-db26f1ce-fdc9-487f-bc98-a5a8a41aa2be tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:44.998107 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-db26f1ce-fdc9-487f-bc98-a5a8a41aa2be tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.154390 Jul 27 20:16:44.998664 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 473/958] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:44 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:45.721201 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0a67a441-6bac-4181-924b-3ba29f3d298f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:45.723396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0a67a441-6bac-4181-924b-3ba29f3d298f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:45.730133 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a67a441-6bac-4181-924b-3ba29f3d298f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:45.730610 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a67a441-6bac-4181-924b-3ba29f3d298f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:45.731372 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a67a441-6bac-4181-924b-3ba29f3d298f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:45.731808 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a67a441-6bac-4181-924b-3ba29f3d298f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:45.761348 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0a67a441-6bac-4181-924b-3ba29f3d298f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044239 Jul 27 20:16:45.761895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 486/959] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:45 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:46.019174 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9f9bd688-71d4-4b49-8fa2-f816c494c6b3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:46.019697 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9f9bd688-71d4-4b49-8fa2-f816c494c6b3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:46.026220 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f9bd688-71d4-4b49-8fa2-f816c494c6b3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:46.026672 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f9bd688-71d4-4b49-8fa2-f816c494c6b3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:46.027439 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f9bd688-71d4-4b49-8fa2-f816c494c6b3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:46.027878 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f9bd688-71d4-4b49-8fa2-f816c494c6b3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:46.159157 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9f9bd688-71d4-4b49-8fa2-f816c494c6b3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:46.167238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9f9bd688-71d4-4b49-8fa2-f816c494c6b3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.152072 Jul 27 20:16:46.167798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 474/960] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:46 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:46.774375 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b1d4bfae-3c51-425a-ad9b-78baad7c5d43 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:46.776553 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b1d4bfae-3c51-425a-ad9b-78baad7c5d43 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:46.782981 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b1d4bfae-3c51-425a-ad9b-78baad7c5d43 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:46.783492 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b1d4bfae-3c51-425a-ad9b-78baad7c5d43 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:46.784264 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b1d4bfae-3c51-425a-ad9b-78baad7c5d43 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:46.784705 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b1d4bfae-3c51-425a-ad9b-78baad7c5d43 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:46.813114 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b1d4bfae-3c51-425a-ad9b-78baad7c5d43 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043341 Jul 27 20:16:46.813655 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 487/961] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:46 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:46.899411 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:16:46.899559 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:16:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:16:47.188893 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fc6eb6aa-67f1-4ba3-b4e6-d765d3c687ec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:47.189679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fc6eb6aa-67f1-4ba3-b4e6-d765d3c687ec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:47.196280 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc6eb6aa-67f1-4ba3-b4e6-d765d3c687ec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:47.196730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc6eb6aa-67f1-4ba3-b4e6-d765d3c687ec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:47.197525 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc6eb6aa-67f1-4ba3-b4e6-d765d3c687ec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:47.197965 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc6eb6aa-67f1-4ba3-b4e6-d765d3c687ec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:47.327641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fc6eb6aa-67f1-4ba3-b4e6-d765d3c687ec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:47.335485 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fc6eb6aa-67f1-4ba3-b4e6-d765d3c687ec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.150504 Jul 27 20:16:47.336052 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 475/962] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:47 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:47.825906 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9ff8ff59-4421-432a-903f-96b598e948c2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:47.828054 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9ff8ff59-4421-432a-903f-96b598e948c2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:47.834455 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ff8ff59-4421-432a-903f-96b598e948c2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:47.834896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ff8ff59-4421-432a-903f-96b598e948c2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:47.835696 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ff8ff59-4421-432a-903f-96b598e948c2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:47.836124 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ff8ff59-4421-432a-903f-96b598e948c2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:47.839640 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:47.864948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9ff8ff59-4421-432a-903f-96b598e948c2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043005 Jul 27 20:16:47.866242 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 488/963] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:47 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:48.356389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-76b2f52f-1f5f-489e-9653-b77008e4c83b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:48.357045 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-76b2f52f-1f5f-489e-9653-b77008e4c83b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:48.359369 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=52 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:48.365322 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76b2f52f-1f5f-489e-9653-b77008e4c83b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:48.365781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76b2f52f-1f5f-489e-9653-b77008e4c83b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:48.366708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76b2f52f-1f5f-489e-9653-b77008e4c83b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:48.367207 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76b2f52f-1f5f-489e-9653-b77008e4c83b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:48.500442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-76b2f52f-1f5f-489e-9653-b77008e4c83b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:48.508800 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-76b2f52f-1f5f-489e-9653-b77008e4c83b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.156231 Jul 27 20:16:48.509401 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 476/964] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:48 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:48.877152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0ecaf4a1-2646-4093-bf99-37389e02cdef tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:48.879329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0ecaf4a1-2646-4093-bf99-37389e02cdef tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:48.886406 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0ecaf4a1-2646-4093-bf99-37389e02cdef tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:48.886860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0ecaf4a1-2646-4093-bf99-37389e02cdef tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:48.887629 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0ecaf4a1-2646-4093-bf99-37389e02cdef tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:48.888073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0ecaf4a1-2646-4093-bf99-37389e02cdef tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:48.915805 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0ecaf4a1-2646-4093-bf99-37389e02cdef tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042638 Jul 27 20:16:48.918085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 489/965] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:48 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:49.530420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9456450e-8837-4c0a-ad3c-9c6bbf1d1504 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:49.531029 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9456450e-8837-4c0a-ad3c-9c6bbf1d1504 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:49.538261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9456450e-8837-4c0a-ad3c-9c6bbf1d1504 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:49.538727 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9456450e-8837-4c0a-ad3c-9c6bbf1d1504 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:49.539487 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9456450e-8837-4c0a-ad3c-9c6bbf1d1504 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:49.539924 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9456450e-8837-4c0a-ad3c-9c6bbf1d1504 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:49.667543 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9456450e-8837-4c0a-ad3c-9c6bbf1d1504 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:49.675074 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9456450e-8837-4c0a-ad3c-9c6bbf1d1504 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.148540 Jul 27 20:16:49.675639 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 477/966] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:49 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:49.927717 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-98f4a30f-063e-4a55-b85c-2cf50aaaffb2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:49.930043 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-98f4a30f-063e-4a55-b85c-2cf50aaaffb2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:49.936485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-98f4a30f-063e-4a55-b85c-2cf50aaaffb2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:49.936930 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-98f4a30f-063e-4a55-b85c-2cf50aaaffb2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:49.937717 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-98f4a30f-063e-4a55-b85c-2cf50aaaffb2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:49.938157 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-98f4a30f-063e-4a55-b85c-2cf50aaaffb2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:49.967387 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-98f4a30f-063e-4a55-b85c-2cf50aaaffb2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043567 Jul 27 20:16:49.967924 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 490/967] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:49 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:50.696375 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7318b48f-ed04-4639-9787-c8b5d59ea216 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:50.696988 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7318b48f-ed04-4639-9787-c8b5d59ea216 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:50.703650 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7318b48f-ed04-4639-9787-c8b5d59ea216 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:50.704095 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7318b48f-ed04-4639-9787-c8b5d59ea216 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:50.704858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7318b48f-ed04-4639-9787-c8b5d59ea216 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:50.705315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7318b48f-ed04-4639-9787-c8b5d59ea216 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:50.838068 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7318b48f-ed04-4639-9787-c8b5d59ea216 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:50.845529 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7318b48f-ed04-4639-9787-c8b5d59ea216 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.153287 Jul 27 20:16:50.846096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 478/968] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:50 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:50.980694 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-46e960c4-2d90-4f7b-a6c4-178d3680c95f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:50.982859 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-46e960c4-2d90-4f7b-a6c4-178d3680c95f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:50.989368 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46e960c4-2d90-4f7b-a6c4-178d3680c95f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:50.989814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46e960c4-2d90-4f7b-a6c4-178d3680c95f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:50.990770 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46e960c4-2d90-4f7b-a6c4-178d3680c95f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:50.991386 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46e960c4-2d90-4f7b-a6c4-178d3680c95f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:51.025127 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-46e960c4-2d90-4f7b-a6c4-178d3680c95f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048463 Jul 27 20:16:51.025683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 491/969] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:50 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:51.867452 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d57f2446-15da-4d54-910e-424eb0d1a3a1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:51.868059 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d57f2446-15da-4d54-910e-424eb0d1a3a1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:51.874499 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d57f2446-15da-4d54-910e-424eb0d1a3a1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:51.874952 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d57f2446-15da-4d54-910e-424eb0d1a3a1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:51.875716 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d57f2446-15da-4d54-910e-424eb0d1a3a1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:51.876154 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d57f2446-15da-4d54-910e-424eb0d1a3a1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:52.005260 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d57f2446-15da-4d54-910e-424eb0d1a3a1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:52.013347 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d57f2446-15da-4d54-910e-424eb0d1a3a1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.150191 Jul 27 20:16:52.013912 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 479/970] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:51 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:52.037140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4f973deb-7d22-47b4-9e9a-51485cc74903 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:52.039315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4f973deb-7d22-47b4-9e9a-51485cc74903 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:52.045890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4f973deb-7d22-47b4-9e9a-51485cc74903 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:52.046334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4f973deb-7d22-47b4-9e9a-51485cc74903 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:52.047086 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4f973deb-7d22-47b4-9e9a-51485cc74903 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:52.047520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4f973deb-7d22-47b4-9e9a-51485cc74903 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:52.078105 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4f973deb-7d22-47b4-9e9a-51485cc74903 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045123 Jul 27 20:16:52.078650 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 492/971] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:52 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:53.034861 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-aa8479a7-a734-4248-9f8e-b54d46bfce5c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:53.035477 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-aa8479a7-a734-4248-9f8e-b54d46bfce5c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:53.043211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa8479a7-a734-4248-9f8e-b54d46bfce5c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:53.043660 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa8479a7-a734-4248-9f8e-b54d46bfce5c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:53.044432 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa8479a7-a734-4248-9f8e-b54d46bfce5c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:53.044875 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa8479a7-a734-4248-9f8e-b54d46bfce5c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:53.091693 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d4e56429-2089-4ac0-8259-801841f8f207 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:53.093901 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d4e56429-2089-4ac0-8259-801841f8f207 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:53.100479 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d4e56429-2089-4ac0-8259-801841f8f207 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:53.100937 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d4e56429-2089-4ac0-8259-801841f8f207 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:53.101751 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d4e56429-2089-4ac0-8259-801841f8f207 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:53.102197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d4e56429-2089-4ac0-8259-801841f8f207 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:53.133173 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d4e56429-2089-4ac0-8259-801841f8f207 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045438 Jul 27 20:16:53.133745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 493/972] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:53 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:53.184948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aa8479a7-a734-4248-9f8e-b54d46bfce5c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:53.192835 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-aa8479a7-a734-4248-9f8e-b54d46bfce5c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.162612 Jul 27 20:16:53.193948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 480/973] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:53 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:54.145625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ce1f497f-fba8-4964-bcd3-23767ddf328b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:54.148396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ce1f497f-fba8-4964-bcd3-23767ddf328b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:54.154878 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ce1f497f-fba8-4964-bcd3-23767ddf328b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:54.155330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ce1f497f-fba8-4964-bcd3-23767ddf328b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:54.156097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ce1f497f-fba8-4964-bcd3-23767ddf328b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:54.156542 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ce1f497f-fba8-4964-bcd3-23767ddf328b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:54.185236 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ce1f497f-fba8-4964-bcd3-23767ddf328b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043584 Jul 27 20:16:54.185775 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 494/974] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:54 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:54.214909 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ed2001a6-d565-4e96-be69-5dc15251afa6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:54.215522 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ed2001a6-d565-4e96-be69-5dc15251afa6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:54.222044 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed2001a6-d565-4e96-be69-5dc15251afa6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:54.222490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed2001a6-d565-4e96-be69-5dc15251afa6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:54.223247 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed2001a6-d565-4e96-be69-5dc15251afa6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:54.223681 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed2001a6-d565-4e96-be69-5dc15251afa6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:54.351718 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ed2001a6-d565-4e96-be69-5dc15251afa6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:54.359122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ed2001a6-d565-4e96-be69-5dc15251afa6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.148031 Jul 27 20:16:54.359682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 481/975] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:54 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:55.197658 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-29f2b553-02f4-458c-aa15-e3d6d2378992 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:55.199810 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-29f2b553-02f4-458c-aa15-e3d6d2378992 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:55.206335 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-29f2b553-02f4-458c-aa15-e3d6d2378992 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:55.206792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-29f2b553-02f4-458c-aa15-e3d6d2378992 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:55.207563 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-29f2b553-02f4-458c-aa15-e3d6d2378992 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:55.208002 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-29f2b553-02f4-458c-aa15-e3d6d2378992 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:55.236496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-29f2b553-02f4-458c-aa15-e3d6d2378992 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042814 Jul 27 20:16:55.237066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 495/976] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:55 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:55.379547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7a9489d0-177a-4ded-a838-8b325e0c0f08 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:55.380088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7a9489d0-177a-4ded-a838-8b325e0c0f08 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:55.386613 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a9489d0-177a-4ded-a838-8b325e0c0f08 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:55.387063 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a9489d0-177a-4ded-a838-8b325e0c0f08 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:55.387828 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a9489d0-177a-4ded-a838-8b325e0c0f08 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:55.388263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a9489d0-177a-4ded-a838-8b325e0c0f08 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:55.517170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7a9489d0-177a-4ded-a838-8b325e0c0f08 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:55.525378 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7a9489d0-177a-4ded-a838-8b325e0c0f08 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.149773 Jul 27 20:16:55.525951 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 482/977] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:55 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:56.249363 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-76a238e9-9811-465b-a3d1-8eca35abc0a1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:56.251503 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-76a238e9-9811-465b-a3d1-8eca35abc0a1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:56.257981 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-76a238e9-9811-465b-a3d1-8eca35abc0a1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:56.258432 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-76a238e9-9811-465b-a3d1-8eca35abc0a1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:56.259184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-76a238e9-9811-465b-a3d1-8eca35abc0a1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:56.259618 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-76a238e9-9811-465b-a3d1-8eca35abc0a1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:56.288397 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-76a238e9-9811-465b-a3d1-8eca35abc0a1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042931 Jul 27 20:16:56.288935 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 496/978] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:56 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:56.546022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d59790da-e3a8-44cf-b307-e29d4eddbe58 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:56.546644 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d59790da-e3a8-44cf-b307-e29d4eddbe58 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:56.555152 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d59790da-e3a8-44cf-b307-e29d4eddbe58 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:56.555615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d59790da-e3a8-44cf-b307-e29d4eddbe58 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:56.556874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d59790da-e3a8-44cf-b307-e29d4eddbe58 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:56.557513 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d59790da-e3a8-44cf-b307-e29d4eddbe58 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:56.694446 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d59790da-e3a8-44cf-b307-e29d4eddbe58 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:56.702095 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d59790da-e3a8-44cf-b307-e29d4eddbe58 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.159986 Jul 27 20:16:56.702658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 483/979] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:56 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:57.299911 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8b44b2db-1f5e-4a64-a280-9b1160d89bb6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:57.302026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8b44b2db-1f5e-4a64-a280-9b1160d89bb6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:57.309149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8b44b2db-1f5e-4a64-a280-9b1160d89bb6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:57.309608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8b44b2db-1f5e-4a64-a280-9b1160d89bb6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:57.310378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8b44b2db-1f5e-4a64-a280-9b1160d89bb6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:57.310823 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8b44b2db-1f5e-4a64-a280-9b1160d89bb6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:57.339643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8b44b2db-1f5e-4a64-a280-9b1160d89bb6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043756 Jul 27 20:16:57.340191 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 497/980] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:57 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:57.723790 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-47c7e4e2-7ae7-45da-a1f0-ddc8c0141bfb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:57.725129 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-47c7e4e2-7ae7-45da-a1f0-ddc8c0141bfb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:57.731685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-47c7e4e2-7ae7-45da-a1f0-ddc8c0141bfb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:57.732136 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-47c7e4e2-7ae7-45da-a1f0-ddc8c0141bfb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:57.732898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-47c7e4e2-7ae7-45da-a1f0-ddc8c0141bfb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:57.733360 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-47c7e4e2-7ae7-45da-a1f0-ddc8c0141bfb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:57.862362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-47c7e4e2-7ae7-45da-a1f0-ddc8c0141bfb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:57.869882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-47c7e4e2-7ae7-45da-a1f0-ddc8c0141bfb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.149971 Jul 27 20:16:57.870446 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 484/981] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:57 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:58.352129 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5179961d-dbea-4dfe-9081-6a3fb96f45c7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:58.354243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5179961d-dbea-4dfe-9081-6a3fb96f45c7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:58.356531 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=58 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:58.362044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5179961d-dbea-4dfe-9081-6a3fb96f45c7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:58.362497 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5179961d-dbea-4dfe-9081-6a3fb96f45c7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:58.363260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5179961d-dbea-4dfe-9081-6a3fb96f45c7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:58.363706 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5179961d-dbea-4dfe-9081-6a3fb96f45c7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:58.392935 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5179961d-dbea-4dfe-9081-6a3fb96f45c7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044960 Jul 27 20:16:58.393501 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 498/982] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:58 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:16:58.890668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-81e68cbf-98ad-4817-9cea-5af4f3f53f5d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:58.891278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-81e68cbf-98ad-4817-9cea-5af4f3f53f5d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:58.898207 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81e68cbf-98ad-4817-9cea-5af4f3f53f5d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:58.898661 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81e68cbf-98ad-4817-9cea-5af4f3f53f5d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:58.899428 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81e68cbf-98ad-4817-9cea-5af4f3f53f5d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:58.899863 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81e68cbf-98ad-4817-9cea-5af4f3f53f5d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:58.914678 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:16:59.035680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-81e68cbf-98ad-4817-9cea-5af4f3f53f5d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:16:59.044167 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-81e68cbf-98ad-4817-9cea-5af4f3f53f5d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.157324 Jul 27 20:16:59.044725 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 485/983] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:16:58 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:16:59.405587 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-662c4b00-195d-42ec-b83c-8d802b436eea tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:16:59.407890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-662c4b00-195d-42ec-b83c-8d802b436eea tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:16:59.415319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-662c4b00-195d-42ec-b83c-8d802b436eea tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:59.415772 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-662c4b00-195d-42ec-b83c-8d802b436eea tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:59.416535 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-662c4b00-195d-42ec-b83c-8d802b436eea tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:16:59.417002 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-662c4b00-195d-42ec-b83c-8d802b436eea tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:16:59.445786 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-662c4b00-195d-42ec-b83c-8d802b436eea tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044148 Jul 27 20:16:59.446324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 499/984] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:16:59 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:17:00.018500 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a7f15294-47a5-42d3-ad5a-8fa66ff39d05 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:00.019022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a7f15294-47a5-42d3-ad5a-8fa66ff39d05 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:00.025896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7f15294-47a5-42d3-ad5a-8fa66ff39d05 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:00.026355 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7f15294-47a5-42d3-ad5a-8fa66ff39d05 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:00.027114 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7f15294-47a5-42d3-ad5a-8fa66ff39d05 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:00.027553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7f15294-47a5-42d3-ad5a-8fa66ff39d05 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:00.060191 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0f4bf528-4de3-4c3a-9e63-71a4fdb2c689 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:17:00.061028 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0f4bf528-4de3-4c3a-9e63-71a4fdb2c689 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:17:00.067623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0f4bf528-4de3-4c3a-9e63-71a4fdb2c689 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:00.068707 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0f4bf528-4de3-4c3a-9e63-71a4fdb2c689 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:00.069616 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0f4bf528-4de3-4c3a-9e63-71a4fdb2c689 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:17:00.070054 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0f4bf528-4de3-4c3a-9e63-71a4fdb2c689 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:17:10.023120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=21 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:10.046169 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=7 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:10.065404 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=5 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:10.127023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=75 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:12.220460 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-a7f15294-47a5-42d3-ad5a-8fa66ff39d05 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lazy-loading 'services' on Instance uuid 0d634922-ac08-46f6-aa94-44abf09f6bc3 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:17:12.261603 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.objects.instance [None req-0f4bf528-4de3-4c3a-9e63-71a4fdb2c689 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lazy-loading 'services' on Instance uuid d725356e-73a3-486b-b590-0324916667ff {{(pid=117876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:17:22.224691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=4 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:17:22.295754 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=4 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:18:23.026813 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:18:23.027424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:18:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3 (ip 10.222.0.65) !!! Jul 27 20:18:27.247991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:18:27.248614 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:18:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3 (ip 10.222.0.65) !!! Jul 27 20:19:00.289841 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a7f15294-47a5-42d3-ad5a-8fa66ff39d05 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3" status: 202 len: 0 microversion: 2.1 time: 120.274305 Jul 27 20:19:00.290953 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 486/985] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Jul 27 20:17:00 2022] DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3 => generated 0 bytes in 120277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:19:00.297343 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fc628e32-9241-4b27-b586-649e9ace317e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:00.298071 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fc628e32-9241-4b27-b586-649e9ace317e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:00.304613 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc628e32-9241-4b27-b586-649e9ace317e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:00.305944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc628e32-9241-4b27-b586-649e9ace317e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:00.306959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc628e32-9241-4b27-b586-649e9ace317e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:00.307458 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc628e32-9241-4b27-b586-649e9ace317e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:00.447442 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0f4bf528-4de3-4c3a-9e63-71a4fdb2c689 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea" status: 202 len: 0 microversion: 2.20 time: 120.391944 Jul 27 20:19:00.448132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 500/986] 10.222.0.65 () {60 vars in 1457 bytes} [Wed Jul 27 20:17:00 2022] DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea => generated 0 bytes in 120394 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 27 20:19:00.450836 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fc628e32-9241-4b27-b586-649e9ace317e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:19:00.462184 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fc628e32-9241-4b27-b586-649e9ace317e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.169166 Jul 27 20:19:00.463321 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 487/987] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:19:00 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:19:00.463797 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9e6b4319-3a6a-46b9-bdc2-ba0b12acb32b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:00.466402 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9e6b4319-3a6a-46b9-bdc2-ba0b12acb32b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:00.471325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b7cecd3e-fa3d-476c-b2b7-aec025262842 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:00.472671 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b7cecd3e-fa3d-476c-b2b7-aec025262842 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:00.473633 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9e6b4319-3a6a-46b9-bdc2-ba0b12acb32b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:00.474345 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9e6b4319-3a6a-46b9-bdc2-ba0b12acb32b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:00.475231 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9e6b4319-3a6a-46b9-bdc2-ba0b12acb32b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:00.475901 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9e6b4319-3a6a-46b9-bdc2-ba0b12acb32b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:00.482940 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7cecd3e-fa3d-476c-b2b7-aec025262842 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:00.483688 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7cecd3e-fa3d-476c-b2b7-aec025262842 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:00.484693 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7cecd3e-fa3d-476c-b2b7-aec025262842 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:00.485672 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7cecd3e-fa3d-476c-b2b7-aec025262842 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:00.518190 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9e6b4319-3a6a-46b9-bdc2-ba0b12acb32b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068574 Jul 27 20:19:00.518759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 501/988] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:19:00 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:19:00.523515 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3191bd7c-29c1-4aa4-83db-bbd07348e71a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:19:00.524018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3191bd7c-29c1-4aa4-83db-bbd07348e71a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:19:00.530099 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3191bd7c-29c1-4aa4-83db-bbd07348e71a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:00.530552 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3191bd7c-29c1-4aa4-83db-bbd07348e71a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:00.531328 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3191bd7c-29c1-4aa4-83db-bbd07348e71a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:19:00.531773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3191bd7c-29c1-4aa4-83db-bbd07348e71a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:19:10.477138 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=4 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:19:10.514660 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:19:10.528128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=4 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:19:10.550215 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:19:12.397420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-b7cecd3e-fa3d-476c-b2b7-aec025262842 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lazy-loading 'services' on Instance uuid 0d634922-ac08-46f6-aa94-44abf09f6bc3 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:19:12.437730 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.objects.instance [None req-3191bd7c-29c1-4aa4-83db-bbd07348e71a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lazy-loading 'services' on Instance uuid d725356e-73a3-486b-b590-0324916667ff {{(pid=117876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:19:22.402576 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=4 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:19:22.441456 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=4 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:20:00.710279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:20:00.710991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:20:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea (ip 10.222.0.65) !!! Jul 27 20:20:06.907620 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:20:06.908333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:20:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea (ip 10.222.0.65) !!! Jul 27 20:21:00.743456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-b7cecd3e-fa3d-476c-b2b7-aec025262842 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0401562a-a1b1-4983-9c94-da59efe65720) Jul 27 20:21:00.745852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b7cecd3e-fa3d-476c-b2b7-aec025262842 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Request method failure captured: Jul 27 20:21:00.745852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3 HTTP/1.1 Jul 27 20:21:00.745852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:21:00.745852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:21:00.745852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:21:00.745852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:21:00.745852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:21:00.745852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:21:00.745852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:21:00.745852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:21:00.745852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4Zs1w1g_5EBOAJHGXZvQfsbeerbcd37lKRD5mUkafMdHZAX3P44SwOy9NISSA8Lh2nFLwJ2io24pgRqnG4EvPMR-HJKAS2sxbES-VziDHtkha7CtqVpqP38PRAt1Y6btPfnsUjV-NLhIZjiSnTrYjlnZs4PaFMjmKlQulWMSRQRQQCg Jul 27 20:21:00.745852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:21:00.745852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:21:00.745852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:21:00.745852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:21:00.745852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:21:00.745852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:21:00.745852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: 1626b826d47a47429a947fa36ace64e4 Jul 27 20:21:00.745852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:21:00.745852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:21:00.745852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:21:00.747258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1626b826d47a47429a947fa36ace64e4", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:21:00.747258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:21:00.747258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 1626b826d47a47429a947fa36ace64e4 Jul 27 20:21:00.747258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:21:00.747258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-ServerRescueNegativeTestJSON-2064775453-project Jul 27 20:21:00.747258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:21:00.747258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:21:00.747258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: a48eaef4d70b4116bd307374d819bca6 Jul 27 20:21:00.747258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2064775453-project Jul 27 20:21:00.747258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:21:00.748209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0401562a-a1b1-4983-9c94-da59efe65720) Jul 27 20:21:00.748209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'server_id': '0d634922-ac08-46f6-aa94-44abf09f6bc3', 'id': 'd4fe68b5-3007-45a2-91be-ff65008cfbc3'} Jul 27 20:21:00.748209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:21:00.748209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:21:00.748209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:21:00.748209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:21:00.748209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:21:00.748209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:21:00.748209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:21:00.748209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:21:00.748209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:21:00.748209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:21:00.748209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:21:00.748209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:21:00.748209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:21:00.748209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:21:00.748209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:21:00.749581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:21:00.749581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:21:00.749581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:21:00.749581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0401562a-a1b1-4983-9c94-da59efe65720) Jul 27 20:21:00.749581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:21:00.749581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:21:00.749581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:21:00.749581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:21:00.749581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:21:00.749581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:21:00.749581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:21:00.749581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:21:00.749581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:21:00.749581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:21:00.749581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:21:00.749581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:21:00.749581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:21:00.749581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:21:00.749581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:21:00.750741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:21:00.750741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:21:00.750741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:21:00.750741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:21:00.750741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:21:00.750741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:21:00.750741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:21:00.750741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:21:00.750741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:21:00.750741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:21:00.750741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:21:00.750741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0401562a-a1b1-4983-9c94-da59efe65720) Jul 27 20:21:00.750741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:21:00.750741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:21:00.750741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:21:00.750741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:21:00.750741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:21:00.751744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:21:00.751744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:21:00.751744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:21:00.751744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:21:00.751744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:21:00.751744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:21:00.751744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:21:00.751744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:21:00.751744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:21:00.751744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:21:00.751744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:21:00.751744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0401562a-a1b1-4983-9c94-da59efe65720) Jul 27 20:21:00.751744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:21:00.751744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:21:00.751744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:21:00.751744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:21:00.751744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:21:00.751744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:21:00.752874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:21:00.752874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:21:00.752874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:21:00.752874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:21:00.752874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:21:00.752874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:21:00.752874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0401562a-a1b1-4983-9c94-da59efe65720) Jul 27 20:21:00.752874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:21:00.752874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:21:00.752874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:21:00.752874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:21:00.752874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:21:00.752874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:21:00.752874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:21:00.752874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:21:00.752874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0401562a-a1b1-4983-9c94-da59efe65720) Jul 27 20:21:00.752874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:21:00.755468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b7cecd3e-fa3d-476c-b2b7-aec025262842 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0401562a-a1b1-4983-9c94-da59efe65720) {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:21:00.755468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b7cecd3e-fa3d-476c-b2b7-aec025262842 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3" status: 400 len: 269 microversion: 2.1 time: 120.282031 Jul 27 20:21:00.755468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 488/989] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Jul 27 20:19:00 2022] DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3 => generated 269 bytes in 120284 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:21:00.779275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-3191bd7c-29c1-4aa4-83db-bbd07348e71a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c68be0b8-e440-4446-9d2f-1751eca602c9) Jul 27 20:21:00.782061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3191bd7c-29c1-4aa4-83db-bbd07348e71a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Request method failure captured: Jul 27 20:21:00.782061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea HTTP/1.1 Jul 27 20:21:00.782061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:21:00.782061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:21:00.782061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:21:00.782061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:21:00.782061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:21:00.782061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:21:00.782061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:21:00.782061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:21:00.782061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4ZszolpoHLv4ymfn-jDIXXwrtat6zA6fU8pUvlIxQFFvg2akujyL-RcTkc0AHUPtL9FfHVEqLLG1P3QFKYKGA6GTuRef7uYyPgJ3tvotGw9j0tfDvIc-GZxx3Nrm1QaM2Jm97CejtJa-hGoo2CtA1AtsmrF2YR6vqcqJ-OZzLMovey0 Jul 27 20:21:00.782061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:21:00.782061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:21:00.782061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:21:00.782061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:21:00.782061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 20:21:00.782061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:21:00.782061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:21:00.782061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:21:00.782061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:21:00.782061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:21:00.782061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:21:00.783474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec01b599458b451e8d04a428c1c33513", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:21:00.783474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:21:00.783474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:21:00.783474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:21:00.783474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:21:00.783474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:21:00.783474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:21:00.783474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: b734a345bfe5483d9a5a1e35d89c935b Jul 27 20:21:00.783474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:21:00.783474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:21:00.784486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c68be0b8-e440-4446-9d2f-1751eca602c9) Jul 27 20:21:00.784486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'server_id': 'd725356e-73a3-486b-b590-0324916667ff', 'id': '2f4bb420-948b-4be6-9672-a9051968dcea'} Jul 27 20:21:00.784486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:21:00.784486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:21:00.784486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:21:00.784486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:21:00.784486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:21:00.784486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:21:00.784486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:21:00.784486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:21:00.784486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:21:00.784486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:21:00.784486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:21:00.784486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:21:00.784486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:21:00.784486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:21:00.784486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:21:00.788040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:21:00.788040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:21:00.788040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:21:00.788040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c68be0b8-e440-4446-9d2f-1751eca602c9) Jul 27 20:21:00.788040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:21:00.788040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:21:00.788040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:21:00.788040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:21:00.788040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:21:00.788040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:21:00.788040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:21:00.788040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:21:00.788040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:21:00.788040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:21:00.788040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:21:00.788040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:21:00.788040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:21:00.788040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:21:00.788040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:21:00.790865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:21:00.790865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:21:00.790865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:21:00.790865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:21:00.790865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:21:00.790865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:21:00.790865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:21:00.790865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:21:00.790865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:21:00.790865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:21:00.790865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:21:00.790865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c68be0b8-e440-4446-9d2f-1751eca602c9) Jul 27 20:21:00.790865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:21:00.790865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:21:00.790865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:21:00.790865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:21:00.790865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:21:00.793158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:21:00.793158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:21:00.793158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:21:00.793158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:21:00.793158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:21:00.793158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:21:00.793158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:21:00.793158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:21:00.793158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:21:00.793158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:21:00.793158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:21:00.793158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c68be0b8-e440-4446-9d2f-1751eca602c9) Jul 27 20:21:00.793158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:21:00.793158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:21:00.793158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:21:00.793158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:21:00.793158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:21:00.793158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:21:00.796298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:21:00.796298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:21:00.796298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:21:00.796298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:21:00.796298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:21:00.796298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:21:00.796298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c68be0b8-e440-4446-9d2f-1751eca602c9) Jul 27 20:21:00.796298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:21:00.796298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:21:00.796298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:21:00.796298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:21:00.796298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:21:00.796298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:21:00.796298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:21:00.796298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:21:00.796298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c68be0b8-e440-4446-9d2f-1751eca602c9) Jul 27 20:21:00.796298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:21:00.797539 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3191bd7c-29c1-4aa4-83db-bbd07348e71a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c68be0b8-e440-4446-9d2f-1751eca602c9) {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:21:00.797539 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3191bd7c-29c1-4aa4-83db-bbd07348e71a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea" status: 400 len: 269 microversion: 2.20 time: 120.264039 Jul 27 20:21:00.797539 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 502/990] 10.222.0.65 () {60 vars in 1457 bytes} [Wed Jul 27 20:19:00 2022] DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea => generated 269 bytes in 120265 msecs (HTTP/1.1 400) 9 headers in 383 bytes (1 switches on core 0) Jul 27 20:21:00.825550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2a48bfab-2d77-4b48-aed6-49e57bb277c7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:00.826327 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2a48bfab-2d77-4b48-aed6-49e57bb277c7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:00.835868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a48bfab-2d77-4b48-aed6-49e57bb277c7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:00.836415 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a48bfab-2d77-4b48-aed6-49e57bb277c7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:00.837408 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a48bfab-2d77-4b48-aed6-49e57bb277c7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:00.838015 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a48bfab-2d77-4b48-aed6-49e57bb277c7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:00.875623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-939622ce-2514-4629-a6f3-d82963dd97e3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:00.877857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-939622ce-2514-4629-a6f3-d82963dd97e3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:00.885249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-939622ce-2514-4629-a6f3-d82963dd97e3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:00.885783 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-939622ce-2514-4629-a6f3-d82963dd97e3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:00.886578 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-939622ce-2514-4629-a6f3-d82963dd97e3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:00.887195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-939622ce-2514-4629-a6f3-d82963dd97e3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:00.922957 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-939622ce-2514-4629-a6f3-d82963dd97e3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136734 Jul 27 20:21:00.923596 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 503/991] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:21:00 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:21:00.928794 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-733c01a7-ff5d-4c07-8876-4ef0079038cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:00.929612 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-733c01a7-ff5d-4c07-8876-4ef0079038cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:00.936059 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-733c01a7-ff5d-4c07-8876-4ef0079038cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:00.936982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-733c01a7-ff5d-4c07-8876-4ef0079038cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:00.938207 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-733c01a7-ff5d-4c07-8876-4ef0079038cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:00.938771 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-733c01a7-ff5d-4c07-8876-4ef0079038cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:00.980422 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2a48bfab-2d77-4b48-aed6-49e57bb277c7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:21:00.988009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2a48bfab-2d77-4b48-aed6-49e57bb277c7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.239326 Jul 27 20:21:00.988578 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 489/992] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:21:00 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:21:00.993305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-835ac06c-7abe-4529-9884-94301c931e7d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:21:00.993784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-835ac06c-7abe-4529-9884-94301c931e7d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:21:00.999352 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-835ac06c-7abe-4529-9884-94301c931e7d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:00.999739 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-835ac06c-7abe-4529-9884-94301c931e7d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:01.000499 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-835ac06c-7abe-4529-9884-94301c931e7d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:21:01.000934 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-835ac06c-7abe-4529-9884-94301c931e7d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:21:10.935533 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=4 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:21:10.960035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=10 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:21:10.996649 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=4 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:21:11.019402 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=10 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:21:12.671257 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.objects.instance [None req-733c01a7-ff5d-4c07-8876-4ef0079038cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lazy-loading 'services' on Instance uuid 0d634922-ac08-46f6-aa94-44abf09f6bc3 {{(pid=117876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:21:12.713610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-835ac06c-7abe-4529-9884-94301c931e7d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lazy-loading 'services' on Instance uuid d725356e-73a3-486b-b590-0324916667ff {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:21:22.675559 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=4 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:21:22.717335 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=4 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:21:43.035369 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:21:43.036159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:21:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea (ip 10.222.0.65) !!! Jul 27 20:21:47.256674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:21:47.257367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:21:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea (ip 10.222.0.65) !!! Jul 27 20:22:06.119941 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:22:06.120447 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:22:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3 (ip 10.222.0.65) !!! Jul 27 20:22:06.637241 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:22:06.637808 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:22:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea (ip 10.222.0.65) !!! Jul 27 20:23:00.983472 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-733c01a7-ff5d-4c07-8876-4ef0079038cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0a416e38-a017-4ea1-8893-167d7c0331c0) Jul 27 20:23:00.986423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-733c01a7-ff5d-4c07-8876-4ef0079038cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Request method failure captured: Jul 27 20:23:00.986423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3 HTTP/1.1 Jul 27 20:23:00.986423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:23:00.986423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:23:00.986423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:23:00.986423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:23:00.986423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:23:00.986423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:23:00.986423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:23:00.986423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:23:00.986423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4Zs1w1g_5EBOAJHGXZvQfsbeerbcd37lKRD5mUkafMdHZAX3P44SwOy9NISSA8Lh2nFLwJ2io24pgRqnG4EvPMR-HJKAS2sxbES-VziDHtkha7CtqVpqP38PRAt1Y6btPfnsUjV-NLhIZjiSnTrYjlnZs4PaFMjmKlQulWMSRQRQQCg Jul 27 20:23:00.986423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:23:00.986423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:23:00.986423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:23:00.986423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:23:00.986423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:23:00.986423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:23:00.986423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 1626b826d47a47429a947fa36ace64e4 Jul 27 20:23:00.986423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:23:00.986423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:23:00.986423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:23:00.988202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1626b826d47a47429a947fa36ace64e4", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:23:00.988202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:23:00.988202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 1626b826d47a47429a947fa36ace64e4 Jul 27 20:23:00.988202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:23:00.988202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-ServerRescueNegativeTestJSON-2064775453-project Jul 27 20:23:00.988202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:23:00.988202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:23:00.988202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: a48eaef4d70b4116bd307374d819bca6 Jul 27 20:23:00.988202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2064775453-project Jul 27 20:23:00.988202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:23:00.990816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0a416e38-a017-4ea1-8893-167d7c0331c0) Jul 27 20:23:00.990816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'server_id': '0d634922-ac08-46f6-aa94-44abf09f6bc3', 'id': 'd4fe68b5-3007-45a2-91be-ff65008cfbc3'} Jul 27 20:23:00.990816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:23:00.990816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:23:00.990816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:23:00.990816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:23:00.990816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:23:00.990816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:23:00.990816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:23:00.990816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:23:00.990816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:23:00.990816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:23:00.990816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:23:00.990816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:23:00.990816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:23:00.990816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:23:00.990816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:23:00.992195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:23:00.992195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:23:00.992195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:23:00.992195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0a416e38-a017-4ea1-8893-167d7c0331c0) Jul 27 20:23:00.992195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:23:00.992195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:23:00.992195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:23:00.992195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:23:00.992195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:23:00.992195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:23:00.992195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:23:00.992195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:23:00.992195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:23:00.992195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:23:00.992195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:23:00.992195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:23:00.992195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:23:00.992195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:23:00.992195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:23:00.995980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:23:00.995980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:23:00.995980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:23:00.995980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:23:00.995980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:23:00.995980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:23:00.995980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:23:00.995980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:23:00.995980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:23:00.995980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:23:00.995980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:23:00.995980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0a416e38-a017-4ea1-8893-167d7c0331c0) Jul 27 20:23:00.995980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:23:00.995980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:23:00.995980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:23:00.995980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:23:00.995980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:23:00.997245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:23:00.997245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:23:00.997245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:23:00.997245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:23:00.997245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:23:00.997245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:23:00.997245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:23:00.997245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:23:00.997245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:23:00.997245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:23:00.997245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:23:00.997245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0a416e38-a017-4ea1-8893-167d7c0331c0) Jul 27 20:23:00.997245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:23:00.997245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:23:00.997245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:23:00.997245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:23:00.997245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:23:00.997245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:23:00.998571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:23:00.998571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:23:00.998571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:23:00.998571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:23:00.998571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:23:00.998571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:23:00.998571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0a416e38-a017-4ea1-8893-167d7c0331c0) Jul 27 20:23:00.998571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:23:00.998571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:23:00.998571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:23:00.998571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:23:00.998571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:23:00.998571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:23:00.998571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:23:00.998571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:23:00.998571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0a416e38-a017-4ea1-8893-167d7c0331c0) Jul 27 20:23:00.998571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:23:00.999833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-733c01a7-ff5d-4c07-8876-4ef0079038cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0a416e38-a017-4ea1-8893-167d7c0331c0) {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:23:00.999833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-733c01a7-ff5d-4c07-8876-4ef0079038cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3" status: 400 len: 269 microversion: 2.1 time: 120.062985 Jul 27 20:23:00.999833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 504/993] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Jul 27 20:21:00 2022] DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3 => generated 269 bytes in 120064 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:23:00.999833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-dbacfe2f-3053-4050-974d-e67abedb906a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:01.000191 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-dbacfe2f-3053-4050-974d-e67abedb906a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:01.002531 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dbacfe2f-3053-4050-974d-e67abedb906a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:01.002989 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dbacfe2f-3053-4050-974d-e67abedb906a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:01.003754 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dbacfe2f-3053-4050-974d-e67abedb906a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:01.004195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dbacfe2f-3053-4050-974d-e67abedb906a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:01.021978 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-835ac06c-7abe-4529-9884-94301c931e7d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f945ac09-2af2-49ea-a6f1-f0c1f76d7710) Jul 27 20:23:01.024325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-835ac06c-7abe-4529-9884-94301c931e7d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Request method failure captured: Jul 27 20:23:01.024325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea HTTP/1.1 Jul 27 20:23:01.024325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:23:01.024325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:23:01.024325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:23:01.024325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:23:01.024325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:23:01.024325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:23:01.024325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:23:01.024325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:23:01.024325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4ZszolpoHLv4ymfn-jDIXXwrtat6zA6fU8pUvlIxQFFvg2akujyL-RcTkc0AHUPtL9FfHVEqLLG1P3QFKYKGA6GTuRef7uYyPgJ3tvotGw9j0tfDvIc-GZxx3Nrm1QaM2Jm97CejtJa-hGoo2CtA1AtsmrF2YR6vqcqJ-OZzLMovey0 Jul 27 20:23:01.024325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:23:01.024325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:23:01.024325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:23:01.024325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:23:01.024325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 20:23:01.024325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:23:01.024325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:23:01.024325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:23:01.024325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:23:01.024325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:23:01.024325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:23:01.026186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec01b599458b451e8d04a428c1c33513", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:23:01.026186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:23:01.026186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:23:01.026186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:23:01.026186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:23:01.026186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:23:01.026186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:23:01.026186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: b734a345bfe5483d9a5a1e35d89c935b Jul 27 20:23:01.026186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:23:01.026186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:23:01.027362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f945ac09-2af2-49ea-a6f1-f0c1f76d7710) Jul 27 20:23:01.027362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'server_id': 'd725356e-73a3-486b-b590-0324916667ff', 'id': '2f4bb420-948b-4be6-9672-a9051968dcea'} Jul 27 20:23:01.027362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:23:01.027362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:23:01.027362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:23:01.027362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:23:01.027362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:23:01.027362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:23:01.027362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:23:01.027362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:23:01.027362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:23:01.027362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:23:01.027362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:23:01.027362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:23:01.027362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:23:01.027362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:23:01.027362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:23:01.028571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:23:01.028571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:23:01.028571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:23:01.028571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f945ac09-2af2-49ea-a6f1-f0c1f76d7710) Jul 27 20:23:01.028571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:23:01.028571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:23:01.028571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:23:01.028571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:23:01.028571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:23:01.028571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:23:01.028571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:23:01.028571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:23:01.028571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:23:01.028571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:23:01.028571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:23:01.028571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:23:01.028571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:23:01.028571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:23:01.028571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:23:01.029858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:23:01.029858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:23:01.029858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:23:01.029858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:23:01.029858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:23:01.029858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:23:01.029858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:23:01.029858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:23:01.029858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:23:01.029858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:23:01.029858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:23:01.029858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f945ac09-2af2-49ea-a6f1-f0c1f76d7710) Jul 27 20:23:01.029858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:23:01.029858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:23:01.029858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:23:01.029858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:23:01.029858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:23:01.031781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:23:01.031781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:23:01.031781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:23:01.031781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:23:01.031781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:23:01.031781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:23:01.031781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:23:01.031781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:23:01.031781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:23:01.031781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:23:01.031781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:23:01.031781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f945ac09-2af2-49ea-a6f1-f0c1f76d7710) Jul 27 20:23:01.031781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:23:01.031781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:23:01.031781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:23:01.031781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:23:01.031781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:23:01.031781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:23:01.033088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:23:01.033088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:23:01.033088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:23:01.033088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:23:01.033088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:23:01.033088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:23:01.033088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f945ac09-2af2-49ea-a6f1-f0c1f76d7710) Jul 27 20:23:01.033088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:23:01.033088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:23:01.033088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:23:01.033088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:23:01.033088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:23:01.033088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:23:01.033088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:23:01.033088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:23:01.033088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f945ac09-2af2-49ea-a6f1-f0c1f76d7710) Jul 27 20:23:01.033088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:23:01.035371 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-835ac06c-7abe-4529-9884-94301c931e7d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f945ac09-2af2-49ea-a6f1-f0c1f76d7710) {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:23:01.035371 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-835ac06c-7abe-4529-9884-94301c931e7d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea" status: 400 len: 269 microversion: 2.20 time: 120.041177 Jul 27 20:23:01.035371 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 490/994] 10.222.0.65 () {60 vars in 1457 bytes} [Wed Jul 27 20:21:00 2022] DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea => generated 269 bytes in 120045 msecs (HTTP/1.1 400) 9 headers in 383 bytes (1 switches on core 0) Jul 27 20:23:01.043534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-369aef48-7b54-43b9-b82a-348d8871bb60 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:01.045970 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-369aef48-7b54-43b9-b82a-348d8871bb60 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:01.053889 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-369aef48-7b54-43b9-b82a-348d8871bb60 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:01.054418 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-369aef48-7b54-43b9-b82a-348d8871bb60 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:01.055279 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-369aef48-7b54-43b9-b82a-348d8871bb60 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:01.056654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-369aef48-7b54-43b9-b82a-348d8871bb60 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:01.088563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-369aef48-7b54-43b9-b82a-348d8871bb60 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051311 Jul 27 20:23:01.089631 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 491/995] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:23:01 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:23:01.094778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-613308c1-e1c1-4c65-b37d-d740d700d271 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:01.095363 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-613308c1-e1c1-4c65-b37d-d740d700d271 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:01.102287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-613308c1-e1c1-4c65-b37d-d740d700d271 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:01.102745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-613308c1-e1c1-4c65-b37d-d740d700d271 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:01.103523 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-613308c1-e1c1-4c65-b37d-d740d700d271 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:01.103971 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-613308c1-e1c1-4c65-b37d-d740d700d271 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:01.156091 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-dbacfe2f-3053-4050-974d-e67abedb906a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:23:01.164250 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-dbacfe2f-3053-4050-974d-e67abedb906a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.173550 Jul 27 20:23:01.164860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 505/996] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:23:00 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:23:01.169475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-781b27fa-ed67-4c2d-974c-1ae8609d3631 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:23:01.169961 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-781b27fa-ed67-4c2d-974c-1ae8609d3631 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:23:01.175773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-781b27fa-ed67-4c2d-974c-1ae8609d3631 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:01.176739 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-781b27fa-ed67-4c2d-974c-1ae8609d3631 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:01.177574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-781b27fa-ed67-4c2d-974c-1ae8609d3631 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:23:01.178005 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-781b27fa-ed67-4c2d-974c-1ae8609d3631 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:23:11.099291 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=4 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:23:11.123542 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=10 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:23:11.173246 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=4 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:23:11.197617 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=10 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:23:12.782864 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-613308c1-e1c1-4c65-b37d-d740d700d271 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lazy-loading 'services' on Instance uuid 0d634922-ac08-46f6-aa94-44abf09f6bc3 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:23:12.824526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.objects.instance [None req-781b27fa-ed67-4c2d-974c-1ae8609d3631 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lazy-loading 'services' on Instance uuid d725356e-73a3-486b-b590-0324916667ff {{(pid=117876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:23:20.718938 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:23:20.719725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:23:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea (ip 10.222.0.65) !!! Jul 27 20:23:22.787352 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=4 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:23:22.828952 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=4 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:23:26.916629 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:23:26.917249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:23:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea (ip 10.222.0.65) !!! Jul 27 20:25:01.375652 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-613308c1-e1c1-4c65-b37d-d740d700d271 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1379f45a-7d08-4d25-9bea-36743344eb1d) Jul 27 20:25:01.377868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-613308c1-e1c1-4c65-b37d-d740d700d271 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Request method failure captured: Jul 27 20:25:01.377868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3 HTTP/1.1 Jul 27 20:25:01.377868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:25:01.377868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:25:01.377868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:25:01.377868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:25:01.377868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:25:01.377868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:25:01.377868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:25:01.377868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:25:01.377868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4Zs1w1g_5EBOAJHGXZvQfsbeerbcd37lKRD5mUkafMdHZAX3P44SwOy9NISSA8Lh2nFLwJ2io24pgRqnG4EvPMR-HJKAS2sxbES-VziDHtkha7CtqVpqP38PRAt1Y6btPfnsUjV-NLhIZjiSnTrYjlnZs4PaFMjmKlQulWMSRQRQQCg Jul 27 20:25:01.377868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:25:01.377868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:25:01.377868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:25:01.377868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:25:01.377868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:25:01.377868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:25:01.377868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: 1626b826d47a47429a947fa36ace64e4 Jul 27 20:25:01.377868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:25:01.377868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:25:01.377868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:25:01.379583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1626b826d47a47429a947fa36ace64e4", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:25:01.379583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:25:01.379583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 1626b826d47a47429a947fa36ace64e4 Jul 27 20:25:01.379583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:25:01.379583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-ServerRescueNegativeTestJSON-2064775453-project Jul 27 20:25:01.379583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:25:01.379583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:25:01.379583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: a48eaef4d70b4116bd307374d819bca6 Jul 27 20:25:01.379583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2064775453-project Jul 27 20:25:01.379583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:25:01.380215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1379f45a-7d08-4d25-9bea-36743344eb1d) Jul 27 20:25:01.380215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'server_id': '0d634922-ac08-46f6-aa94-44abf09f6bc3', 'id': 'd4fe68b5-3007-45a2-91be-ff65008cfbc3'} Jul 27 20:25:01.380215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:25:01.380215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:01.380215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:01.380215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:01.380215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:01.380215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:01.380215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:01.380215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:01.380215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:01.380215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:01.380215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:01.380215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:01.380215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:01.380215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:01.380215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:01.381411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:01.381411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:01.381411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:01.381411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1379f45a-7d08-4d25-9bea-36743344eb1d) Jul 27 20:25:01.381411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.381411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:01.381411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.381411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:01.381411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:25:01.381411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:25:01.381411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:25:01.381411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:25:01.381411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:25:01.381411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:25:01.381411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:01.381411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:01.381411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:01.381411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:01.381411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:01.383315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:01.383315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:01.383315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:01.383315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:01.383315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:01.383315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:01.383315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:01.383315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:01.383315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:01.383315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:01.383315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:01.383315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1379f45a-7d08-4d25-9bea-36743344eb1d) Jul 27 20:25:01.383315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.383315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:01.383315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.383315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:01.383315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:25:01.384536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:25:01.384536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:25:01.384536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:01.384536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:25:01.384536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:25:01.384536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:25:01.384536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:25:01.384536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:25:01.384536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:01.384536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:25:01.384536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:25:01.384536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1379f45a-7d08-4d25-9bea-36743344eb1d) Jul 27 20:25:01.384536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.384536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:01.384536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.384536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:01.384536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:01.384536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:01.385946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:25:01.385946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:25:01.385946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:25:01.385946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:25:01.385946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:25:01.385946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:25:01.385946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1379f45a-7d08-4d25-9bea-36743344eb1d) Jul 27 20:25:01.385946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.385946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:01.385946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.385946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:01.385946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:01.385946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:01.385946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:25:01.385946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:25:01.385946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1379f45a-7d08-4d25-9bea-36743344eb1d) Jul 27 20:25:01.385946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.387216 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-613308c1-e1c1-4c65-b37d-d740d700d271 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1379f45a-7d08-4d25-9bea-36743344eb1d) {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:25:01.387216 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-613308c1-e1c1-4c65-b37d-d740d700d271 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3" status: 400 len: 269 microversion: 2.1 time: 120.288651 Jul 27 20:25:01.387216 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:25:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3 (ip 10.222.0.65) !!! Jul 27 20:25:01.387216 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:25:01 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3 (10.222.0.65) Jul 27 20:25:01.387216 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: CRITICAL nova [None req-613308c1-e1c1-4c65-b37d-d740d700d271 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Unhandled error: OSError: write error Jul 27 20:25:01.387216 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova OSError: write error Jul 27 20:25:01.387216 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova Jul 27 20:25:01.387812 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 492/997] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Jul 27 20:23:01 2022] DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3 => generated 0 bytes in 120291 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jul 27 20:25:01.387812 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6a145af3-1526-4f0b-b899-348336901740 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:01.387812 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6a145af3-1526-4f0b-b899-348336901740 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:01.393798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6a145af3-1526-4f0b-b899-348336901740 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:01.394253 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6a145af3-1526-4f0b-b899-348336901740 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:01.395025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6a145af3-1526-4f0b-b899-348336901740 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:01.395493 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6a145af3-1526-4f0b-b899-348336901740 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:01.528031 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6a145af3-1526-4f0b-b899-348336901740 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:01.535592 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6a145af3-1526-4f0b-b899-348336901740 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.153833 Jul 27 20:25:01.536503 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:25:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 (ip 10.222.0.65) !!! Jul 27 20:25:01.536503 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:25:01 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 (10.222.0.65) Jul 27 20:25:01.537117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: CRITICAL nova [None req-6a145af3-1526-4f0b-b899-348336901740 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Unhandled error: OSError: write error Jul 27 20:25:01.537117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova OSError: write error Jul 27 20:25:01.537117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova Jul 27 20:25:01.537395 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 493/998] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:01 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 0 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 27 20:25:01.541966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b3e9bcf0-d9b3-4ea0-900b-e8aec3182a53 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:01.544240 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b3e9bcf0-d9b3-4ea0-900b-e8aec3182a53 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:01.550921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3e9bcf0-d9b3-4ea0-900b-e8aec3182a53 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:01.551354 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3e9bcf0-d9b3-4ea0-900b-e8aec3182a53 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:01.552259 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3e9bcf0-d9b3-4ea0-900b-e8aec3182a53 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:01.552756 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3e9bcf0-d9b3-4ea0-900b-e8aec3182a53 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:01.577341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-781b27fa-ed67-4c2d-974c-1ae8609d3631 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-58c37068-7a70-4d9b-aaeb-8d73cf806886) Jul 27 20:25:01.579558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-781b27fa-ed67-4c2d-974c-1ae8609d3631 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Request method failure captured: Jul 27 20:25:01.579558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea HTTP/1.1 Jul 27 20:25:01.579558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:25:01.579558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:25:01.579558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:25:01.579558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:25:01.579558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:25:01.579558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:25:01.579558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:25:01.579558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:25:01.579558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4ZszolpoHLv4ymfn-jDIXXwrtat6zA6fU8pUvlIxQFFvg2akujyL-RcTkc0AHUPtL9FfHVEqLLG1P3QFKYKGA6GTuRef7uYyPgJ3tvotGw9j0tfDvIc-GZxx3Nrm1QaM2Jm97CejtJa-hGoo2CtA1AtsmrF2YR6vqcqJ-OZzLMovey0 Jul 27 20:25:01.579558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:25:01.579558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:25:01.579558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:25:01.579558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:25:01.579558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 20:25:01.579558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:25:01.579558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:25:01.579558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:25:01.579558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:25:01.579558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:25:01.579558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:25:01.580944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec01b599458b451e8d04a428c1c33513", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:25:01.580944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:25:01.580944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:25:01.580944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:25:01.580944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:25:01.580944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:25:01.580944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:25:01.580944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: b734a345bfe5483d9a5a1e35d89c935b Jul 27 20:25:01.580944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:25:01.580944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:25:01.581597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-58c37068-7a70-4d9b-aaeb-8d73cf806886) Jul 27 20:25:01.581597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'server_id': 'd725356e-73a3-486b-b590-0324916667ff', 'id': '2f4bb420-948b-4be6-9672-a9051968dcea'} Jul 27 20:25:01.581597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:25:01.581597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:01.581597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:01.581597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:01.581597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:01.581597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:01.581597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:01.581597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:01.581597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:01.581597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:01.581597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:01.581597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:01.581597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:01.581597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:01.581597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:01.582642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:01.582642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:01.582642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:01.582642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-58c37068-7a70-4d9b-aaeb-8d73cf806886) Jul 27 20:25:01.582642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.582642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:01.582642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.582642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:01.582642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:25:01.582642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:25:01.582642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:25:01.582642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:25:01.582642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:25:01.582642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:25:01.582642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:01.582642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:01.582642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:01.582642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:01.582642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:01.585307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:01.585307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:01.585307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:01.585307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:01.585307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:01.585307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:01.585307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:01.585307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:01.585307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:01.585307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:01.585307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:01.585307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-58c37068-7a70-4d9b-aaeb-8d73cf806886) Jul 27 20:25:01.585307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.585307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:01.585307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.585307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:01.585307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:25:01.587026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:25:01.587026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:25:01.587026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:01.587026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:25:01.587026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:25:01.587026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:25:01.587026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:25:01.587026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:25:01.587026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:01.587026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:25:01.587026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:25:01.587026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-58c37068-7a70-4d9b-aaeb-8d73cf806886) Jul 27 20:25:01.587026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.587026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:01.587026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.587026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:01.587026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:01.587026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:01.588496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:25:01.588496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:25:01.588496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:25:01.588496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:25:01.588496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:25:01.588496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:25:01.588496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-58c37068-7a70-4d9b-aaeb-8d73cf806886) Jul 27 20:25:01.588496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.588496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:01.588496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.588496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:01.588496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:01.588496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:01.588496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:25:01.588496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:25:01.588496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-58c37068-7a70-4d9b-aaeb-8d73cf806886) Jul 27 20:25:01.588496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.590595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-781b27fa-ed67-4c2d-974c-1ae8609d3631 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-58c37068-7a70-4d9b-aaeb-8d73cf806886) {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:25:01.590595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-781b27fa-ed67-4c2d-974c-1ae8609d3631 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea" status: 400 len: 269 microversion: 2.20 time: 120.415116 Jul 27 20:25:01.590595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:25:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea (ip 10.222.0.65) !!! Jul 27 20:25:01.590595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:25:01 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea (10.222.0.65) Jul 27 20:25:01.590595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: CRITICAL nova [None req-781b27fa-ed67-4c2d-974c-1ae8609d3631 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Unhandled error: OSError: write error Jul 27 20:25:01.590595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova OSError: write error Jul 27 20:25:01.590595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova Jul 27 20:25:01.591168 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 506/999] 10.222.0.65 () {60 vars in 1457 bytes} [Wed Jul 27 20:23:01 2022] DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea => generated 0 bytes in 120417 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jul 27 20:25:01.591263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b3e9bcf0-d9b3-4ea0-900b-e8aec3182a53 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044611 Jul 27 20:25:01.591263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:25:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments (ip 10.222.0.65) !!! Jul 27 20:25:01.591263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:25:01 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments (10.222.0.65) Jul 27 20:25:01.591263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: CRITICAL nova [None req-b3e9bcf0-d9b3-4ea0-900b-e8aec3182a53 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Unhandled error: OSError: write error Jul 27 20:25:01.591263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova OSError: write error Jul 27 20:25:01.591263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova Jul 27 20:25:01.591263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 494/1000] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:01 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 27 20:25:01.592054 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6b4fb7ef-f8c5-484a-8a26-443a4c149a0e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:01.592233 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-02b45111-654d-4ab9-b703-595c502dcc6e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:01.592391 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6b4fb7ef-f8c5-484a-8a26-443a4c149a0e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:01.592553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-02b45111-654d-4ab9-b703-595c502dcc6e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:01.595609 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6b4fb7ef-f8c5-484a-8a26-443a4c149a0e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:01.596072 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6b4fb7ef-f8c5-484a-8a26-443a4c149a0e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:01.596948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6b4fb7ef-f8c5-484a-8a26-443a4c149a0e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:01.597432 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6b4fb7ef-f8c5-484a-8a26-443a4c149a0e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:01.597943 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02b45111-654d-4ab9-b703-595c502dcc6e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:01.598476 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02b45111-654d-4ab9-b703-595c502dcc6e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:01.599342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02b45111-654d-4ab9-b703-595c502dcc6e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:01.599796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02b45111-654d-4ab9-b703-595c502dcc6e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:01.678396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.objects.instance [None req-6b4fb7ef-f8c5-484a-8a26-443a4c149a0e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lazy-loading 'services' on Instance uuid 0d634922-ac08-46f6-aa94-44abf09f6bc3 {{(pid=117876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:25:01.728855 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-02b45111-654d-4ab9-b703-595c502dcc6e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lazy-loading 'services' on Instance uuid d725356e-73a3-486b-b590-0324916667ff {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:25:01.759413 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-6b4fb7ef-f8c5-484a-8a26-443a4c149a0e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b67e700d-ae94-43e6-8d59-8b5b792015d3) Jul 27 20:25:01.762295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6b4fb7ef-f8c5-484a-8a26-443a4c149a0e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Request method failure captured: Jul 27 20:25:01.762295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3 HTTP/1.1 Jul 27 20:25:01.762295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:25:01.762295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:25:01.762295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:25:01.762295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:25:01.762295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:25:01.762295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:25:01.762295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:25:01.762295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:25:01.762295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4Zs1w1g_5EBOAJHGXZvQfsbeerbcd37lKRD5mUkafMdHZAX3P44SwOy9NISSA8Lh2nFLwJ2io24pgRqnG4EvPMR-HJKAS2sxbES-VziDHtkha7CtqVpqP38PRAt1Y6btPfnsUjV-NLhIZjiSnTrYjlnZs4PaFMjmKlQulWMSRQRQQCg Jul 27 20:25:01.762295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:25:01.762295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:25:01.762295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:25:01.762295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:25:01.762295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:25:01.762295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:25:01.762295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 1626b826d47a47429a947fa36ace64e4 Jul 27 20:25:01.762295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:25:01.762295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:25:01.762295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:25:01.763602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1626b826d47a47429a947fa36ace64e4", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:25:01.763602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:25:01.763602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 1626b826d47a47429a947fa36ace64e4 Jul 27 20:25:01.763602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:25:01.763602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-ServerRescueNegativeTestJSON-2064775453-project Jul 27 20:25:01.763602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:25:01.763602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:25:01.763602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: a48eaef4d70b4116bd307374d819bca6 Jul 27 20:25:01.763602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2064775453-project Jul 27 20:25:01.763602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:25:01.764429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b67e700d-ae94-43e6-8d59-8b5b792015d3) Jul 27 20:25:01.764429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'server_id': '0d634922-ac08-46f6-aa94-44abf09f6bc3', 'id': 'd4fe68b5-3007-45a2-91be-ff65008cfbc3'} Jul 27 20:25:01.764429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:25:01.764429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:01.764429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:01.764429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:01.764429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:01.764429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:01.764429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:01.764429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:01.764429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:01.764429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:01.764429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:01.764429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:01.764429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:01.764429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:01.764429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:01.765477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:01.765477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:01.765477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:01.765477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b67e700d-ae94-43e6-8d59-8b5b792015d3) Jul 27 20:25:01.765477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.765477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:01.765477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.765477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:01.765477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:25:01.765477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:25:01.765477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:25:01.765477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:25:01.765477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:25:01.765477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:25:01.765477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:01.765477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:01.765477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:01.765477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:01.765477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:01.768567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:01.768567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:01.768567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:01.768567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:01.768567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:01.768567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:01.768567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:01.768567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:01.768567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:01.768567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:01.768567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:01.768567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b67e700d-ae94-43e6-8d59-8b5b792015d3) Jul 27 20:25:01.768567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.768567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:01.768567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.768567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:01.768567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:25:01.770689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:25:01.770689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:25:01.770689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:01.770689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:25:01.770689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:25:01.770689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:25:01.770689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:25:01.770689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:25:01.770689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:01.770689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:25:01.770689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:25:01.770689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b67e700d-ae94-43e6-8d59-8b5b792015d3) Jul 27 20:25:01.770689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.770689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:01.770689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.770689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:01.770689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:01.770689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:01.772467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:25:01.772467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:25:01.772467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:25:01.772467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:25:01.772467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:25:01.772467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:25:01.772467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b67e700d-ae94-43e6-8d59-8b5b792015d3) Jul 27 20:25:01.772467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.772467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:01.772467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.772467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:01.772467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:01.772467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:01.772467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:25:01.772467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:25:01.772467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b67e700d-ae94-43e6-8d59-8b5b792015d3) Jul 27 20:25:01.772467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.774650 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6b4fb7ef-f8c5-484a-8a26-443a4c149a0e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b67e700d-ae94-43e6-8d59-8b5b792015d3) {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:25:01.774650 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6b4fb7ef-f8c5-484a-8a26-443a4c149a0e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3" status: 400 len: 269 microversion: 2.1 time: 0.180628 Jul 27 20:25:01.774650 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 507/1001] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Jul 27 20:25:01 2022] DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3 => generated 269 bytes in 182 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:25:01.774650 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0e900bc8-55b8-4c07-beaf-cd9f12201636 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:01.775136 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0e900bc8-55b8-4c07-beaf-cd9f12201636 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:01.779285 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e900bc8-55b8-4c07-beaf-cd9f12201636 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:01.779908 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e900bc8-55b8-4c07-beaf-cd9f12201636 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:01.780694 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e900bc8-55b8-4c07-beaf-cd9f12201636 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:01.781182 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e900bc8-55b8-4c07-beaf-cd9f12201636 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:01.798876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-02b45111-654d-4ab9-b703-595c502dcc6e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ddb9169b-35ed-44de-bce4-f7b050ef5cfd) Jul 27 20:25:01.801061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-02b45111-654d-4ab9-b703-595c502dcc6e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Request method failure captured: Jul 27 20:25:01.801061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea HTTP/1.1 Jul 27 20:25:01.801061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:25:01.801061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:25:01.801061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:25:01.801061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:25:01.801061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:25:01.801061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:25:01.801061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:25:01.801061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:25:01.801061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4ZszolpoHLv4ymfn-jDIXXwrtat6zA6fU8pUvlIxQFFvg2akujyL-RcTkc0AHUPtL9FfHVEqLLG1P3QFKYKGA6GTuRef7uYyPgJ3tvotGw9j0tfDvIc-GZxx3Nrm1QaM2Jm97CejtJa-hGoo2CtA1AtsmrF2YR6vqcqJ-OZzLMovey0 Jul 27 20:25:01.801061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:25:01.801061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:25:01.801061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:25:01.801061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:25:01.801061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 20:25:01.801061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:25:01.801061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:25:01.801061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:25:01.801061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:25:01.801061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:25:01.801061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:25:01.802695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec01b599458b451e8d04a428c1c33513", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:25:01.802695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:25:01.802695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:25:01.802695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:25:01.802695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:25:01.802695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:25:01.802695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:25:01.802695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: b734a345bfe5483d9a5a1e35d89c935b Jul 27 20:25:01.802695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:25:01.802695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:25:01.803597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ddb9169b-35ed-44de-bce4-f7b050ef5cfd) Jul 27 20:25:01.803597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'server_id': 'd725356e-73a3-486b-b590-0324916667ff', 'id': '2f4bb420-948b-4be6-9672-a9051968dcea'} Jul 27 20:25:01.803597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:25:01.803597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:01.803597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:01.803597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:01.803597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:01.803597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:01.803597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:01.803597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:01.803597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:01.803597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:01.803597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:01.803597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:01.803597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:01.803597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:01.803597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:01.805143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:01.805143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:01.805143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:01.805143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ddb9169b-35ed-44de-bce4-f7b050ef5cfd) Jul 27 20:25:01.805143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.805143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:01.805143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.805143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:01.805143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:25:01.805143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:25:01.805143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:25:01.805143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:25:01.805143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:25:01.805143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:25:01.805143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:01.805143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:01.805143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:01.805143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:01.805143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:01.808020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:01.808020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:01.808020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:01.808020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:01.808020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:01.808020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:01.808020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:01.808020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:01.808020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:01.808020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:01.808020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:01.808020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ddb9169b-35ed-44de-bce4-f7b050ef5cfd) Jul 27 20:25:01.808020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.808020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:01.808020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.808020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:01.808020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:25:01.809442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:25:01.809442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:25:01.809442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:01.809442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:25:01.809442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:25:01.809442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:25:01.809442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:25:01.809442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:25:01.809442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:01.809442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:25:01.809442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:25:01.809442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ddb9169b-35ed-44de-bce4-f7b050ef5cfd) Jul 27 20:25:01.809442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.809442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:01.809442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.809442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:01.809442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:01.809442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:01.810784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:25:01.810784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:25:01.810784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:25:01.810784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:25:01.810784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:25:01.810784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:25:01.810784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ddb9169b-35ed-44de-bce4-f7b050ef5cfd) Jul 27 20:25:01.810784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.810784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:01.810784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.810784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:01.810784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:01.810784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:01.810784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:25:01.810784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:25:01.810784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ddb9169b-35ed-44de-bce4-f7b050ef5cfd) Jul 27 20:25:01.810784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:01.813753 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-02b45111-654d-4ab9-b703-595c502dcc6e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ddb9169b-35ed-44de-bce4-f7b050ef5cfd) {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:25:01.813753 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-02b45111-654d-4ab9-b703-595c502dcc6e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea" status: 400 len: 269 microversion: 2.20 time: 0.217305 Jul 27 20:25:01.813753 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 495/1002] 10.222.0.65 () {60 vars in 1457 bytes} [Wed Jul 27 20:25:01 2022] DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea => generated 269 bytes in 218 msecs (HTTP/1.1 400) 9 headers in 383 bytes (1 switches on core 0) Jul 27 20:25:01.813753 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-db06baa5-59e0-41d5-a2b2-549f7502b9fc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:01.814274 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-db06baa5-59e0-41d5-a2b2-549f7502b9fc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:01.816613 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db06baa5-59e0-41d5-a2b2-549f7502b9fc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:01.817126 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db06baa5-59e0-41d5-a2b2-549f7502b9fc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:01.817921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db06baa5-59e0-41d5-a2b2-549f7502b9fc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:01.818365 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db06baa5-59e0-41d5-a2b2-549f7502b9fc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:01.848767 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-db06baa5-59e0-41d5-a2b2-549f7502b9fc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044393 Jul 27 20:25:01.849278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 496/1003] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:01 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:01.930705 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0e900bc8-55b8-4c07-beaf-cd9f12201636 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:01.939802 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0e900bc8-55b8-4c07-beaf-cd9f12201636 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.174203 Jul 27 20:25:01.940390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 508/1004] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:01 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:02.002343 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f20bc8d7-d931-41d5-8c6c-4d0d2abab45d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:02.002926 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f20bc8d7-d931-41d5-8c6c-4d0d2abab45d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:02.009240 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f20bc8d7-d931-41d5-8c6c-4d0d2abab45d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:02.009683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f20bc8d7-d931-41d5-8c6c-4d0d2abab45d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:02.011006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f20bc8d7-d931-41d5-8c6c-4d0d2abab45d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:02.011482 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f20bc8d7-d931-41d5-8c6c-4d0d2abab45d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:02.077984 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-60acb072-7f47-443c-a294-34ded7f77916 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:02.080258 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-60acb072-7f47-443c-a294-34ded7f77916 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:02.086630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-60acb072-7f47-443c-a294-34ded7f77916 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:02.087079 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-60acb072-7f47-443c-a294-34ded7f77916 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:02.087870 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-60acb072-7f47-443c-a294-34ded7f77916 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:02.088310 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-60acb072-7f47-443c-a294-34ded7f77916 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:02.118152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-60acb072-7f47-443c-a294-34ded7f77916 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176425 Jul 27 20:25:02.118627 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 509/1005] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:01 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:02.123822 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6de8fa3b-814f-41db-bba8-5f6531cc6d6d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:02.124309 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6de8fa3b-814f-41db-bba8-5f6531cc6d6d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:02.130010 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6de8fa3b-814f-41db-bba8-5f6531cc6d6d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:02.130462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6de8fa3b-814f-41db-bba8-5f6531cc6d6d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:02.131245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6de8fa3b-814f-41db-bba8-5f6531cc6d6d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:02.131679 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6de8fa3b-814f-41db-bba8-5f6531cc6d6d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:03.044150 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:25:03.044739 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:25:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25/os-volume_attachments/b32b8226-ea5d-421f-97d5-90f6f0dcaff5 (ip 10.222.0.65) !!! Jul 27 20:25:07.265127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:25:07.265732 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:25:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25/os-volume_attachments/b32b8226-ea5d-421f-97d5-90f6f0dcaff5 (ip 10.222.0.65) !!! Jul 27 20:25:12.006416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=10 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:12.030558 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=30 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:12.127678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=8 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:12.151551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=24 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:12.906680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-f20bc8d7-d931-41d5-8c6c-4d0d2abab45d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lazy-loading 'services' on Instance uuid e1fe489c-2f01-4942-ad86-cf5193eaac25 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:25:12.954391 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.objects.instance [None req-6de8fa3b-814f-41db-bba8-5f6531cc6d6d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lazy-loading 'services' on Instance uuid 0d634922-ac08-46f6-aa94-44abf09f6bc3 {{(pid=117876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:25:12.998912 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f20bc8d7-d931-41d5-8c6c-4d0d2abab45d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [bb09c108-9350-46bd-b31d-9a819fec7994] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 27 20:25:13.023802 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-6de8fa3b-814f-41db-bba8-5f6531cc6d6d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-33e56a87-9523-4783-a724-1a3648fd843f) Jul 27 20:25:13.026394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6de8fa3b-814f-41db-bba8-5f6531cc6d6d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Request method failure captured: Jul 27 20:25:13.026394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3 HTTP/1.1 Jul 27 20:25:13.026394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:25:13.026394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:25:13.026394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:25:13.026394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:25:13.026394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:25:13.026394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:25:13.026394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:25:13.026394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:25:13.026394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4Zs1w1g_5EBOAJHGXZvQfsbeerbcd37lKRD5mUkafMdHZAX3P44SwOy9NISSA8Lh2nFLwJ2io24pgRqnG4EvPMR-HJKAS2sxbES-VziDHtkha7CtqVpqP38PRAt1Y6btPfnsUjV-NLhIZjiSnTrYjlnZs4PaFMjmKlQulWMSRQRQQCg Jul 27 20:25:13.026394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:25:13.026394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:25:13.026394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:25:13.026394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:25:13.026394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:25:13.026394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:25:13.026394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 1626b826d47a47429a947fa36ace64e4 Jul 27 20:25:13.026394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:25:13.026394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:25:13.026394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:25:13.028131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1626b826d47a47429a947fa36ace64e4", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:25:13.028131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:25:13.028131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 1626b826d47a47429a947fa36ace64e4 Jul 27 20:25:13.028131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:25:13.028131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-ServerRescueNegativeTestJSON-2064775453-project Jul 27 20:25:13.028131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:25:13.028131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:25:13.028131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: a48eaef4d70b4116bd307374d819bca6 Jul 27 20:25:13.028131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2064775453-project Jul 27 20:25:13.028131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:25:13.028790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-33e56a87-9523-4783-a724-1a3648fd843f) Jul 27 20:25:13.028790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'server_id': '0d634922-ac08-46f6-aa94-44abf09f6bc3', 'id': 'd4fe68b5-3007-45a2-91be-ff65008cfbc3'} Jul 27 20:25:13.028790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:25:13.028790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:13.028790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:13.028790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:13.028790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:13.028790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:13.028790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:13.028790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:13.028790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:13.028790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:13.028790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:13.028790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:13.028790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:13.028790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:13.028790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:13.029950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:13.029950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:13.029950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:13.029950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-33e56a87-9523-4783-a724-1a3648fd843f) Jul 27 20:25:13.029950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.029950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:13.029950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.029950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:13.029950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:25:13.029950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:25:13.029950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:25:13.029950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:25:13.029950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:25:13.029950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:25:13.029950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:13.029950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:13.029950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:13.029950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:13.029950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:13.031111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:13.031111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:13.031111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:13.031111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:13.031111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:13.031111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:13.031111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:13.031111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:13.031111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:13.031111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:13.031111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:13.031111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-33e56a87-9523-4783-a724-1a3648fd843f) Jul 27 20:25:13.031111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.031111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:13.031111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.031111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:13.031111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:25:13.032333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:25:13.032333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:25:13.032333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:13.032333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:25:13.032333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:25:13.032333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:25:13.032333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:25:13.032333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:25:13.032333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:13.032333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:25:13.032333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:25:13.032333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-33e56a87-9523-4783-a724-1a3648fd843f) Jul 27 20:25:13.032333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.032333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:13.032333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.032333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:13.032333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:13.032333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:13.033818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:25:13.033818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:25:13.033818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:25:13.033818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:25:13.033818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:25:13.033818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:25:13.033818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-33e56a87-9523-4783-a724-1a3648fd843f) Jul 27 20:25:13.033818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.033818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:13.033818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.033818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:13.033818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:13.033818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:13.033818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:25:13.033818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:25:13.033818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-33e56a87-9523-4783-a724-1a3648fd843f) Jul 27 20:25:13.033818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.035217 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6de8fa3b-814f-41db-bba8-5f6531cc6d6d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-33e56a87-9523-4783-a724-1a3648fd843f) {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:25:13.035217 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6de8fa3b-814f-41db-bba8-5f6531cc6d6d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3" status: 400 len: 269 microversion: 2.1 time: 10.908273 Jul 27 20:25:13.035217 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 510/1006] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Jul 27 20:25:02 2022] DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3 => generated 269 bytes in 10909 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:25:13.035217 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-90eb262b-bc15-4ec5-93ef-e23936e8c77b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:13.035594 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-90eb262b-bc15-4ec5-93ef-e23936e8c77b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:13.039543 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90eb262b-bc15-4ec5-93ef-e23936e8c77b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:13.039987 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90eb262b-bc15-4ec5-93ef-e23936e8c77b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:13.040741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90eb262b-bc15-4ec5-93ef-e23936e8c77b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:13.041275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90eb262b-bc15-4ec5-93ef-e23936e8c77b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:13.173910 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-90eb262b-bc15-4ec5-93ef-e23936e8c77b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:13.181399 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-90eb262b-bc15-4ec5-93ef-e23936e8c77b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1560 microversion: 2.1 time: 0.152094 Jul 27 20:25:13.182526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 511/1007] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:13 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:13.187560 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5c2a0f83-7d11-43fe-a200-00d5f092251a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:13.188056 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5c2a0f83-7d11-43fe-a200-00d5f092251a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:13.193880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5c2a0f83-7d11-43fe-a200-00d5f092251a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:13.194334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5c2a0f83-7d11-43fe-a200-00d5f092251a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:13.195100 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5c2a0f83-7d11-43fe-a200-00d5f092251a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:13.195541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5c2a0f83-7d11-43fe-a200-00d5f092251a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:13.275590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.objects.instance [None req-5c2a0f83-7d11-43fe-a200-00d5f092251a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lazy-loading 'services' on Instance uuid d725356e-73a3-486b-b590-0324916667ff {{(pid=117876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:25:13.331477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-5c2a0f83-7d11-43fe-a200-00d5f092251a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3397d5cb-fef2-4c41-aaeb-d10f555f4abf) Jul 27 20:25:13.333834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5c2a0f83-7d11-43fe-a200-00d5f092251a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Request method failure captured: Jul 27 20:25:13.333834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea HTTP/1.1 Jul 27 20:25:13.333834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:25:13.333834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:25:13.333834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:25:13.333834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:25:13.333834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:25:13.333834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:25:13.333834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:25:13.333834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:25:13.333834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4ZszolpoHLv4ymfn-jDIXXwrtat6zA6fU8pUvlIxQFFvg2akujyL-RcTkc0AHUPtL9FfHVEqLLG1P3QFKYKGA6GTuRef7uYyPgJ3tvotGw9j0tfDvIc-GZxx3Nrm1QaM2Jm97CejtJa-hGoo2CtA1AtsmrF2YR6vqcqJ-OZzLMovey0 Jul 27 20:25:13.333834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:25:13.333834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:25:13.333834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:25:13.333834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:25:13.333834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 20:25:13.333834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:25:13.333834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:25:13.333834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:25:13.333834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:25:13.333834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:25:13.333834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:25:13.335430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec01b599458b451e8d04a428c1c33513", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:25:13.335430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:25:13.335430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:25:13.335430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:25:13.335430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:25:13.335430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:25:13.335430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:25:13.335430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: b734a345bfe5483d9a5a1e35d89c935b Jul 27 20:25:13.335430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:25:13.335430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:25:13.336176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3397d5cb-fef2-4c41-aaeb-d10f555f4abf) Jul 27 20:25:13.336176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'server_id': 'd725356e-73a3-486b-b590-0324916667ff', 'id': '2f4bb420-948b-4be6-9672-a9051968dcea'} Jul 27 20:25:13.336176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:25:13.336176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:13.336176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:13.336176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:13.336176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:13.336176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:13.336176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:13.336176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:13.336176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:13.336176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:13.336176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:13.336176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:13.336176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:13.336176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:13.336176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:13.337489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:13.337489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:13.337489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:13.337489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3397d5cb-fef2-4c41-aaeb-d10f555f4abf) Jul 27 20:25:13.337489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.337489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:13.337489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.337489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:13.337489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:25:13.337489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:25:13.337489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:25:13.337489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:25:13.337489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:25:13.337489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:25:13.337489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:13.337489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:13.337489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:13.337489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:13.337489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:13.339128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:13.339128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:13.339128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:13.339128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:13.339128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:13.339128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:13.339128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:13.339128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:13.339128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:13.339128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:13.339128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:13.339128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3397d5cb-fef2-4c41-aaeb-d10f555f4abf) Jul 27 20:25:13.339128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.339128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:13.339128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.339128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:13.339128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:25:13.340337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:25:13.340337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:25:13.340337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:13.340337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:25:13.340337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:25:13.340337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:25:13.340337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:25:13.340337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:25:13.340337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:13.340337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:25:13.340337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:25:13.340337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3397d5cb-fef2-4c41-aaeb-d10f555f4abf) Jul 27 20:25:13.340337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.340337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:13.340337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.340337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:13.340337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:13.340337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:13.341636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:25:13.341636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:25:13.341636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:25:13.341636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:25:13.341636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:25:13.341636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:25:13.341636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3397d5cb-fef2-4c41-aaeb-d10f555f4abf) Jul 27 20:25:13.341636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.341636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:13.341636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.341636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:13.341636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:13.341636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:13.341636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:25:13.341636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:25:13.341636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3397d5cb-fef2-4c41-aaeb-d10f555f4abf) Jul 27 20:25:13.341636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.342886 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5c2a0f83-7d11-43fe-a200-00d5f092251a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3397d5cb-fef2-4c41-aaeb-d10f555f4abf) {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:25:13.342886 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5c2a0f83-7d11-43fe-a200-00d5f092251a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea" status: 400 len: 269 microversion: 2.20 time: 0.151355 Jul 27 20:25:13.342886 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 512/1008] 10.222.0.65 () {60 vars in 1457 bytes} [Wed Jul 27 20:25:13 2022] DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea => generated 269 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 383 bytes (1 switches on core 0) Jul 27 20:25:13.342886 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-54e6477d-d64e-4815-83e5-5433976bac62 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:13.343237 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-54e6477d-d64e-4815-83e5-5433976bac62 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:13.349674 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-54e6477d-d64e-4815-83e5-5433976bac62 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:13.350131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-54e6477d-d64e-4815-83e5-5433976bac62 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:13.350898 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-54e6477d-d64e-4815-83e5-5433976bac62 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:13.351340 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-54e6477d-d64e-4815-83e5-5433976bac62 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:13.379988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-54e6477d-d64e-4815-83e5-5433976bac62 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042889 Jul 27 20:25:13.380463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 513/1009] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:13 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:13.384984 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-29ce2901-267c-415c-9c42-6169fb5eddc2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:13.385534 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-29ce2901-267c-415c-9c42-6169fb5eddc2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:13.390895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-29ce2901-267c-415c-9c42-6169fb5eddc2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:13.391354 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-29ce2901-267c-415c-9c42-6169fb5eddc2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:13.392111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-29ce2901-267c-415c-9c42-6169fb5eddc2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:13.392555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-29ce2901-267c-415c-9c42-6169fb5eddc2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:13.471544 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.objects.instance [None req-29ce2901-267c-415c-9c42-6169fb5eddc2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lazy-loading 'services' on Instance uuid e1fe489c-2f01-4942-ad86-cf5193eaac25 {{(pid=117876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:25:13.526084 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-29ce2901-267c-415c-9c42-6169fb5eddc2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9efa4738-26de-42cd-b5b3-e9d834b11de3) Jul 27 20:25:13.528255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-29ce2901-267c-415c-9c42-6169fb5eddc2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Request method failure captured: Jul 27 20:25:13.528255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: DELETE /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25/os-volume_attachments/b32b8226-ea5d-421f-97d5-90f6f0dcaff5 HTTP/1.1 Jul 27 20:25:13.528255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:25:13.528255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:25:13.528255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:25:13.528255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:25:13.528255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:25:13.528255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:25:13.528255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:25:13.528255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:25:13.528255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4ZxClMtBVPf_psOFiR_V5VfzzlVOTs8KN0v3UVCzLetLxMGmzPfiqv4sQUOzc5KUzuK0FYM5iL1Yqrla3OmSaqqFIqiqS1UBVKFT5DcyldBJo18jK1HI63KdsQNlHgSmlwFXfkFX85SnfWe7krfq_F9HRcP2oetHpdkHLDBXRCdCe0I Jul 27 20:25:13.528255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:25:13.528255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:25:13.528255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:25:13.528255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:25:13.528255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:25:13.528255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:25:13.528255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 5acfaf1104da41f8ba35ddbebb79b506 Jul 27 20:25:13.528255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-VolumesSnapshotTestJSON-804812837 Jul 27 20:25:13.528255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:25:13.528255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:25:13.529890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5acfaf1104da41f8ba35ddbebb79b506"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5acfaf1104da41f8ba35ddbebb79b506"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5acfaf1104da41f8ba35ddbebb79b506", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5acfaf1104da41f8ba35ddbebb79b506"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:25:13.529890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-VolumesSnapshotTestJSON-804812837 Jul 27 20:25:13.529890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 5acfaf1104da41f8ba35ddbebb79b506 Jul 27 20:25:13.529890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-804812837 Jul 27 20:25:13.529890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-VolumesSnapshotTestJSON-804812837-project Jul 27 20:25:13.529890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:25:13.529890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:25:13.529890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: 5cc7b5ba908541cf929eaf10ba24e465 Jul 27 20:25:13.529890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-VolumesSnapshotTestJSON-804812837-project Jul 27 20:25:13.529890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:25:13.530601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9efa4738-26de-42cd-b5b3-e9d834b11de3) Jul 27 20:25:13.530601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'server_id': 'e1fe489c-2f01-4942-ad86-cf5193eaac25', 'id': 'b32b8226-ea5d-421f-97d5-90f6f0dcaff5'} Jul 27 20:25:13.530601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:25:13.530601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:13.530601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:13.530601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:13.530601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:13.530601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:13.530601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:13.530601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:13.530601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:13.530601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:13.530601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:13.530601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:13.530601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:13.530601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:13.530601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:13.531723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:13.531723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:13.531723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:13.531723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9efa4738-26de-42cd-b5b3-e9d834b11de3) Jul 27 20:25:13.531723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.531723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:13.531723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.531723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:13.531723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:25:13.531723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:25:13.531723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:25:13.531723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:25:13.531723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:25:13.531723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:25:13.531723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:13.531723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:13.531723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:13.531723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:13.531723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:13.532836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:13.532836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:13.532836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:13.532836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:13.532836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:13.532836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:13.532836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:13.532836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:13.532836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:13.532836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:13.532836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:13.532836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9efa4738-26de-42cd-b5b3-e9d834b11de3) Jul 27 20:25:13.532836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.532836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:13.532836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.532836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:13.532836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:25:13.533888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:25:13.533888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:25:13.533888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:13.533888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:25:13.533888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:25:13.533888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:25:13.533888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:25:13.533888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:25:13.533888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:13.533888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:25:13.533888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:25:13.533888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9efa4738-26de-42cd-b5b3-e9d834b11de3) Jul 27 20:25:13.533888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.533888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:13.533888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.533888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:13.533888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:13.533888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:13.535011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:25:13.535011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:25:13.535011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:25:13.535011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:25:13.535011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:25:13.535011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:25:13.535011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9efa4738-26de-42cd-b5b3-e9d834b11de3) Jul 27 20:25:13.535011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.535011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:13.535011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.535011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:13.535011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:13.535011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:13.535011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:25:13.535011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:25:13.535011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9efa4738-26de-42cd-b5b3-e9d834b11de3) Jul 27 20:25:13.535011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.536010 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-29ce2901-267c-415c-9c42-6169fb5eddc2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9efa4738-26de-42cd-b5b3-e9d834b11de3) {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:25:13.536010 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-29ce2901-267c-415c-9c42-6169fb5eddc2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25/os-volume_attachments/b32b8226-ea5d-421f-97d5-90f6f0dcaff5" status: 400 len: 269 microversion: 2.1 time: 0.148173 Jul 27 20:25:13.536010 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 514/1010] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Jul 27 20:25:13 2022] DELETE /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25/os-volume_attachments/b32b8226-ea5d-421f-97d5-90f6f0dcaff5 => generated 269 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:25:13.536010 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-624a0993-3131-4167-aa0f-d82a72fc82d4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:13.536983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-624a0993-3131-4167-aa0f-d82a72fc82d4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:13.543490 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-624a0993-3131-4167-aa0f-d82a72fc82d4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:13.543941 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-624a0993-3131-4167-aa0f-d82a72fc82d4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:13.544696 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-624a0993-3131-4167-aa0f-d82a72fc82d4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:13.545164 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-624a0993-3131-4167-aa0f-d82a72fc82d4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:13.574421 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-624a0993-3131-4167-aa0f-d82a72fc82d4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042938 Jul 27 20:25:13.574956 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 515/1011] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:13 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:13.579395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ac9c87e5-95e6-4fee-a9b7-4fe87ac6077d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:13.579894 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ac9c87e5-95e6-4fee-a9b7-4fe87ac6077d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:13.585279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ac9c87e5-95e6-4fee-a9b7-4fe87ac6077d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:13.585729 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ac9c87e5-95e6-4fee-a9b7-4fe87ac6077d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:13.586485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ac9c87e5-95e6-4fee-a9b7-4fe87ac6077d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:13.586926 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ac9c87e5-95e6-4fee-a9b7-4fe87ac6077d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:13.665261 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.objects.instance [None req-ac9c87e5-95e6-4fee-a9b7-4fe87ac6077d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lazy-loading 'services' on Instance uuid 0d634922-ac08-46f6-aa94-44abf09f6bc3 {{(pid=117876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:25:13.720174 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-ac9c87e5-95e6-4fee-a9b7-4fe87ac6077d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6961579a-ca6d-4226-a8ed-ebbfb001367c) Jul 27 20:25:13.722378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ac9c87e5-95e6-4fee-a9b7-4fe87ac6077d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Request method failure captured: Jul 27 20:25:13.722378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3 HTTP/1.1 Jul 27 20:25:13.722378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:25:13.722378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:25:13.722378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:25:13.722378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:25:13.722378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:25:13.722378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:25:13.722378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:25:13.722378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:25:13.722378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4Zs1w1g_5EBOAJHGXZvQfsbeerbcd37lKRD5mUkafMdHZAX3P44SwOy9NISSA8Lh2nFLwJ2io24pgRqnG4EvPMR-HJKAS2sxbES-VziDHtkha7CtqVpqP38PRAt1Y6btPfnsUjV-NLhIZjiSnTrYjlnZs4PaFMjmKlQulWMSRQRQQCg Jul 27 20:25:13.722378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:25:13.722378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:25:13.722378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:25:13.722378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:25:13.722378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:25:13.722378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:25:13.722378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 1626b826d47a47429a947fa36ace64e4 Jul 27 20:25:13.722378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:25:13.722378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:25:13.722378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:25:13.723959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1626b826d47a47429a947fa36ace64e4", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:25:13.723959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:25:13.723959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 1626b826d47a47429a947fa36ace64e4 Jul 27 20:25:13.723959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:25:13.723959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-ServerRescueNegativeTestJSON-2064775453-project Jul 27 20:25:13.723959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:25:13.723959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:25:13.723959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: a48eaef4d70b4116bd307374d819bca6 Jul 27 20:25:13.723959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2064775453-project Jul 27 20:25:13.723959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:25:13.724833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6961579a-ca6d-4226-a8ed-ebbfb001367c) Jul 27 20:25:13.724833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'server_id': '0d634922-ac08-46f6-aa94-44abf09f6bc3', 'id': 'd4fe68b5-3007-45a2-91be-ff65008cfbc3'} Jul 27 20:25:13.724833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:25:13.724833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:13.724833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:13.724833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:13.724833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:13.724833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:13.724833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:13.724833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:13.724833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:13.724833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:13.724833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:13.724833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:13.724833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:13.724833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:13.724833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:13.726078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:13.726078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:13.726078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:13.726078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6961579a-ca6d-4226-a8ed-ebbfb001367c) Jul 27 20:25:13.726078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.726078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:13.726078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.726078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:13.726078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:25:13.726078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:25:13.726078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:25:13.726078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:25:13.726078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:25:13.726078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:25:13.726078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:13.726078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:13.726078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:13.726078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:13.726078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:13.727420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:13.727420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:13.727420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:13.727420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:13.727420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:13.727420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:13.727420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:13.727420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:13.727420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:13.727420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:13.727420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:13.727420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6961579a-ca6d-4226-a8ed-ebbfb001367c) Jul 27 20:25:13.727420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.727420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:13.727420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.727420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:13.727420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:25:13.728613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:25:13.728613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:25:13.728613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:13.728613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:25:13.728613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:25:13.728613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:25:13.728613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:25:13.728613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:25:13.728613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:13.728613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:25:13.728613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:25:13.728613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6961579a-ca6d-4226-a8ed-ebbfb001367c) Jul 27 20:25:13.728613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.728613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:13.728613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.728613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:13.728613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:13.728613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:13.729983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:25:13.729983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:25:13.729983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:25:13.729983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:25:13.729983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:25:13.729983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:25:13.729983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6961579a-ca6d-4226-a8ed-ebbfb001367c) Jul 27 20:25:13.729983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.729983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:13.729983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.729983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:13.729983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:13.729983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:13.729983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:25:13.729983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:25:13.729983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6961579a-ca6d-4226-a8ed-ebbfb001367c) Jul 27 20:25:13.729983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:13.731210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ac9c87e5-95e6-4fee-a9b7-4fe87ac6077d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6961579a-ca6d-4226-a8ed-ebbfb001367c) {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:25:13.731210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ac9c87e5-95e6-4fee-a9b7-4fe87ac6077d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3" status: 400 len: 269 microversion: 2.1 time: 0.147934 Jul 27 20:25:13.731210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 516/1012] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Jul 27 20:25:13 2022] DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3 => generated 269 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:25:13.731210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-70bf6ed2-041a-4be8-aea6-9159c0136c82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:13.731637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-70bf6ed2-041a-4be8-aea6-9159c0136c82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:13.735555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-70bf6ed2-041a-4be8-aea6-9159c0136c82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:13.736008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-70bf6ed2-041a-4be8-aea6-9159c0136c82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:13.736767 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-70bf6ed2-041a-4be8-aea6-9159c0136c82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:13.737241 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-70bf6ed2-041a-4be8-aea6-9159c0136c82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.006246 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [None req-f20bc8d7-d931-41d5-8c6c-4d0d2abab45d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [bb09c108-9350-46bd-b31d-9a819fec7994] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 34642. Jul 27 20:25:14.009506 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f20bc8d7-d931-41d5-8c6c-4d0d2abab45d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25/os-volume_attachments/b32b8226-ea5d-421f-97d5-90f6f0dcaff5" status: 202 len: 0 microversion: 2.1 time: 12.159275 Jul 27 20:25:14.011043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 497/1013] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Jul 27 20:25:01 2022] DELETE /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25/os-volume_attachments/b32b8226-ea5d-421f-97d5-90f6f0dcaff5 => generated 0 bytes in 12161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:25:14.016457 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0b9d969f-3f8a-41fe-956e-7fdafae5a3d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:14.017228 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0b9d969f-3f8a-41fe-956e-7fdafae5a3d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:14.025350 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b9d969f-3f8a-41fe-956e-7fdafae5a3d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.026440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b9d969f-3f8a-41fe-956e-7fdafae5a3d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.027529 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b9d969f-3f8a-41fe-956e-7fdafae5a3d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.028131 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b9d969f-3f8a-41fe-956e-7fdafae5a3d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.113937 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-70bf6ed2-041a-4be8-aea6-9159c0136c82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:14.116537 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-0b9d969f-3f8a-41fe-956e-7fdafae5a3d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lazy-loading 'services' on Instance uuid d725356e-73a3-486b-b590-0324916667ff {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:25:14.122308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-70bf6ed2-041a-4be8-aea6-9159c0136c82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1560 microversion: 2.1 time: 0.396967 Jul 27 20:25:14.123176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 517/1014] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:13 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1560 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:14.127723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-944a14b4-5873-46a3-9769-87f8f7a41b04 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:14.130091 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-944a14b4-5873-46a3-9769-87f8f7a41b04 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:14.137089 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-944a14b4-5873-46a3-9769-87f8f7a41b04 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.137552 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-944a14b4-5873-46a3-9769-87f8f7a41b04 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.138332 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-944a14b4-5873-46a3-9769-87f8f7a41b04 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.138773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-944a14b4-5873-46a3-9769-87f8f7a41b04 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.168031 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-944a14b4-5873-46a3-9769-87f8f7a41b04 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043808 Jul 27 20:25:14.168897 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 518/1015] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:14 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:14.174041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6ed1e11c-fc0f-400d-8a3c-878e3673d833 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:14.174634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6ed1e11c-fc0f-400d-8a3c-878e3673d833 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:14.180358 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ed1e11c-fc0f-400d-8a3c-878e3673d833 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.180809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ed1e11c-fc0f-400d-8a3c-878e3673d833 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.181629 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ed1e11c-fc0f-400d-8a3c-878e3673d833 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.182141 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ed1e11c-fc0f-400d-8a3c-878e3673d833 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.206758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-0b9d969f-3f8a-41fe-956e-7fdafae5a3d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0eea6fef-6919-4a42-a3e7-5c2d639fe29d) Jul 27 20:25:14.209227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0b9d969f-3f8a-41fe-956e-7fdafae5a3d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Request method failure captured: Jul 27 20:25:14.209227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea HTTP/1.1 Jul 27 20:25:14.209227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:25:14.209227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:25:14.209227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:25:14.209227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:25:14.209227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:25:14.209227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:25:14.209227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:25:14.209227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:25:14.209227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4ZszolpoHLv4ymfn-jDIXXwrtat6zA6fU8pUvlIxQFFvg2akujyL-RcTkc0AHUPtL9FfHVEqLLG1P3QFKYKGA6GTuRef7uYyPgJ3tvotGw9j0tfDvIc-GZxx3Nrm1QaM2Jm97CejtJa-hGoo2CtA1AtsmrF2YR6vqcqJ-OZzLMovey0 Jul 27 20:25:14.209227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:25:14.209227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:25:14.209227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:25:14.209227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:25:14.209227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 20:25:14.209227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:25:14.209227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:25:14.209227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:25:14.209227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:25:14.209227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:25:14.209227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:25:14.210825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec01b599458b451e8d04a428c1c33513", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:25:14.210825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:25:14.210825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:25:14.210825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:25:14.210825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:25:14.210825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:25:14.210825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:25:14.210825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: b734a345bfe5483d9a5a1e35d89c935b Jul 27 20:25:14.210825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:25:14.210825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:25:14.211480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0eea6fef-6919-4a42-a3e7-5c2d639fe29d) Jul 27 20:25:14.211480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'server_id': 'd725356e-73a3-486b-b590-0324916667ff', 'id': '2f4bb420-948b-4be6-9672-a9051968dcea'} Jul 27 20:25:14.211480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:25:14.211480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.211480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:14.211480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:14.211480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:14.211480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:14.211480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:14.211480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:14.211480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:14.211480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:14.211480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:14.211480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:14.211480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:14.211480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:14.211480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:14.212497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:14.212497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:14.212497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:14.212497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0eea6fef-6919-4a42-a3e7-5c2d639fe29d) Jul 27 20:25:14.212497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.212497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.212497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.212497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.212497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:25:14.212497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:25:14.212497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:25:14.212497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:25:14.212497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:25:14.212497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:25:14.212497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:14.212497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:14.212497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:14.212497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:14.212497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:14.215316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:14.215316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:14.215316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:14.215316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:14.215316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:14.215316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:14.215316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:14.215316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:14.215316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:14.215316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:14.215316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:14.215316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0eea6fef-6919-4a42-a3e7-5c2d639fe29d) Jul 27 20:25:14.215316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.215316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.215316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.215316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.215316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:25:14.217489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:25:14.217489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:25:14.217489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:14.217489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:25:14.217489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:25:14.217489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:25:14.217489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:25:14.217489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:25:14.217489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:14.217489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:25:14.217489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:25:14.217489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0eea6fef-6919-4a42-a3e7-5c2d639fe29d) Jul 27 20:25:14.217489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.217489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.217489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.217489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.217489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:14.217489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:14.219638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:25:14.219638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:25:14.219638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:25:14.219638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:25:14.219638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:25:14.219638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:25:14.219638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0eea6fef-6919-4a42-a3e7-5c2d639fe29d) Jul 27 20:25:14.219638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.219638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.219638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.219638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.219638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:14.219638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:14.219638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:25:14.219638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:25:14.219638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0eea6fef-6919-4a42-a3e7-5c2d639fe29d) Jul 27 20:25:14.219638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.223178 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0b9d969f-3f8a-41fe-956e-7fdafae5a3d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0eea6fef-6919-4a42-a3e7-5c2d639fe29d) {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:25:14.223178 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0b9d969f-3f8a-41fe-956e-7fdafae5a3d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea" status: 400 len: 269 microversion: 2.20 time: 0.199712 Jul 27 20:25:14.223178 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 498/1016] 10.222.0.65 () {60 vars in 1457 bytes} [Wed Jul 27 20:25:14 2022] DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea => generated 269 bytes in 201 msecs (HTTP/1.1 400) 9 headers in 383 bytes (1 switches on core 0) Jul 27 20:25:14.223178 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cdfd88c8-0c03-4f2b-b40d-1a37aa2dda89 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:14.223670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cdfd88c8-0c03-4f2b-b40d-1a37aa2dda89 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:14.228211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdfd88c8-0c03-4f2b-b40d-1a37aa2dda89 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.228658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdfd88c8-0c03-4f2b-b40d-1a37aa2dda89 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.229860 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdfd88c8-0c03-4f2b-b40d-1a37aa2dda89 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.230311 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdfd88c8-0c03-4f2b-b40d-1a37aa2dda89 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.259267 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cdfd88c8-0c03-4f2b-b40d-1a37aa2dda89 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043939 Jul 27 20:25:14.259709 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 499/1017] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:14 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:14.265579 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-654f1778-b3c8-491c-b792-17e25d945308 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:14.266066 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-654f1778-b3c8-491c-b792-17e25d945308 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:14.268854 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.objects.instance [None req-6ed1e11c-fc0f-400d-8a3c-878e3673d833 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lazy-loading 'services' on Instance uuid e1fe489c-2f01-4942-ad86-cf5193eaac25 {{(pid=117876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:25:14.271716 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-654f1778-b3c8-491c-b792-17e25d945308 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.272167 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-654f1778-b3c8-491c-b792-17e25d945308 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.272927 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-654f1778-b3c8-491c-b792-17e25d945308 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.273390 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-654f1778-b3c8-491c-b792-17e25d945308 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.326116 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-6ed1e11c-fc0f-400d-8a3c-878e3673d833 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-90dc8814-960f-42c5-b804-1a726f48fe8d) Jul 27 20:25:14.328234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6ed1e11c-fc0f-400d-8a3c-878e3673d833 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Request method failure captured: Jul 27 20:25:14.328234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: DELETE /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25/os-volume_attachments/b32b8226-ea5d-421f-97d5-90f6f0dcaff5 HTTP/1.1 Jul 27 20:25:14.328234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:25:14.328234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:25:14.328234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:25:14.328234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:25:14.328234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:25:14.328234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:25:14.328234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:25:14.328234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:25:14.328234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4ZxClMtBVPf_psOFiR_V5VfzzlVOTs8KN0v3UVCzLetLxMGmzPfiqv4sQUOzc5KUzuK0FYM5iL1Yqrla3OmSaqqFIqiqS1UBVKFT5DcyldBJo18jK1HI63KdsQNlHgSmlwFXfkFX85SnfWe7krfq_F9HRcP2oetHpdkHLDBXRCdCe0I Jul 27 20:25:14.328234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:25:14.328234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:25:14.328234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:25:14.328234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:25:14.328234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:25:14.328234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:25:14.328234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 5acfaf1104da41f8ba35ddbebb79b506 Jul 27 20:25:14.328234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-VolumesSnapshotTestJSON-804812837 Jul 27 20:25:14.328234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:25:14.328234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:25:14.329803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5acfaf1104da41f8ba35ddbebb79b506"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5acfaf1104da41f8ba35ddbebb79b506"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5acfaf1104da41f8ba35ddbebb79b506", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5acfaf1104da41f8ba35ddbebb79b506"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:25:14.329803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-VolumesSnapshotTestJSON-804812837 Jul 27 20:25:14.329803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 5acfaf1104da41f8ba35ddbebb79b506 Jul 27 20:25:14.329803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-804812837 Jul 27 20:25:14.329803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-VolumesSnapshotTestJSON-804812837-project Jul 27 20:25:14.329803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:25:14.329803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:25:14.329803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: 5cc7b5ba908541cf929eaf10ba24e465 Jul 27 20:25:14.329803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-VolumesSnapshotTestJSON-804812837-project Jul 27 20:25:14.329803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:25:14.330732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-90dc8814-960f-42c5-b804-1a726f48fe8d) Jul 27 20:25:14.330732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'server_id': 'e1fe489c-2f01-4942-ad86-cf5193eaac25', 'id': 'b32b8226-ea5d-421f-97d5-90f6f0dcaff5'} Jul 27 20:25:14.330732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:25:14.330732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.330732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:14.330732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:14.330732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:14.330732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:14.330732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:14.330732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:14.330732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:14.330732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:14.330732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:14.330732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:14.330732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:14.330732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:14.330732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:14.332094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:14.332094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:14.332094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:14.332094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-90dc8814-960f-42c5-b804-1a726f48fe8d) Jul 27 20:25:14.332094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.332094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.332094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.332094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.332094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:25:14.332094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:25:14.332094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:25:14.332094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:25:14.332094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:25:14.332094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:25:14.332094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:14.332094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:14.332094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:14.332094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:14.332094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:14.333639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:14.333639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:14.333639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:14.333639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:14.333639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:14.333639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:14.333639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:14.333639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:14.333639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:14.333639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:14.333639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:14.333639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-90dc8814-960f-42c5-b804-1a726f48fe8d) Jul 27 20:25:14.333639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.333639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.333639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.333639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.333639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:25:14.334946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:25:14.334946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:25:14.334946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:14.334946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:25:14.334946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:25:14.334946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:25:14.334946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:25:14.334946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:25:14.334946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:14.334946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:25:14.334946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:25:14.334946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-90dc8814-960f-42c5-b804-1a726f48fe8d) Jul 27 20:25:14.334946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.334946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.334946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.334946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.334946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:14.334946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:14.336466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:25:14.336466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:25:14.336466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:25:14.336466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:25:14.336466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:25:14.336466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:25:14.336466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-90dc8814-960f-42c5-b804-1a726f48fe8d) Jul 27 20:25:14.336466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.336466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.336466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.336466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.336466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:14.336466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:14.336466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:25:14.336466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:25:14.336466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-90dc8814-960f-42c5-b804-1a726f48fe8d) Jul 27 20:25:14.336466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.337715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6ed1e11c-fc0f-400d-8a3c-878e3673d833 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-90dc8814-960f-42c5-b804-1a726f48fe8d) {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:25:14.337715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6ed1e11c-fc0f-400d-8a3c-878e3673d833 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25/os-volume_attachments/b32b8226-ea5d-421f-97d5-90f6f0dcaff5" status: 400 len: 269 microversion: 2.1 time: 0.159829 Jul 27 20:25:14.337715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 519/1018] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Jul 27 20:25:14 2022] DELETE /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25/os-volume_attachments/b32b8226-ea5d-421f-97d5-90f6f0dcaff5 => generated 269 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:25:14.337715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4278bd61-0314-495c-b5fc-59876eead456 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:14.338049 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4278bd61-0314-495c-b5fc-59876eead456 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:14.342688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4278bd61-0314-495c-b5fc-59876eead456 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.343133 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4278bd61-0314-495c-b5fc-59876eead456 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.343893 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4278bd61-0314-495c-b5fc-59876eead456 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.344324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4278bd61-0314-495c-b5fc-59876eead456 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.375423 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-654f1778-b3c8-491c-b792-17e25d945308 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lazy-loading 'services' on Instance uuid 0d634922-ac08-46f6-aa94-44abf09f6bc3 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:25:14.432786 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-654f1778-b3c8-491c-b792-17e25d945308 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b07d43e6-441f-409a-a2d8-d1e8596be673) Jul 27 20:25:14.435021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-654f1778-b3c8-491c-b792-17e25d945308 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Request method failure captured: Jul 27 20:25:14.435021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3 HTTP/1.1 Jul 27 20:25:14.435021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:25:14.435021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:25:14.435021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:25:14.435021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:25:14.435021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:25:14.435021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:25:14.435021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:25:14.435021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:25:14.435021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4Zs1w1g_5EBOAJHGXZvQfsbeerbcd37lKRD5mUkafMdHZAX3P44SwOy9NISSA8Lh2nFLwJ2io24pgRqnG4EvPMR-HJKAS2sxbES-VziDHtkha7CtqVpqP38PRAt1Y6btPfnsUjV-NLhIZjiSnTrYjlnZs4PaFMjmKlQulWMSRQRQQCg Jul 27 20:25:14.435021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:25:14.435021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:25:14.435021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:25:14.435021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:25:14.435021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:25:14.435021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:25:14.435021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: 1626b826d47a47429a947fa36ace64e4 Jul 27 20:25:14.435021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:25:14.435021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:25:14.435021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:25:14.436668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1626b826d47a47429a947fa36ace64e4", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:25:14.436668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:25:14.436668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 1626b826d47a47429a947fa36ace64e4 Jul 27 20:25:14.436668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:25:14.436668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-ServerRescueNegativeTestJSON-2064775453-project Jul 27 20:25:14.436668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:25:14.436668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:25:14.436668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: a48eaef4d70b4116bd307374d819bca6 Jul 27 20:25:14.436668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2064775453-project Jul 27 20:25:14.436668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:25:14.437691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b07d43e6-441f-409a-a2d8-d1e8596be673) Jul 27 20:25:14.437691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'server_id': '0d634922-ac08-46f6-aa94-44abf09f6bc3', 'id': 'd4fe68b5-3007-45a2-91be-ff65008cfbc3'} Jul 27 20:25:14.437691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:25:14.437691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.437691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:14.437691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:14.437691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:14.437691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:14.437691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:14.437691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:14.437691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:14.437691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:14.437691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:14.437691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:14.437691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:14.437691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:14.437691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:14.438730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:14.438730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:14.438730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:14.438730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b07d43e6-441f-409a-a2d8-d1e8596be673) Jul 27 20:25:14.438730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.438730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.438730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.438730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.438730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:25:14.438730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:25:14.438730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:25:14.438730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:25:14.438730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:25:14.438730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:25:14.438730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:14.438730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:14.438730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:14.438730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:14.438730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:14.440888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:14.440888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:14.440888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:14.440888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:14.440888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:14.440888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:14.440888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:14.440888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:14.440888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:14.440888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:14.440888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:14.440888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b07d43e6-441f-409a-a2d8-d1e8596be673) Jul 27 20:25:14.440888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.440888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.440888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.440888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.440888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:25:14.443172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:25:14.443172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:25:14.443172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:14.443172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:25:14.443172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:25:14.443172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:25:14.443172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:25:14.443172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:25:14.443172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:14.443172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:25:14.443172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:25:14.443172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b07d43e6-441f-409a-a2d8-d1e8596be673) Jul 27 20:25:14.443172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.443172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.443172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.443172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.443172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:14.443172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:14.444921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:25:14.444921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:25:14.444921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:25:14.444921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:25:14.444921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:25:14.444921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:25:14.444921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b07d43e6-441f-409a-a2d8-d1e8596be673) Jul 27 20:25:14.444921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.444921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.444921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.444921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.444921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:14.444921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:14.444921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:25:14.444921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:25:14.444921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b07d43e6-441f-409a-a2d8-d1e8596be673) Jul 27 20:25:14.444921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.446239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-654f1778-b3c8-491c-b792-17e25d945308 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b07d43e6-441f-409a-a2d8-d1e8596be673) {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:25:14.446239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-654f1778-b3c8-491c-b792-17e25d945308 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3" status: 400 len: 269 microversion: 2.1 time: 0.174728 Jul 27 20:25:14.446239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 500/1019] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Jul 27 20:25:14 2022] DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3 => generated 269 bytes in 177 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:25:14.446239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-14e98d5e-19b8-4c60-a89d-fd35572707da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:14.446885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-14e98d5e-19b8-4c60-a89d-fd35572707da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:14.448133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14e98d5e-19b8-4c60-a89d-fd35572707da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.448572 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14e98d5e-19b8-4c60-a89d-fd35572707da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.449617 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14e98d5e-19b8-4c60-a89d-fd35572707da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.450046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14e98d5e-19b8-4c60-a89d-fd35572707da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.479515 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4278bd61-0314-495c-b5fc-59876eead456 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:14.487370 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4278bd61-0314-495c-b5fc-59876eead456 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1560 microversion: 2.1 time: 0.155987 Jul 27 20:25:14.487932 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 520/1020] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:14 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:14.492455 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-336a3b25-63c9-4a4e-85a7-937a603ecac4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:14.495269 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-336a3b25-63c9-4a4e-85a7-937a603ecac4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:14.501209 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-336a3b25-63c9-4a4e-85a7-937a603ecac4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.501666 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-336a3b25-63c9-4a4e-85a7-937a603ecac4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.502442 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-336a3b25-63c9-4a4e-85a7-937a603ecac4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.502879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-336a3b25-63c9-4a4e-85a7-937a603ecac4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.529743 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-14e98d5e-19b8-4c60-a89d-fd35572707da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lazy-loading 'services' on Instance uuid d725356e-73a3-486b-b590-0324916667ff {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:25:14.532814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-336a3b25-63c9-4a4e-85a7-937a603ecac4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043857 Jul 27 20:25:14.533400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 521/1021] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:14 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:14.537989 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ec681a39-34af-4357-9a3e-5adb26844dd4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:14.538480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ec681a39-34af-4357-9a3e-5adb26844dd4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:14.544476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec681a39-34af-4357-9a3e-5adb26844dd4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.544930 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec681a39-34af-4357-9a3e-5adb26844dd4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.545719 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec681a39-34af-4357-9a3e-5adb26844dd4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.546166 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec681a39-34af-4357-9a3e-5adb26844dd4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.587325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-14e98d5e-19b8-4c60-a89d-fd35572707da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4a0b23bc-728f-442c-b3bf-c6a084749359) Jul 27 20:25:14.589729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-14e98d5e-19b8-4c60-a89d-fd35572707da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Request method failure captured: Jul 27 20:25:14.589729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea HTTP/1.1 Jul 27 20:25:14.589729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:25:14.589729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:25:14.589729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:25:14.589729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:25:14.589729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:25:14.589729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:25:14.589729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:25:14.589729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:25:14.589729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4ZszolpoHLv4ymfn-jDIXXwrtat6zA6fU8pUvlIxQFFvg2akujyL-RcTkc0AHUPtL9FfHVEqLLG1P3QFKYKGA6GTuRef7uYyPgJ3tvotGw9j0tfDvIc-GZxx3Nrm1QaM2Jm97CejtJa-hGoo2CtA1AtsmrF2YR6vqcqJ-OZzLMovey0 Jul 27 20:25:14.589729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:25:14.589729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:25:14.589729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:25:14.589729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:25:14.589729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 20:25:14.589729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:25:14.589729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:25:14.589729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:25:14.589729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:25:14.589729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:25:14.589729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:25:14.591217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec01b599458b451e8d04a428c1c33513", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:25:14.591217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:25:14.591217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:25:14.591217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:25:14.591217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:25:14.591217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:25:14.591217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:25:14.591217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: b734a345bfe5483d9a5a1e35d89c935b Jul 27 20:25:14.591217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:25:14.591217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:25:14.592043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4a0b23bc-728f-442c-b3bf-c6a084749359) Jul 27 20:25:14.592043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'server_id': 'd725356e-73a3-486b-b590-0324916667ff', 'id': '2f4bb420-948b-4be6-9672-a9051968dcea'} Jul 27 20:25:14.592043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:25:14.592043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.592043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:14.592043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:14.592043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:14.592043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:14.592043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:14.592043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:14.592043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:14.592043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:14.592043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:14.592043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:14.592043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:14.592043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:14.592043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:14.593080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:14.593080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:14.593080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:14.593080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4a0b23bc-728f-442c-b3bf-c6a084749359) Jul 27 20:25:14.593080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.593080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.593080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.593080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.593080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:25:14.593080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:25:14.593080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:25:14.593080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:25:14.593080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:25:14.593080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:25:14.593080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:14.593080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:14.593080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:14.593080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:14.593080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:14.594194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:14.594194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:14.594194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:14.594194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:14.594194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:14.594194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:14.594194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:14.594194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:14.594194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:14.594194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:14.594194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:14.594194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4a0b23bc-728f-442c-b3bf-c6a084749359) Jul 27 20:25:14.594194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.594194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.594194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.594194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.594194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:25:14.595226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:25:14.595226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:25:14.595226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:14.595226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:25:14.595226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:25:14.595226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:25:14.595226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:25:14.595226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:25:14.595226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:14.595226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:25:14.595226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:25:14.595226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4a0b23bc-728f-442c-b3bf-c6a084749359) Jul 27 20:25:14.595226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.595226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.595226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.595226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.595226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:14.595226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:14.596336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:25:14.596336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:25:14.596336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:25:14.596336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:25:14.596336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:25:14.596336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:25:14.596336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4a0b23bc-728f-442c-b3bf-c6a084749359) Jul 27 20:25:14.596336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.596336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.596336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.596336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.596336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:14.596336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:14.596336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:25:14.596336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:25:14.596336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4a0b23bc-728f-442c-b3bf-c6a084749359) Jul 27 20:25:14.596336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.597745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-14e98d5e-19b8-4c60-a89d-fd35572707da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4a0b23bc-728f-442c-b3bf-c6a084749359) {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:25:14.597745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-14e98d5e-19b8-4c60-a89d-fd35572707da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea" status: 400 len: 269 microversion: 2.20 time: 0.153301 Jul 27 20:25:14.597745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 501/1022] 10.222.0.65 () {60 vars in 1457 bytes} [Wed Jul 27 20:25:14 2022] DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea => generated 269 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 383 bytes (1 switches on core 0) Jul 27 20:25:14.597745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fca45140-c90f-444d-9515-a5e602f0db62 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:14.598643 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fca45140-c90f-444d-9515-a5e602f0db62 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:14.605183 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fca45140-c90f-444d-9515-a5e602f0db62 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.605772 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fca45140-c90f-444d-9515-a5e602f0db62 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.606578 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fca45140-c90f-444d-9515-a5e602f0db62 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.607017 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fca45140-c90f-444d-9515-a5e602f0db62 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.638293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fca45140-c90f-444d-9515-a5e602f0db62 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045635 Jul 27 20:25:14.639114 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 502/1023] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:14 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:14.643491 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a489beff-c421-42f7-b1aa-8018bfb823ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:14.643618 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.objects.instance [None req-ec681a39-34af-4357-9a3e-5adb26844dd4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lazy-loading 'services' on Instance uuid e1fe489c-2f01-4942-ad86-cf5193eaac25 {{(pid=117876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:25:14.643978 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a489beff-c421-42f7-b1aa-8018bfb823ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:14.649650 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a489beff-c421-42f7-b1aa-8018bfb823ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.650115 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a489beff-c421-42f7-b1aa-8018bfb823ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.650901 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a489beff-c421-42f7-b1aa-8018bfb823ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.651362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a489beff-c421-42f7-b1aa-8018bfb823ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.699839 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-ec681a39-34af-4357-9a3e-5adb26844dd4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e83488f9-8c0b-40a1-b6c8-9bd8e982ebe3) Jul 27 20:25:14.701992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ec681a39-34af-4357-9a3e-5adb26844dd4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Request method failure captured: Jul 27 20:25:14.701992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: DELETE /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25/os-volume_attachments/b32b8226-ea5d-421f-97d5-90f6f0dcaff5 HTTP/1.1 Jul 27 20:25:14.701992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:25:14.701992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:25:14.701992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:25:14.701992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:25:14.701992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:25:14.701992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:25:14.701992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:25:14.701992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:25:14.701992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4ZxClMtBVPf_psOFiR_V5VfzzlVOTs8KN0v3UVCzLetLxMGmzPfiqv4sQUOzc5KUzuK0FYM5iL1Yqrla3OmSaqqFIqiqS1UBVKFT5DcyldBJo18jK1HI63KdsQNlHgSmlwFXfkFX85SnfWe7krfq_F9HRcP2oetHpdkHLDBXRCdCe0I Jul 27 20:25:14.701992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:25:14.701992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:25:14.701992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:25:14.701992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:25:14.701992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:25:14.701992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:25:14.701992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 5acfaf1104da41f8ba35ddbebb79b506 Jul 27 20:25:14.701992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-VolumesSnapshotTestJSON-804812837 Jul 27 20:25:14.701992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:25:14.701992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:25:14.703549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5acfaf1104da41f8ba35ddbebb79b506"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5acfaf1104da41f8ba35ddbebb79b506"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5acfaf1104da41f8ba35ddbebb79b506", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5acfaf1104da41f8ba35ddbebb79b506"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:25:14.703549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-VolumesSnapshotTestJSON-804812837 Jul 27 20:25:14.703549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 5acfaf1104da41f8ba35ddbebb79b506 Jul 27 20:25:14.703549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-804812837 Jul 27 20:25:14.703549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-VolumesSnapshotTestJSON-804812837-project Jul 27 20:25:14.703549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:25:14.703549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:25:14.703549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: 5cc7b5ba908541cf929eaf10ba24e465 Jul 27 20:25:14.703549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-VolumesSnapshotTestJSON-804812837-project Jul 27 20:25:14.703549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:25:14.704371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e83488f9-8c0b-40a1-b6c8-9bd8e982ebe3) Jul 27 20:25:14.704371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'server_id': 'e1fe489c-2f01-4942-ad86-cf5193eaac25', 'id': 'b32b8226-ea5d-421f-97d5-90f6f0dcaff5'} Jul 27 20:25:14.704371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:25:14.704371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.704371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:14.704371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:14.704371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:14.704371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:14.704371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:14.704371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:14.704371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:14.704371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:14.704371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:14.704371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:14.704371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:14.704371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:14.704371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:14.705408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:14.705408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:14.705408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:14.705408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e83488f9-8c0b-40a1-b6c8-9bd8e982ebe3) Jul 27 20:25:14.705408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.705408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.705408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.705408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.705408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:25:14.705408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:25:14.705408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:25:14.705408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:25:14.705408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:25:14.705408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:25:14.705408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:14.705408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:14.705408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:14.705408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:14.705408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:14.708634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:14.708634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:14.708634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:14.708634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:14.708634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:14.708634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:14.708634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:14.708634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:14.708634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:14.708634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:14.708634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:14.708634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e83488f9-8c0b-40a1-b6c8-9bd8e982ebe3) Jul 27 20:25:14.708634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.708634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.708634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.708634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.708634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:25:14.709902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:25:14.709902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:25:14.709902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:14.709902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:25:14.709902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:25:14.709902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:25:14.709902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:25:14.709902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:25:14.709902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:14.709902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:25:14.709902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:25:14.709902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e83488f9-8c0b-40a1-b6c8-9bd8e982ebe3) Jul 27 20:25:14.709902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.709902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.709902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.709902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.709902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:14.709902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:14.711373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:25:14.711373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:25:14.711373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:25:14.711373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:25:14.711373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:25:14.711373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:25:14.711373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e83488f9-8c0b-40a1-b6c8-9bd8e982ebe3) Jul 27 20:25:14.711373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.711373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.711373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.711373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.711373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:14.711373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:14.711373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:25:14.711373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:25:14.711373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e83488f9-8c0b-40a1-b6c8-9bd8e982ebe3) Jul 27 20:25:14.711373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.713638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ec681a39-34af-4357-9a3e-5adb26844dd4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e83488f9-8c0b-40a1-b6c8-9bd8e982ebe3) {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:25:14.713638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ec681a39-34af-4357-9a3e-5adb26844dd4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25/os-volume_attachments/b32b8226-ea5d-421f-97d5-90f6f0dcaff5" status: 400 len: 269 microversion: 2.1 time: 0.169016 Jul 27 20:25:14.713638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 522/1024] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Jul 27 20:25:14 2022] DELETE /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25/os-volume_attachments/b32b8226-ea5d-421f-97d5-90f6f0dcaff5 => generated 269 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:25:14.713638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7463e0da-3bb8-4564-af3a-f0c2507104b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:14.714100 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7463e0da-3bb8-4564-af3a-f0c2507104b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:14.716594 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7463e0da-3bb8-4564-af3a-f0c2507104b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.717074 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7463e0da-3bb8-4564-af3a-f0c2507104b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.717845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7463e0da-3bb8-4564-af3a-f0c2507104b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.718396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7463e0da-3bb8-4564-af3a-f0c2507104b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.748024 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-a489beff-c421-42f7-b1aa-8018bfb823ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lazy-loading 'services' on Instance uuid 0d634922-ac08-46f6-aa94-44abf09f6bc3 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:25:14.798245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.objects.instance [None req-7463e0da-3bb8-4564-af3a-f0c2507104b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lazy-loading 'services' on Instance uuid d725356e-73a3-486b-b590-0324916667ff {{(pid=117876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:25:14.826967 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-a489beff-c421-42f7-b1aa-8018bfb823ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6fa1af0-5de0-4868-9ca9-c621c187abcf) Jul 27 20:25:14.829212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a489beff-c421-42f7-b1aa-8018bfb823ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Request method failure captured: Jul 27 20:25:14.829212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3 HTTP/1.1 Jul 27 20:25:14.829212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:25:14.829212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:25:14.829212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:25:14.829212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:25:14.829212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:25:14.829212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:25:14.829212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:25:14.829212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:25:14.829212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4Zs1w1g_5EBOAJHGXZvQfsbeerbcd37lKRD5mUkafMdHZAX3P44SwOy9NISSA8Lh2nFLwJ2io24pgRqnG4EvPMR-HJKAS2sxbES-VziDHtkha7CtqVpqP38PRAt1Y6btPfnsUjV-NLhIZjiSnTrYjlnZs4PaFMjmKlQulWMSRQRQQCg Jul 27 20:25:14.829212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:25:14.829212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:25:14.829212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:25:14.829212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:25:14.829212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:25:14.829212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:25:14.829212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: 1626b826d47a47429a947fa36ace64e4 Jul 27 20:25:14.829212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:25:14.829212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:25:14.829212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:25:14.830502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1626b826d47a47429a947fa36ace64e4", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:25:14.830502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:25:14.830502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 1626b826d47a47429a947fa36ace64e4 Jul 27 20:25:14.830502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:25:14.830502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-ServerRescueNegativeTestJSON-2064775453-project Jul 27 20:25:14.830502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:25:14.830502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:25:14.830502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: a48eaef4d70b4116bd307374d819bca6 Jul 27 20:25:14.830502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2064775453-project Jul 27 20:25:14.830502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:25:14.831344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6fa1af0-5de0-4868-9ca9-c621c187abcf) Jul 27 20:25:14.831344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'server_id': '0d634922-ac08-46f6-aa94-44abf09f6bc3', 'id': 'd4fe68b5-3007-45a2-91be-ff65008cfbc3'} Jul 27 20:25:14.831344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:25:14.831344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.831344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:14.831344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:14.831344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:14.831344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:14.831344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:14.831344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:14.831344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:14.831344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:14.831344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:14.831344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:14.831344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:14.831344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:14.831344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:14.832338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:14.832338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:14.832338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:14.832338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6fa1af0-5de0-4868-9ca9-c621c187abcf) Jul 27 20:25:14.832338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.832338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.832338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.832338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.832338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:25:14.832338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:25:14.832338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:25:14.832338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:25:14.832338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:25:14.832338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:25:14.832338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:14.832338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:14.832338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:14.832338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:14.832338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:14.835827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:14.835827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:14.835827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:14.835827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:14.835827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:14.835827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:14.835827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:14.835827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:14.835827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:14.835827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:14.835827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:14.835827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6fa1af0-5de0-4868-9ca9-c621c187abcf) Jul 27 20:25:14.835827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.835827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.835827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.835827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.835827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:25:14.837547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:25:14.837547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:25:14.837547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:14.837547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:25:14.837547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:25:14.837547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:25:14.837547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:25:14.837547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:25:14.837547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:14.837547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:25:14.837547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:25:14.837547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6fa1af0-5de0-4868-9ca9-c621c187abcf) Jul 27 20:25:14.837547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.837547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.837547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.837547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.837547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:14.837547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:14.838900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:25:14.838900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:25:14.838900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:25:14.838900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:25:14.838900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:25:14.838900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:25:14.838900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6fa1af0-5de0-4868-9ca9-c621c187abcf) Jul 27 20:25:14.838900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.838900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.838900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.838900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.838900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:14.838900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:14.838900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:25:14.838900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:25:14.838900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6fa1af0-5de0-4868-9ca9-c621c187abcf) Jul 27 20:25:14.838900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.840101 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a489beff-c421-42f7-b1aa-8018bfb823ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e6fa1af0-5de0-4868-9ca9-c621c187abcf) {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:25:14.840101 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a489beff-c421-42f7-b1aa-8018bfb823ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3" status: 400 len: 269 microversion: 2.1 time: 0.190880 Jul 27 20:25:14.840101 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 503/1025] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Jul 27 20:25:14 2022] DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments/d4fe68b5-3007-45a2-91be-ff65008cfbc3 => generated 269 bytes in 192 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:25:14.840101 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0d0d6106-636d-458c-b654-1be4fb3ee0e9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:14.840455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0d0d6106-636d-458c-b654-1be4fb3ee0e9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:14.843229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d0d6106-636d-458c-b654-1be4fb3ee0e9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.843677 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d0d6106-636d-458c-b654-1be4fb3ee0e9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.844440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d0d6106-636d-458c-b654-1be4fb3ee0e9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.844876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d0d6106-636d-458c-b654-1be4fb3ee0e9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.862319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-7463e0da-3bb8-4564-af3a-f0c2507104b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f1f4f59-119d-4319-b65c-870b7dc82495) Jul 27 20:25:14.864509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7463e0da-3bb8-4564-af3a-f0c2507104b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Request method failure captured: Jul 27 20:25:14.864509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea HTTP/1.1 Jul 27 20:25:14.864509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:25:14.864509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:25:14.864509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:25:14.864509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:25:14.864509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:25:14.864509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:25:14.864509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:25:14.864509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:25:14.864509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4ZszolpoHLv4ymfn-jDIXXwrtat6zA6fU8pUvlIxQFFvg2akujyL-RcTkc0AHUPtL9FfHVEqLLG1P3QFKYKGA6GTuRef7uYyPgJ3tvotGw9j0tfDvIc-GZxx3Nrm1QaM2Jm97CejtJa-hGoo2CtA1AtsmrF2YR6vqcqJ-OZzLMovey0 Jul 27 20:25:14.864509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:25:14.864509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:25:14.864509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:25:14.864509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:25:14.864509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 20:25:14.864509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:25:14.864509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:25:14.864509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:25:14.864509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:25:14.864509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:25:14.864509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:25:14.866184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec01b599458b451e8d04a428c1c33513", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:25:14.866184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:25:14.866184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:25:14.866184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:25:14.866184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:25:14.866184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:25:14.866184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:25:14.866184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: b734a345bfe5483d9a5a1e35d89c935b Jul 27 20:25:14.866184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:25:14.866184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:25:14.866816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f1f4f59-119d-4319-b65c-870b7dc82495) Jul 27 20:25:14.866816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'server_id': 'd725356e-73a3-486b-b590-0324916667ff', 'id': '2f4bb420-948b-4be6-9672-a9051968dcea'} Jul 27 20:25:14.866816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:25:14.866816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.866816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:14.866816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:14.866816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:14.866816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:14.866816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:14.866816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:14.866816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:14.866816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:14.866816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:14.866816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:14.866816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:14.866816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:14.866816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:14.867843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:14.867843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:14.867843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:14.867843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f1f4f59-119d-4319-b65c-870b7dc82495) Jul 27 20:25:14.867843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.867843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.867843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.867843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.867843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:25:14.867843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:25:14.867843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:25:14.867843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:25:14.867843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:25:14.867843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:25:14.867843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:14.867843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:14.867843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:14.867843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:14.867843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:14.869013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:14.869013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:14.869013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:14.869013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:14.869013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:14.869013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:14.869013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:14.869013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:14.869013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:14.869013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:14.869013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:14.869013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f1f4f59-119d-4319-b65c-870b7dc82495) Jul 27 20:25:14.869013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.869013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.869013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.869013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.869013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:25:14.870745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:25:14.870745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:25:14.870745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:14.870745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:25:14.870745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:25:14.870745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:25:14.870745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:25:14.870745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:25:14.870745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:14.870745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:25:14.870745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:25:14.870745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f1f4f59-119d-4319-b65c-870b7dc82495) Jul 27 20:25:14.870745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.870745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.870745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.870745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.870745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:14.870745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:14.872716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:25:14.872716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:25:14.872716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:25:14.872716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:25:14.872716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:25:14.872716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:25:14.872716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f1f4f59-119d-4319-b65c-870b7dc82495) Jul 27 20:25:14.872716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.872716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:14.872716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.872716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:14.872716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:14.872716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:14.872716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:25:14.872716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:25:14.872716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f1f4f59-119d-4319-b65c-870b7dc82495) Jul 27 20:25:14.872716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:14.874370 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7463e0da-3bb8-4564-af3a-f0c2507104b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2f1f4f59-119d-4319-b65c-870b7dc82495) {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:25:14.874370 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7463e0da-3bb8-4564-af3a-f0c2507104b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea" status: 400 len: 269 microversion: 2.20 time: 0.161278 Jul 27 20:25:14.874370 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 523/1026] 10.222.0.65 () {60 vars in 1457 bytes} [Wed Jul 27 20:25:14 2022] DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments/2f4bb420-948b-4be6-9672-a9051968dcea => generated 269 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 383 bytes (1 switches on core 0) Jul 27 20:25:14.874370 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-79d298e0-cc0b-4fc9-862f-90561be15119 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:14.875929 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-79d298e0-cc0b-4fc9-862f-90561be15119 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:14.883951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-79d298e0-cc0b-4fc9-862f-90561be15119 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.884402 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-79d298e0-cc0b-4fc9-862f-90561be15119 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.885245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-79d298e0-cc0b-4fc9-862f-90561be15119 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.885685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-79d298e0-cc0b-4fc9-862f-90561be15119 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.910085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:14.915125 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-79d298e0-cc0b-4fc9-862f-90561be15119 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047571 Jul 27 20:25:14.915992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 524/1027] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:14 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:14.921205 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8035908a-b5af-49dc-8848-9b807363a82b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:14.921700 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8035908a-b5af-49dc-8848-9b807363a82b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:14.927540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8035908a-b5af-49dc-8848-9b807363a82b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.927996 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8035908a-b5af-49dc-8848-9b807363a82b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.928751 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8035908a-b5af-49dc-8848-9b807363a82b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:14.929224 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8035908a-b5af-49dc-8848-9b807363a82b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:14.989744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0d0d6106-636d-458c-b654-1be4fb3ee0e9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:14.998203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0d0d6106-636d-458c-b654-1be4fb3ee0e9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1560 microversion: 2.1 time: 0.165956 Jul 27 20:25:14.998766 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 504/1028] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:14 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:15.003464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-31fdcdb2-09f9-46be-b407-c9984afde139 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:15.010563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-31fdcdb2-09f9-46be-b407-c9984afde139 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:15.012421 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.objects.instance [None req-8035908a-b5af-49dc-8848-9b807363a82b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lazy-loading 'services' on Instance uuid e1fe489c-2f01-4942-ad86-cf5193eaac25 {{(pid=117876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:25:15.019049 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-31fdcdb2-09f9-46be-b407-c9984afde139 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:15.019504 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-31fdcdb2-09f9-46be-b407-c9984afde139 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:15.020275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-31fdcdb2-09f9-46be-b407-c9984afde139 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:15.020705 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-31fdcdb2-09f9-46be-b407-c9984afde139 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:15.055017 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-31fdcdb2-09f9-46be-b407-c9984afde139 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055217 Jul 27 20:25:15.055583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 505/1029] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:14 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:15.060803 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-507dbb67-fa01-4924-bdda-9fe3e5192c91 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:15.062959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-507dbb67-fa01-4924-bdda-9fe3e5192c91 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:15.069539 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-507dbb67-fa01-4924-bdda-9fe3e5192c91 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:15.070057 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-507dbb67-fa01-4924-bdda-9fe3e5192c91 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:15.070884 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-507dbb67-fa01-4924-bdda-9fe3e5192c91 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:15.071384 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-507dbb67-fa01-4924-bdda-9fe3e5192c91 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:15.082249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-8035908a-b5af-49dc-8848-9b807363a82b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e40ae51-a2eb-469a-8460-d123fe853257) Jul 27 20:25:15.084426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8035908a-b5af-49dc-8848-9b807363a82b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Request method failure captured: Jul 27 20:25:15.084426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: DELETE /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25/os-volume_attachments/b32b8226-ea5d-421f-97d5-90f6f0dcaff5 HTTP/1.1 Jul 27 20:25:15.084426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:25:15.084426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:25:15.084426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:25:15.084426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:25:15.084426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:25:15.084426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:25:15.084426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:25:15.084426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:25:15.084426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4ZxClMtBVPf_psOFiR_V5VfzzlVOTs8KN0v3UVCzLetLxMGmzPfiqv4sQUOzc5KUzuK0FYM5iL1Yqrla3OmSaqqFIqiqS1UBVKFT5DcyldBJo18jK1HI63KdsQNlHgSmlwFXfkFX85SnfWe7krfq_F9HRcP2oetHpdkHLDBXRCdCe0I Jul 27 20:25:15.084426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:25:15.084426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:25:15.084426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:25:15.084426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:25:15.084426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:25:15.084426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:25:15.084426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 5acfaf1104da41f8ba35ddbebb79b506 Jul 27 20:25:15.084426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-VolumesSnapshotTestJSON-804812837 Jul 27 20:25:15.084426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:25:15.084426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:25:15.086003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5acfaf1104da41f8ba35ddbebb79b506"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5acfaf1104da41f8ba35ddbebb79b506"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5acfaf1104da41f8ba35ddbebb79b506", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5acfaf1104da41f8ba35ddbebb79b506"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:25:15.086003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-VolumesSnapshotTestJSON-804812837 Jul 27 20:25:15.086003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 5acfaf1104da41f8ba35ddbebb79b506 Jul 27 20:25:15.086003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-804812837 Jul 27 20:25:15.086003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-VolumesSnapshotTestJSON-804812837-project Jul 27 20:25:15.086003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:25:15.086003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:25:15.086003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: 5cc7b5ba908541cf929eaf10ba24e465 Jul 27 20:25:15.086003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-VolumesSnapshotTestJSON-804812837-project Jul 27 20:25:15.086003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:25:15.086881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e40ae51-a2eb-469a-8460-d123fe853257) Jul 27 20:25:15.086881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'server_id': 'e1fe489c-2f01-4942-ad86-cf5193eaac25', 'id': 'b32b8226-ea5d-421f-97d5-90f6f0dcaff5'} Jul 27 20:25:15.086881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:25:15.086881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:15.086881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:15.086881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:15.086881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:15.086881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:15.086881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:15.086881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:15.086881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:15.086881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:15.086881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:15.086881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:15.086881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:15.086881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:15.086881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:15.088158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:15.088158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:15.088158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:15.088158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e40ae51-a2eb-469a-8460-d123fe853257) Jul 27 20:25:15.088158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:15.088158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:15.088158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:15.088158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:15.088158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:25:15.088158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:25:15.088158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:25:15.088158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:25:15.088158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:25:15.088158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:25:15.088158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:15.088158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:15.088158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:15.088158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:15.088158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:15.089395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:15.089395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:15.089395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:15.089395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:15.089395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:15.089395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:15.089395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:15.089395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:15.089395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:15.089395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:15.089395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:15.089395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e40ae51-a2eb-469a-8460-d123fe853257) Jul 27 20:25:15.089395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:15.089395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:15.089395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:15.089395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:15.089395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:25:15.090412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:25:15.090412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:25:15.090412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:15.090412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:25:15.090412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:25:15.090412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:25:15.090412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:25:15.090412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:25:15.090412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:15.090412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:25:15.090412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:25:15.090412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e40ae51-a2eb-469a-8460-d123fe853257) Jul 27 20:25:15.090412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:15.090412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:15.090412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:15.090412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:15.090412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:15.090412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:15.091462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:25:15.091462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:25:15.091462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:25:15.091462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:25:15.091462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:25:15.091462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:25:15.091462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e40ae51-a2eb-469a-8460-d123fe853257) Jul 27 20:25:15.091462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:15.091462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:15.091462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:15.091462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:15.091462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:15.091462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:15.091462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:25:15.091462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:25:15.091462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e40ae51-a2eb-469a-8460-d123fe853257) Jul 27 20:25:15.091462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:25:15.093683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8035908a-b5af-49dc-8848-9b807363a82b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4e40ae51-a2eb-469a-8460-d123fe853257) {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:25:15.094753 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8035908a-b5af-49dc-8848-9b807363a82b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25/os-volume_attachments/b32b8226-ea5d-421f-97d5-90f6f0dcaff5" status: 400 len: 269 microversion: 2.1 time: 0.177272 Jul 27 20:25:15.095785 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 525/1030] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Jul 27 20:25:14 2022] DELETE /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25/os-volume_attachments/b32b8226-ea5d-421f-97d5-90f6f0dcaff5 => generated 269 bytes in 179 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:25:15.100831 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f9f31bc7-ba3f-49c2-89ec-b16bf14f8e1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:15.104616 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f9f31bc7-ba3f-49c2-89ec-b16bf14f8e1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:15.113364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-507dbb67-fa01-4924-bdda-9fe3e5192c91 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056407 Jul 27 20:25:15.122867 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 506/1031] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:15 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:15.124601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f9f31bc7-ba3f-49c2-89ec-b16bf14f8e1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:15.125093 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f9f31bc7-ba3f-49c2-89ec-b16bf14f8e1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:15.126196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f9f31bc7-ba3f-49c2-89ec-b16bf14f8e1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:15.126808 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f9f31bc7-ba3f-49c2-89ec-b16bf14f8e1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:15.157895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f9f31bc7-ba3f-49c2-89ec-b16bf14f8e1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060873 Jul 27 20:25:15.158789 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 526/1032] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:15 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:15.916487 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-66f68708-4c9a-4f38-a844-69e996641d0d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:15.917003 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-66f68708-4c9a-4f38-a844-69e996641d0d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:15.925378 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-66f68708-4c9a-4f38-a844-69e996641d0d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:15.925824 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-66f68708-4c9a-4f38-a844-69e996641d0d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:15.926581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-66f68708-4c9a-4f38-a844-69e996641d0d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:15.927005 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-66f68708-4c9a-4f38-a844-69e996641d0d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:15.954012 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-66f68708-4c9a-4f38-a844-69e996641d0d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:25:15.980767 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-66b10bd2-1af7-48d1-8438-ea4bfbe23da6 req-d541cb28-6273-4af9-9573-dbd57fdf8742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c560ad96-cd64-4d84-86c8-c315f0fa0ab7", "tag": "12f96d47-a8d9-4367-b8bf-0bb05f9ee59b"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:25:15.992443 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-66b10bd2-1af7-48d1-8438-ea4bfbe23da6 req-d541cb28-6273-4af9-9573-dbd57fdf8742 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:15.992936 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-66b10bd2-1af7-48d1-8438-ea4bfbe23da6 req-d541cb28-6273-4af9-9573-dbd57fdf8742 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:16.006058 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-66b10bd2-1af7-48d1-8438-ea4bfbe23da6 req-d541cb28-6273-4af9-9573-dbd57fdf8742 service nova] Creating event network-changed:12f96d47-a8d9-4367-b8bf-0bb05f9ee59b for instance c560ad96-cd64-4d84-86c8-c315f0fa0ab7 on hv-cinder-79987 Jul 27 20:25:16.010501 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR oslo.messaging._drivers.impl_rabbit [req-66b10bd2-1af7-48d1-8438-ea4bfbe23da6 req-d541cb28-6273-4af9-9573-dbd57fdf8742 service nova] [cee1dc85-d8a9-4e52-a9e4-b102c103c541] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 27 20:25:16.035282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-66f68708-4c9a-4f38-a844-69e996641d0d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 204 len: 0 microversion: 2.1 time: 0.122543 Jul 27 20:25:16.035881 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 507/1033] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 20:25:15 2022] DELETE /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:25:16.044189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a494f41c-ab1e-479e-b773-43275fb1ee8f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:25:16.046930 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a494f41c-ab1e-479e-b773-43275fb1ee8f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:16.053527 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a494f41c-ab1e-479e-b773-43275fb1ee8f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:16.054055 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a494f41c-ab1e-479e-b773-43275fb1ee8f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:16.054907 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a494f41c-ab1e-479e-b773-43275fb1ee8f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:16.055419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a494f41c-ab1e-479e-b773-43275fb1ee8f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:16.324497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a494f41c-ab1e-479e-b773-43275fb1ee8f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "POST /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/action" status: 200 len: 82571 microversion: 2.1 time: 0.285727 Jul 27 20:25:16.325480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 508/1034] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Jul 27 20:25:16 2022] POST /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/action => generated 82571 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:16.330765 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c998d4c7-ccd4-4802-9fb8-6c0e689ff969 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:16.331470 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c998d4c7-ccd4-4802-9fb8-6c0e689ff969 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:16.337833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c998d4c7-ccd4-4802-9fb8-6c0e689ff969 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:16.338342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c998d4c7-ccd4-4802-9fb8-6c0e689ff969 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:16.339122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c998d4c7-ccd4-4802-9fb8-6c0e689ff969 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:16.339557 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c998d4c7-ccd4-4802-9fb8-6c0e689ff969 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:16.569350 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c998d4c7-ccd4-4802-9fb8-6c0e689ff969 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:16.577420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c998d4c7-ccd4-4802-9fb8-6c0e689ff969 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1566 microversion: 2.1 time: 0.250897 Jul 27 20:25:16.578082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 509/1035] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:16 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1566 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:16.583529 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0e75505c-96d3-4d19-b482-8f7cf3b4d6b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:16.586084 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0e75505c-96d3-4d19-b482-8f7cf3b4d6b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:16.593227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e75505c-96d3-4d19-b482-8f7cf3b4d6b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:16.593779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e75505c-96d3-4d19-b482-8f7cf3b4d6b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:16.594614 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e75505c-96d3-4d19-b482-8f7cf3b4d6b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:16.595110 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e75505c-96d3-4d19-b482-8f7cf3b4d6b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:16.623107 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:16.628657 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0e75505c-96d3-4d19-b482-8f7cf3b4d6b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049341 Jul 27 20:25:16.633680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 510/1036] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:16 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:16.634235 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9b4fa85a-6516-416c-8ccd-7383fccc0c0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:16.636499 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9b4fa85a-6516-416c-8ccd-7383fccc0c0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:16.643706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9b4fa85a-6516-416c-8ccd-7383fccc0c0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:16.644166 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9b4fa85a-6516-416c-8ccd-7383fccc0c0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:16.644951 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9b4fa85a-6516-416c-8ccd-7383fccc0c0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:16.645433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9b4fa85a-6516-416c-8ccd-7383fccc0c0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:16.678559 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9b4fa85a-6516-416c-8ccd-7383fccc0c0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048231 Jul 27 20:25:16.679146 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 511/1037] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:16 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:16.683830 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bb6b9a4f-066e-410d-9ace-607ac965370f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:16.686282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bb6b9a4f-066e-410d-9ace-607ac965370f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:16.692312 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb6b9a4f-066e-410d-9ace-607ac965370f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:16.692761 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb6b9a4f-066e-410d-9ace-607ac965370f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:16.693575 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb6b9a4f-066e-410d-9ace-607ac965370f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:16.694006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb6b9a4f-066e-410d-9ace-607ac965370f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:16.727075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bb6b9a4f-066e-410d-9ace-607ac965370f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046374 Jul 27 20:25:16.727888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 512/1038] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:16 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:16.734093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-88f6951d-4936-4915-a7c3-9b56a02e0fac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:16.734585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-88f6951d-4936-4915-a7c3-9b56a02e0fac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:16.740419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-88f6951d-4936-4915-a7c3-9b56a02e0fac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:16.740871 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-88f6951d-4936-4915-a7c3-9b56a02e0fac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:16.741667 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-88f6951d-4936-4915-a7c3-9b56a02e0fac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:16.742109 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-88f6951d-4936-4915-a7c3-9b56a02e0fac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:16.835763 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-88f6951d-4936-4915-a7c3-9b56a02e0fac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lazy-loading 'services' on Instance uuid 8a92495d-74f4-4470-b9a4-919eb729c2a7 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:25:16.899271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-88f6951d-4936-4915-a7c3-9b56a02e0fac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee5b2aad-cd37-4359-8d79-bce4c11a2bbc) Jul 27 20:25:16.902075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-88f6951d-4936-4915-a7c3-9b56a02e0fac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Request method failure captured: Jul 27 20:25:16.902075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments/2d1afb1c-74a8-4609-bb99-2a7c6a98a47a HTTP/1.1 Jul 27 20:25:16.902075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:25:16.902075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:25:16.902075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:25:16.902075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:25:16.902075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:25:16.902075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:25:16.902075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:25:16.902075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:25:16.902075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4Zt9hA08fCimx4VPaFBX-Sb7TdxVO4GYWLzVL2LfBoMfr7ZhXkuy-lnm2BfcdV0YE0d5EBhsKRAZ16RMmCNU9HYiu0JxcDVLn8ZqaaAMoLRhtWq6pEnxYJAPilJ52XM9g38yH_zmccu9erlX4FHhrArqdp5LBowsHqtf82VC5HAzctw Jul 27 20:25:16.902075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:25:16.902075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:25:16.902075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:25:16.902075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:25:16.902075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:25:16.902075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:25:16.902075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: 4d888dcf554944adae3e03bc1c24c52b Jul 27 20:25:16.902075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-TestMinimumBasicScenario-1138539075 Jul 27 20:25:16.902075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:25:16.902075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:25:16.903655 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4d888dcf554944adae3e03bc1c24c52b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4d888dcf554944adae3e03bc1c24c52b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4d888dcf554944adae3e03bc1c24c52b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4d888dcf554944adae3e03bc1c24c52b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:25:16.903655 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-TestMinimumBasicScenario-1138539075 Jul 27 20:25:16.903655 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 4d888dcf554944adae3e03bc1c24c52b Jul 27 20:25:16.903655 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1138539075 Jul 27 20:25:16.903655 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-TestMinimumBasicScenario-1138539075-project Jul 27 20:25:16.903655 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:25:16.903655 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:25:16.903655 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: 5fa85a53bfbe4ef5a36c01031f9016aa Jul 27 20:25:16.903655 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-TestMinimumBasicScenario-1138539075-project Jul 27 20:25:16.903655 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:25:16.904294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee5b2aad-cd37-4359-8d79-bce4c11a2bbc) Jul 27 20:25:16.904294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'server_id': '8a92495d-74f4-4470-b9a4-919eb729c2a7', 'id': '2d1afb1c-74a8-4609-bb99-2a7c6a98a47a'} Jul 27 20:25:16.904294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:25:16.904294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:16.904294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:16.904294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:16.904294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:16.904294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:16.904294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:16.904294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:16.904294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:16.904294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:16.904294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:16.904294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:16.904294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:16.904294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:16.904294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:16.905359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:16.905359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:16.905359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:16.905359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee5b2aad-cd37-4359-8d79-bce4c11a2bbc) Jul 27 20:25:16.905359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:16.905359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:16.905359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:16.905359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:16.905359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 27 20:25:16.905359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 27 20:25:16.905359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 27 20:25:16.905359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 27 20:25:16.905359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:25:16.905359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:25:16.905359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:25:16.905359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:25:16.905359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:25:16.905359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:25:16.905359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 27 20:25:16.906490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 27 20:25:16.906490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 27 20:25:16.906490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 27 20:25:16.906490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 27 20:25:16.906490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 27 20:25:16.906490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 27 20:25:16.906490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 27 20:25:16.906490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:25:16.906490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:25:16.906490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:25:16.906490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:25:16.906490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee5b2aad-cd37-4359-8d79-bce4c11a2bbc) Jul 27 20:25:16.906490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:16.906490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:16.906490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:16.906490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:16.906490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 27 20:25:16.907593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 27 20:25:16.907593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:25:16.907593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:16.907593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:25:16.907593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:25:16.907593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 27 20:25:16.907593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 27 20:25:16.907593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 27 20:25:16.907593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:25:16.907593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 27 20:25:16.907593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 27 20:25:16.907593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee5b2aad-cd37-4359-8d79-bce4c11a2bbc) Jul 27 20:25:16.907593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:16.907593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:16.907593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:16.907593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:16.907593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:16.907593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:16.908674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:25:16.908674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:25:16.908674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:25:16.908674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:25:16.908674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 27 20:25:16.908674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:25:16.908674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee5b2aad-cd37-4359-8d79-bce4c11a2bbc) Jul 27 20:25:16.908674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:16.908674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:25:16.908674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:16.908674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:25:16.908674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:25:16.908674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:25:16.908674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:25:16.908674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:25:16.908674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee5b2aad-cd37-4359-8d79-bce4c11a2bbc) Jul 27 20:25:16.908674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:25:16.910911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-88f6951d-4936-4915-a7c3-9b56a02e0fac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee5b2aad-cd37-4359-8d79-bce4c11a2bbc) {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:25:16.910911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-88f6951d-4936-4915-a7c3-9b56a02e0fac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments/2d1afb1c-74a8-4609-bb99-2a7c6a98a47a" status: 400 len: 269 microversion: 2.1 time: 0.173387 Jul 27 20:25:16.910911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 513/1039] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Jul 27 20:25:16 2022] DELETE /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7/os-volume_attachments/2d1afb1c-74a8-4609-bb99-2a7c6a98a47a => generated 269 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:25:17.020726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [req-66b10bd2-1af7-48d1-8438-ea4bfbe23da6 req-d541cb28-6273-4af9-9573-dbd57fdf8742 service nova] [cee1dc85-d8a9-4e52-a9e4-b102c103c541] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 34716. Jul 27 20:25:17.029147 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-66b10bd2-1af7-48d1-8438-ea4bfbe23da6 req-d541cb28-6273-4af9-9573-dbd57fdf8742 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.109070 Jul 27 20:25:17.031245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 527/1040] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:17.099770 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-217c5dbd-d278-4342-bf9c-42282ec6deca req-5a3eda2f-9d60-462c-9fab-2eb48046037f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c560ad96-cd64-4d84-86c8-c315f0fa0ab7", "name": "network-vif-deleted", "tag": "12f96d47-a8d9-4367-b8bf-0bb05f9ee59b"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:25:17.115968 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-217c5dbd-d278-4342-bf9c-42282ec6deca req-5a3eda2f-9d60-462c-9fab-2eb48046037f service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:17.116470 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-217c5dbd-d278-4342-bf9c-42282ec6deca req-5a3eda2f-9d60-462c-9fab-2eb48046037f service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:17.129767 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-217c5dbd-d278-4342-bf9c-42282ec6deca req-5a3eda2f-9d60-462c-9fab-2eb48046037f service nova] Creating event network-vif-deleted:12f96d47-a8d9-4367-b8bf-0bb05f9ee59b for instance c560ad96-cd64-4d84-86c8-c315f0fa0ab7 on hv-cinder-79987 Jul 27 20:25:17.135445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-217c5dbd-d278-4342-bf9c-42282ec6deca req-5a3eda2f-9d60-462c-9fab-2eb48046037f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143020 Jul 27 20:25:17.136232 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 514/1041] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:17.599192 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5db0c669-5f2f-4e2d-bc7d-c4c77a50ada0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:17.599816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5db0c669-5f2f-4e2d-bc7d-c4c77a50ada0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:17.606714 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5db0c669-5f2f-4e2d-bc7d-c4c77a50ada0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:17.607162 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5db0c669-5f2f-4e2d-bc7d-c4c77a50ada0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:17.607918 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5db0c669-5f2f-4e2d-bc7d-c4c77a50ada0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:17.608354 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5db0c669-5f2f-4e2d-bc7d-c4c77a50ada0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:17.642177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9877c008-79f5-405e-83d5-3f82b95f0f42 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:17.644489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9877c008-79f5-405e-83d5-3f82b95f0f42 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:17.651299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9877c008-79f5-405e-83d5-3f82b95f0f42 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:17.651907 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9877c008-79f5-405e-83d5-3f82b95f0f42 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:17.652695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9877c008-79f5-405e-83d5-3f82b95f0f42 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:17.653179 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9877c008-79f5-405e-83d5-3f82b95f0f42 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:17.673955 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5db0c669-5f2f-4e2d-bc7d-c4c77a50ada0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:17.682397 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5db0c669-5f2f-4e2d-bc7d-c4c77a50ada0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.087452 Jul 27 20:25:17.682982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 528/1042] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:17 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:17.684736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9877c008-79f5-405e-83d5-3f82b95f0f42 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047271 Jul 27 20:25:17.689324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 515/1043] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:17 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:25:17.690479 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-96a7c9b2-9b6e-4452-9643-5aea3ab2a83e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:17.692612 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-96a7c9b2-9b6e-4452-9643-5aea3ab2a83e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:17.699058 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-96a7c9b2-9b6e-4452-9643-5aea3ab2a83e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:17.699778 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-96a7c9b2-9b6e-4452-9643-5aea3ab2a83e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:17.700556 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-96a7c9b2-9b6e-4452-9643-5aea3ab2a83e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:17.701199 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-96a7c9b2-9b6e-4452-9643-5aea3ab2a83e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:17.730742 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-96a7c9b2-9b6e-4452-9643-5aea3ab2a83e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043957 Jul 27 20:25:17.731292 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 529/1044] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:17 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:25:17.739726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c1ba0f26-4c15-4489-a419-9a4a40d80cfe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:17.741945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c1ba0f26-4c15-4489-a419-9a4a40d80cfe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:17.748153 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1ba0f26-4c15-4489-a419-9a4a40d80cfe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:17.748608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1ba0f26-4c15-4489-a419-9a4a40d80cfe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:17.749416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1ba0f26-4c15-4489-a419-9a4a40d80cfe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:17.749855 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1ba0f26-4c15-4489-a419-9a4a40d80cfe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:17.779082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c1ba0f26-4c15-4489-a419-9a4a40d80cfe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043260 Jul 27 20:25:17.779625 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 516/1045] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:17 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:18.696269 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e9474fb7-62b2-4c1b-bc8f-46c33283ddf0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:18.698526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e9474fb7-62b2-4c1b-bc8f-46c33283ddf0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:18.703137 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4350972d-dcf9-4723-8d84-071dbeb09f7a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:18.703759 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4350972d-dcf9-4723-8d84-071dbeb09f7a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:18.705433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e9474fb7-62b2-4c1b-bc8f-46c33283ddf0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:18.705885 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e9474fb7-62b2-4c1b-bc8f-46c33283ddf0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:18.706657 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e9474fb7-62b2-4c1b-bc8f-46c33283ddf0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:18.707104 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e9474fb7-62b2-4c1b-bc8f-46c33283ddf0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:18.710055 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4350972d-dcf9-4723-8d84-071dbeb09f7a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:18.710514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4350972d-dcf9-4723-8d84-071dbeb09f7a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:18.711287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4350972d-dcf9-4723-8d84-071dbeb09f7a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:18.711727 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4350972d-dcf9-4723-8d84-071dbeb09f7a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:18.736612 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e9474fb7-62b2-4c1b-bc8f-46c33283ddf0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044218 Jul 27 20:25:18.737412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 530/1046] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:18 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:18.742824 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2b3c46b3-5503-4d50-85be-84cd51302525 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:18.745708 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2b3c46b3-5503-4d50-85be-84cd51302525 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:18.751638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2b3c46b3-5503-4d50-85be-84cd51302525 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:18.752089 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2b3c46b3-5503-4d50-85be-84cd51302525 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:18.752852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2b3c46b3-5503-4d50-85be-84cd51302525 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:18.753327 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2b3c46b3-5503-4d50-85be-84cd51302525 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:18.776083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4350972d-dcf9-4723-8d84-071dbeb09f7a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:18.783048 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2b3c46b3-5503-4d50-85be-84cd51302525 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043847 Jul 27 20:25:18.783373 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4350972d-dcf9-4723-8d84-071dbeb09f7a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084418 Jul 27 20:25:18.783626 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 531/1047] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:18 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:18.783999 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 517/1048] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:18 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:18.790977 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bf0f1e83-6ae9-4ea3-b4a5-a24af4a14939 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:18.793758 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bf0f1e83-6ae9-4ea3-b4a5-a24af4a14939 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:18.799756 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bf0f1e83-6ae9-4ea3-b4a5-a24af4a14939 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:18.800217 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bf0f1e83-6ae9-4ea3-b4a5-a24af4a14939 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:18.801021 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bf0f1e83-6ae9-4ea3-b4a5-a24af4a14939 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:18.801498 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bf0f1e83-6ae9-4ea3-b4a5-a24af4a14939 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:18.831611 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bf0f1e83-6ae9-4ea3-b4a5-a24af4a14939 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044276 Jul 27 20:25:18.832154 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 532/1049] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:18 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:25:19.749841 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c661b7f3-68e0-4eac-a9c8-630691075c54 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:19.751943 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c661b7f3-68e0-4eac-a9c8-630691075c54 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:19.758529 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c661b7f3-68e0-4eac-a9c8-630691075c54 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:19.758983 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c661b7f3-68e0-4eac-a9c8-630691075c54 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:19.759745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c661b7f3-68e0-4eac-a9c8-630691075c54 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:19.761039 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c661b7f3-68e0-4eac-a9c8-630691075c54 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:19.796141 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4a9fc1af-39a7-4cbf-ae0e-182e3c37d2ba tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:19.798634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4a9fc1af-39a7-4cbf-ae0e-182e3c37d2ba tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:19.805694 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4a9fc1af-39a7-4cbf-ae0e-182e3c37d2ba tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:19.806271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4a9fc1af-39a7-4cbf-ae0e-182e3c37d2ba tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:19.807600 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4a9fc1af-39a7-4cbf-ae0e-182e3c37d2ba tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:19.808043 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4a9fc1af-39a7-4cbf-ae0e-182e3c37d2ba tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:19.842939 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4a9fc1af-39a7-4cbf-ae0e-182e3c37d2ba tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050879 Jul 27 20:25:19.847667 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 533/1050] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:19 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:25:19.848293 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-96da8120-7f4e-4a9b-92ec-3d59d2cf675a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:19.848924 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-96da8120-7f4e-4a9b-92ec-3d59d2cf675a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:19.855636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-96da8120-7f4e-4a9b-92ec-3d59d2cf675a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:19.856364 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-96da8120-7f4e-4a9b-92ec-3d59d2cf675a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:19.856869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-96da8120-7f4e-4a9b-92ec-3d59d2cf675a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:19.857425 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-96da8120-7f4e-4a9b-92ec-3d59d2cf675a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:19.931275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-96da8120-7f4e-4a9b-92ec-3d59d2cf675a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:19.940242 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-96da8120-7f4e-4a9b-92ec-3d59d2cf675a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.095701 Jul 27 20:25:19.940812 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 534/1051] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:19 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:19.940917 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c661b7f3-68e0-4eac-a9c8-630691075c54 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195245 Jul 27 20:25:19.945362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 518/1052] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:19 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:19.945529 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7068f8a2-4580-44e3-b21c-9d4499e80360 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:19.948244 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7068f8a2-4580-44e3-b21c-9d4499e80360 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:19.954381 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7068f8a2-4580-44e3-b21c-9d4499e80360 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:19.954830 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7068f8a2-4580-44e3-b21c-9d4499e80360 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:19.955597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7068f8a2-4580-44e3-b21c-9d4499e80360 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:19.956039 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7068f8a2-4580-44e3-b21c-9d4499e80360 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:19.984602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7068f8a2-4580-44e3-b21c-9d4499e80360 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042746 Jul 27 20:25:19.985184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 535/1053] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:19 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:20.855271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-536fc34e-66e1-42a2-b7c7-46f08b0f7f5d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:20.857408 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-536fc34e-66e1-42a2-b7c7-46f08b0f7f5d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:20.863824 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-536fc34e-66e1-42a2-b7c7-46f08b0f7f5d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:20.864273 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-536fc34e-66e1-42a2-b7c7-46f08b0f7f5d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:20.865064 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-536fc34e-66e1-42a2-b7c7-46f08b0f7f5d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:20.865501 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-536fc34e-66e1-42a2-b7c7-46f08b0f7f5d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:20.894199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-536fc34e-66e1-42a2-b7c7-46f08b0f7f5d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042893 Jul 27 20:25:20.894749 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 519/1054] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:20 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:20.953280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-602d4216-902d-4c23-9189-685e5a334fdc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:20.955403 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-602d4216-902d-4c23-9189-685e5a334fdc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:20.961278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bc2a3d7d-5123-461e-9884-1a29f62795b0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:20.961888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bc2a3d7d-5123-461e-9884-1a29f62795b0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:20.962061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-602d4216-902d-4c23-9189-685e5a334fdc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:20.962506 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-602d4216-902d-4c23-9189-685e5a334fdc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:20.963869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-602d4216-902d-4c23-9189-685e5a334fdc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:20.964312 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-602d4216-902d-4c23-9189-685e5a334fdc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:20.968601 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc2a3d7d-5123-461e-9884-1a29f62795b0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:20.969091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc2a3d7d-5123-461e-9884-1a29f62795b0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:20.969851 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc2a3d7d-5123-461e-9884-1a29f62795b0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:20.970278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc2a3d7d-5123-461e-9884-1a29f62795b0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:20.993124 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-602d4216-902d-4c23-9189-685e5a334fdc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043957 Jul 27 20:25:20.993689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 536/1055] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:20 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:25:20.998325 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f64e1e4c-91b6-41cb-92c5-1fb76159fdb1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:21.000614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f64e1e4c-91b6-41cb-92c5-1fb76159fdb1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:21.006599 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f64e1e4c-91b6-41cb-92c5-1fb76159fdb1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:21.007043 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f64e1e4c-91b6-41cb-92c5-1fb76159fdb1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:21.007875 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f64e1e4c-91b6-41cb-92c5-1fb76159fdb1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:21.008309 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f64e1e4c-91b6-41cb-92c5-1fb76159fdb1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:21.031310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bc2a3d7d-5123-461e-9884-1a29f62795b0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:21.038800 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bc2a3d7d-5123-461e-9884-1a29f62795b0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081217 Jul 27 20:25:21.038955 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f64e1e4c-91b6-41cb-92c5-1fb76159fdb1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044247 Jul 27 20:25:21.039356 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 520/1056] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:20 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:25:21.039515 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 537/1057] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:20 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:21.906800 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3a9c68f0-6de9-42ad-80d0-08fd53ddac33 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:21.908934 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3a9c68f0-6de9-42ad-80d0-08fd53ddac33 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:21.915367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3a9c68f0-6de9-42ad-80d0-08fd53ddac33 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:21.915816 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3a9c68f0-6de9-42ad-80d0-08fd53ddac33 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:21.917227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3a9c68f0-6de9-42ad-80d0-08fd53ddac33 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:21.917657 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3a9c68f0-6de9-42ad-80d0-08fd53ddac33 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:21.945469 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3a9c68f0-6de9-42ad-80d0-08fd53ddac33 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042524 Jul 27 20:25:21.946005 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 521/1058] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:21 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:22.005136 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-46556cd5-8955-45b3-842d-f9e0f304ba32 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:22.007271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-46556cd5-8955-45b3-842d-f9e0f304ba32 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:22.014038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46556cd5-8955-45b3-842d-f9e0f304ba32 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:22.014486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46556cd5-8955-45b3-842d-f9e0f304ba32 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:22.015253 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46556cd5-8955-45b3-842d-f9e0f304ba32 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:22.015691 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46556cd5-8955-45b3-842d-f9e0f304ba32 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:22.045151 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-46556cd5-8955-45b3-842d-f9e0f304ba32 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043896 Jul 27 20:25:22.045886 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 538/1059] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:22 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:22.050716 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a52bd133-d282-436b-9761-8a6dcb7a3bb1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:22.053086 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a52bd133-d282-436b-9761-8a6dcb7a3bb1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:22.059821 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a52bd133-d282-436b-9761-8a6dcb7a3bb1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:22.060018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cf70d917-d84a-4f63-982f-377d52f0c46a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:22.060261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a52bd133-d282-436b-9761-8a6dcb7a3bb1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:22.060516 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cf70d917-d84a-4f63-982f-377d52f0c46a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:22.061103 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a52bd133-d282-436b-9761-8a6dcb7a3bb1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:22.061535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a52bd133-d282-436b-9761-8a6dcb7a3bb1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:22.066449 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf70d917-d84a-4f63-982f-377d52f0c46a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:22.066895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf70d917-d84a-4f63-982f-377d52f0c46a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:22.067659 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf70d917-d84a-4f63-982f-377d52f0c46a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:22.068094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf70d917-d84a-4f63-982f-377d52f0c46a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:22.091230 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a52bd133-d282-436b-9761-8a6dcb7a3bb1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044440 Jul 27 20:25:22.091987 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 522/1060] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:22 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:25:22.130515 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cf70d917-d84a-4f63-982f-377d52f0c46a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:22.138740 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cf70d917-d84a-4f63-982f-377d52f0c46a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083493 Jul 27 20:25:22.139325 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 539/1061] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:22 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:25:22.957970 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c32a3709-d187-4a21-a44a-a6244070bc25 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:22.960101 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c32a3709-d187-4a21-a44a-a6244070bc25 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:22.967216 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c32a3709-d187-4a21-a44a-a6244070bc25 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:22.967662 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c32a3709-d187-4a21-a44a-a6244070bc25 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:22.968535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c32a3709-d187-4a21-a44a-a6244070bc25 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:22.968883 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c32a3709-d187-4a21-a44a-a6244070bc25 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:22.997996 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c32a3709-d187-4a21-a44a-a6244070bc25 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043965 Jul 27 20:25:22.998538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 523/1062] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:22 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:23.057280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2e332658-30f7-4a89-9a91-2279a9f3cd62 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:23.059453 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2e332658-30f7-4a89-9a91-2279a9f3cd62 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:23.065900 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2e332658-30f7-4a89-9a91-2279a9f3cd62 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:23.066342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2e332658-30f7-4a89-9a91-2279a9f3cd62 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:23.067101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2e332658-30f7-4a89-9a91-2279a9f3cd62 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:23.067530 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2e332658-30f7-4a89-9a91-2279a9f3cd62 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:23.099183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2e332658-30f7-4a89-9a91-2279a9f3cd62 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045827 Jul 27 20:25:23.099746 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 540/1063] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:23 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:23.109472 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bf516f8e-d5bd-4fae-a095-53453fb2a16f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:23.111628 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bf516f8e-d5bd-4fae-a095-53453fb2a16f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:23.117695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf516f8e-d5bd-4fae-a095-53453fb2a16f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:23.118156 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf516f8e-d5bd-4fae-a095-53453fb2a16f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:23.118924 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf516f8e-d5bd-4fae-a095-53453fb2a16f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:23.120803 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf516f8e-d5bd-4fae-a095-53453fb2a16f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:23.158099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bf516f8e-d5bd-4fae-a095-53453fb2a16f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052686 Jul 27 20:25:23.158665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 524/1064] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:23 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:25:23.160376 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-812fab96-0fc4-4677-a02a-1d3d7ad77342 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:23.161069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-812fab96-0fc4-4677-a02a-1d3d7ad77342 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:23.167354 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-812fab96-0fc4-4677-a02a-1d3d7ad77342 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:23.167810 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-812fab96-0fc4-4677-a02a-1d3d7ad77342 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:23.168582 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-812fab96-0fc4-4677-a02a-1d3d7ad77342 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:23.169061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-812fab96-0fc4-4677-a02a-1d3d7ad77342 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:23.229627 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-812fab96-0fc4-4677-a02a-1d3d7ad77342 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:23.233139 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:23.238155 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-812fab96-0fc4-4677-a02a-1d3d7ad77342 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082417 Jul 27 20:25:23.238731 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 541/1065] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:23 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:25:24.010475 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4d23869d-02cb-4874-ac14-830bcf55a0e3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:24.012622 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4d23869d-02cb-4874-ac14-830bcf55a0e3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:24.019064 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4d23869d-02cb-4874-ac14-830bcf55a0e3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:24.019514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4d23869d-02cb-4874-ac14-830bcf55a0e3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:24.020277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4d23869d-02cb-4874-ac14-830bcf55a0e3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:24.020712 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4d23869d-02cb-4874-ac14-830bcf55a0e3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:24.049833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4d23869d-02cb-4874-ac14-830bcf55a0e3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043376 Jul 27 20:25:24.050380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 525/1066] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:24 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:24.111457 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-12b5db52-1105-41aa-a6ca-98276007608f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:24.113673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-12b5db52-1105-41aa-a6ca-98276007608f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:24.120945 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-12b5db52-1105-41aa-a6ca-98276007608f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:24.121418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-12b5db52-1105-41aa-a6ca-98276007608f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:24.122182 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-12b5db52-1105-41aa-a6ca-98276007608f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:24.122623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-12b5db52-1105-41aa-a6ca-98276007608f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:24.151238 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-12b5db52-1105-41aa-a6ca-98276007608f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043227 Jul 27 20:25:24.151775 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 542/1067] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:24 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:24.170137 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4a3de07c-f640-42ac-9a38-c0d7ce08d89a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:24.172519 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4a3de07c-f640-42ac-9a38-c0d7ce08d89a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:24.178463 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a3de07c-f640-42ac-9a38-c0d7ce08d89a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:24.178910 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a3de07c-f640-42ac-9a38-c0d7ce08d89a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:24.179667 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a3de07c-f640-42ac-9a38-c0d7ce08d89a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:24.180098 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a3de07c-f640-42ac-9a38-c0d7ce08d89a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:24.208049 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4a3de07c-f640-42ac-9a38-c0d7ce08d89a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042510 Jul 27 20:25:24.208580 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 526/1068] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:24 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:24.258530 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-37db8ce6-1f59-4d6d-bb64-9cb6b39e7b31 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:24.259152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-37db8ce6-1f59-4d6d-bb64-9cb6b39e7b31 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:24.266050 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-37db8ce6-1f59-4d6d-bb64-9cb6b39e7b31 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:24.266453 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-37db8ce6-1f59-4d6d-bb64-9cb6b39e7b31 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:24.267229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-37db8ce6-1f59-4d6d-bb64-9cb6b39e7b31 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:24.267674 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-37db8ce6-1f59-4d6d-bb64-9cb6b39e7b31 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:24.328336 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-37db8ce6-1f59-4d6d-bb64-9cb6b39e7b31 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:24.335959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-37db8ce6-1f59-4d6d-bb64-9cb6b39e7b31 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081272 Jul 27 20:25:24.336530 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 543/1069] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:24 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:25.062107 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-16afec52-64b2-4a15-bbae-e45b133684da tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:25.064433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-16afec52-64b2-4a15-bbae-e45b133684da tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:25.071250 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16afec52-64b2-4a15-bbae-e45b133684da tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:25.071713 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16afec52-64b2-4a15-bbae-e45b133684da tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:25.072663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16afec52-64b2-4a15-bbae-e45b133684da tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:25.073349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16afec52-64b2-4a15-bbae-e45b133684da tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:25.100521 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:25.106142 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-16afec52-64b2-4a15-bbae-e45b133684da tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048142 Jul 27 20:25:25.106694 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 527/1070] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:25 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:25.163391 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9d0ab1cb-df81-4a58-86a2-edde44c705f6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:25.165572 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9d0ab1cb-df81-4a58-86a2-edde44c705f6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:25.173691 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d0ab1cb-df81-4a58-86a2-edde44c705f6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:25.174150 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d0ab1cb-df81-4a58-86a2-edde44c705f6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:25.174929 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d0ab1cb-df81-4a58-86a2-edde44c705f6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:25.175374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d0ab1cb-df81-4a58-86a2-edde44c705f6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:25.207364 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9d0ab1cb-df81-4a58-86a2-edde44c705f6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048158 Jul 27 20:25:25.207915 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 544/1071] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:25 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:25.220464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-68248958-78ba-47a8-89fa-4500203b9eef tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:25.222653 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-68248958-78ba-47a8-89fa-4500203b9eef tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:25.229422 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68248958-78ba-47a8-89fa-4500203b9eef tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:25.230174 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68248958-78ba-47a8-89fa-4500203b9eef tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:25.230948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68248958-78ba-47a8-89fa-4500203b9eef tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:25.231389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68248958-78ba-47a8-89fa-4500203b9eef tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:25.259441 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-68248958-78ba-47a8-89fa-4500203b9eef tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042954 Jul 27 20:25:25.260645 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 528/1072] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:25 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:25.356663 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-112b11e9-06f2-4257-a671-79529bf37d50 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:25.357233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-112b11e9-06f2-4257-a671-79529bf37d50 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:25.363286 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-112b11e9-06f2-4257-a671-79529bf37d50 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:25.363743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-112b11e9-06f2-4257-a671-79529bf37d50 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:25.364501 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-112b11e9-06f2-4257-a671-79529bf37d50 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:25.364941 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-112b11e9-06f2-4257-a671-79529bf37d50 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:25.429251 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-112b11e9-06f2-4257-a671-79529bf37d50 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:25.437166 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-112b11e9-06f2-4257-a671-79529bf37d50 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084397 Jul 27 20:25:25.437741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 545/1073] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:25 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:26.118302 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1de581df-0729-4a05-b88f-6ab9d45acd0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:26.121140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1de581df-0729-4a05-b88f-6ab9d45acd0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:26.127662 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1de581df-0729-4a05-b88f-6ab9d45acd0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:26.128109 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1de581df-0729-4a05-b88f-6ab9d45acd0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:26.128899 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1de581df-0729-4a05-b88f-6ab9d45acd0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:26.129365 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1de581df-0729-4a05-b88f-6ab9d45acd0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:26.157698 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1de581df-0729-4a05-b88f-6ab9d45acd0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043334 Jul 27 20:25:26.158242 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 529/1074] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:26 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:26.219377 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e8c65e5d-7490-4b81-97c6-e3d4ab749dce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:26.221627 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e8c65e5d-7490-4b81-97c6-e3d4ab749dce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:26.227991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8c65e5d-7490-4b81-97c6-e3d4ab749dce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:26.228445 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8c65e5d-7490-4b81-97c6-e3d4ab749dce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:26.229839 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8c65e5d-7490-4b81-97c6-e3d4ab749dce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:26.230285 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8c65e5d-7490-4b81-97c6-e3d4ab749dce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:26.258970 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e8c65e5d-7490-4b81-97c6-e3d4ab749dce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043520 Jul 27 20:25:26.259513 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 546/1075] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:26 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:26.271747 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6a72757f-5e68-4159-91b6-cec52ade0c28 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:26.273915 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6a72757f-5e68-4159-91b6-cec52ade0c28 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:26.280303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6a72757f-5e68-4159-91b6-cec52ade0c28 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:26.280745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6a72757f-5e68-4159-91b6-cec52ade0c28 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:26.281524 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6a72757f-5e68-4159-91b6-cec52ade0c28 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:26.281980 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6a72757f-5e68-4159-91b6-cec52ade0c28 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:26.310862 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6a72757f-5e68-4159-91b6-cec52ade0c28 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043178 Jul 27 20:25:26.311405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 530/1076] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:26 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:26.458667 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c51852af-7df3-4990-8362-68ff504c7e1e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:26.459308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c51852af-7df3-4990-8362-68ff504c7e1e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:26.465822 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c51852af-7df3-4990-8362-68ff504c7e1e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:26.466266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c51852af-7df3-4990-8362-68ff504c7e1e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:26.467022 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c51852af-7df3-4990-8362-68ff504c7e1e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:26.467455 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c51852af-7df3-4990-8362-68ff504c7e1e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:26.527431 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c51852af-7df3-4990-8362-68ff504c7e1e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:26.534863 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c51852af-7df3-4990-8362-68ff504c7e1e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080053 Jul 27 20:25:26.535417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 547/1077] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:26 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:27.169856 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-02d8c436-9a73-4d2b-80dd-720d2a3fa7aa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:27.171985 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-02d8c436-9a73-4d2b-80dd-720d2a3fa7aa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:27.178636 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02d8c436-9a73-4d2b-80dd-720d2a3fa7aa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:27.179076 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02d8c436-9a73-4d2b-80dd-720d2a3fa7aa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:27.179830 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02d8c436-9a73-4d2b-80dd-720d2a3fa7aa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:27.180259 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02d8c436-9a73-4d2b-80dd-720d2a3fa7aa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:27.209716 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-02d8c436-9a73-4d2b-80dd-720d2a3fa7aa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043765 Jul 27 20:25:27.210249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 531/1078] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:27 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:27.271599 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-71c93ed9-0eea-4c60-b3fb-b0b85c28b3a7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:27.273825 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-71c93ed9-0eea-4c60-b3fb-b0b85c28b3a7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:27.280626 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-71c93ed9-0eea-4c60-b3fb-b0b85c28b3a7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:27.281118 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-71c93ed9-0eea-4c60-b3fb-b0b85c28b3a7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:27.281889 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-71c93ed9-0eea-4c60-b3fb-b0b85c28b3a7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:27.282332 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-71c93ed9-0eea-4c60-b3fb-b0b85c28b3a7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:27.311520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-71c93ed9-0eea-4c60-b3fb-b0b85c28b3a7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044148 Jul 27 20:25:27.312066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 548/1079] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:27 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:27.323876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4ab62491-ef01-4f91-84a0-4307e3151961 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:27.326329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4ab62491-ef01-4f91-84a0-4307e3151961 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:27.332229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ab62491-ef01-4f91-84a0-4307e3151961 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:27.332671 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ab62491-ef01-4f91-84a0-4307e3151961 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:27.333480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ab62491-ef01-4f91-84a0-4307e3151961 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:27.333909 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ab62491-ef01-4f91-84a0-4307e3151961 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:27.362309 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4ab62491-ef01-4f91-84a0-4307e3151961 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043058 Jul 27 20:25:27.362779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 532/1080] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:27 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:27.555662 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bbcdd709-b7b8-4756-9d4c-e672a506d851 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:27.556321 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bbcdd709-b7b8-4756-9d4c-e672a506d851 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:27.563054 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bbcdd709-b7b8-4756-9d4c-e672a506d851 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:27.563512 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bbcdd709-b7b8-4756-9d4c-e672a506d851 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:27.564275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bbcdd709-b7b8-4756-9d4c-e672a506d851 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:27.564722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bbcdd709-b7b8-4756-9d4c-e672a506d851 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:27.625344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bbcdd709-b7b8-4756-9d4c-e672a506d851 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:27.632876 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bbcdd709-b7b8-4756-9d4c-e672a506d851 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081038 Jul 27 20:25:27.633510 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 549/1081] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:27 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:28.221906 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-30b059f7-2a5e-41cb-9d9e-93cc2c7359e7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:28.224085 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-30b059f7-2a5e-41cb-9d9e-93cc2c7359e7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:28.231084 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30b059f7-2a5e-41cb-9d9e-93cc2c7359e7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:28.231532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30b059f7-2a5e-41cb-9d9e-93cc2c7359e7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:28.232301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30b059f7-2a5e-41cb-9d9e-93cc2c7359e7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:28.232765 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30b059f7-2a5e-41cb-9d9e-93cc2c7359e7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:28.263423 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-30b059f7-2a5e-41cb-9d9e-93cc2c7359e7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045405 Jul 27 20:25:28.263980 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 533/1082] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:28 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:28.324781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a1267da3-5753-4003-8167-b79f0ab7e639 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:28.326959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a1267da3-5753-4003-8167-b79f0ab7e639 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:28.333405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a1267da3-5753-4003-8167-b79f0ab7e639 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:28.333857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a1267da3-5753-4003-8167-b79f0ab7e639 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:28.334620 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a1267da3-5753-4003-8167-b79f0ab7e639 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:28.335089 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a1267da3-5753-4003-8167-b79f0ab7e639 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:28.364348 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a1267da3-5753-4003-8167-b79f0ab7e639 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044541 Jul 27 20:25:28.364906 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 550/1083] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:28 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:28.374445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c4b2802f-f4b2-4210-90dd-694475f52738 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:28.376602 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c4b2802f-f4b2-4210-90dd-694475f52738 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:28.382632 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c4b2802f-f4b2-4210-90dd-694475f52738 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:28.383074 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c4b2802f-f4b2-4210-90dd-694475f52738 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:28.383831 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c4b2802f-f4b2-4210-90dd-694475f52738 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:28.384264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c4b2802f-f4b2-4210-90dd-694475f52738 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:28.413613 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c4b2802f-f4b2-4210-90dd-694475f52738 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043029 Jul 27 20:25:28.414084 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 534/1084] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:28 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:28.653982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-605bcdca-29d2-4fd6-96c5-fe002a0e8f59 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:28.654621 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-605bcdca-29d2-4fd6-96c5-fe002a0e8f59 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:28.660651 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-605bcdca-29d2-4fd6-96c5-fe002a0e8f59 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:28.661127 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-605bcdca-29d2-4fd6-96c5-fe002a0e8f59 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:28.661899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-605bcdca-29d2-4fd6-96c5-fe002a0e8f59 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:28.662336 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-605bcdca-29d2-4fd6-96c5-fe002a0e8f59 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:28.722584 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-605bcdca-29d2-4fd6-96c5-fe002a0e8f59 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:28.730294 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-605bcdca-29d2-4fd6-96c5-fe002a0e8f59 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080724 Jul 27 20:25:28.730851 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 551/1085] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:28 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:29.276261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-594264c6-f155-4d44-8338-603ddfea5763 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:29.278441 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-594264c6-f155-4d44-8338-603ddfea5763 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:29.284851 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-594264c6-f155-4d44-8338-603ddfea5763 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:29.285336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-594264c6-f155-4d44-8338-603ddfea5763 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:29.286102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-594264c6-f155-4d44-8338-603ddfea5763 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:29.286539 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-594264c6-f155-4d44-8338-603ddfea5763 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:29.316210 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-594264c6-f155-4d44-8338-603ddfea5763 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044511 Jul 27 20:25:29.316756 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 535/1086] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:29 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:29.376076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a7622f08-b500-486d-8930-cc25a3c9fc1f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:29.378328 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a7622f08-b500-486d-8930-cc25a3c9fc1f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:29.385926 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a7622f08-b500-486d-8930-cc25a3c9fc1f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:29.386365 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a7622f08-b500-486d-8930-cc25a3c9fc1f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:29.387129 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a7622f08-b500-486d-8930-cc25a3c9fc1f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:29.387567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a7622f08-b500-486d-8930-cc25a3c9fc1f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:29.417389 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a7622f08-b500-486d-8930-cc25a3c9fc1f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045267 Jul 27 20:25:29.417943 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 552/1087] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:29 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:29.425763 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9c8608aa-fe2e-49cb-a015-ff9bff431497 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:29.427915 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9c8608aa-fe2e-49cb-a015-ff9bff431497 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:29.434625 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c8608aa-fe2e-49cb-a015-ff9bff431497 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:29.435065 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c8608aa-fe2e-49cb-a015-ff9bff431497 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:29.435813 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c8608aa-fe2e-49cb-a015-ff9bff431497 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:29.436248 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c8608aa-fe2e-49cb-a015-ff9bff431497 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:29.465548 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9c8608aa-fe2e-49cb-a015-ff9bff431497 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043678 Jul 27 20:25:29.466388 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 536/1088] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:29 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:29.751317 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fad0a668-12bb-4ad7-aee7-547422bc95ec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:29.751936 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fad0a668-12bb-4ad7-aee7-547422bc95ec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:29.757920 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fad0a668-12bb-4ad7-aee7-547422bc95ec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:29.758372 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fad0a668-12bb-4ad7-aee7-547422bc95ec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:29.759133 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fad0a668-12bb-4ad7-aee7-547422bc95ec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:29.759578 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fad0a668-12bb-4ad7-aee7-547422bc95ec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:29.828277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fad0a668-12bb-4ad7-aee7-547422bc95ec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:29.835799 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fad0a668-12bb-4ad7-aee7-547422bc95ec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.088330 Jul 27 20:25:29.836357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 553/1089] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:29 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:30.328889 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-12e8a4cf-01b1-48eb-8d00-6902a4f23027 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:30.330950 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-12e8a4cf-01b1-48eb-8d00-6902a4f23027 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:30.337412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12e8a4cf-01b1-48eb-8d00-6902a4f23027 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:30.338032 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12e8a4cf-01b1-48eb-8d00-6902a4f23027 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:30.338699 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12e8a4cf-01b1-48eb-8d00-6902a4f23027 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:30.339133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12e8a4cf-01b1-48eb-8d00-6902a4f23027 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:30.366566 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-12e8a4cf-01b1-48eb-8d00-6902a4f23027 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042033 Jul 27 20:25:30.367099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 537/1090] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:30 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:30.429540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b4e4a898-affd-4b4f-b6ca-7864ea8567ef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:30.432266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b4e4a898-affd-4b4f-b6ca-7864ea8567ef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:30.438737 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4e4a898-affd-4b4f-b6ca-7864ea8567ef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:30.439189 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4e4a898-affd-4b4f-b6ca-7864ea8567ef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:30.439955 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4e4a898-affd-4b4f-b6ca-7864ea8567ef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:30.440399 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4e4a898-affd-4b4f-b6ca-7864ea8567ef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:30.470183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b4e4a898-affd-4b4f-b6ca-7864ea8567ef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044548 Jul 27 20:25:30.470738 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 554/1091] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:30 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:30.478717 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8777f420-445e-41f7-9186-9f5cfbcca206 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:30.481197 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8777f420-445e-41f7-9186-9f5cfbcca206 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:30.487100 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8777f420-445e-41f7-9186-9f5cfbcca206 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:30.487539 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8777f420-445e-41f7-9186-9f5cfbcca206 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:30.488292 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8777f420-445e-41f7-9186-9f5cfbcca206 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:30.488723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8777f420-445e-41f7-9186-9f5cfbcca206 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:30.518236 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8777f420-445e-41f7-9186-9f5cfbcca206 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043471 Jul 27 20:25:30.518781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 538/1092] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:30 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:30.856844 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4d90c008-e70a-4c1e-afaf-643ff13dbff6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:30.857490 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4d90c008-e70a-4c1e-afaf-643ff13dbff6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:30.863500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4d90c008-e70a-4c1e-afaf-643ff13dbff6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:30.863954 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4d90c008-e70a-4c1e-afaf-643ff13dbff6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:30.864715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4d90c008-e70a-4c1e-afaf-643ff13dbff6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:30.865187 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4d90c008-e70a-4c1e-afaf-643ff13dbff6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:30.925687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4d90c008-e70a-4c1e-afaf-643ff13dbff6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:30.933084 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4d90c008-e70a-4c1e-afaf-643ff13dbff6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080664 Jul 27 20:25:30.933650 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 555/1093] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:30 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:31.379178 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fbcbd45f-24f7-47ce-b75a-c4221836cd42 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:31.381328 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fbcbd45f-24f7-47ce-b75a-c4221836cd42 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:31.388260 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fbcbd45f-24f7-47ce-b75a-c4221836cd42 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:31.388703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fbcbd45f-24f7-47ce-b75a-c4221836cd42 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:31.389491 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fbcbd45f-24f7-47ce-b75a-c4221836cd42 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:31.389920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fbcbd45f-24f7-47ce-b75a-c4221836cd42 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:31.418248 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fbcbd45f-24f7-47ce-b75a-c4221836cd42 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043058 Jul 27 20:25:31.418784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 539/1094] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:31 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:31.482308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6d367e7b-1412-461f-ad0a-aa5a387ad0dc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:31.484467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6d367e7b-1412-461f-ad0a-aa5a387ad0dc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:31.490974 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d367e7b-1412-461f-ad0a-aa5a387ad0dc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:31.491418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d367e7b-1412-461f-ad0a-aa5a387ad0dc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:31.492170 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d367e7b-1412-461f-ad0a-aa5a387ad0dc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:31.492604 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d367e7b-1412-461f-ad0a-aa5a387ad0dc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:31.521727 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6d367e7b-1412-461f-ad0a-aa5a387ad0dc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043366 Jul 27 20:25:31.522291 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 556/1095] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:31 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:31.531255 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-17213328-34c8-4bf2-8b6f-bf2e3299af3b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:31.533423 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-17213328-34c8-4bf2-8b6f-bf2e3299af3b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:31.539410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-17213328-34c8-4bf2-8b6f-bf2e3299af3b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:31.539865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-17213328-34c8-4bf2-8b6f-bf2e3299af3b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:31.540623 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-17213328-34c8-4bf2-8b6f-bf2e3299af3b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:31.541127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-17213328-34c8-4bf2-8b6f-bf2e3299af3b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:31.570006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-17213328-34c8-4bf2-8b6f-bf2e3299af3b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042590 Jul 27 20:25:31.570596 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 540/1096] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:31 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:31.954485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fc2b0bd8-f1de-4a7c-834b-25bc732bdd74 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:31.955114 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fc2b0bd8-f1de-4a7c-834b-25bc732bdd74 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:31.961096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fc2b0bd8-f1de-4a7c-834b-25bc732bdd74 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:31.961556 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fc2b0bd8-f1de-4a7c-834b-25bc732bdd74 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:31.962325 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fc2b0bd8-f1de-4a7c-834b-25bc732bdd74 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:31.962770 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fc2b0bd8-f1de-4a7c-834b-25bc732bdd74 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:32.025041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fc2b0bd8-f1de-4a7c-834b-25bc732bdd74 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:32.032596 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fc2b0bd8-f1de-4a7c-834b-25bc732bdd74 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081951 Jul 27 20:25:32.033188 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 557/1097] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:31 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:32.430345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ec237ecc-bb2d-4cbc-9d84-4d08fdf5e8ff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:32.432810 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ec237ecc-bb2d-4cbc-9d84-4d08fdf5e8ff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:32.439306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec237ecc-bb2d-4cbc-9d84-4d08fdf5e8ff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:32.439739 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec237ecc-bb2d-4cbc-9d84-4d08fdf5e8ff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:32.440501 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec237ecc-bb2d-4cbc-9d84-4d08fdf5e8ff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:32.440936 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec237ecc-bb2d-4cbc-9d84-4d08fdf5e8ff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:32.470261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ec237ecc-bb2d-4cbc-9d84-4d08fdf5e8ff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043848 Jul 27 20:25:32.470806 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 541/1098] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:32 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:32.536206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2864f9c6-a9e6-45d2-b5a2-ce745550bd6b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:32.538391 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2864f9c6-a9e6-45d2-b5a2-ce745550bd6b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:32.545240 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2864f9c6-a9e6-45d2-b5a2-ce745550bd6b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:32.545696 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2864f9c6-a9e6-45d2-b5a2-ce745550bd6b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:32.546466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2864f9c6-a9e6-45d2-b5a2-ce745550bd6b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:32.546913 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2864f9c6-a9e6-45d2-b5a2-ce745550bd6b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:32.563301 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:32.576740 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2864f9c6-a9e6-45d2-b5a2-ce745550bd6b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044517 Jul 27 20:25:32.577416 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 558/1099] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:32 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:32.583964 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5b896339-fa0f-415e-bf4b-6e8971e85434 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:32.586130 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5b896339-fa0f-415e-bf4b-6e8971e85434 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:32.592649 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b896339-fa0f-415e-bf4b-6e8971e85434 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:32.593135 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b896339-fa0f-415e-bf4b-6e8971e85434 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:32.593894 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b896339-fa0f-415e-bf4b-6e8971e85434 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:32.594324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b896339-fa0f-415e-bf4b-6e8971e85434 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:32.622552 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5b896339-fa0f-415e-bf4b-6e8971e85434 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042999 Jul 27 20:25:32.623095 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 542/1100] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:32 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:33.053586 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-638a48ed-6ab9-4114-b585-880118cf70ac tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:33.054216 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-638a48ed-6ab9-4114-b585-880118cf70ac tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:33.060259 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-638a48ed-6ab9-4114-b585-880118cf70ac tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:33.060700 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-638a48ed-6ab9-4114-b585-880118cf70ac tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:33.061481 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-638a48ed-6ab9-4114-b585-880118cf70ac tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:33.061915 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-638a48ed-6ab9-4114-b585-880118cf70ac tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:33.122142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-638a48ed-6ab9-4114-b585-880118cf70ac tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:33.129572 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-638a48ed-6ab9-4114-b585-880118cf70ac tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.079786 Jul 27 20:25:33.130131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 559/1101] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:33 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:33.483024 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cb8fbdfd-b199-42e4-8d1b-7fc63f448bd2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:33.485246 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cb8fbdfd-b199-42e4-8d1b-7fc63f448bd2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:33.491663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cb8fbdfd-b199-42e4-8d1b-7fc63f448bd2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:33.492110 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cb8fbdfd-b199-42e4-8d1b-7fc63f448bd2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:33.492880 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cb8fbdfd-b199-42e4-8d1b-7fc63f448bd2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:33.493353 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cb8fbdfd-b199-42e4-8d1b-7fc63f448bd2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:33.523266 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cb8fbdfd-b199-42e4-8d1b-7fc63f448bd2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044287 Jul 27 20:25:33.523809 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 543/1102] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:33 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:33.589077 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-25acd18b-d135-4be7-9013-254959f008a5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:33.591222 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-25acd18b-d135-4be7-9013-254959f008a5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:33.594556 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:33.598643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-25acd18b-d135-4be7-9013-254959f008a5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:33.599090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-25acd18b-d135-4be7-9013-254959f008a5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:33.599853 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-25acd18b-d135-4be7-9013-254959f008a5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:33.600292 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-25acd18b-d135-4be7-9013-254959f008a5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:33.629593 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-25acd18b-d135-4be7-9013-254959f008a5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044698 Jul 27 20:25:33.630172 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 560/1103] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:33 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:33.638142 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0b48281f-d8b3-46ab-aaf2-b32e7b6a0e35 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:33.640352 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0b48281f-d8b3-46ab-aaf2-b32e7b6a0e35 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:33.643258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:33.647340 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b48281f-d8b3-46ab-aaf2-b32e7b6a0e35 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:33.647787 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b48281f-d8b3-46ab-aaf2-b32e7b6a0e35 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:33.648552 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b48281f-d8b3-46ab-aaf2-b32e7b6a0e35 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:33.649009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b48281f-d8b3-46ab-aaf2-b32e7b6a0e35 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:33.665808 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:33.679194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0b48281f-d8b3-46ab-aaf2-b32e7b6a0e35 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047899 Jul 27 20:25:33.679742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 544/1104] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:33 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:25:34.151447 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b124882d-15b8-4af6-8248-3644dc9d9223 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:34.152068 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b124882d-15b8-4af6-8248-3644dc9d9223 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:34.158076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b124882d-15b8-4af6-8248-3644dc9d9223 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:34.158529 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b124882d-15b8-4af6-8248-3644dc9d9223 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:34.159285 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b124882d-15b8-4af6-8248-3644dc9d9223 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:34.159724 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b124882d-15b8-4af6-8248-3644dc9d9223 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:34.222652 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b124882d-15b8-4af6-8248-3644dc9d9223 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:34.231120 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b124882d-15b8-4af6-8248-3644dc9d9223 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084092 Jul 27 20:25:34.231681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 561/1105] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:34 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:34.535712 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-198fcfa2-6f42-4a7f-9a25-46606c00fe82 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:34.537947 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-198fcfa2-6f42-4a7f-9a25-46606c00fe82 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:34.544431 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-198fcfa2-6f42-4a7f-9a25-46606c00fe82 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:34.544876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-198fcfa2-6f42-4a7f-9a25-46606c00fe82 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:34.545661 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-198fcfa2-6f42-4a7f-9a25-46606c00fe82 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:34.546095 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-198fcfa2-6f42-4a7f-9a25-46606c00fe82 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:34.574804 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-198fcfa2-6f42-4a7f-9a25-46606c00fe82 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042763 Jul 27 20:25:34.575340 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 545/1106] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:34 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:34.643879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-474dbac5-255a-4ad0-a0af-f44e7a6cbc48 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:34.646056 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-474dbac5-255a-4ad0-a0af-f44e7a6cbc48 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:34.653306 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-474dbac5-255a-4ad0-a0af-f44e7a6cbc48 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:34.653766 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-474dbac5-255a-4ad0-a0af-f44e7a6cbc48 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:34.654535 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-474dbac5-255a-4ad0-a0af-f44e7a6cbc48 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:34.654980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-474dbac5-255a-4ad0-a0af-f44e7a6cbc48 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:34.683627 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-474dbac5-255a-4ad0-a0af-f44e7a6cbc48 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043812 Jul 27 20:25:34.684178 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 562/1107] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:34 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:34.692057 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b7740577-1ae0-4224-8950-d6fa1e01e449 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:34.694272 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b7740577-1ae0-4224-8950-d6fa1e01e449 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:34.701409 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7740577-1ae0-4224-8950-d6fa1e01e449 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:34.701860 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7740577-1ae0-4224-8950-d6fa1e01e449 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:34.702624 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7740577-1ae0-4224-8950-d6fa1e01e449 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:34.703062 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7740577-1ae0-4224-8950-d6fa1e01e449 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:34.730991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b7740577-1ae0-4224-8950-d6fa1e01e449 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042858 Jul 27 20:25:34.731539 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 546/1108] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:34 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:35.251482 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3ee8ceb5-1b4e-4d3b-a2a7-a5e59fb50fa9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:35.252015 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3ee8ceb5-1b4e-4d3b-a2a7-a5e59fb50fa9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:35.258025 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3ee8ceb5-1b4e-4d3b-a2a7-a5e59fb50fa9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:35.258480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3ee8ceb5-1b4e-4d3b-a2a7-a5e59fb50fa9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:35.259243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3ee8ceb5-1b4e-4d3b-a2a7-a5e59fb50fa9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:35.259742 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3ee8ceb5-1b4e-4d3b-a2a7-a5e59fb50fa9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:35.327504 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3ee8ceb5-1b4e-4d3b-a2a7-a5e59fb50fa9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:35.333084 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3ee8ceb5-1b4e-4d3b-a2a7-a5e59fb50fa9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.085499 Jul 27 20:25:35.333662 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 563/1109] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:35 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:35.587139 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-626c5fff-c01a-4881-aaf7-cde449df7093 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:35.589790 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-626c5fff-c01a-4881-aaf7-cde449df7093 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:35.596130 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-626c5fff-c01a-4881-aaf7-cde449df7093 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:35.596577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-626c5fff-c01a-4881-aaf7-cde449df7093 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:35.597353 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-626c5fff-c01a-4881-aaf7-cde449df7093 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:35.597806 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-626c5fff-c01a-4881-aaf7-cde449df7093 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:35.626273 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-626c5fff-c01a-4881-aaf7-cde449df7093 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043135 Jul 27 20:25:35.626806 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 547/1110] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:35 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:35.695220 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-045f8f75-a6d5-479d-9b77-549871775bdb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:35.697471 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-045f8f75-a6d5-479d-9b77-549871775bdb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:35.704229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-045f8f75-a6d5-479d-9b77-549871775bdb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:35.704681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-045f8f75-a6d5-479d-9b77-549871775bdb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:35.705484 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-045f8f75-a6d5-479d-9b77-549871775bdb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:35.705930 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-045f8f75-a6d5-479d-9b77-549871775bdb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:35.735227 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-045f8f75-a6d5-479d-9b77-549871775bdb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043951 Jul 27 20:25:35.735772 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 564/1111] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:35 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:35.742934 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-77bfbfea-cdff-4972-bef5-f56a9116ff9a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:35.745409 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-77bfbfea-cdff-4972-bef5-f56a9116ff9a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:35.751317 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-77bfbfea-cdff-4972-bef5-f56a9116ff9a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:35.751759 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-77bfbfea-cdff-4972-bef5-f56a9116ff9a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:35.752511 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-77bfbfea-cdff-4972-bef5-f56a9116ff9a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:35.752941 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-77bfbfea-cdff-4972-bef5-f56a9116ff9a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:35.784090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-77bfbfea-cdff-4972-bef5-f56a9116ff9a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045031 Jul 27 20:25:35.784642 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 548/1112] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:35 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:36.354112 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fa7add75-12ec-4461-8ad8-40817c388323 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:36.354677 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fa7add75-12ec-4461-8ad8-40817c388323 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:36.360636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa7add75-12ec-4461-8ad8-40817c388323 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:36.361119 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa7add75-12ec-4461-8ad8-40817c388323 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:36.361879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa7add75-12ec-4461-8ad8-40817c388323 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:36.362322 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa7add75-12ec-4461-8ad8-40817c388323 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:36.422085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fa7add75-12ec-4461-8ad8-40817c388323 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:36.429609 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fa7add75-12ec-4461-8ad8-40817c388323 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.079549 Jul 27 20:25:36.430181 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 565/1113] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:36 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:36.638851 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b6a1c5fa-bb71-4347-a09a-da722a2a2c11 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:36.641044 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b6a1c5fa-bb71-4347-a09a-da722a2a2c11 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:36.647452 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6a1c5fa-bb71-4347-a09a-da722a2a2c11 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:36.647893 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6a1c5fa-bb71-4347-a09a-da722a2a2c11 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:36.648645 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6a1c5fa-bb71-4347-a09a-da722a2a2c11 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:36.649104 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6a1c5fa-bb71-4347-a09a-da722a2a2c11 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:36.677472 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b6a1c5fa-bb71-4347-a09a-da722a2a2c11 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042791 Jul 27 20:25:36.678010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 549/1114] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:36 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:36.747988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e3a9c293-2935-4b4d-9935-9970b7949675 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:36.750146 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e3a9c293-2935-4b4d-9935-9970b7949675 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:36.756532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e3a9c293-2935-4b4d-9935-9970b7949675 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:36.757004 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e3a9c293-2935-4b4d-9935-9970b7949675 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:36.757765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e3a9c293-2935-4b4d-9935-9970b7949675 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:36.758230 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e3a9c293-2935-4b4d-9935-9970b7949675 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:36.786759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e3a9c293-2935-4b4d-9935-9970b7949675 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043439 Jul 27 20:25:36.787330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 566/1115] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:36 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:36.796310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ed34f84e-c7b8-44c8-90ab-d119d684b03e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:36.798535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ed34f84e-c7b8-44c8-90ab-d119d684b03e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:36.804443 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed34f84e-c7b8-44c8-90ab-d119d684b03e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:36.804892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed34f84e-c7b8-44c8-90ab-d119d684b03e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:36.805692 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed34f84e-c7b8-44c8-90ab-d119d684b03e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:36.806127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed34f84e-c7b8-44c8-90ab-d119d684b03e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:36.834895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ed34f84e-c7b8-44c8-90ab-d119d684b03e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042490 Jul 27 20:25:36.835448 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 550/1116] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:36 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:37.451492 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7419d45d-41a9-4079-a717-81abc926a186 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:37.452110 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7419d45d-41a9-4079-a717-81abc926a186 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:37.458104 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7419d45d-41a9-4079-a717-81abc926a186 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:37.458561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7419d45d-41a9-4079-a717-81abc926a186 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:37.459507 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7419d45d-41a9-4079-a717-81abc926a186 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:37.459955 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7419d45d-41a9-4079-a717-81abc926a186 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:37.519436 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7419d45d-41a9-4079-a717-81abc926a186 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:37.527636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7419d45d-41a9-4079-a717-81abc926a186 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080890 Jul 27 20:25:37.528197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 567/1117] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:37 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:37.690021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5e72cef5-0cf8-4967-b917-c256fdf2f689 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:37.692199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5e72cef5-0cf8-4967-b917-c256fdf2f689 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:37.699845 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e72cef5-0cf8-4967-b917-c256fdf2f689 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:37.700293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e72cef5-0cf8-4967-b917-c256fdf2f689 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:37.701092 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e72cef5-0cf8-4967-b917-c256fdf2f689 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:37.701580 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e72cef5-0cf8-4967-b917-c256fdf2f689 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:37.729511 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5e72cef5-0cf8-4967-b917-c256fdf2f689 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043448 Jul 27 20:25:37.730049 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 551/1118] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:37 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:37.799395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6742b26b-6cc0-41e4-98d3-713eeb5edd49 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:37.801590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6742b26b-6cc0-41e4-98d3-713eeb5edd49 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:37.808806 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6742b26b-6cc0-41e4-98d3-713eeb5edd49 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:37.809298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6742b26b-6cc0-41e4-98d3-713eeb5edd49 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:37.810075 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6742b26b-6cc0-41e4-98d3-713eeb5edd49 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:37.810519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6742b26b-6cc0-41e4-98d3-713eeb5edd49 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:37.840810 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6742b26b-6cc0-41e4-98d3-713eeb5edd49 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045361 Jul 27 20:25:37.841391 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 568/1119] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:37 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:37.847507 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8604bf5d-d4e3-47a4-a630-414b2e0bcad9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:37.849717 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8604bf5d-d4e3-47a4-a630-414b2e0bcad9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:37.855799 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8604bf5d-d4e3-47a4-a630-414b2e0bcad9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:37.856242 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8604bf5d-d4e3-47a4-a630-414b2e0bcad9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:37.857013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8604bf5d-d4e3-47a4-a630-414b2e0bcad9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:37.857445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8604bf5d-d4e3-47a4-a630-414b2e0bcad9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:37.886266 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8604bf5d-d4e3-47a4-a630-414b2e0bcad9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042662 Jul 27 20:25:37.886805 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 552/1120] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:37 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:38.548090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-331d7c61-7d93-407c-a55d-98673b3ccc38 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:38.548702 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-331d7c61-7d93-407c-a55d-98673b3ccc38 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:38.554681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-331d7c61-7d93-407c-a55d-98673b3ccc38 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:38.555125 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-331d7c61-7d93-407c-a55d-98673b3ccc38 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:38.555873 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-331d7c61-7d93-407c-a55d-98673b3ccc38 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:38.556332 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-331d7c61-7d93-407c-a55d-98673b3ccc38 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:38.619563 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-331d7c61-7d93-407c-a55d-98673b3ccc38 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:38.627039 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-331d7c61-7d93-407c-a55d-98673b3ccc38 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082788 Jul 27 20:25:38.627665 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 569/1121] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:38 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:38.741965 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-14d72b7e-d428-48f0-82a4-5d8f9a942ba6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:38.744166 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-14d72b7e-d428-48f0-82a4-5d8f9a942ba6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:38.750810 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14d72b7e-d428-48f0-82a4-5d8f9a942ba6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:38.751260 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14d72b7e-d428-48f0-82a4-5d8f9a942ba6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:38.752022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14d72b7e-d428-48f0-82a4-5d8f9a942ba6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:38.752460 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14d72b7e-d428-48f0-82a4-5d8f9a942ba6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:38.782239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-14d72b7e-d428-48f0-82a4-5d8f9a942ba6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044221 Jul 27 20:25:38.782781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 553/1122] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:38 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:38.852686 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b7d0f51e-b308-43e3-9168-58177eb897cb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:38.854872 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b7d0f51e-b308-43e3-9168-58177eb897cb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:38.861326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b7d0f51e-b308-43e3-9168-58177eb897cb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:38.861771 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b7d0f51e-b308-43e3-9168-58177eb897cb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:38.862557 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b7d0f51e-b308-43e3-9168-58177eb897cb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:38.862991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b7d0f51e-b308-43e3-9168-58177eb897cb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:38.892040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b7d0f51e-b308-43e3-9168-58177eb897cb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043144 Jul 27 20:25:38.892593 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 570/1123] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:38 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:38.898528 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b5a176a8-a9c5-40f2-83be-90662bd19730 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:38.901291 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b5a176a8-a9c5-40f2-83be-90662bd19730 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:38.907120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b5a176a8-a9c5-40f2-83be-90662bd19730 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:38.907561 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b5a176a8-a9c5-40f2-83be-90662bd19730 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:38.908311 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b5a176a8-a9c5-40f2-83be-90662bd19730 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:38.908736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b5a176a8-a9c5-40f2-83be-90662bd19730 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:38.936784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b5a176a8-a9c5-40f2-83be-90662bd19730 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042158 Jul 27 20:25:38.937376 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 554/1124] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:38 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:39.648116 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2cbb8dbf-5e5f-42b7-9ac4-c6455fe6b9ae tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:39.648721 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2cbb8dbf-5e5f-42b7-9ac4-c6455fe6b9ae tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:39.654798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2cbb8dbf-5e5f-42b7-9ac4-c6455fe6b9ae tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:39.655271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2cbb8dbf-5e5f-42b7-9ac4-c6455fe6b9ae tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:39.656260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2cbb8dbf-5e5f-42b7-9ac4-c6455fe6b9ae tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:39.656855 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2cbb8dbf-5e5f-42b7-9ac4-c6455fe6b9ae tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:39.717131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2cbb8dbf-5e5f-42b7-9ac4-c6455fe6b9ae tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:39.724587 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2cbb8dbf-5e5f-42b7-9ac4-c6455fe6b9ae tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080351 Jul 27 20:25:39.725193 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 571/1125] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:39 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:39.794812 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1cc073fd-45e8-478e-8d08-58c4a4f58de9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:39.796980 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1cc073fd-45e8-478e-8d08-58c4a4f58de9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:39.803364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cc073fd-45e8-478e-8d08-58c4a4f58de9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:39.803810 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cc073fd-45e8-478e-8d08-58c4a4f58de9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:39.804561 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cc073fd-45e8-478e-8d08-58c4a4f58de9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:39.805014 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cc073fd-45e8-478e-8d08-58c4a4f58de9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:39.833425 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1cc073fd-45e8-478e-8d08-58c4a4f58de9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043103 Jul 27 20:25:39.833958 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 555/1126] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:39 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:39.904383 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e9598c31-83ab-4514-90bb-f8f506d32778 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:39.906581 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e9598c31-83ab-4514-90bb-f8f506d32778 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:39.913033 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e9598c31-83ab-4514-90bb-f8f506d32778 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:39.913496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e9598c31-83ab-4514-90bb-f8f506d32778 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:39.914260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e9598c31-83ab-4514-90bb-f8f506d32778 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:39.914702 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e9598c31-83ab-4514-90bb-f8f506d32778 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:39.943744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e9598c31-83ab-4514-90bb-f8f506d32778 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043981 Jul 27 20:25:39.944293 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 572/1127] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:39 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:39.949011 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-69ae5ec9-7671-407f-9868-312c2a9e4fea tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:39.951439 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-69ae5ec9-7671-407f-9868-312c2a9e4fea tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:39.957389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-69ae5ec9-7671-407f-9868-312c2a9e4fea tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:39.957830 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-69ae5ec9-7671-407f-9868-312c2a9e4fea tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:39.958573 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-69ae5ec9-7671-407f-9868-312c2a9e4fea tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:39.959000 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-69ae5ec9-7671-407f-9868-312c2a9e4fea tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:39.987952 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-69ae5ec9-7671-407f-9868-312c2a9e4fea tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042882 Jul 27 20:25:39.988488 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 556/1128] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:39 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:25:40.746243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-07e21ea0-d6ed-4be6-9abf-95a78154e311 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:40.746852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-07e21ea0-d6ed-4be6-9abf-95a78154e311 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:40.752843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-07e21ea0-d6ed-4be6-9abf-95a78154e311 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:40.753313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-07e21ea0-d6ed-4be6-9abf-95a78154e311 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:40.754064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-07e21ea0-d6ed-4be6-9abf-95a78154e311 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:40.754496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-07e21ea0-d6ed-4be6-9abf-95a78154e311 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:40.813995 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-07e21ea0-d6ed-4be6-9abf-95a78154e311 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:40.821450 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-07e21ea0-d6ed-4be6-9abf-95a78154e311 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.079553 Jul 27 20:25:40.822036 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 573/1129] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:40 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:40.845407 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a75da6da-1b82-41db-8d10-172cf89dded6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:40.847582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a75da6da-1b82-41db-8d10-172cf89dded6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:40.854126 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a75da6da-1b82-41db-8d10-172cf89dded6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:40.854578 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a75da6da-1b82-41db-8d10-172cf89dded6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:40.855343 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a75da6da-1b82-41db-8d10-172cf89dded6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:40.855782 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a75da6da-1b82-41db-8d10-172cf89dded6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:40.883869 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a75da6da-1b82-41db-8d10-172cf89dded6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042346 Jul 27 20:25:40.884401 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 557/1130] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:40 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:40.956357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-328b5b22-f2cd-4cb1-958d-28117b2b27d2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:40.965008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-328b5b22-f2cd-4cb1-958d-28117b2b27d2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:40.972065 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-328b5b22-f2cd-4cb1-958d-28117b2b27d2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:40.972512 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-328b5b22-f2cd-4cb1-958d-28117b2b27d2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:40.973311 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-328b5b22-f2cd-4cb1-958d-28117b2b27d2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:40.973818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-328b5b22-f2cd-4cb1-958d-28117b2b27d2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:41.000623 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-45a36224-a444-4ad7-ac0c-5a9d855c580c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:41.002733 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-328b5b22-f2cd-4cb1-958d-28117b2b27d2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050723 Jul 27 20:25:41.002855 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-45a36224-a444-4ad7-ac0c-5a9d855c580c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:41.003286 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 574/1131] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:40 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:41.008891 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-45a36224-a444-4ad7-ac0c-5a9d855c580c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:41.009372 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-45a36224-a444-4ad7-ac0c-5a9d855c580c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:41.010907 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-45a36224-a444-4ad7-ac0c-5a9d855c580c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:41.011348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-45a36224-a444-4ad7-ac0c-5a9d855c580c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:41.039746 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-45a36224-a444-4ad7-ac0c-5a9d855c580c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043124 Jul 27 20:25:41.040324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 558/1132] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:40 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:25:41.843092 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0e42d29e-69b0-4e0a-abd0-cd3c5c30bc5b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:41.843706 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0e42d29e-69b0-4e0a-abd0-cd3c5c30bc5b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:41.849818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e42d29e-69b0-4e0a-abd0-cd3c5c30bc5b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:41.850268 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e42d29e-69b0-4e0a-abd0-cd3c5c30bc5b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:41.851026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e42d29e-69b0-4e0a-abd0-cd3c5c30bc5b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:41.851465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e42d29e-69b0-4e0a-abd0-cd3c5c30bc5b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:41.856088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:41.896646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-af991118-c0d4-46e2-8a2a-0d019b02a7b3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:41.898817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-af991118-c0d4-46e2-8a2a-0d019b02a7b3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:41.905436 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af991118-c0d4-46e2-8a2a-0d019b02a7b3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:41.905879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af991118-c0d4-46e2-8a2a-0d019b02a7b3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:41.906636 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af991118-c0d4-46e2-8a2a-0d019b02a7b3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:41.907063 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af991118-c0d4-46e2-8a2a-0d019b02a7b3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:41.913396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0e42d29e-69b0-4e0a-abd0-cd3c5c30bc5b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:41.921663 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0e42d29e-69b0-4e0a-abd0-cd3c5c30bc5b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082401 Jul 27 20:25:41.922228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 575/1133] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:41 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:41.936914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-af991118-c0d4-46e2-8a2a-0d019b02a7b3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044186 Jul 27 20:25:41.937476 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 559/1134] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:41 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:25:42.015006 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ddefaddc-6171-45f0-bfe1-aa8ef881b6d8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:42.017165 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ddefaddc-6171-45f0-bfe1-aa8ef881b6d8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:42.023587 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddefaddc-6171-45f0-bfe1-aa8ef881b6d8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:42.024038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddefaddc-6171-45f0-bfe1-aa8ef881b6d8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:42.024800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddefaddc-6171-45f0-bfe1-aa8ef881b6d8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:42.025320 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddefaddc-6171-45f0-bfe1-aa8ef881b6d8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:42.051940 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-48fc0be7-c371-4091-bde5-f26b3aaaa7ea tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:42.054163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-48fc0be7-c371-4091-bde5-f26b3aaaa7ea tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:42.055247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ddefaddc-6171-45f0-bfe1-aa8ef881b6d8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044126 Jul 27 20:25:42.055815 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 576/1135] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:42 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:42.060886 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-48fc0be7-c371-4091-bde5-f26b3aaaa7ea tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:42.061359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-48fc0be7-c371-4091-bde5-f26b3aaaa7ea tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:42.062121 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-48fc0be7-c371-4091-bde5-f26b3aaaa7ea tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:42.062548 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-48fc0be7-c371-4091-bde5-f26b3aaaa7ea tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:42.092665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-48fc0be7-c371-4091-bde5-f26b3aaaa7ea tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044748 Jul 27 20:25:42.093320 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 560/1136] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:42 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:25:42.942811 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0e793993-f834-4e73-9a8c-aa37e861c0ca tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:42.943495 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0e793993-f834-4e73-9a8c-aa37e861c0ca tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:42.948511 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-355a6105-a938-4792-b4bc-3d6e6999618d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:42.949925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e793993-f834-4e73-9a8c-aa37e861c0ca tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:42.950372 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e793993-f834-4e73-9a8c-aa37e861c0ca tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:42.950966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-355a6105-a938-4792-b4bc-3d6e6999618d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:42.951131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e793993-f834-4e73-9a8c-aa37e861c0ca tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:42.951566 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e793993-f834-4e73-9a8c-aa37e861c0ca tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:42.957356 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-355a6105-a938-4792-b4bc-3d6e6999618d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:42.957801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-355a6105-a938-4792-b4bc-3d6e6999618d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:42.958559 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-355a6105-a938-4792-b4bc-3d6e6999618d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:42.958992 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-355a6105-a938-4792-b4bc-3d6e6999618d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:42.963946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:42.990424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-355a6105-a938-4792-b4bc-3d6e6999618d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045899 Jul 27 20:25:42.990982 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 561/1137] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:42 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:25:43.015540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0e793993-f834-4e73-9a8c-aa37e861c0ca tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:43.023460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0e793993-f834-4e73-9a8c-aa37e861c0ca tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084483 Jul 27 20:25:43.024007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 577/1138] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:42 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:43.068381 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3eed08b5-4446-42a0-8005-f3fc0388b96e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:43.070550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3eed08b5-4446-42a0-8005-f3fc0388b96e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:43.077016 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3eed08b5-4446-42a0-8005-f3fc0388b96e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:43.077462 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3eed08b5-4446-42a0-8005-f3fc0388b96e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:43.078227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3eed08b5-4446-42a0-8005-f3fc0388b96e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:43.078658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3eed08b5-4446-42a0-8005-f3fc0388b96e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:43.105769 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e454a22f-8ac5-4a2d-be26-b0b383043f2c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:43.107901 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e454a22f-8ac5-4a2d-be26-b0b383043f2c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:43.108626 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3eed08b5-4446-42a0-8005-f3fc0388b96e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044147 Jul 27 20:25:43.109217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 562/1139] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:43 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:43.114143 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e454a22f-8ac5-4a2d-be26-b0b383043f2c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:43.114603 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e454a22f-8ac5-4a2d-be26-b0b383043f2c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:43.115378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e454a22f-8ac5-4a2d-be26-b0b383043f2c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:43.115820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e454a22f-8ac5-4a2d-be26-b0b383043f2c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:43.144694 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e454a22f-8ac5-4a2d-be26-b0b383043f2c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043605 Jul 27 20:25:43.145363 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 578/1140] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:43 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:25:44.002859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-57139f2c-2c3c-4edb-a285-837bbd54b978 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:44.005052 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-57139f2c-2c3c-4edb-a285-837bbd54b978 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:44.012055 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57139f2c-2c3c-4edb-a285-837bbd54b978 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:44.012494 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57139f2c-2c3c-4edb-a285-837bbd54b978 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:44.013310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57139f2c-2c3c-4edb-a285-837bbd54b978 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:44.013739 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57139f2c-2c3c-4edb-a285-837bbd54b978 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:44.042187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-57139f2c-2c3c-4edb-a285-837bbd54b978 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043284 Jul 27 20:25:44.042732 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 563/1141] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:43 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:44.044291 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fc0eafee-c62c-423b-8dca-c891caeff3b5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:44.044949 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fc0eafee-c62c-423b-8dca-c891caeff3b5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:44.051441 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fc0eafee-c62c-423b-8dca-c891caeff3b5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:44.051903 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fc0eafee-c62c-423b-8dca-c891caeff3b5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:44.052673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fc0eafee-c62c-423b-8dca-c891caeff3b5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:44.053151 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fc0eafee-c62c-423b-8dca-c891caeff3b5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:44.115796 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fc0eafee-c62c-423b-8dca-c891caeff3b5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:44.120794 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-39e9ad26-7cfc-4540-9961-6f1264a20b71 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:44.123005 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-39e9ad26-7cfc-4540-9961-6f1264a20b71 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:44.124095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fc0eafee-c62c-423b-8dca-c891caeff3b5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084390 Jul 27 20:25:44.124656 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 579/1142] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:44 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:25:44.129011 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39e9ad26-7cfc-4540-9961-6f1264a20b71 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:44.129465 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39e9ad26-7cfc-4540-9961-6f1264a20b71 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:44.130233 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39e9ad26-7cfc-4540-9961-6f1264a20b71 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:44.130669 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39e9ad26-7cfc-4540-9961-6f1264a20b71 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:44.157190 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bf055d54-f789-405d-9454-856add1e06f9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:44.159062 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-39e9ad26-7cfc-4540-9961-6f1264a20b71 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042839 Jul 27 20:25:44.159316 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bf055d54-f789-405d-9454-856add1e06f9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:44.159614 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 564/1143] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:44 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:25:44.165266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bf055d54-f789-405d-9454-856add1e06f9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:44.166313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bf055d54-f789-405d-9454-856add1e06f9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:44.167276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bf055d54-f789-405d-9454-856add1e06f9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:44.167715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bf055d54-f789-405d-9454-856add1e06f9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:44.196324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bf055d54-f789-405d-9454-856add1e06f9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043118 Jul 27 20:25:44.196881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 580/1144] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:44 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:25:45.054394 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c884b42d-33e3-4ae3-bf76-2cf7ab163cde tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:45.056672 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c884b42d-33e3-4ae3-bf76-2cf7ab163cde tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:45.063244 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c884b42d-33e3-4ae3-bf76-2cf7ab163cde tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:45.063725 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c884b42d-33e3-4ae3-bf76-2cf7ab163cde tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:45.064485 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c884b42d-33e3-4ae3-bf76-2cf7ab163cde tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:45.064921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c884b42d-33e3-4ae3-bf76-2cf7ab163cde tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:45.095369 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c884b42d-33e3-4ae3-bf76-2cf7ab163cde tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044906 Jul 27 20:25:45.095951 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 565/1145] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:45 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:45.145078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9839c2df-80c8-46e0-8cc5-6a414a73c834 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:45.145677 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9839c2df-80c8-46e0-8cc5-6a414a73c834 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:45.152948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9839c2df-80c8-46e0-8cc5-6a414a73c834 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:45.153428 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9839c2df-80c8-46e0-8cc5-6a414a73c834 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:45.154212 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9839c2df-80c8-46e0-8cc5-6a414a73c834 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:45.154645 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9839c2df-80c8-46e0-8cc5-6a414a73c834 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:45.171000 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2c9d0263-cbe6-4a4a-8619-ca2e67035c8e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:45.173163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2c9d0263-cbe6-4a4a-8619-ca2e67035c8e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:45.179106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c9d0263-cbe6-4a4a-8619-ca2e67035c8e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:45.179557 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c9d0263-cbe6-4a4a-8619-ca2e67035c8e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:45.180318 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c9d0263-cbe6-4a4a-8619-ca2e67035c8e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:45.180755 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c9d0263-cbe6-4a4a-8619-ca2e67035c8e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:45.211534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2c9d0263-cbe6-4a4a-8619-ca2e67035c8e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044378 Jul 27 20:25:45.212092 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 566/1146] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:45 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:25:45.216424 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9839c2df-80c8-46e0-8cc5-6a414a73c834 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:45.218501 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fa12f322-d339-4ce8-944b-f6506150c83e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:45.221603 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fa12f322-d339-4ce8-944b-f6506150c83e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:45.224003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9839c2df-80c8-46e0-8cc5-6a414a73c834 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082687 Jul 27 20:25:45.224565 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 581/1147] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:45 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:45.227560 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fa12f322-d339-4ce8-944b-f6506150c83e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:45.228008 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fa12f322-d339-4ce8-944b-f6506150c83e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:45.228826 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fa12f322-d339-4ce8-944b-f6506150c83e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:45.229292 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fa12f322-d339-4ce8-944b-f6506150c83e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:45.258332 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fa12f322-d339-4ce8-944b-f6506150c83e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045075 Jul 27 20:25:45.259270 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 567/1148] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:45 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:46.108515 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5212016d-0740-43db-81a0-fd12a5cb703b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:46.110683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5212016d-0740-43db-81a0-fd12a5cb703b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:46.116731 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5212016d-0740-43db-81a0-fd12a5cb703b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:46.117209 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5212016d-0740-43db-81a0-fd12a5cb703b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:46.117969 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5212016d-0740-43db-81a0-fd12a5cb703b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:46.118406 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5212016d-0740-43db-81a0-fd12a5cb703b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:46.146576 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5212016d-0740-43db-81a0-fd12a5cb703b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042139 Jul 27 20:25:46.147189 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 582/1149] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:46 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:46.223757 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ee177427-4d05-45b5-9481-a19c52c4a0f6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:46.225899 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ee177427-4d05-45b5-9481-a19c52c4a0f6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:46.232947 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee177427-4d05-45b5-9481-a19c52c4a0f6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:46.233417 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee177427-4d05-45b5-9481-a19c52c4a0f6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:46.234164 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee177427-4d05-45b5-9481-a19c52c4a0f6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:46.234595 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee177427-4d05-45b5-9481-a19c52c4a0f6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:46.244545 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-50e375c1-a4e5-4c03-8949-2eebe7ae52e9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:46.245311 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-50e375c1-a4e5-4c03-8949-2eebe7ae52e9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:46.251722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-50e375c1-a4e5-4c03-8949-2eebe7ae52e9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:46.252177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-50e375c1-a4e5-4c03-8949-2eebe7ae52e9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:46.252945 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-50e375c1-a4e5-4c03-8949-2eebe7ae52e9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:46.253411 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-50e375c1-a4e5-4c03-8949-2eebe7ae52e9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:46.264386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ee177427-4d05-45b5-9481-a19c52c4a0f6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044552 Jul 27 20:25:46.264947 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 568/1150] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:46 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:46.274727 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b3eaa28c-c936-4b8c-92ab-c635ea929c1f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:46.277582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b3eaa28c-c936-4b8c-92ab-c635ea929c1f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:46.283367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3eaa28c-c936-4b8c-92ab-c635ea929c1f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:46.283808 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3eaa28c-c936-4b8c-92ab-c635ea929c1f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:46.284561 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3eaa28c-c936-4b8c-92ab-c635ea929c1f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:46.285009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3eaa28c-c936-4b8c-92ab-c635ea929c1f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:46.313561 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b3eaa28c-c936-4b8c-92ab-c635ea929c1f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042571 Jul 27 20:25:46.314308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 569/1151] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:46 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:25:46.316782 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-50e375c1-a4e5-4c03-8949-2eebe7ae52e9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:46.325515 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-50e375c1-a4e5-4c03-8949-2eebe7ae52e9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084669 Jul 27 20:25:46.326116 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 583/1152] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:46 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:25:47.159200 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-abf91c6a-31aa-42b1-8920-cfb508804210 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:47.161369 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-abf91c6a-31aa-42b1-8920-cfb508804210 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:47.167845 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-abf91c6a-31aa-42b1-8920-cfb508804210 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:47.168306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-abf91c6a-31aa-42b1-8920-cfb508804210 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:47.169095 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-abf91c6a-31aa-42b1-8920-cfb508804210 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:47.169538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-abf91c6a-31aa-42b1-8920-cfb508804210 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:47.198451 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-abf91c6a-31aa-42b1-8920-cfb508804210 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043208 Jul 27 20:25:47.199006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 570/1153] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:47 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:47.277032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-03d6acaf-ce1d-4c1a-a9e7-a11a1d560ba0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:47.279410 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-03d6acaf-ce1d-4c1a-a9e7-a11a1d560ba0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:47.285905 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-03d6acaf-ce1d-4c1a-a9e7-a11a1d560ba0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:47.286358 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-03d6acaf-ce1d-4c1a-a9e7-a11a1d560ba0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:47.287126 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-03d6acaf-ce1d-4c1a-a9e7-a11a1d560ba0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:47.287568 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-03d6acaf-ce1d-4c1a-a9e7-a11a1d560ba0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:47.317988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-03d6acaf-ce1d-4c1a-a9e7-a11a1d560ba0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046199 Jul 27 20:25:47.318893 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 584/1154] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:47 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:47.325893 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-70d2218c-7441-4f0b-a2b8-454fc15b065e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:47.328081 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-70d2218c-7441-4f0b-a2b8-454fc15b065e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:47.334025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70d2218c-7441-4f0b-a2b8-454fc15b065e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:47.334476 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70d2218c-7441-4f0b-a2b8-454fc15b065e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:47.335239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70d2218c-7441-4f0b-a2b8-454fc15b065e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:47.335679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70d2218c-7441-4f0b-a2b8-454fc15b065e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:47.346335 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d5e6c41e-113b-44f2-912f-44744c5af120 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:47.346948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d5e6c41e-113b-44f2-912f-44744c5af120 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:47.352921 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d5e6c41e-113b-44f2-912f-44744c5af120 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:47.354060 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d5e6c41e-113b-44f2-912f-44744c5af120 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:47.354818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d5e6c41e-113b-44f2-912f-44744c5af120 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:47.355257 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d5e6c41e-113b-44f2-912f-44744c5af120 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:47.365093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-70d2218c-7441-4f0b-a2b8-454fc15b065e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043626 Jul 27 20:25:47.365656 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 571/1155] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:47 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:47.422216 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d5e6c41e-113b-44f2-912f-44744c5af120 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:47.429646 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d5e6c41e-113b-44f2-912f-44744c5af120 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.087051 Jul 27 20:25:47.430201 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 585/1156] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:47 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:25:48.211047 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1bad1383-171d-46aa-8de8-23558a7d1ca4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:48.213392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1bad1383-171d-46aa-8de8-23558a7d1ca4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:48.219418 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1bad1383-171d-46aa-8de8-23558a7d1ca4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:48.219872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1bad1383-171d-46aa-8de8-23558a7d1ca4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:48.220639 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1bad1383-171d-46aa-8de8-23558a7d1ca4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:48.221106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1bad1383-171d-46aa-8de8-23558a7d1ca4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:48.250293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1bad1383-171d-46aa-8de8-23558a7d1ca4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043244 Jul 27 20:25:48.250835 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 572/1157] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:48 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:48.330602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a861f10a-5132-4c58-bb23-08bfde090362 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:48.332742 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a861f10a-5132-4c58-bb23-08bfde090362 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:48.339614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a861f10a-5132-4c58-bb23-08bfde090362 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:48.340164 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a861f10a-5132-4c58-bb23-08bfde090362 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:48.341132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a861f10a-5132-4c58-bb23-08bfde090362 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:48.341679 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a861f10a-5132-4c58-bb23-08bfde090362 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:48.370491 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a861f10a-5132-4c58-bb23-08bfde090362 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043936 Jul 27 20:25:48.371081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 586/1158] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:48 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:48.377418 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9572482a-2284-4a41-982e-3bc4f5fc8d65 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:48.379553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9572482a-2284-4a41-982e-3bc4f5fc8d65 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:48.386658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9572482a-2284-4a41-982e-3bc4f5fc8d65 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:48.387104 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9572482a-2284-4a41-982e-3bc4f5fc8d65 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:48.387861 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9572482a-2284-4a41-982e-3bc4f5fc8d65 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:48.388314 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9572482a-2284-4a41-982e-3bc4f5fc8d65 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:48.416456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9572482a-2284-4a41-982e-3bc4f5fc8d65 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042776 Jul 27 20:25:48.417019 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 573/1159] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:48 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:48.450919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-86637536-ef49-4617-a1ea-b849b2018533 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:48.451533 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-86637536-ef49-4617-a1ea-b849b2018533 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:48.457494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-86637536-ef49-4617-a1ea-b849b2018533 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:48.457944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-86637536-ef49-4617-a1ea-b849b2018533 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:48.458707 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-86637536-ef49-4617-a1ea-b849b2018533 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:48.459147 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-86637536-ef49-4617-a1ea-b849b2018533 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:48.519759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-86637536-ef49-4617-a1ea-b849b2018533 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:48.527250 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-86637536-ef49-4617-a1ea-b849b2018533 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081065 Jul 27 20:25:48.527959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 587/1160] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:48 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:49.263302 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-992c7ab0-ccaa-4e1f-a4ad-5ad074a91a45 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:49.265443 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-992c7ab0-ccaa-4e1f-a4ad-5ad074a91a45 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:49.271519 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-992c7ab0-ccaa-4e1f-a4ad-5ad074a91a45 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:49.271966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-992c7ab0-ccaa-4e1f-a4ad-5ad074a91a45 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:49.272734 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-992c7ab0-ccaa-4e1f-a4ad-5ad074a91a45 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:49.273215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-992c7ab0-ccaa-4e1f-a4ad-5ad074a91a45 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:49.303205 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-992c7ab0-ccaa-4e1f-a4ad-5ad074a91a45 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044549 Jul 27 20:25:49.303744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 574/1161] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:49 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:49.382577 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6692ef39-04cb-4425-b4a0-4c12d6f22c1d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:49.385240 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6692ef39-04cb-4425-b4a0-4c12d6f22c1d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:49.391647 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6692ef39-04cb-4425-b4a0-4c12d6f22c1d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:49.392094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6692ef39-04cb-4425-b4a0-4c12d6f22c1d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:49.392849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6692ef39-04cb-4425-b4a0-4c12d6f22c1d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:49.393310 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6692ef39-04cb-4425-b4a0-4c12d6f22c1d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:49.421890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6692ef39-04cb-4425-b4a0-4c12d6f22c1d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043300 Jul 27 20:25:49.422448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 588/1162] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:49 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:49.429611 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-caf0fcbc-9bfd-4aec-9f82-49367a31e4f6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:49.431995 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-caf0fcbc-9bfd-4aec-9f82-49367a31e4f6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:49.438416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-caf0fcbc-9bfd-4aec-9f82-49367a31e4f6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:49.438862 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-caf0fcbc-9bfd-4aec-9f82-49367a31e4f6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:49.439618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-caf0fcbc-9bfd-4aec-9f82-49367a31e4f6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:49.440054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-caf0fcbc-9bfd-4aec-9f82-49367a31e4f6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:49.469973 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-caf0fcbc-9bfd-4aec-9f82-49367a31e4f6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044522 Jul 27 20:25:49.470528 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 575/1163] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:49 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:49.547590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1b8b2bb7-9002-43df-ac87-1a7bc9755dec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:49.548176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1b8b2bb7-9002-43df-ac87-1a7bc9755dec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:49.554185 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1b8b2bb7-9002-43df-ac87-1a7bc9755dec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:49.554635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1b8b2bb7-9002-43df-ac87-1a7bc9755dec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:49.555400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1b8b2bb7-9002-43df-ac87-1a7bc9755dec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:49.555842 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1b8b2bb7-9002-43df-ac87-1a7bc9755dec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:49.621916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1b8b2bb7-9002-43df-ac87-1a7bc9755dec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:49.629462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1b8b2bb7-9002-43df-ac87-1a7bc9755dec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.085772 Jul 27 20:25:49.630024 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 589/1164] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:49 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:50.315156 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5111006f-1af0-4b31-91c9-345fb17a906d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:50.317312 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5111006f-1af0-4b31-91c9-345fb17a906d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:50.323384 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5111006f-1af0-4b31-91c9-345fb17a906d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:50.323825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5111006f-1af0-4b31-91c9-345fb17a906d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:50.324839 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5111006f-1af0-4b31-91c9-345fb17a906d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:50.325299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5111006f-1af0-4b31-91c9-345fb17a906d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:50.352905 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5111006f-1af0-4b31-91c9-345fb17a906d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041681 Jul 27 20:25:50.354074 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 576/1165] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:50 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:50.434621 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ac60b30d-7cdf-4af3-acd4-572a0142f875 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:50.436766 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ac60b30d-7cdf-4af3-acd4-572a0142f875 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:50.443278 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ac60b30d-7cdf-4af3-acd4-572a0142f875 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:50.443733 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ac60b30d-7cdf-4af3-acd4-572a0142f875 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:50.444498 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ac60b30d-7cdf-4af3-acd4-572a0142f875 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:50.444944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ac60b30d-7cdf-4af3-acd4-572a0142f875 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:50.473894 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ac60b30d-7cdf-4af3-acd4-572a0142f875 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043259 Jul 27 20:25:50.474468 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 590/1166] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:50 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:50.482460 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-504604f0-52bd-40cd-9e26-2b05388c1920 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:50.484597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-504604f0-52bd-40cd-9e26-2b05388c1920 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:50.491005 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-504604f0-52bd-40cd-9e26-2b05388c1920 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:50.491454 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-504604f0-52bd-40cd-9e26-2b05388c1920 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:50.492205 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-504604f0-52bd-40cd-9e26-2b05388c1920 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:50.492639 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-504604f0-52bd-40cd-9e26-2b05388c1920 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:50.516463 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:50.521704 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-504604f0-52bd-40cd-9e26-2b05388c1920 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043878 Jul 27 20:25:50.522252 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 577/1167] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:50 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:50.651302 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-14518c9a-246e-4f5c-9c1b-91e2d1bc0a58 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:50.651923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-14518c9a-246e-4f5c-9c1b-91e2d1bc0a58 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:50.657903 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-14518c9a-246e-4f5c-9c1b-91e2d1bc0a58 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:50.658361 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-14518c9a-246e-4f5c-9c1b-91e2d1bc0a58 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:50.659126 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-14518c9a-246e-4f5c-9c1b-91e2d1bc0a58 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:50.659570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-14518c9a-246e-4f5c-9c1b-91e2d1bc0a58 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:50.721068 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-14518c9a-246e-4f5c-9c1b-91e2d1bc0a58 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:50.726267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:50.735421 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-14518c9a-246e-4f5c-9c1b-91e2d1bc0a58 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.088696 Jul 27 20:25:50.736007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 591/1168] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:50 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:51.365670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cb5c7f63-5fb4-497d-81f2-3429118c25ba tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:51.367764 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cb5c7f63-5fb4-497d-81f2-3429118c25ba tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:51.374975 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cb5c7f63-5fb4-497d-81f2-3429118c25ba tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:51.375416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cb5c7f63-5fb4-497d-81f2-3429118c25ba tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:51.376164 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cb5c7f63-5fb4-497d-81f2-3429118c25ba tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:51.376593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cb5c7f63-5fb4-497d-81f2-3429118c25ba tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:51.405604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cb5c7f63-5fb4-497d-81f2-3429118c25ba tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043916 Jul 27 20:25:51.406146 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 578/1169] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:51 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:51.486959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5b1aae86-e885-4a1e-86c8-b78f9a4c6c0c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:51.489090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5b1aae86-e885-4a1e-86c8-b78f9a4c6c0c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:51.496071 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5b1aae86-e885-4a1e-86c8-b78f9a4c6c0c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:51.496519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5b1aae86-e885-4a1e-86c8-b78f9a4c6c0c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:51.497291 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5b1aae86-e885-4a1e-86c8-b78f9a4c6c0c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:51.497721 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5b1aae86-e885-4a1e-86c8-b78f9a4c6c0c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:51.525371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5b1aae86-e885-4a1e-86c8-b78f9a4c6c0c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042295 Jul 27 20:25:51.525913 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 592/1170] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:51 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:51.533994 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-51782e5c-dcc9-41e6-bef9-e0dfb1dbd6da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:51.536185 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-51782e5c-dcc9-41e6-bef9-e0dfb1dbd6da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:51.543133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-51782e5c-dcc9-41e6-bef9-e0dfb1dbd6da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:51.543580 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-51782e5c-dcc9-41e6-bef9-e0dfb1dbd6da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:51.544342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-51782e5c-dcc9-41e6-bef9-e0dfb1dbd6da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:51.544776 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-51782e5c-dcc9-41e6-bef9-e0dfb1dbd6da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:51.573088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-51782e5c-dcc9-41e6-bef9-e0dfb1dbd6da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042980 Jul 27 20:25:51.573829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 579/1171] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:51 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:51.757076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8fcacf61-70a5-40cf-bcc6-147d5fedec6b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:51.757698 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8fcacf61-70a5-40cf-bcc6-147d5fedec6b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:51.764137 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8fcacf61-70a5-40cf-bcc6-147d5fedec6b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:51.764586 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8fcacf61-70a5-40cf-bcc6-147d5fedec6b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:51.765378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8fcacf61-70a5-40cf-bcc6-147d5fedec6b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:51.765813 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8fcacf61-70a5-40cf-bcc6-147d5fedec6b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:51.833677 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8fcacf61-70a5-40cf-bcc6-147d5fedec6b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:51.843041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8fcacf61-70a5-40cf-bcc6-147d5fedec6b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.089895 Jul 27 20:25:51.843606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 593/1172] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:51 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:52.417485 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-db734881-5c02-4225-a7f7-536ea5890cf9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:52.419902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-db734881-5c02-4225-a7f7-536ea5890cf9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:52.427493 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db734881-5c02-4225-a7f7-536ea5890cf9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:52.427941 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db734881-5c02-4225-a7f7-536ea5890cf9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:52.428702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db734881-5c02-4225-a7f7-536ea5890cf9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:52.429299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db734881-5c02-4225-a7f7-536ea5890cf9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:52.462197 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-db734881-5c02-4225-a7f7-536ea5890cf9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048983 Jul 27 20:25:52.462756 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 580/1173] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:52 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:52.537958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-88824b7c-9f76-4add-b8c0-aedaaa4263fd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:52.540120 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-88824b7c-9f76-4add-b8c0-aedaaa4263fd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:52.546822 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88824b7c-9f76-4add-b8c0-aedaaa4263fd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:52.547282 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88824b7c-9f76-4add-b8c0-aedaaa4263fd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:52.548047 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88824b7c-9f76-4add-b8c0-aedaaa4263fd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:52.548487 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88824b7c-9f76-4add-b8c0-aedaaa4263fd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:52.578119 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-88824b7c-9f76-4add-b8c0-aedaaa4263fd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044135 Jul 27 20:25:52.578673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 594/1174] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:52 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:52.585947 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b9557359-0363-403b-b94a-b6a8ed9b29aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:52.588060 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b9557359-0363-403b-b94a-b6a8ed9b29aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:52.595178 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b9557359-0363-403b-b94a-b6a8ed9b29aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:52.595619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b9557359-0363-403b-b94a-b6a8ed9b29aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:52.596366 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b9557359-0363-403b-b94a-b6a8ed9b29aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:52.596793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b9557359-0363-403b-b94a-b6a8ed9b29aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:52.625510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b9557359-0363-403b-b94a-b6a8ed9b29aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043402 Jul 27 20:25:52.626060 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 581/1175] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:52 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:52.864313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a676da4f-34e7-47ac-8a5c-845299335ae3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:52.864879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a676da4f-34e7-47ac-8a5c-845299335ae3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:52.871411 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a676da4f-34e7-47ac-8a5c-845299335ae3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:52.871865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a676da4f-34e7-47ac-8a5c-845299335ae3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:52.872626 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a676da4f-34e7-47ac-8a5c-845299335ae3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:52.873111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a676da4f-34e7-47ac-8a5c-845299335ae3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:52.932664 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a676da4f-34e7-47ac-8a5c-845299335ae3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:52.940885 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a676da4f-34e7-47ac-8a5c-845299335ae3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080490 Jul 27 20:25:52.941477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 595/1176] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:52 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:53.475446 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-15e3e474-6d72-4566-9746-9dd826c9f46f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:53.477512 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-15e3e474-6d72-4566-9746-9dd826c9f46f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:53.484124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-15e3e474-6d72-4566-9746-9dd826c9f46f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:53.484560 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-15e3e474-6d72-4566-9746-9dd826c9f46f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:53.485340 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-15e3e474-6d72-4566-9746-9dd826c9f46f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:53.485765 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-15e3e474-6d72-4566-9746-9dd826c9f46f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:53.513333 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-15e3e474-6d72-4566-9746-9dd826c9f46f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041878 Jul 27 20:25:53.513865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 582/1177] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:53 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:53.590958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3de438b0-3325-4d9b-b90d-347af562e4bc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:53.593137 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3de438b0-3325-4d9b-b90d-347af562e4bc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:53.599586 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3de438b0-3325-4d9b-b90d-347af562e4bc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:53.600030 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3de438b0-3325-4d9b-b90d-347af562e4bc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:53.600788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3de438b0-3325-4d9b-b90d-347af562e4bc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:53.601247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3de438b0-3325-4d9b-b90d-347af562e4bc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:53.630286 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3de438b0-3325-4d9b-b90d-347af562e4bc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043947 Jul 27 20:25:53.630833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 596/1178] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:53 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:53.637992 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a4e1e294-a7cd-430f-9678-1a8a0edfe845 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:53.640124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a4e1e294-a7cd-430f-9678-1a8a0edfe845 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:53.646607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a4e1e294-a7cd-430f-9678-1a8a0edfe845 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:53.647088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a4e1e294-a7cd-430f-9678-1a8a0edfe845 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:53.647848 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a4e1e294-a7cd-430f-9678-1a8a0edfe845 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:53.648282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a4e1e294-a7cd-430f-9678-1a8a0edfe845 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:53.677872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a4e1e294-a7cd-430f-9678-1a8a0edfe845 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043886 Jul 27 20:25:53.678413 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 583/1179] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:53 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:53.962654 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-30c472bb-6e58-4f9f-ab0c-1579bd141582 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:53.963279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-30c472bb-6e58-4f9f-ab0c-1579bd141582 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:53.969950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-30c472bb-6e58-4f9f-ab0c-1579bd141582 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:53.970403 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-30c472bb-6e58-4f9f-ab0c-1579bd141582 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:53.971165 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-30c472bb-6e58-4f9f-ab0c-1579bd141582 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:53.971610 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-30c472bb-6e58-4f9f-ab0c-1579bd141582 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:54.031288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-30c472bb-6e58-4f9f-ab0c-1579bd141582 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:54.038760 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-30c472bb-6e58-4f9f-ab0c-1579bd141582 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.079956 Jul 27 20:25:54.039325 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 597/1180] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:53 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:54.525512 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f4dff373-8e79-4469-a728-f9ce00a94d49 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:54.528324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f4dff373-8e79-4469-a728-f9ce00a94d49 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:54.534323 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f4dff373-8e79-4469-a728-f9ce00a94d49 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:54.534772 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f4dff373-8e79-4469-a728-f9ce00a94d49 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:54.535533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f4dff373-8e79-4469-a728-f9ce00a94d49 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:54.535971 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f4dff373-8e79-4469-a728-f9ce00a94d49 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:54.564260 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f4dff373-8e79-4469-a728-f9ce00a94d49 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042689 Jul 27 20:25:54.564803 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 584/1181] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:54 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:54.643144 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ecf22ec0-13fd-467b-b975-505f9a4f4043 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:54.645328 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ecf22ec0-13fd-467b-b975-505f9a4f4043 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:54.652408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ecf22ec0-13fd-467b-b975-505f9a4f4043 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:54.652912 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ecf22ec0-13fd-467b-b975-505f9a4f4043 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:54.653697 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ecf22ec0-13fd-467b-b975-505f9a4f4043 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:54.654135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ecf22ec0-13fd-467b-b975-505f9a4f4043 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:54.682272 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ecf22ec0-13fd-467b-b975-505f9a4f4043 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043042 Jul 27 20:25:54.682812 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 598/1182] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:54 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:54.690018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6bf00f8a-1db9-4048-b895-7abb6b9ce118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:54.692185 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6bf00f8a-1db9-4048-b895-7abb6b9ce118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:54.699120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6bf00f8a-1db9-4048-b895-7abb6b9ce118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:54.699819 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6bf00f8a-1db9-4048-b895-7abb6b9ce118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:54.700586 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6bf00f8a-1db9-4048-b895-7abb6b9ce118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:54.701052 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6bf00f8a-1db9-4048-b895-7abb6b9ce118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:54.729336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6bf00f8a-1db9-4048-b895-7abb6b9ce118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043246 Jul 27 20:25:54.730026 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 585/1183] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:54 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:55.060092 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-48eb7b0d-4402-4eaa-a16c-f94a7e5ff95a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:55.060742 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-48eb7b0d-4402-4eaa-a16c-f94a7e5ff95a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:55.066741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48eb7b0d-4402-4eaa-a16c-f94a7e5ff95a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:55.067187 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48eb7b0d-4402-4eaa-a16c-f94a7e5ff95a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:55.067953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48eb7b0d-4402-4eaa-a16c-f94a7e5ff95a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:55.068396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48eb7b0d-4402-4eaa-a16c-f94a7e5ff95a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:55.130661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-48eb7b0d-4402-4eaa-a16c-f94a7e5ff95a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:55.138766 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-48eb7b0d-4402-4eaa-a16c-f94a7e5ff95a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083314 Jul 27 20:25:55.139327 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 599/1184] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:55 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:55.576099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0a24205a-d7d0-4b87-bec3-cff2c3fe8b87 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:55.578305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0a24205a-d7d0-4b87-bec3-cff2c3fe8b87 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:55.584259 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0a24205a-d7d0-4b87-bec3-cff2c3fe8b87 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:55.584705 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0a24205a-d7d0-4b87-bec3-cff2c3fe8b87 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:55.585510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0a24205a-d7d0-4b87-bec3-cff2c3fe8b87 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:55.585952 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0a24205a-d7d0-4b87-bec3-cff2c3fe8b87 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:55.614813 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0a24205a-d7d0-4b87-bec3-cff2c3fe8b87 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043012 Jul 27 20:25:55.615358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 586/1185] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:55 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:55.694711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-49619f9d-13f0-4b80-b9ae-49b5b02fa639 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:55.696824 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-49619f9d-13f0-4b80-b9ae-49b5b02fa639 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:55.703794 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-49619f9d-13f0-4b80-b9ae-49b5b02fa639 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:55.704237 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-49619f9d-13f0-4b80-b9ae-49b5b02fa639 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:55.705030 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-49619f9d-13f0-4b80-b9ae-49b5b02fa639 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:55.705466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-49619f9d-13f0-4b80-b9ae-49b5b02fa639 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:55.734439 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-49619f9d-13f0-4b80-b9ae-49b5b02fa639 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043763 Jul 27 20:25:55.734985 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 600/1186] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:55 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:55.741720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bd4d7d53-78a4-4f1c-94b9-471e800ff6d0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:55.743823 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bd4d7d53-78a4-4f1c-94b9-471e800ff6d0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:55.750324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bd4d7d53-78a4-4f1c-94b9-471e800ff6d0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:55.750762 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bd4d7d53-78a4-4f1c-94b9-471e800ff6d0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:55.751504 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bd4d7d53-78a4-4f1c-94b9-471e800ff6d0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:55.751930 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bd4d7d53-78a4-4f1c-94b9-471e800ff6d0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:55.780318 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bd4d7d53-78a4-4f1c-94b9-471e800ff6d0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042443 Jul 27 20:25:55.780856 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 587/1187] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:55 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:56.159535 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1cbf75a5-2160-40ad-ab75-0317f122c84f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:56.160158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1cbf75a5-2160-40ad-ab75-0317f122c84f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:56.166201 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1cbf75a5-2160-40ad-ab75-0317f122c84f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:56.166657 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1cbf75a5-2160-40ad-ab75-0317f122c84f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:56.167732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1cbf75a5-2160-40ad-ab75-0317f122c84f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:56.168176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1cbf75a5-2160-40ad-ab75-0317f122c84f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:56.230474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1cbf75a5-2160-40ad-ab75-0317f122c84f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:56.238113 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1cbf75a5-2160-40ad-ab75-0317f122c84f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082548 Jul 27 20:25:56.238684 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 601/1188] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:56 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:56.627538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9de25c10-ebe0-4e5b-ada1-6bdf1a5a3368 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:56.629722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9de25c10-ebe0-4e5b-ada1-6bdf1a5a3368 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:56.635737 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9de25c10-ebe0-4e5b-ada1-6bdf1a5a3368 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:56.636997 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9de25c10-ebe0-4e5b-ada1-6bdf1a5a3368 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:56.637758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9de25c10-ebe0-4e5b-ada1-6bdf1a5a3368 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:56.638188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9de25c10-ebe0-4e5b-ada1-6bdf1a5a3368 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:56.666131 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9de25c10-ebe0-4e5b-ada1-6bdf1a5a3368 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042542 Jul 27 20:25:56.666677 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 588/1189] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:56 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:56.747533 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1f0b1d82-2444-4cfc-a290-ec66e784df08 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:56.749668 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1f0b1d82-2444-4cfc-a290-ec66e784df08 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:56.756050 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f0b1d82-2444-4cfc-a290-ec66e784df08 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:56.756504 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f0b1d82-2444-4cfc-a290-ec66e784df08 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:56.757327 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f0b1d82-2444-4cfc-a290-ec66e784df08 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:56.757770 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f0b1d82-2444-4cfc-a290-ec66e784df08 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:56.786005 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1f0b1d82-2444-4cfc-a290-ec66e784df08 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043244 Jul 27 20:25:56.786585 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 602/1190] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:56 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:56.791974 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0c71c5af-f896-4373-80e1-b3553279f419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:56.794726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0c71c5af-f896-4373-80e1-b3553279f419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:56.801073 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c71c5af-f896-4373-80e1-b3553279f419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:56.801515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c71c5af-f896-4373-80e1-b3553279f419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:56.802261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c71c5af-f896-4373-80e1-b3553279f419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:56.802687 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c71c5af-f896-4373-80e1-b3553279f419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:56.831276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0c71c5af-f896-4373-80e1-b3553279f419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043203 Jul 27 20:25:56.831807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 589/1191] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:56 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:57.258468 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2a0c28f1-9e8d-463c-a2c8-2bd63e6dd956 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:57.259105 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2a0c28f1-9e8d-463c-a2c8-2bd63e6dd956 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:57.266475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2a0c28f1-9e8d-463c-a2c8-2bd63e6dd956 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:57.266951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2a0c28f1-9e8d-463c-a2c8-2bd63e6dd956 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:57.267710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2a0c28f1-9e8d-463c-a2c8-2bd63e6dd956 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:57.268141 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2a0c28f1-9e8d-463c-a2c8-2bd63e6dd956 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:57.329392 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2a0c28f1-9e8d-463c-a2c8-2bd63e6dd956 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:57.336728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2a0c28f1-9e8d-463c-a2c8-2bd63e6dd956 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082126 Jul 27 20:25:57.337311 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 603/1192] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:57 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:57.678485 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-189fd48a-20d0-4971-abda-3f5dc1e5baa6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:57.680883 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-189fd48a-20d0-4971-abda-3f5dc1e5baa6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:57.687055 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-189fd48a-20d0-4971-abda-3f5dc1e5baa6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:57.687501 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-189fd48a-20d0-4971-abda-3f5dc1e5baa6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:57.688256 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-189fd48a-20d0-4971-abda-3f5dc1e5baa6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:57.688680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-189fd48a-20d0-4971-abda-3f5dc1e5baa6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:57.718025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-189fd48a-20d0-4971-abda-3f5dc1e5baa6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043502 Jul 27 20:25:57.718576 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 590/1193] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:57 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:25:57.797816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-26b6da1c-c3fb-4af7-aa62-cfc1af704d3c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:57.799934 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-26b6da1c-c3fb-4af7-aa62-cfc1af704d3c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:57.806304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-26b6da1c-c3fb-4af7-aa62-cfc1af704d3c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:57.806752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-26b6da1c-c3fb-4af7-aa62-cfc1af704d3c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:57.807505 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-26b6da1c-c3fb-4af7-aa62-cfc1af704d3c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:57.807938 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-26b6da1c-c3fb-4af7-aa62-cfc1af704d3c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:57.836174 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-26b6da1c-c3fb-4af7-aa62-cfc1af704d3c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042289 Jul 27 20:25:57.836710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 604/1194] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:57 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:57.844570 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5774ae2a-5368-48c1-87c4-42ebd59e1a8b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:57.846786 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5774ae2a-5368-48c1-87c4-42ebd59e1a8b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:57.853258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5774ae2a-5368-48c1-87c4-42ebd59e1a8b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:57.853712 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5774ae2a-5368-48c1-87c4-42ebd59e1a8b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:57.854511 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5774ae2a-5368-48c1-87c4-42ebd59e1a8b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:57.854951 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5774ae2a-5368-48c1-87c4-42ebd59e1a8b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:57.883707 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5774ae2a-5368-48c1-87c4-42ebd59e1a8b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043821 Jul 27 20:25:57.884254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 591/1195] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:57 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:58.357644 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a97de19f-142f-4845-819c-e90d46536628 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:58.358178 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a97de19f-142f-4845-819c-e90d46536628 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:58.364459 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a97de19f-142f-4845-819c-e90d46536628 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:58.364907 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a97de19f-142f-4845-819c-e90d46536628 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:58.365694 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a97de19f-142f-4845-819c-e90d46536628 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:58.366130 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a97de19f-142f-4845-819c-e90d46536628 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:58.427164 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a97de19f-142f-4845-819c-e90d46536628 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:58.434923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a97de19f-142f-4845-819c-e90d46536628 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081662 Jul 27 20:25:58.435494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 605/1196] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:58 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:58.730623 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ae160c54-f9ee-40c9-8cd8-3facb6d5c165 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:58.733112 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ae160c54-f9ee-40c9-8cd8-3facb6d5c165 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:58.739118 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae160c54-f9ee-40c9-8cd8-3facb6d5c165 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:58.739567 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae160c54-f9ee-40c9-8cd8-3facb6d5c165 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:58.740327 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae160c54-f9ee-40c9-8cd8-3facb6d5c165 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:58.740764 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae160c54-f9ee-40c9-8cd8-3facb6d5c165 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:58.769763 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ae160c54-f9ee-40c9-8cd8-3facb6d5c165 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043177 Jul 27 20:25:58.770307 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 592/1197] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:58 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:58.848832 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c73b870c-641c-4552-bfcb-19c9d9d96759 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:58.850996 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c73b870c-641c-4552-bfcb-19c9d9d96759 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:58.857959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c73b870c-641c-4552-bfcb-19c9d9d96759 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:58.858406 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c73b870c-641c-4552-bfcb-19c9d9d96759 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:58.859161 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c73b870c-641c-4552-bfcb-19c9d9d96759 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:58.859593 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c73b870c-641c-4552-bfcb-19c9d9d96759 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:58.890091 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c73b870c-641c-4552-bfcb-19c9d9d96759 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044998 Jul 27 20:25:58.890669 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 606/1198] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:58 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:58.896566 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cbba52d4-0ad1-444b-a62c-a5d0c6f3ef84 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:58.898771 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cbba52d4-0ad1-444b-a62c-a5d0c6f3ef84 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:58.905317 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cbba52d4-0ad1-444b-a62c-a5d0c6f3ef84 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:58.905768 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cbba52d4-0ad1-444b-a62c-a5d0c6f3ef84 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:58.906527 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cbba52d4-0ad1-444b-a62c-a5d0c6f3ef84 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:58.906961 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cbba52d4-0ad1-444b-a62c-a5d0c6f3ef84 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:58.935484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cbba52d4-0ad1-444b-a62c-a5d0c6f3ef84 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042835 Jul 27 20:25:58.936032 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 593/1199] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:58 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:25:59.455893 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-beb0fe39-9c1f-4790-807e-3631736b18ed tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:59.456507 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-beb0fe39-9c1f-4790-807e-3631736b18ed tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:59.462609 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-beb0fe39-9c1f-4790-807e-3631736b18ed tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:59.463050 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-beb0fe39-9c1f-4790-807e-3631736b18ed tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:59.463800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-beb0fe39-9c1f-4790-807e-3631736b18ed tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:59.464234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-beb0fe39-9c1f-4790-807e-3631736b18ed tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:59.523820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-beb0fe39-9c1f-4790-807e-3631736b18ed tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:25:59.531467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-beb0fe39-9c1f-4790-807e-3631736b18ed tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.079418 Jul 27 20:25:59.532020 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 607/1200] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:25:59 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:25:59.782178 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-055cf378-2472-48f1-9d6f-4590fbbfd01a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:59.784225 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-055cf378-2472-48f1-9d6f-4590fbbfd01a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:59.787117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:59.790989 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-055cf378-2472-48f1-9d6f-4590fbbfd01a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:59.791437 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-055cf378-2472-48f1-9d6f-4590fbbfd01a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:59.792192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-055cf378-2472-48f1-9d6f-4590fbbfd01a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:59.792628 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-055cf378-2472-48f1-9d6f-4590fbbfd01a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:59.809940 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:59.822658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-055cf378-2472-48f1-9d6f-4590fbbfd01a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044733 Jul 27 20:25:59.823196 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 594/1201] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:59 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:59.902190 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-81ef5e38-af57-4a5a-8c00-2c9562d2d550 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:59.904394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-81ef5e38-af57-4a5a-8c00-2c9562d2d550 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:59.910935 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-81ef5e38-af57-4a5a-8c00-2c9562d2d550 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:59.911378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-81ef5e38-af57-4a5a-8c00-2c9562d2d550 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:59.912137 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-81ef5e38-af57-4a5a-8c00-2c9562d2d550 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:59.912577 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-81ef5e38-af57-4a5a-8c00-2c9562d2d550 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:59.929296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:25:59.942681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-81ef5e38-af57-4a5a-8c00-2c9562d2d550 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044279 Jul 27 20:25:59.943236 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 608/1202] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:25:59 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:25:59.947748 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0c5d6b5b-4c73-4fe1-aed4-33390c6a496a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:25:59.950277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0c5d6b5b-4c73-4fe1-aed4-33390c6a496a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:25:59.956711 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c5d6b5b-4c73-4fe1-aed4-33390c6a496a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:59.957191 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c5d6b5b-4c73-4fe1-aed4-33390c6a496a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:59.957957 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c5d6b5b-4c73-4fe1-aed4-33390c6a496a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:25:59.958391 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c5d6b5b-4c73-4fe1-aed4-33390c6a496a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:25:59.986893 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0c5d6b5b-4c73-4fe1-aed4-33390c6a496a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043078 Jul 27 20:25:59.987442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 595/1203] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:25:59 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:26:00.552695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a3518c77-2d6f-4c6e-ab33-3f01ce4a2206 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:00.566277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a3518c77-2d6f-4c6e-ab33-3f01ce4a2206 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:00.566277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a3518c77-2d6f-4c6e-ab33-3f01ce4a2206 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:00.566277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a3518c77-2d6f-4c6e-ab33-3f01ce4a2206 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:00.566277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a3518c77-2d6f-4c6e-ab33-3f01ce4a2206 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:00.566679 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a3518c77-2d6f-4c6e-ab33-3f01ce4a2206 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:00.625808 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a3518c77-2d6f-4c6e-ab33-3f01ce4a2206 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:00.633236 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a3518c77-2d6f-4c6e-ab33-3f01ce4a2206 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084553 Jul 27 20:26:00.633798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 609/1204] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:00 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:00.835550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b3f3a7ac-50e2-4f7c-bee0-686a49f08e76 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:00.837680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b3f3a7ac-50e2-4f7c-bee0-686a49f08e76 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:00.844343 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3f3a7ac-50e2-4f7c-bee0-686a49f08e76 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:00.844793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3f3a7ac-50e2-4f7c-bee0-686a49f08e76 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:00.845604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3f3a7ac-50e2-4f7c-bee0-686a49f08e76 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:00.846045 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3f3a7ac-50e2-4f7c-bee0-686a49f08e76 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:00.874984 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b3f3a7ac-50e2-4f7c-bee0-686a49f08e76 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043459 Jul 27 20:26:00.875528 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 596/1205] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:00 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:00.955686 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f336972c-266e-4a6b-a908-67f5bc036b11 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:00.957830 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f336972c-266e-4a6b-a908-67f5bc036b11 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:00.961153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:00.965165 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f336972c-266e-4a6b-a908-67f5bc036b11 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:00.965612 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f336972c-266e-4a6b-a908-67f5bc036b11 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:00.966411 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f336972c-266e-4a6b-a908-67f5bc036b11 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:00.966798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f336972c-266e-4a6b-a908-67f5bc036b11 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:00.994817 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f336972c-266e-4a6b-a908-67f5bc036b11 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043190 Jul 27 20:26:00.995366 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 610/1206] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:00 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:00.999504 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-343d7421-a3b7-4c12-8aba-5599ddabde68 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:01.001750 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-343d7421-a3b7-4c12-8aba-5599ddabde68 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:01.008170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-343d7421-a3b7-4c12-8aba-5599ddabde68 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:01.008623 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-343d7421-a3b7-4c12-8aba-5599ddabde68 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:01.009422 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-343d7421-a3b7-4c12-8aba-5599ddabde68 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:01.009861 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-343d7421-a3b7-4c12-8aba-5599ddabde68 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:01.038796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-343d7421-a3b7-4c12-8aba-5599ddabde68 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043753 Jul 27 20:26:01.039345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 597/1207] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:00 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:26:01.760898 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-04372a2a-2fb1-4474-82e7-163c6e0b1c82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:01.761545 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-04372a2a-2fb1-4474-82e7-163c6e0b1c82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:01.768022 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-04372a2a-2fb1-4474-82e7-163c6e0b1c82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:01.768469 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-04372a2a-2fb1-4474-82e7-163c6e0b1c82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:01.769250 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-04372a2a-2fb1-4474-82e7-163c6e0b1c82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:01.769690 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-04372a2a-2fb1-4474-82e7-163c6e0b1c82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:01.829522 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-04372a2a-2fb1-4474-82e7-163c6e0b1c82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:01.836865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-04372a2a-2fb1-4474-82e7-163c6e0b1c82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.186275 Jul 27 20:26:01.837457 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 611/1208] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:01 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:01.887697 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ba1d0ecd-3513-415b-b48c-f9443212a4c3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:01.889853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ba1d0ecd-3513-415b-b48c-f9443212a4c3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:01.895942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba1d0ecd-3513-415b-b48c-f9443212a4c3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:01.896389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba1d0ecd-3513-415b-b48c-f9443212a4c3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:01.897180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba1d0ecd-3513-415b-b48c-f9443212a4c3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:01.897618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba1d0ecd-3513-415b-b48c-f9443212a4c3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:01.925914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ba1d0ecd-3513-415b-b48c-f9443212a4c3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042716 Jul 27 20:26:01.926399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 598/1209] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:01 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:02.006941 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1ed8be37-c2de-4688-969c-bba59c0d9466 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:02.009136 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1ed8be37-c2de-4688-969c-bba59c0d9466 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:02.015596 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1ed8be37-c2de-4688-969c-bba59c0d9466 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:02.016047 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1ed8be37-c2de-4688-969c-bba59c0d9466 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:02.016820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1ed8be37-c2de-4688-969c-bba59c0d9466 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:02.017296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1ed8be37-c2de-4688-969c-bba59c0d9466 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:02.046662 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1ed8be37-c2de-4688-969c-bba59c0d9466 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043632 Jul 27 20:26:02.047221 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 612/1210] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:02 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:02.050680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ab38159b-fb5f-4ca0-8343-948cd9a0a89c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:02.052865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ab38159b-fb5f-4ca0-8343-948cd9a0a89c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:02.060018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab38159b-fb5f-4ca0-8343-948cd9a0a89c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:02.060466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab38159b-fb5f-4ca0-8343-948cd9a0a89c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:02.061251 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab38159b-fb5f-4ca0-8343-948cd9a0a89c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:02.061692 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab38159b-fb5f-4ca0-8343-948cd9a0a89c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:02.090846 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ab38159b-fb5f-4ca0-8343-948cd9a0a89c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043821 Jul 27 20:26:02.091635 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 599/1211] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:02 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:26:02.857749 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-556c3d7d-d68a-4eca-a4cd-34b24b2f9713 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:02.858373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-556c3d7d-d68a-4eca-a4cd-34b24b2f9713 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:02.864427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-556c3d7d-d68a-4eca-a4cd-34b24b2f9713 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:02.864874 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-556c3d7d-d68a-4eca-a4cd-34b24b2f9713 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:02.865657 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-556c3d7d-d68a-4eca-a4cd-34b24b2f9713 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:02.866092 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-556c3d7d-d68a-4eca-a4cd-34b24b2f9713 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:02.926621 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-556c3d7d-d68a-4eca-a4cd-34b24b2f9713 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:02.934178 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-556c3d7d-d68a-4eca-a4cd-34b24b2f9713 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080495 Jul 27 20:26:02.934732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 613/1212] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:02 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:02.938125 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-75b0081d-9d88-46f3-9f6a-24d3fc333cf5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:02.940262 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-75b0081d-9d88-46f3-9f6a-24d3fc333cf5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:02.946097 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-75b0081d-9d88-46f3-9f6a-24d3fc333cf5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:02.946542 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-75b0081d-9d88-46f3-9f6a-24d3fc333cf5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:02.947300 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-75b0081d-9d88-46f3-9f6a-24d3fc333cf5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:02.947726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-75b0081d-9d88-46f3-9f6a-24d3fc333cf5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:02.977538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-75b0081d-9d88-46f3-9f6a-24d3fc333cf5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043450 Jul 27 20:26:02.978084 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 600/1213] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:02 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:26:03.058742 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-63b22ba4-148d-443c-800a-cb226240604b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:03.061077 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-63b22ba4-148d-443c-800a-cb226240604b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:03.067092 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63b22ba4-148d-443c-800a-cb226240604b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:03.067552 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63b22ba4-148d-443c-800a-cb226240604b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:03.068315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63b22ba4-148d-443c-800a-cb226240604b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:03.068757 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63b22ba4-148d-443c-800a-cb226240604b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:03.103336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4bb9f1c0-07f4-4815-8a09-8b56a492898f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:03.103932 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-63b22ba4-148d-443c-800a-cb226240604b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048585 Jul 27 20:26:03.104043 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 614/1214] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:03 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:03.105682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4bb9f1c0-07f4-4815-8a09-8b56a492898f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:03.112246 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4bb9f1c0-07f4-4815-8a09-8b56a492898f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:03.112634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4bb9f1c0-07f4-4815-8a09-8b56a492898f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:03.113430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4bb9f1c0-07f4-4815-8a09-8b56a492898f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:03.113871 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4bb9f1c0-07f4-4815-8a09-8b56a492898f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:03.143552 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4bb9f1c0-07f4-4815-8a09-8b56a492898f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044303 Jul 27 20:26:03.144103 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 601/1215] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:03 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:26:03.954449 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2db44063-7f58-4f68-8c68-a91c7ef5f0a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:03.955228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2db44063-7f58-4f68-8c68-a91c7ef5f0a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:03.961767 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2db44063-7f58-4f68-8c68-a91c7ef5f0a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:03.962222 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2db44063-7f58-4f68-8c68-a91c7ef5f0a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:03.962990 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2db44063-7f58-4f68-8c68-a91c7ef5f0a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:03.963433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2db44063-7f58-4f68-8c68-a91c7ef5f0a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:03.989866 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ab1c8e66-3b5f-4939-bce3-562a9fd7d65e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:03.991996 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ab1c8e66-3b5f-4939-bce3-562a9fd7d65e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:03.997973 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab1c8e66-3b5f-4939-bce3-562a9fd7d65e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:03.998417 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab1c8e66-3b5f-4939-bce3-562a9fd7d65e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:03.999169 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab1c8e66-3b5f-4939-bce3-562a9fd7d65e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:03.999597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab1c8e66-3b5f-4939-bce3-562a9fd7d65e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:04.024435 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2db44063-7f58-4f68-8c68-a91c7ef5f0a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:04.029636 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ab1c8e66-3b5f-4939-bce3-562a9fd7d65e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043588 Jul 27 20:26:04.030537 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 602/1216] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:03 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:26:04.033037 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2db44063-7f58-4f68-8c68-a91c7ef5f0a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082517 Jul 27 20:26:04.033600 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 615/1217] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:03 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:04.115613 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1c9eabc5-6adc-41ee-b437-40dd30afc6c1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:04.117854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1c9eabc5-6adc-41ee-b437-40dd30afc6c1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:04.124327 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c9eabc5-6adc-41ee-b437-40dd30afc6c1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:04.124771 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c9eabc5-6adc-41ee-b437-40dd30afc6c1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:04.125570 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c9eabc5-6adc-41ee-b437-40dd30afc6c1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:04.125992 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c9eabc5-6adc-41ee-b437-40dd30afc6c1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:04.154740 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1c9eabc5-6adc-41ee-b437-40dd30afc6c1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042984 Jul 27 20:26:04.155282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 603/1218] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:04 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:04.156656 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e780a45c-ff36-44d0-8aee-6e4293e28989 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:04.158884 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e780a45c-ff36-44d0-8aee-6e4293e28989 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:04.164893 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e780a45c-ff36-44d0-8aee-6e4293e28989 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:04.165380 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e780a45c-ff36-44d0-8aee-6e4293e28989 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:04.166150 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e780a45c-ff36-44d0-8aee-6e4293e28989 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:04.166591 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e780a45c-ff36-44d0-8aee-6e4293e28989 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:04.195563 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e780a45c-ff36-44d0-8aee-6e4293e28989 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043446 Jul 27 20:26:04.196119 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 616/1219] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:04 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:26:05.041751 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-49559fe8-4dad-49ea-82f4-30cb0d6c1988 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:05.044641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-49559fe8-4dad-49ea-82f4-30cb0d6c1988 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:05.050649 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49559fe8-4dad-49ea-82f4-30cb0d6c1988 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:05.051102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49559fe8-4dad-49ea-82f4-30cb0d6c1988 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:05.051860 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49559fe8-4dad-49ea-82f4-30cb0d6c1988 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:05.052292 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49559fe8-4dad-49ea-82f4-30cb0d6c1988 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:05.054253 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3a150a73-b2bb-4e4e-9412-80392f87b433 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:05.054877 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3a150a73-b2bb-4e4e-9412-80392f87b433 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:05.062030 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3a150a73-b2bb-4e4e-9412-80392f87b433 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:05.062489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3a150a73-b2bb-4e4e-9412-80392f87b433 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:05.063262 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3a150a73-b2bb-4e4e-9412-80392f87b433 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:05.063702 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3a150a73-b2bb-4e4e-9412-80392f87b433 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:05.082313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-49559fe8-4dad-49ea-82f4-30cb0d6c1988 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044423 Jul 27 20:26:05.082883 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 604/1220] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:05 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:05.129127 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3a150a73-b2bb-4e4e-9412-80392f87b433 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:05.136610 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3a150a73-b2bb-4e4e-9412-80392f87b433 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.086453 Jul 27 20:26:05.137241 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 617/1221] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:05 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:26:05.166718 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-205d79e8-753c-4b25-af39-cabae33905a9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:05.169445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-205d79e8-753c-4b25-af39-cabae33905a9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:05.175861 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-205d79e8-753c-4b25-af39-cabae33905a9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:05.176303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-205d79e8-753c-4b25-af39-cabae33905a9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:05.177084 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-205d79e8-753c-4b25-af39-cabae33905a9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:05.177511 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-205d79e8-753c-4b25-af39-cabae33905a9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:05.205885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-205d79e8-753c-4b25-af39-cabae33905a9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043045 Jul 27 20:26:05.206426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 605/1222] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:05 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:05.207852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-955b7951-7750-48b9-9431-51abfd6ca829 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:05.210037 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-955b7951-7750-48b9-9431-51abfd6ca829 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:05.216006 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-955b7951-7750-48b9-9431-51abfd6ca829 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:05.216447 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-955b7951-7750-48b9-9431-51abfd6ca829 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:05.217233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-955b7951-7750-48b9-9431-51abfd6ca829 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:05.217677 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-955b7951-7750-48b9-9431-51abfd6ca829 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:05.247437 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-955b7951-7750-48b9-9431-51abfd6ca829 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043590 Jul 27 20:26:05.248047 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 618/1223] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:05 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:26:06.095849 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-99e034d7-292d-419b-b858-370a03cd0abb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:06.098085 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-99e034d7-292d-419b-b858-370a03cd0abb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:06.108572 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99e034d7-292d-419b-b858-370a03cd0abb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:06.109042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99e034d7-292d-419b-b858-370a03cd0abb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:06.109804 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99e034d7-292d-419b-b858-370a03cd0abb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:06.110233 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99e034d7-292d-419b-b858-370a03cd0abb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:06.141764 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-99e034d7-292d-419b-b858-370a03cd0abb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050283 Jul 27 20:26:06.142337 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 606/1224] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:06 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:06.156652 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-32fc34c7-4846-4de4-a01a-3579400a2603 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:06.157310 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-32fc34c7-4846-4de4-a01a-3579400a2603 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:06.163809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-32fc34c7-4846-4de4-a01a-3579400a2603 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:06.164266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-32fc34c7-4846-4de4-a01a-3579400a2603 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:06.165062 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-32fc34c7-4846-4de4-a01a-3579400a2603 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:06.165510 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-32fc34c7-4846-4de4-a01a-3579400a2603 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:06.218086 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3b2fff46-0532-4ca6-8c5d-4ad5679d8fee tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:06.220369 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3b2fff46-0532-4ca6-8c5d-4ad5679d8fee tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:06.226469 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-32fc34c7-4846-4de4-a01a-3579400a2603 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:06.227570 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b2fff46-0532-4ca6-8c5d-4ad5679d8fee tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:06.228021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b2fff46-0532-4ca6-8c5d-4ad5679d8fee tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:06.228802 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b2fff46-0532-4ca6-8c5d-4ad5679d8fee tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:06.229272 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b2fff46-0532-4ca6-8c5d-4ad5679d8fee tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:06.234118 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-32fc34c7-4846-4de4-a01a-3579400a2603 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081463 Jul 27 20:26:06.234696 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 619/1225] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:06 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:06.258887 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3b2fff46-0532-4ca6-8c5d-4ad5679d8fee tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044808 Jul 27 20:26:06.259442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 607/1226] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:06 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:26:06.259901 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3e38278a-bce4-4a62-bc34-410e3e897f26 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:06.262922 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3e38278a-bce4-4a62-bc34-410e3e897f26 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:06.268868 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3e38278a-bce4-4a62-bc34-410e3e897f26 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:06.269349 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3e38278a-bce4-4a62-bc34-410e3e897f26 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:06.270114 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3e38278a-bce4-4a62-bc34-410e3e897f26 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:06.270555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3e38278a-bce4-4a62-bc34-410e3e897f26 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:06.300433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3e38278a-bce4-4a62-bc34-410e3e897f26 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044350 Jul 27 20:26:06.301008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 620/1227] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:06 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:26:07.154875 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-aecfcd19-0c91-482d-b8e6-d70b3d6d55c2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:07.157096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-aecfcd19-0c91-482d-b8e6-d70b3d6d55c2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:07.163124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aecfcd19-0c91-482d-b8e6-d70b3d6d55c2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:07.163575 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aecfcd19-0c91-482d-b8e6-d70b3d6d55c2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:07.164341 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aecfcd19-0c91-482d-b8e6-d70b3d6d55c2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:07.164777 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aecfcd19-0c91-482d-b8e6-d70b3d6d55c2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:07.193788 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-aecfcd19-0c91-482d-b8e6-d70b3d6d55c2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043539 Jul 27 20:26:07.194329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 608/1228] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:07 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:07.255145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3cc58b8c-c715-42a5-9485-8a6773fea5b1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:07.255757 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3cc58b8c-c715-42a5-9485-8a6773fea5b1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:07.262737 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3cc58b8c-c715-42a5-9485-8a6773fea5b1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:07.263369 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3cc58b8c-c715-42a5-9485-8a6773fea5b1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:07.264129 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3cc58b8c-c715-42a5-9485-8a6773fea5b1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:07.264566 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3cc58b8c-c715-42a5-9485-8a6773fea5b1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:07.271464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d10860ef-b4bd-4d93-af9d-89fe191205f8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:07.273594 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d10860ef-b4bd-4d93-af9d-89fe191205f8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:07.280809 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d10860ef-b4bd-4d93-af9d-89fe191205f8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:07.281282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d10860ef-b4bd-4d93-af9d-89fe191205f8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:07.282044 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d10860ef-b4bd-4d93-af9d-89fe191205f8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:07.282474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d10860ef-b4bd-4d93-af9d-89fe191205f8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:07.313159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d10860ef-b4bd-4d93-af9d-89fe191205f8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045379 Jul 27 20:26:07.313731 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 609/1229] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:07 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:26:07.318643 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4c36ea40-7602-4154-9354-001fe8737821 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:07.321027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4c36ea40-7602-4154-9354-001fe8737821 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:07.328449 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c36ea40-7602-4154-9354-001fe8737821 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:07.328869 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c36ea40-7602-4154-9354-001fe8737821 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:07.329671 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c36ea40-7602-4154-9354-001fe8737821 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:07.330103 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c36ea40-7602-4154-9354-001fe8737821 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:07.331283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3cc58b8c-c715-42a5-9485-8a6773fea5b1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:07.339162 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3cc58b8c-c715-42a5-9485-8a6773fea5b1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.087861 Jul 27 20:26:07.339731 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 621/1230] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:07 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:07.361284 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4c36ea40-7602-4154-9354-001fe8737821 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046498 Jul 27 20:26:07.361829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 610/1231] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:07 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:08.206931 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c2fd1a53-f06f-447b-9c93-c66ab2e0212e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:08.209145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c2fd1a53-f06f-447b-9c93-c66ab2e0212e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:08.215765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c2fd1a53-f06f-447b-9c93-c66ab2e0212e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:08.216222 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c2fd1a53-f06f-447b-9c93-c66ab2e0212e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:08.217038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c2fd1a53-f06f-447b-9c93-c66ab2e0212e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:08.217482 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c2fd1a53-f06f-447b-9c93-c66ab2e0212e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:08.246438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c2fd1a53-f06f-447b-9c93-c66ab2e0212e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043250 Jul 27 20:26:08.247013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 622/1232] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:08 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:08.325905 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7a3fc59f-0fcb-402b-b62a-c2b0ee5fd8be tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:08.328113 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7a3fc59f-0fcb-402b-b62a-c2b0ee5fd8be tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:08.334466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a3fc59f-0fcb-402b-b62a-c2b0ee5fd8be tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:08.334902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a3fc59f-0fcb-402b-b62a-c2b0ee5fd8be tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:08.335650 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a3fc59f-0fcb-402b-b62a-c2b0ee5fd8be tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:08.336074 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a3fc59f-0fcb-402b-b62a-c2b0ee5fd8be tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:08.339727 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:08.361009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-507051c0-08da-491e-b33d-cf9035b11de8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:08.361627 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-507051c0-08da-491e-b33d-cf9035b11de8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:08.366501 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7a3fc59f-0fcb-402b-b62a-c2b0ee5fd8be tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045234 Jul 27 20:26:08.368306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 611/1233] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:08 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:08.368438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-507051c0-08da-491e-b33d-cf9035b11de8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:08.368527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-507051c0-08da-491e-b33d-cf9035b11de8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:08.369323 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-507051c0-08da-491e-b33d-cf9035b11de8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:08.369766 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-507051c0-08da-491e-b33d-cf9035b11de8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:08.374332 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b469e5f2-5432-4667-b745-36e75de495af tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:08.376484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b469e5f2-5432-4667-b745-36e75de495af tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:08.382301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b469e5f2-5432-4667-b745-36e75de495af tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:08.382741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b469e5f2-5432-4667-b745-36e75de495af tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:08.383526 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b469e5f2-5432-4667-b745-36e75de495af tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:08.383958 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b469e5f2-5432-4667-b745-36e75de495af tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:08.412690 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b469e5f2-5432-4667-b745-36e75de495af tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042759 Jul 27 20:26:08.413487 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 612/1234] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:08 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:08.432550 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-507051c0-08da-491e-b33d-cf9035b11de8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:08.440624 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-507051c0-08da-491e-b33d-cf9035b11de8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083475 Jul 27 20:26:08.441221 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 623/1235] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:08 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:26:09.258341 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-feac2acb-38cd-4d4f-b7c4-2e63c964601d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:09.260425 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-feac2acb-38cd-4d4f-b7c4-2e63c964601d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:09.266653 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-feac2acb-38cd-4d4f-b7c4-2e63c964601d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:09.267096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-feac2acb-38cd-4d4f-b7c4-2e63c964601d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:09.267844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-feac2acb-38cd-4d4f-b7c4-2e63c964601d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:09.268272 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-feac2acb-38cd-4d4f-b7c4-2e63c964601d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:09.298143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-feac2acb-38cd-4d4f-b7c4-2e63c964601d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043827 Jul 27 20:26:09.298694 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 613/1236] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:09 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:09.378944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-91cb515c-50c7-412b-8d58-d53e429f807f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:09.381102 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-91cb515c-50c7-412b-8d58-d53e429f807f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:09.387688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-91cb515c-50c7-412b-8d58-d53e429f807f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:09.388132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-91cb515c-50c7-412b-8d58-d53e429f807f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:09.388891 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-91cb515c-50c7-412b-8d58-d53e429f807f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:09.389353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-91cb515c-50c7-412b-8d58-d53e429f807f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:09.419292 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-91cb515c-50c7-412b-8d58-d53e429f807f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044300 Jul 27 20:26:09.419848 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 624/1237] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:09 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:09.425626 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-80fef9a1-4e68-47e7-abbe-a8389b0daab8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:09.427755 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-80fef9a1-4e68-47e7-abbe-a8389b0daab8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:09.434173 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80fef9a1-4e68-47e7-abbe-a8389b0daab8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:09.434718 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80fef9a1-4e68-47e7-abbe-a8389b0daab8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:09.435464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80fef9a1-4e68-47e7-abbe-a8389b0daab8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:09.435892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80fef9a1-4e68-47e7-abbe-a8389b0daab8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:09.462082 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b735bcb9-077e-41d7-97e1-8e9a719bc3d3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:09.462696 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b735bcb9-077e-41d7-97e1-8e9a719bc3d3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:09.467295 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-80fef9a1-4e68-47e7-abbe-a8389b0daab8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045564 Jul 27 20:26:09.467857 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 614/1238] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:09 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:09.469576 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b735bcb9-077e-41d7-97e1-8e9a719bc3d3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:09.470022 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b735bcb9-077e-41d7-97e1-8e9a719bc3d3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:09.470795 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b735bcb9-077e-41d7-97e1-8e9a719bc3d3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:09.471218 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b735bcb9-077e-41d7-97e1-8e9a719bc3d3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:09.475187 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:09.534036 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b735bcb9-077e-41d7-97e1-8e9a719bc3d3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:09.541545 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b735bcb9-077e-41d7-97e1-8e9a719bc3d3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083223 Jul 27 20:26:09.542112 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 625/1239] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:09 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:26:10.310936 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-65be5a16-88e5-4d1f-99ef-5de95de93cf3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:10.313149 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-65be5a16-88e5-4d1f-99ef-5de95de93cf3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:10.319227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65be5a16-88e5-4d1f-99ef-5de95de93cf3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:10.319680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65be5a16-88e5-4d1f-99ef-5de95de93cf3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:10.320452 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65be5a16-88e5-4d1f-99ef-5de95de93cf3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:10.320890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65be5a16-88e5-4d1f-99ef-5de95de93cf3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:10.350482 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-65be5a16-88e5-4d1f-99ef-5de95de93cf3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044243 Jul 27 20:26:10.350955 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 615/1240] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:10 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:10.431265 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-755a4633-7381-49bf-ba79-df4be49c4059 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:10.433398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-755a4633-7381-49bf-ba79-df4be49c4059 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:10.440559 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-755a4633-7381-49bf-ba79-df4be49c4059 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:10.441034 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-755a4633-7381-49bf-ba79-df4be49c4059 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:10.441793 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-755a4633-7381-49bf-ba79-df4be49c4059 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:10.442227 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-755a4633-7381-49bf-ba79-df4be49c4059 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:10.471311 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-755a4633-7381-49bf-ba79-df4be49c4059 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043724 Jul 27 20:26:10.471847 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 626/1241] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:10 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:10.479627 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c4c0e55b-dd18-431c-a0b4-cc3b2fe41711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:10.482374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c4c0e55b-dd18-431c-a0b4-cc3b2fe41711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:10.488758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c4c0e55b-dd18-431c-a0b4-cc3b2fe41711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:10.489240 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c4c0e55b-dd18-431c-a0b4-cc3b2fe41711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:10.490002 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c4c0e55b-dd18-431c-a0b4-cc3b2fe41711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:10.490434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c4c0e55b-dd18-431c-a0b4-cc3b2fe41711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:10.518959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c4c0e55b-dd18-431c-a0b4-cc3b2fe41711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043284 Jul 27 20:26:10.519506 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 616/1242] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:10 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:10.562240 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-16690171-31b1-41a6-b4a9-6ecb195abeb5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:10.562893 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-16690171-31b1-41a6-b4a9-6ecb195abeb5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:10.568874 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-16690171-31b1-41a6-b4a9-6ecb195abeb5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:10.569366 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-16690171-31b1-41a6-b4a9-6ecb195abeb5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:10.570132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-16690171-31b1-41a6-b4a9-6ecb195abeb5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:10.570575 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-16690171-31b1-41a6-b4a9-6ecb195abeb5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:10.633510 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-16690171-31b1-41a6-b4a9-6ecb195abeb5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:10.641087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-16690171-31b1-41a6-b4a9-6ecb195abeb5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083272 Jul 27 20:26:10.641661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 627/1243] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:10 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:11.362654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b2e49714-6c1e-44dc-83d6-43e4ac067d27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:11.364783 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b2e49714-6c1e-44dc-83d6-43e4ac067d27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:11.370806 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b2e49714-6c1e-44dc-83d6-43e4ac067d27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:11.372015 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b2e49714-6c1e-44dc-83d6-43e4ac067d27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:11.372773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b2e49714-6c1e-44dc-83d6-43e4ac067d27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:11.373313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b2e49714-6c1e-44dc-83d6-43e4ac067d27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:11.401823 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b2e49714-6c1e-44dc-83d6-43e4ac067d27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043225 Jul 27 20:26:11.402917 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 617/1244] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:11 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:11.484143 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bca90413-0b75-4799-8363-2b96370cca49 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:11.486308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bca90413-0b75-4799-8363-2b96370cca49 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:11.492775 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bca90413-0b75-4799-8363-2b96370cca49 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:11.493262 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bca90413-0b75-4799-8363-2b96370cca49 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:11.494038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bca90413-0b75-4799-8363-2b96370cca49 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:11.494480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bca90413-0b75-4799-8363-2b96370cca49 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:11.522934 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bca90413-0b75-4799-8363-2b96370cca49 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043357 Jul 27 20:26:11.523481 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 628/1245] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:11 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:11.531597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0d2a55ca-2a1a-4b62-8e3b-bd30a2807e58 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:11.533839 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0d2a55ca-2a1a-4b62-8e3b-bd30a2807e58 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:11.540262 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d2a55ca-2a1a-4b62-8e3b-bd30a2807e58 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:11.540709 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d2a55ca-2a1a-4b62-8e3b-bd30a2807e58 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:11.541500 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d2a55ca-2a1a-4b62-8e3b-bd30a2807e58 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:11.541946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d2a55ca-2a1a-4b62-8e3b-bd30a2807e58 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:11.570935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0d2a55ca-2a1a-4b62-8e3b-bd30a2807e58 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044021 Jul 27 20:26:11.571483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 618/1246] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:11 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:11.661192 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ddc05c86-19f0-4f09-832b-c382517d2a52 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:11.661813 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ddc05c86-19f0-4f09-832b-c382517d2a52 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:11.667837 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddc05c86-19f0-4f09-832b-c382517d2a52 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:11.669039 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddc05c86-19f0-4f09-832b-c382517d2a52 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:11.669985 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddc05c86-19f0-4f09-832b-c382517d2a52 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:11.670439 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddc05c86-19f0-4f09-832b-c382517d2a52 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:11.731053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ddc05c86-19f0-4f09-832b-c382517d2a52 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:11.738567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ddc05c86-19f0-4f09-832b-c382517d2a52 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081299 Jul 27 20:26:11.739133 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 629/1247] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:11 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:12.414289 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b70bd6a8-dea7-49be-a394-741488de8e83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:12.416433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b70bd6a8-dea7-49be-a394-741488de8e83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:12.422706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b70bd6a8-dea7-49be-a394-741488de8e83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:12.423152 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b70bd6a8-dea7-49be-a394-741488de8e83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:12.423914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b70bd6a8-dea7-49be-a394-741488de8e83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:12.424348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b70bd6a8-dea7-49be-a394-741488de8e83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:12.453883 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b70bd6a8-dea7-49be-a394-741488de8e83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043491 Jul 27 20:26:12.454471 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 619/1248] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:12 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:12.534946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bbcd292b-c589-4d1b-a22c-428f548f0cc7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:12.537122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bbcd292b-c589-4d1b-a22c-428f548f0cc7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:12.544153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bbcd292b-c589-4d1b-a22c-428f548f0cc7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:12.544612 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bbcd292b-c589-4d1b-a22c-428f548f0cc7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:12.545397 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bbcd292b-c589-4d1b-a22c-428f548f0cc7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:12.545837 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bbcd292b-c589-4d1b-a22c-428f548f0cc7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:12.576008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bbcd292b-c589-4d1b-a22c-428f548f0cc7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045067 Jul 27 20:26:12.576565 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 630/1249] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:12 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:12.583406 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1a48c29c-39e4-4a5a-a2d8-0fc739d8ecfc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:12.585691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1a48c29c-39e4-4a5a-a2d8-0fc739d8ecfc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:12.592349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1a48c29c-39e4-4a5a-a2d8-0fc739d8ecfc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:12.592786 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1a48c29c-39e4-4a5a-a2d8-0fc739d8ecfc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:12.593576 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1a48c29c-39e4-4a5a-a2d8-0fc739d8ecfc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:12.594004 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1a48c29c-39e4-4a5a-a2d8-0fc739d8ecfc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:12.623552 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1a48c29c-39e4-4a5a-a2d8-0fc739d8ecfc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044087 Jul 27 20:26:12.624090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 620/1250] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:12 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:12.758940 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-aecefd89-edf1-46bf-abbc-5c914fd2a8a3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:12.759477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-aecefd89-edf1-46bf-abbc-5c914fd2a8a3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:12.766068 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aecefd89-edf1-46bf-abbc-5c914fd2a8a3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:12.766516 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aecefd89-edf1-46bf-abbc-5c914fd2a8a3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:12.767266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aecefd89-edf1-46bf-abbc-5c914fd2a8a3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:12.767696 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aecefd89-edf1-46bf-abbc-5c914fd2a8a3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:12.828116 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-aecefd89-edf1-46bf-abbc-5c914fd2a8a3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:12.835494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-aecefd89-edf1-46bf-abbc-5c914fd2a8a3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080378 Jul 27 20:26:12.836050 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 631/1251] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:12 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:13.466029 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-656b25bf-ffa1-41ee-9f69-6518b49f9501 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:13.468188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-656b25bf-ffa1-41ee-9f69-6518b49f9501 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:13.474195 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-656b25bf-ffa1-41ee-9f69-6518b49f9501 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:13.474650 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-656b25bf-ffa1-41ee-9f69-6518b49f9501 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:13.475404 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-656b25bf-ffa1-41ee-9f69-6518b49f9501 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:13.475841 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-656b25bf-ffa1-41ee-9f69-6518b49f9501 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:13.505968 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-656b25bf-ffa1-41ee-9f69-6518b49f9501 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043937 Jul 27 20:26:13.506517 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 621/1252] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:13 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:13.587812 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c14f52e2-b285-4dd0-8589-ff28e1040518 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:13.590472 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c14f52e2-b285-4dd0-8589-ff28e1040518 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:13.597137 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c14f52e2-b285-4dd0-8589-ff28e1040518 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:13.597588 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c14f52e2-b285-4dd0-8589-ff28e1040518 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:13.598345 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c14f52e2-b285-4dd0-8589-ff28e1040518 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:13.598782 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c14f52e2-b285-4dd0-8589-ff28e1040518 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:13.627441 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c14f52e2-b285-4dd0-8589-ff28e1040518 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043635 Jul 27 20:26:13.627991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 632/1253] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:13 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:13.635636 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e5c467f6-4801-4095-966b-fc1728be08c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:13.637874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e5c467f6-4801-4095-966b-fc1728be08c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:13.644236 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e5c467f6-4801-4095-966b-fc1728be08c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:13.644685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e5c467f6-4801-4095-966b-fc1728be08c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:13.645493 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e5c467f6-4801-4095-966b-fc1728be08c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:13.645929 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e5c467f6-4801-4095-966b-fc1728be08c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:13.675118 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e5c467f6-4801-4095-966b-fc1728be08c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043407 Jul 27 20:26:13.675665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 622/1254] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:13 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:13.855466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cecc097b-0c08-47a1-8f0f-0af5ccf5f8a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:13.856635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cecc097b-0c08-47a1-8f0f-0af5ccf5f8a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:13.862569 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cecc097b-0c08-47a1-8f0f-0af5ccf5f8a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:13.863017 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cecc097b-0c08-47a1-8f0f-0af5ccf5f8a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:13.863767 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cecc097b-0c08-47a1-8f0f-0af5ccf5f8a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:13.864199 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cecc097b-0c08-47a1-8f0f-0af5ccf5f8a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:13.926683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cecc097b-0c08-47a1-8f0f-0af5ccf5f8a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:13.934643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cecc097b-0c08-47a1-8f0f-0af5ccf5f8a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082928 Jul 27 20:26:13.935237 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 633/1255] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:13 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:14.518616 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d9d53d75-6687-4932-8a85-350ce4c3f2a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:14.520705 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d9d53d75-6687-4932-8a85-350ce4c3f2a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:14.526732 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d9d53d75-6687-4932-8a85-350ce4c3f2a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:14.527179 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d9d53d75-6687-4932-8a85-350ce4c3f2a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:14.528444 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d9d53d75-6687-4932-8a85-350ce4c3f2a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:14.528878 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d9d53d75-6687-4932-8a85-350ce4c3f2a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:14.557509 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d9d53d75-6687-4932-8a85-350ce4c3f2a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042979 Jul 27 20:26:14.558052 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 623/1256] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:14 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:14.640195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-18f80e6a-41ed-4270-b016-93e4b284f603 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:14.642357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-18f80e6a-41ed-4270-b016-93e4b284f603 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:14.648855 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-18f80e6a-41ed-4270-b016-93e4b284f603 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:14.649340 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-18f80e6a-41ed-4270-b016-93e4b284f603 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:14.650101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-18f80e6a-41ed-4270-b016-93e4b284f603 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:14.650538 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-18f80e6a-41ed-4270-b016-93e4b284f603 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:14.679823 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-18f80e6a-41ed-4270-b016-93e4b284f603 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043739 Jul 27 20:26:14.680363 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 634/1257] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:14 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:14.687360 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-52787b55-dbb5-4220-ae56-9eeadb667eb3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:14.689509 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-52787b55-dbb5-4220-ae56-9eeadb667eb3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:14.695865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-52787b55-dbb5-4220-ae56-9eeadb667eb3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:14.696311 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-52787b55-dbb5-4220-ae56-9eeadb667eb3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:14.697101 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-52787b55-dbb5-4220-ae56-9eeadb667eb3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:14.697537 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-52787b55-dbb5-4220-ae56-9eeadb667eb3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:14.726866 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-52787b55-dbb5-4220-ae56-9eeadb667eb3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043544 Jul 27 20:26:14.727415 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 624/1258] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:14 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:14.955909 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9883fecb-e73a-4ffe-8ac2-c7247344c4f2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:14.956527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9883fecb-e73a-4ffe-8ac2-c7247344c4f2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:14.962500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9883fecb-e73a-4ffe-8ac2-c7247344c4f2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:14.962922 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9883fecb-e73a-4ffe-8ac2-c7247344c4f2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:14.963690 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9883fecb-e73a-4ffe-8ac2-c7247344c4f2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:14.964131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9883fecb-e73a-4ffe-8ac2-c7247344c4f2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:15.026085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9883fecb-e73a-4ffe-8ac2-c7247344c4f2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:15.034464 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9883fecb-e73a-4ffe-8ac2-c7247344c4f2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082481 Jul 27 20:26:15.035028 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 635/1259] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:14 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:15.569615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-373d7377-6c1c-4bed-83ab-1285352eee28 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:15.571714 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-373d7377-6c1c-4bed-83ab-1285352eee28 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:15.578577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-373d7377-6c1c-4bed-83ab-1285352eee28 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:15.579025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-373d7377-6c1c-4bed-83ab-1285352eee28 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:15.579793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-373d7377-6c1c-4bed-83ab-1285352eee28 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:15.580229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-373d7377-6c1c-4bed-83ab-1285352eee28 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:15.608758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-373d7377-6c1c-4bed-83ab-1285352eee28 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043130 Jul 27 20:26:15.609312 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 625/1260] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:15 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:15.692301 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-35c79059-51eb-45b2-82d7-568d3ec3e075 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:15.694502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-35c79059-51eb-45b2-82d7-568d3ec3e075 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:15.701797 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-35c79059-51eb-45b2-82d7-568d3ec3e075 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:15.702253 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-35c79059-51eb-45b2-82d7-568d3ec3e075 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:15.703021 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-35c79059-51eb-45b2-82d7-568d3ec3e075 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:15.703465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-35c79059-51eb-45b2-82d7-568d3ec3e075 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:15.732631 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-35c79059-51eb-45b2-82d7-568d3ec3e075 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044294 Jul 27 20:26:15.733203 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 636/1261] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:15 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:15.738881 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8c939cd2-e73d-40db-9e9f-7bdb664bd184 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:15.741078 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8c939cd2-e73d-40db-9e9f-7bdb664bd184 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:15.747734 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c939cd2-e73d-40db-9e9f-7bdb664bd184 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:15.748181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c939cd2-e73d-40db-9e9f-7bdb664bd184 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:15.748943 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c939cd2-e73d-40db-9e9f-7bdb664bd184 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:15.749399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c939cd2-e73d-40db-9e9f-7bdb664bd184 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:15.778311 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8c939cd2-e73d-40db-9e9f-7bdb664bd184 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042688 Jul 27 20:26:15.778857 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 626/1262] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:15 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:16.055598 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-37ecb9ee-760a-4421-9423-24f6e284ea4c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:16.056245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-37ecb9ee-760a-4421-9423-24f6e284ea4c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:16.062829 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-37ecb9ee-760a-4421-9423-24f6e284ea4c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:16.063282 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-37ecb9ee-760a-4421-9423-24f6e284ea4c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:16.064076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-37ecb9ee-760a-4421-9423-24f6e284ea4c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:16.064520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-37ecb9ee-760a-4421-9423-24f6e284ea4c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:16.124832 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-37ecb9ee-760a-4421-9423-24f6e284ea4c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:16.132171 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-37ecb9ee-760a-4421-9423-24f6e284ea4c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080475 Jul 27 20:26:16.132738 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 637/1263] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:16 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:16.621652 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2e2b2af4-4d7d-4f5e-8384-cad947bd92a2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:16.623804 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2e2b2af4-4d7d-4f5e-8384-cad947bd92a2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:16.629906 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e2b2af4-4d7d-4f5e-8384-cad947bd92a2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:16.630359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e2b2af4-4d7d-4f5e-8384-cad947bd92a2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:16.631126 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e2b2af4-4d7d-4f5e-8384-cad947bd92a2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:16.631566 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e2b2af4-4d7d-4f5e-8384-cad947bd92a2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:16.656039 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:16.661495 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2e2b2af4-4d7d-4f5e-8384-cad947bd92a2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044296 Jul 27 20:26:16.662051 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 627/1264] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:16 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:16.743618 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7517e8ca-a8ec-4300-8ec8-69a92304e2cd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:16.745813 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7517e8ca-a8ec-4300-8ec8-69a92304e2cd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:16.752770 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7517e8ca-a8ec-4300-8ec8-69a92304e2cd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:16.753248 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7517e8ca-a8ec-4300-8ec8-69a92304e2cd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:16.754012 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7517e8ca-a8ec-4300-8ec8-69a92304e2cd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:16.754445 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7517e8ca-a8ec-4300-8ec8-69a92304e2cd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:16.782742 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7517e8ca-a8ec-4300-8ec8-69a92304e2cd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043042 Jul 27 20:26:16.783280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 638/1265] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:16 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:16.790706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-93b45c1f-e9c7-420c-a4ec-788b149f4761 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:16.792884 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-93b45c1f-e9c7-420c-a4ec-788b149f4761 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:16.799344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93b45c1f-e9c7-420c-a4ec-788b149f4761 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:16.799791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93b45c1f-e9c7-420c-a4ec-788b149f4761 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:16.800546 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93b45c1f-e9c7-420c-a4ec-788b149f4761 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:16.800996 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93b45c1f-e9c7-420c-a4ec-788b149f4761 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:16.830359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-93b45c1f-e9c7-420c-a4ec-788b149f4761 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043799 Jul 27 20:26:16.830901 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 628/1266] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:16 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:17.153323 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4da45ad7-673e-4a8b-a962-e4fb14272808 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:17.153927 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4da45ad7-673e-4a8b-a962-e4fb14272808 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:17.159883 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4da45ad7-673e-4a8b-a962-e4fb14272808 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:17.160323 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4da45ad7-673e-4a8b-a962-e4fb14272808 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:17.161093 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4da45ad7-673e-4a8b-a962-e4fb14272808 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:17.161526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4da45ad7-673e-4a8b-a962-e4fb14272808 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:17.222621 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4da45ad7-673e-4a8b-a962-e4fb14272808 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:17.230005 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4da45ad7-673e-4a8b-a962-e4fb14272808 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080534 Jul 27 20:26:17.231075 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 639/1267] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:17 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:17.674405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-57234292-3986-4156-ad30-8e5fa422ac39 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:17.676991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-57234292-3986-4156-ad30-8e5fa422ac39 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:17.683719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57234292-3986-4156-ad30-8e5fa422ac39 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:17.684172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57234292-3986-4156-ad30-8e5fa422ac39 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:17.684941 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57234292-3986-4156-ad30-8e5fa422ac39 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:17.685410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57234292-3986-4156-ad30-8e5fa422ac39 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:17.714251 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-57234292-3986-4156-ad30-8e5fa422ac39 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043895 Jul 27 20:26:17.715481 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 629/1268] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:17 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:17.794133 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-14e8ee3c-5ec3-4c86-92b3-24fe87998b33 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:17.796305 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-14e8ee3c-5ec3-4c86-92b3-24fe87998b33 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:17.802840 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-14e8ee3c-5ec3-4c86-92b3-24fe87998b33 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:17.803294 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-14e8ee3c-5ec3-4c86-92b3-24fe87998b33 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:17.804064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-14e8ee3c-5ec3-4c86-92b3-24fe87998b33 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:17.804508 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-14e8ee3c-5ec3-4c86-92b3-24fe87998b33 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:17.833465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-14e8ee3c-5ec3-4c86-92b3-24fe87998b33 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043314 Jul 27 20:26:17.834012 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 640/1269] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:17 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:17.842997 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-00cd9fa4-15fe-4116-8dab-8526dc62bc45 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:17.845169 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-00cd9fa4-15fe-4116-8dab-8526dc62bc45 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:17.851148 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00cd9fa4-15fe-4116-8dab-8526dc62bc45 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:17.851591 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00cd9fa4-15fe-4116-8dab-8526dc62bc45 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:17.852373 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00cd9fa4-15fe-4116-8dab-8526dc62bc45 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:17.852805 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00cd9fa4-15fe-4116-8dab-8526dc62bc45 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:17.881620 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-00cd9fa4-15fe-4116-8dab-8526dc62bc45 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043248 Jul 27 20:26:17.882160 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 630/1270] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:17 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:18.251678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9bf2e7f4-43f8-44ec-a63f-6d3515fe5223 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:18.252283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9bf2e7f4-43f8-44ec-a63f-6d3515fe5223 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:18.258242 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9bf2e7f4-43f8-44ec-a63f-6d3515fe5223 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:18.258688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9bf2e7f4-43f8-44ec-a63f-6d3515fe5223 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:18.259439 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9bf2e7f4-43f8-44ec-a63f-6d3515fe5223 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:18.259876 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9bf2e7f4-43f8-44ec-a63f-6d3515fe5223 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:18.322420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9bf2e7f4-43f8-44ec-a63f-6d3515fe5223 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:18.326079 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:18.330833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9bf2e7f4-43f8-44ec-a63f-6d3515fe5223 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083110 Jul 27 20:26:18.331454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 641/1271] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:18 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:18.727113 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-425eb3c9-c866-4f6b-ab75-48304a644302 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:18.729333 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-425eb3c9-c866-4f6b-ab75-48304a644302 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:18.735794 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-425eb3c9-c866-4f6b-ab75-48304a644302 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:18.736233 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-425eb3c9-c866-4f6b-ab75-48304a644302 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:18.736992 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-425eb3c9-c866-4f6b-ab75-48304a644302 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:18.737424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-425eb3c9-c866-4f6b-ab75-48304a644302 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:18.766148 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-425eb3c9-c866-4f6b-ab75-48304a644302 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042948 Jul 27 20:26:18.766686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 631/1272] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:18 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:18.846550 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-93af17ba-6c5c-4380-99bb-7726b4344a63 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:18.848679 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-93af17ba-6c5c-4380-99bb-7726b4344a63 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:18.855123 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-93af17ba-6c5c-4380-99bb-7726b4344a63 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:18.856271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-93af17ba-6c5c-4380-99bb-7726b4344a63 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:18.857228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-93af17ba-6c5c-4380-99bb-7726b4344a63 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:18.857675 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-93af17ba-6c5c-4380-99bb-7726b4344a63 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:18.886337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-93af17ba-6c5c-4380-99bb-7726b4344a63 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043964 Jul 27 20:26:18.886883 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 642/1273] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:18 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:18.893829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-eee662d0-79ca-467d-95df-8a830cf884c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:18.895990 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-eee662d0-79ca-467d-95df-8a830cf884c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:18.901953 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eee662d0-79ca-467d-95df-8a830cf884c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:18.902937 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eee662d0-79ca-467d-95df-8a830cf884c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:18.903761 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eee662d0-79ca-467d-95df-8a830cf884c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:18.904195 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eee662d0-79ca-467d-95df-8a830cf884c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:18.933608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-eee662d0-79ca-467d-95df-8a830cf884c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043717 Jul 27 20:26:18.934264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 632/1274] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:18 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:19.353223 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b47c1822-4128-42ea-a002-3f650b1fde8b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:19.353769 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b47c1822-4128-42ea-a002-3f650b1fde8b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:19.359758 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b47c1822-4128-42ea-a002-3f650b1fde8b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:19.360210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b47c1822-4128-42ea-a002-3f650b1fde8b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:19.360979 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b47c1822-4128-42ea-a002-3f650b1fde8b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:19.361413 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b47c1822-4128-42ea-a002-3f650b1fde8b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:19.425187 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b47c1822-4128-42ea-a002-3f650b1fde8b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:19.432535 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b47c1822-4128-42ea-a002-3f650b1fde8b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083233 Jul 27 20:26:19.433112 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 643/1275] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:19 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:19.778536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e1312432-6c2c-4246-9414-e6d760b676ec tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:19.780765 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e1312432-6c2c-4246-9414-e6d760b676ec tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:19.787284 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1312432-6c2c-4246-9414-e6d760b676ec tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:19.787732 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1312432-6c2c-4246-9414-e6d760b676ec tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:19.788490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1312432-6c2c-4246-9414-e6d760b676ec tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:19.788952 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1312432-6c2c-4246-9414-e6d760b676ec tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:19.817713 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e1312432-6c2c-4246-9414-e6d760b676ec tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043321 Jul 27 20:26:19.818258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 633/1276] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:19 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:19.898750 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9d62050f-b4be-4798-9a0e-2e186b06da6d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:19.900908 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9d62050f-b4be-4798-9a0e-2e186b06da6d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:19.907649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d62050f-b4be-4798-9a0e-2e186b06da6d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:19.908108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d62050f-b4be-4798-9a0e-2e186b06da6d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:19.908872 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d62050f-b4be-4798-9a0e-2e186b06da6d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:19.909345 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d62050f-b4be-4798-9a0e-2e186b06da6d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:19.944643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9d62050f-b4be-4798-9a0e-2e186b06da6d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049821 Jul 27 20:26:19.945239 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 644/1277] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:19 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:19.946179 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-38a766a6-3303-4ee8-b39e-187a5ed40b2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:19.948330 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-38a766a6-3303-4ee8-b39e-187a5ed40b2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:19.955397 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-38a766a6-3303-4ee8-b39e-187a5ed40b2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:19.955834 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-38a766a6-3303-4ee8-b39e-187a5ed40b2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:19.956586 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-38a766a6-3303-4ee8-b39e-187a5ed40b2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:19.957031 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-38a766a6-3303-4ee8-b39e-187a5ed40b2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:19.986215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-38a766a6-3303-4ee8-b39e-187a5ed40b2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044068 Jul 27 20:26:19.986764 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 634/1278] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:19 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:20.454003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9915f717-fd9a-428e-80a9-3f41dae1b50b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:20.454623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9915f717-fd9a-428e-80a9-3f41dae1b50b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:20.460598 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9915f717-fd9a-428e-80a9-3f41dae1b50b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:20.461080 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9915f717-fd9a-428e-80a9-3f41dae1b50b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:20.461844 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9915f717-fd9a-428e-80a9-3f41dae1b50b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:20.462282 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9915f717-fd9a-428e-80a9-3f41dae1b50b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:20.522391 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9915f717-fd9a-428e-80a9-3f41dae1b50b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:20.530092 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9915f717-fd9a-428e-80a9-3f41dae1b50b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080976 Jul 27 20:26:20.530660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 645/1279] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:20 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:20.829464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-eaeeea0b-874a-40a9-b30d-0bb098f4fe2d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:20.831546 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-eaeeea0b-874a-40a9-b30d-0bb098f4fe2d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:20.837961 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eaeeea0b-874a-40a9-b30d-0bb098f4fe2d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:20.838406 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eaeeea0b-874a-40a9-b30d-0bb098f4fe2d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:20.839158 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eaeeea0b-874a-40a9-b30d-0bb098f4fe2d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:20.839586 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eaeeea0b-874a-40a9-b30d-0bb098f4fe2d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:20.867797 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-eaeeea0b-874a-40a9-b30d-0bb098f4fe2d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042704 Jul 27 20:26:20.868342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 635/1280] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:20 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:20.956987 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ddc824af-20c4-46c6-b7ae-088f66dc2977 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:20.959337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ddc824af-20c4-46c6-b7ae-088f66dc2977 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:20.965869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddc824af-20c4-46c6-b7ae-088f66dc2977 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:20.966512 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddc824af-20c4-46c6-b7ae-088f66dc2977 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:20.967290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddc824af-20c4-46c6-b7ae-088f66dc2977 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:20.967734 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddc824af-20c4-46c6-b7ae-088f66dc2977 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:20.996951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ddc824af-20c4-46c6-b7ae-088f66dc2977 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043849 Jul 27 20:26:20.998089 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 646/1281] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:20 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:20.999501 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-87eb3ecb-bed1-4b2c-9de8-71ee6c78f416 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:21.001671 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-87eb3ecb-bed1-4b2c-9de8-71ee6c78f416 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:21.007598 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87eb3ecb-bed1-4b2c-9de8-71ee6c78f416 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:21.008044 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87eb3ecb-bed1-4b2c-9de8-71ee6c78f416 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:21.008804 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87eb3ecb-bed1-4b2c-9de8-71ee6c78f416 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:21.009271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87eb3ecb-bed1-4b2c-9de8-71ee6c78f416 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:21.037884 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-87eb3ecb-bed1-4b2c-9de8-71ee6c78f416 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043186 Jul 27 20:26:21.038438 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 636/1282] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:20 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:26:21.550609 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-90e92303-8c88-4de6-b264-4b872d80607f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:21.551216 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-90e92303-8c88-4de6-b264-4b872d80607f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:21.557169 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90e92303-8c88-4de6-b264-4b872d80607f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:21.557616 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90e92303-8c88-4de6-b264-4b872d80607f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:21.558368 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90e92303-8c88-4de6-b264-4b872d80607f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:21.558799 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90e92303-8c88-4de6-b264-4b872d80607f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:21.620391 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-90e92303-8c88-4de6-b264-4b872d80607f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:21.628852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-90e92303-8c88-4de6-b264-4b872d80607f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082109 Jul 27 20:26:21.629480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 647/1283] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:21 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:26:21.880135 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e90f837e-55f7-4e26-9b35-7cbdf0a19d09 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:21.882277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e90f837e-55f7-4e26-9b35-7cbdf0a19d09 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:21.888826 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e90f837e-55f7-4e26-9b35-7cbdf0a19d09 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:21.889310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e90f837e-55f7-4e26-9b35-7cbdf0a19d09 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:21.890078 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e90f837e-55f7-4e26-9b35-7cbdf0a19d09 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:21.890516 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e90f837e-55f7-4e26-9b35-7cbdf0a19d09 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:21.918905 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e90f837e-55f7-4e26-9b35-7cbdf0a19d09 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042878 Jul 27 20:26:21.920128 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 637/1284] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:21 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:22.010429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-743f335d-7303-4a33-9ae9-ec6adfd9d9e7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:22.012673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-743f335d-7303-4a33-9ae9-ec6adfd9d9e7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:22.019943 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-743f335d-7303-4a33-9ae9-ec6adfd9d9e7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:22.020610 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-743f335d-7303-4a33-9ae9-ec6adfd9d9e7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:22.021417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-743f335d-7303-4a33-9ae9-ec6adfd9d9e7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:22.021861 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-743f335d-7303-4a33-9ae9-ec6adfd9d9e7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:22.050839 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f164f73e-d98c-4390-b189-097ded62b6f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:22.051669 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-743f335d-7303-4a33-9ae9-ec6adfd9d9e7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045807 Jul 27 20:26:22.052233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 648/1285] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:22 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:22.053068 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f164f73e-d98c-4390-b189-097ded62b6f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:22.059089 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f164f73e-d98c-4390-b189-097ded62b6f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:22.059531 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f164f73e-d98c-4390-b189-097ded62b6f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:22.060291 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f164f73e-d98c-4390-b189-097ded62b6f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:22.060725 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f164f73e-d98c-4390-b189-097ded62b6f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:22.089297 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f164f73e-d98c-4390-b189-097ded62b6f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042296 Jul 27 20:26:22.089850 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 638/1286] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:22 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:26:22.649364 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-026b2e52-757a-4c1f-a8e2-346265f82e23 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:22.649988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-026b2e52-757a-4c1f-a8e2-346265f82e23 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:22.656080 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-026b2e52-757a-4c1f-a8e2-346265f82e23 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:22.656539 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-026b2e52-757a-4c1f-a8e2-346265f82e23 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:22.657329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-026b2e52-757a-4c1f-a8e2-346265f82e23 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:22.657775 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-026b2e52-757a-4c1f-a8e2-346265f82e23 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:22.720987 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-026b2e52-757a-4c1f-a8e2-346265f82e23 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:22.728485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-026b2e52-757a-4c1f-a8e2-346265f82e23 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082975 Jul 27 20:26:22.729080 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 649/1287] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:22 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:22.931144 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bf5ae49b-7a40-4332-912e-6ab729a05038 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:22.933235 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bf5ae49b-7a40-4332-912e-6ab729a05038 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:22.940526 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf5ae49b-7a40-4332-912e-6ab729a05038 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:22.940979 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf5ae49b-7a40-4332-912e-6ab729a05038 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:22.941747 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf5ae49b-7a40-4332-912e-6ab729a05038 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:22.942172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf5ae49b-7a40-4332-912e-6ab729a05038 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:22.971643 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bf5ae49b-7a40-4332-912e-6ab729a05038 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044458 Jul 27 20:26:22.972682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 639/1288] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:22 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:23.063635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f7e1f87d-dc6e-4cf9-b69b-ffe0ccb392d5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:23.065826 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f7e1f87d-dc6e-4cf9-b69b-ffe0ccb392d5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:23.072262 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f7e1f87d-dc6e-4cf9-b69b-ffe0ccb392d5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:23.072711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f7e1f87d-dc6e-4cf9-b69b-ffe0ccb392d5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:23.073504 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f7e1f87d-dc6e-4cf9-b69b-ffe0ccb392d5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:23.073977 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f7e1f87d-dc6e-4cf9-b69b-ffe0ccb392d5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:23.102194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-660fac80-3732-4fe8-ab1f-06f8e3f4f79f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:23.104158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f7e1f87d-dc6e-4cf9-b69b-ffe0ccb392d5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044582 Jul 27 20:26:23.104338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-660fac80-3732-4fe8-ab1f-06f8e3f4f79f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:23.104714 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 650/1289] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:23 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:23.111249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-660fac80-3732-4fe8-ab1f-06f8e3f4f79f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:23.111699 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-660fac80-3732-4fe8-ab1f-06f8e3f4f79f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:23.112468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-660fac80-3732-4fe8-ab1f-06f8e3f4f79f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:23.112902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-660fac80-3732-4fe8-ab1f-06f8e3f4f79f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:23.142072 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-660fac80-3732-4fe8-ab1f-06f8e3f4f79f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043822 Jul 27 20:26:23.142631 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 640/1290] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:23 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:26:23.750073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b88356ad-69b7-484c-ae0c-aa2a0af80cfd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:23.750684 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b88356ad-69b7-484c-ae0c-aa2a0af80cfd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:23.756723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b88356ad-69b7-484c-ae0c-aa2a0af80cfd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:23.757204 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b88356ad-69b7-484c-ae0c-aa2a0af80cfd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:23.757952 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b88356ad-69b7-484c-ae0c-aa2a0af80cfd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:23.758385 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b88356ad-69b7-484c-ae0c-aa2a0af80cfd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:23.818214 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b88356ad-69b7-484c-ae0c-aa2a0af80cfd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:23.825975 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b88356ad-69b7-484c-ae0c-aa2a0af80cfd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080358 Jul 27 20:26:23.826532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 651/1291] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:23 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:23.984564 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-be36bc9a-3d98-4fd2-81df-6a26f32413a0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:23.986770 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-be36bc9a-3d98-4fd2-81df-6a26f32413a0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:23.993261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-be36bc9a-3d98-4fd2-81df-6a26f32413a0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:23.993714 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-be36bc9a-3d98-4fd2-81df-6a26f32413a0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:23.994478 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-be36bc9a-3d98-4fd2-81df-6a26f32413a0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:23.994916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-be36bc9a-3d98-4fd2-81df-6a26f32413a0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:24.023740 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-be36bc9a-3d98-4fd2-81df-6a26f32413a0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043588 Jul 27 20:26:24.024404 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 641/1292] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:23 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:24.117425 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-153efb5e-03b3-4aa6-a91b-24c7304c4e91 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:24.119558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-153efb5e-03b3-4aa6-a91b-24c7304c4e91 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:24.126082 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-153efb5e-03b3-4aa6-a91b-24c7304c4e91 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:24.126526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-153efb5e-03b3-4aa6-a91b-24c7304c4e91 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:24.127278 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-153efb5e-03b3-4aa6-a91b-24c7304c4e91 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:24.127712 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-153efb5e-03b3-4aa6-a91b-24c7304c4e91 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:24.155159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-021dbcc6-f17a-4e0a-953a-85b0d546417b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:24.156545 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-153efb5e-03b3-4aa6-a91b-24c7304c4e91 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043118 Jul 27 20:26:24.157127 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 652/1293] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:24 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:24.157409 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-021dbcc6-f17a-4e0a-953a-85b0d546417b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:24.163430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-021dbcc6-f17a-4e0a-953a-85b0d546417b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:24.163879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-021dbcc6-f17a-4e0a-953a-85b0d546417b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:24.164635 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-021dbcc6-f17a-4e0a-953a-85b0d546417b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:24.165102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-021dbcc6-f17a-4e0a-953a-85b0d546417b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:24.193533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-021dbcc6-f17a-4e0a-953a-85b0d546417b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043024 Jul 27 20:26:24.194081 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 642/1294] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:24 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:26:24.846446 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e4e9c7b4-9ee3-4124-8bdf-7c0687ca5ed7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:24.847063 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e4e9c7b4-9ee3-4124-8bdf-7c0687ca5ed7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:24.853603 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4e9c7b4-9ee3-4124-8bdf-7c0687ca5ed7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:24.853603 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4e9c7b4-9ee3-4124-8bdf-7c0687ca5ed7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:24.854356 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4e9c7b4-9ee3-4124-8bdf-7c0687ca5ed7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:24.854778 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4e9c7b4-9ee3-4124-8bdf-7c0687ca5ed7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:24.915543 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e4e9c7b4-9ee3-4124-8bdf-7c0687ca5ed7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:24.923180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e4e9c7b4-9ee3-4124-8bdf-7c0687ca5ed7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080621 Jul 27 20:26:24.923744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 653/1295] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:24 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:25.035796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-37ccb10c-57a8-47e8-bcf6-4675959c8bd9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:25.037995 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-37ccb10c-57a8-47e8-bcf6-4675959c8bd9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:25.044394 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37ccb10c-57a8-47e8-bcf6-4675959c8bd9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:25.044889 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37ccb10c-57a8-47e8-bcf6-4675959c8bd9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:25.045696 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37ccb10c-57a8-47e8-bcf6-4675959c8bd9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:25.046140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37ccb10c-57a8-47e8-bcf6-4675959c8bd9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:25.077013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-37ccb10c-57a8-47e8-bcf6-4675959c8bd9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044842 Jul 27 20:26:25.077650 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 643/1296] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:25 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:25.168988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-84e4ab24-717b-4947-b83f-de2cc3102fc4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:25.171789 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-84e4ab24-717b-4947-b83f-de2cc3102fc4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:25.178167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84e4ab24-717b-4947-b83f-de2cc3102fc4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:25.178617 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84e4ab24-717b-4947-b83f-de2cc3102fc4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:25.179387 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84e4ab24-717b-4947-b83f-de2cc3102fc4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:25.179822 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84e4ab24-717b-4947-b83f-de2cc3102fc4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:25.206412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5c1054fd-0eec-4bcb-b8f0-9efc5388e212 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:25.208659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5c1054fd-0eec-4bcb-b8f0-9efc5388e212 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:25.209541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-84e4ab24-717b-4947-b83f-de2cc3102fc4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044601 Jul 27 20:26:25.210211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 654/1297] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:25 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:25.211538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:25.215569 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c1054fd-0eec-4bcb-b8f0-9efc5388e212 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:25.216018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c1054fd-0eec-4bcb-b8f0-9efc5388e212 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:25.217032 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c1054fd-0eec-4bcb-b8f0-9efc5388e212 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:25.217478 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c1054fd-0eec-4bcb-b8f0-9efc5388e212 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:25.235084 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:25.248651 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5c1054fd-0eec-4bcb-b8f0-9efc5388e212 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046258 Jul 27 20:26:25.249228 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 644/1298] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:25 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:26:25.944299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ff0e2667-6fc9-42a1-8de5-b1dd396acce8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:25.944941 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ff0e2667-6fc9-42a1-8de5-b1dd396acce8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:25.951913 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ff0e2667-6fc9-42a1-8de5-b1dd396acce8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:25.952354 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ff0e2667-6fc9-42a1-8de5-b1dd396acce8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:25.953134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ff0e2667-6fc9-42a1-8de5-b1dd396acce8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:25.953567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ff0e2667-6fc9-42a1-8de5-b1dd396acce8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:26.021911 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ff0e2667-6fc9-42a1-8de5-b1dd396acce8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:26.030147 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ff0e2667-6fc9-42a1-8de5-b1dd396acce8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.089827 Jul 27 20:26:26.030727 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 655/1299] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:25 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:26.089292 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-35a4d6a4-9393-48ac-842f-bd27e49d1792 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:26.092434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-35a4d6a4-9393-48ac-842f-bd27e49d1792 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:26.099150 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35a4d6a4-9393-48ac-842f-bd27e49d1792 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:26.099593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35a4d6a4-9393-48ac-842f-bd27e49d1792 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:26.100364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35a4d6a4-9393-48ac-842f-bd27e49d1792 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:26.100800 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35a4d6a4-9393-48ac-842f-bd27e49d1792 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:26.131572 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-35a4d6a4-9393-48ac-842f-bd27e49d1792 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046301 Jul 27 20:26:26.132127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 645/1300] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:26 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:26.221566 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f44dffca-a9d2-4722-92bb-dc93d511a0a4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:26.223646 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f44dffca-a9d2-4722-92bb-dc93d511a0a4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:26.230090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f44dffca-a9d2-4722-92bb-dc93d511a0a4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:26.230543 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f44dffca-a9d2-4722-92bb-dc93d511a0a4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:26.231295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f44dffca-a9d2-4722-92bb-dc93d511a0a4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:26.232262 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f44dffca-a9d2-4722-92bb-dc93d511a0a4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:26.260893 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f44dffca-a9d2-4722-92bb-dc93d511a0a4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043318 Jul 27 20:26:26.261086 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f6da2188-56dd-4b0f-b609-b2495e9b2265 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:26.261540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 656/1301] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:26 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:26.263265 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f6da2188-56dd-4b0f-b609-b2495e9b2265 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:26.269355 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f6da2188-56dd-4b0f-b609-b2495e9b2265 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:26.269803 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f6da2188-56dd-4b0f-b609-b2495e9b2265 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:26.270564 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f6da2188-56dd-4b0f-b609-b2495e9b2265 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:26.271000 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f6da2188-56dd-4b0f-b609-b2495e9b2265 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:26.303254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f6da2188-56dd-4b0f-b609-b2495e9b2265 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046223 Jul 27 20:26:26.303983 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 646/1302] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:26 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:26:27.050622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7d499649-8bc0-4dd4-b395-42b9447b7793 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:27.051247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7d499649-8bc0-4dd4-b395-42b9447b7793 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:27.057273 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d499649-8bc0-4dd4-b395-42b9447b7793 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:27.057729 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d499649-8bc0-4dd4-b395-42b9447b7793 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:27.058499 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d499649-8bc0-4dd4-b395-42b9447b7793 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:27.058941 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d499649-8bc0-4dd4-b395-42b9447b7793 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:27.123301 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7d499649-8bc0-4dd4-b395-42b9447b7793 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:27.130863 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7d499649-8bc0-4dd4-b395-42b9447b7793 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084181 Jul 27 20:26:27.131432 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 657/1303] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:27 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:27.144388 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fea0e228-2b44-45c7-836e-fdcc580bcc87 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:27.146630 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fea0e228-2b44-45c7-836e-fdcc580bcc87 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:27.153070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fea0e228-2b44-45c7-836e-fdcc580bcc87 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:27.153544 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fea0e228-2b44-45c7-836e-fdcc580bcc87 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:27.154433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fea0e228-2b44-45c7-836e-fdcc580bcc87 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:27.154872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fea0e228-2b44-45c7-836e-fdcc580bcc87 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:27.183043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fea0e228-2b44-45c7-836e-fdcc580bcc87 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042561 Jul 27 20:26:27.183587 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 647/1304] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:27 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:26:27.273325 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-80829338-a3bd-4fe1-a4ac-fcd110ac3fee tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:27.275464 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-80829338-a3bd-4fe1-a4ac-fcd110ac3fee tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:27.282117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-80829338-a3bd-4fe1-a4ac-fcd110ac3fee tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:27.282571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-80829338-a3bd-4fe1-a4ac-fcd110ac3fee tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:27.283338 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-80829338-a3bd-4fe1-a4ac-fcd110ac3fee tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:27.283783 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-80829338-a3bd-4fe1-a4ac-fcd110ac3fee tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:27.300325 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:27.317234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-80829338-a3bd-4fe1-a4ac-fcd110ac3fee tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046623 Jul 27 20:26:27.317823 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 658/1305] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:27 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:27.318091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-737580a7-b3df-4448-a72d-351934a402ce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:27.321897 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-737580a7-b3df-4448-a72d-351934a402ce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:27.331122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-737580a7-b3df-4448-a72d-351934a402ce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:27.331579 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-737580a7-b3df-4448-a72d-351934a402ce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:27.332350 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-737580a7-b3df-4448-a72d-351934a402ce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:27.332785 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-737580a7-b3df-4448-a72d-351934a402ce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:27.361208 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-737580a7-b3df-4448-a72d-351934a402ce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048808 Jul 27 20:26:27.361758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 648/1306] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:27 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:26:28.152566 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-efc75bfd-a670-4ec5-b364-c904467d334f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:28.153204 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-efc75bfd-a670-4ec5-b364-c904467d334f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:28.159665 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-efc75bfd-a670-4ec5-b364-c904467d334f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:28.160107 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-efc75bfd-a670-4ec5-b364-c904467d334f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:28.160863 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-efc75bfd-a670-4ec5-b364-c904467d334f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:28.161321 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-efc75bfd-a670-4ec5-b364-c904467d334f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:28.195720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ab8db3e3-69e4-4b4e-9d39-d28705429dc8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:28.197903 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ab8db3e3-69e4-4b4e-9d39-d28705429dc8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:28.205231 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab8db3e3-69e4-4b4e-9d39-d28705429dc8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:28.205679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab8db3e3-69e4-4b4e-9d39-d28705429dc8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:28.206453 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab8db3e3-69e4-4b4e-9d39-d28705429dc8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:28.206892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab8db3e3-69e4-4b4e-9d39-d28705429dc8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:28.222640 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-efc75bfd-a670-4ec5-b364-c904467d334f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:28.230036 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-efc75bfd-a670-4ec5-b364-c904467d334f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081768 Jul 27 20:26:28.230599 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 659/1307] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:28 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:28.237260 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ab8db3e3-69e4-4b4e-9d39-d28705429dc8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045408 Jul 27 20:26:28.237825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 649/1308] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:28 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:26:28.329842 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4592cfbd-7c39-4292-a54b-303b3ecae1ee tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:28.331900 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4592cfbd-7c39-4292-a54b-303b3ecae1ee tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:28.335207 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:28.339057 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4592cfbd-7c39-4292-a54b-303b3ecae1ee tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:28.339502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4592cfbd-7c39-4292-a54b-303b3ecae1ee tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:28.340255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4592cfbd-7c39-4292-a54b-303b3ecae1ee tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:28.340686 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4592cfbd-7c39-4292-a54b-303b3ecae1ee tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:28.369571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4592cfbd-7c39-4292-a54b-303b3ecae1ee tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043620 Jul 27 20:26:28.370123 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 660/1309] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:28 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:28.374714 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c32e69e4-cd26-4866-bbc7-c75e0587dc45 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:28.376876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c32e69e4-cd26-4866-bbc7-c75e0587dc45 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:28.382920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c32e69e4-cd26-4866-bbc7-c75e0587dc45 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:28.383377 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c32e69e4-cd26-4866-bbc7-c75e0587dc45 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:28.384172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c32e69e4-cd26-4866-bbc7-c75e0587dc45 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:28.384605 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c32e69e4-cd26-4866-bbc7-c75e0587dc45 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:28.412910 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c32e69e4-cd26-4866-bbc7-c75e0587dc45 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043353 Jul 27 20:26:28.413578 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 650/1310] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:28 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:26:29.250188 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-250c24da-1a0f-4c9b-a7a6-b4b2171d8c69 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:29.251819 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-35774b7c-5a0f-43ad-9eee-0a0e6e0f2995 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:29.252319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-250c24da-1a0f-4c9b-a7a6-b4b2171d8c69 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:29.252467 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-35774b7c-5a0f-43ad-9eee-0a0e6e0f2995 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:29.258444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-250c24da-1a0f-4c9b-a7a6-b4b2171d8c69 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:29.258858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35774b7c-5a0f-43ad-9eee-0a0e6e0f2995 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:29.258970 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-250c24da-1a0f-4c9b-a7a6-b4b2171d8c69 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:29.259308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35774b7c-5a0f-43ad-9eee-0a0e6e0f2995 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:29.259642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-250c24da-1a0f-4c9b-a7a6-b4b2171d8c69 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:29.260077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35774b7c-5a0f-43ad-9eee-0a0e6e0f2995 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:29.260185 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-250c24da-1a0f-4c9b-a7a6-b4b2171d8c69 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:29.260516 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35774b7c-5a0f-43ad-9eee-0a0e6e0f2995 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:29.289940 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-250c24da-1a0f-4c9b-a7a6-b4b2171d8c69 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044353 Jul 27 20:26:29.290704 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 661/1311] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:29 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:29.327378 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-35774b7c-5a0f-43ad-9eee-0a0e6e0f2995 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:29.334901 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-35774b7c-5a0f-43ad-9eee-0a0e6e0f2995 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.087746 Jul 27 20:26:29.335460 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 651/1312] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:29 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:26:29.382488 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-eab1d34d-301b-445a-a037-15dd775f2a96 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:29.384622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-eab1d34d-301b-445a-a037-15dd775f2a96 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:29.391812 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eab1d34d-301b-445a-a037-15dd775f2a96 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:29.392284 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eab1d34d-301b-445a-a037-15dd775f2a96 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:29.393061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eab1d34d-301b-445a-a037-15dd775f2a96 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:29.393497 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eab1d34d-301b-445a-a037-15dd775f2a96 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:29.422038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-eab1d34d-301b-445a-a037-15dd775f2a96 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043330 Jul 27 20:26:29.422590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 662/1313] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:29 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:29.425424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8a508c64-2409-4e72-9553-0856ce2327a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:29.427589 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8a508c64-2409-4e72-9553-0856ce2327a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:29.433624 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8a508c64-2409-4e72-9553-0856ce2327a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:29.434059 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8a508c64-2409-4e72-9553-0856ce2327a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:29.435390 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8a508c64-2409-4e72-9553-0856ce2327a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:29.435823 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8a508c64-2409-4e72-9553-0856ce2327a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:29.465881 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8a508c64-2409-4e72-9553-0856ce2327a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044420 Jul 27 20:26:29.466626 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 652/1314] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:29 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:26:30.301953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2d8fb28f-a9f0-4bd0-a9bd-efec183f0a5f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:30.304098 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2d8fb28f-a9f0-4bd0-a9bd-efec183f0a5f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:30.310477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d8fb28f-a9f0-4bd0-a9bd-efec183f0a5f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:30.310978 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d8fb28f-a9f0-4bd0-a9bd-efec183f0a5f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:30.311755 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d8fb28f-a9f0-4bd0-a9bd-efec183f0a5f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:30.312197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d8fb28f-a9f0-4bd0-a9bd-efec183f0a5f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:30.342115 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2d8fb28f-a9f0-4bd0-a9bd-efec183f0a5f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043386 Jul 27 20:26:30.342919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 663/1315] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:30 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:30.355268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c61f0dab-5cdf-4334-9a1f-043d7419623b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:30.355907 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c61f0dab-5cdf-4334-9a1f-043d7419623b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:30.363085 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c61f0dab-5cdf-4334-9a1f-043d7419623b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:30.363529 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c61f0dab-5cdf-4334-9a1f-043d7419623b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:30.364289 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c61f0dab-5cdf-4334-9a1f-043d7419623b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:30.364728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c61f0dab-5cdf-4334-9a1f-043d7419623b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:30.436011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e8c08e5b-29c4-44c2-bdd5-54299cfedba1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:30.438237 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e8c08e5b-29c4-44c2-bdd5-54299cfedba1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:30.439877 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c61f0dab-5cdf-4334-9a1f-043d7419623b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:30.444828 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8c08e5b-29c4-44c2-bdd5-54299cfedba1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:30.445329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8c08e5b-29c4-44c2-bdd5-54299cfedba1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:30.446102 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8c08e5b-29c4-44c2-bdd5-54299cfedba1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:30.446540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8c08e5b-29c4-44c2-bdd5-54299cfedba1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:30.447680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c61f0dab-5cdf-4334-9a1f-043d7419623b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.096200 Jul 27 20:26:30.448489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 653/1316] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:30 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:30.477682 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e8c08e5b-29c4-44c2-bdd5-54299cfedba1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045609 Jul 27 20:26:30.478425 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2866e9a9-1386-461b-a4ce-5de45aa62a69 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:30.478561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 664/1317] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:30 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:26:30.480339 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2866e9a9-1386-461b-a4ce-5de45aa62a69 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:30.486432 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2866e9a9-1386-461b-a4ce-5de45aa62a69 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:30.486890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2866e9a9-1386-461b-a4ce-5de45aa62a69 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:30.487665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2866e9a9-1386-461b-a4ce-5de45aa62a69 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:30.488122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2866e9a9-1386-461b-a4ce-5de45aa62a69 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:30.518993 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2866e9a9-1386-461b-a4ce-5de45aa62a69 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044761 Jul 27 20:26:30.519475 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 654/1318] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:30 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:26:31.354647 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0fb5a0b5-7fc3-4d00-b72d-7f458b42d15d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:31.357630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0fb5a0b5-7fc3-4d00-b72d-7f458b42d15d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:31.363597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0fb5a0b5-7fc3-4d00-b72d-7f458b42d15d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:31.364047 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0fb5a0b5-7fc3-4d00-b72d-7f458b42d15d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:31.364798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0fb5a0b5-7fc3-4d00-b72d-7f458b42d15d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:31.365266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0fb5a0b5-7fc3-4d00-b72d-7f458b42d15d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:31.394619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0fb5a0b5-7fc3-4d00-b72d-7f458b42d15d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043922 Jul 27 20:26:31.395175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 665/1319] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:31 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:31.469149 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a035e9d1-11ed-4d28-951b-1e38bfc38867 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:31.469754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a035e9d1-11ed-4d28-951b-1e38bfc38867 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:31.476164 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a035e9d1-11ed-4d28-951b-1e38bfc38867 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:31.476609 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a035e9d1-11ed-4d28-951b-1e38bfc38867 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:31.477395 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a035e9d1-11ed-4d28-951b-1e38bfc38867 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:31.477825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a035e9d1-11ed-4d28-951b-1e38bfc38867 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:31.490088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f40797ce-4e13-4b45-851e-c2ccfe6c5657 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:31.492227 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f40797ce-4e13-4b45-851e-c2ccfe6c5657 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:31.499264 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f40797ce-4e13-4b45-851e-c2ccfe6c5657 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:31.499730 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f40797ce-4e13-4b45-851e-c2ccfe6c5657 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:31.500507 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f40797ce-4e13-4b45-851e-c2ccfe6c5657 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:31.500951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f40797ce-4e13-4b45-851e-c2ccfe6c5657 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:31.531288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f40797ce-4e13-4b45-851e-c2ccfe6c5657 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045038 Jul 27 20:26:31.531854 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 666/1320] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:31 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:26:31.536557 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-097de276-c61d-47a0-9a14-d5cf3b7ae685 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:31.538692 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-097de276-c61d-47a0-9a14-d5cf3b7ae685 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:31.539961 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a035e9d1-11ed-4d28-951b-1e38bfc38867 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:31.545192 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-097de276-c61d-47a0-9a14-d5cf3b7ae685 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:31.545683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-097de276-c61d-47a0-9a14-d5cf3b7ae685 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:31.546505 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-097de276-c61d-47a0-9a14-d5cf3b7ae685 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:31.546938 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-097de276-c61d-47a0-9a14-d5cf3b7ae685 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:31.548251 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a035e9d1-11ed-4d28-951b-1e38bfc38867 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082979 Jul 27 20:26:31.548814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 655/1321] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:31 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:31.575718 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-097de276-c61d-47a0-9a14-d5cf3b7ae685 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042485 Jul 27 20:26:31.576429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 667/1322] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:31 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:32.406927 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4ebb2e17-8a02-4df2-ab6c-5420070ba537 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:32.409080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4ebb2e17-8a02-4df2-ab6c-5420070ba537 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:32.415091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ebb2e17-8a02-4df2-ab6c-5420070ba537 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:32.415532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ebb2e17-8a02-4df2-ab6c-5420070ba537 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:32.416283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ebb2e17-8a02-4df2-ab6c-5420070ba537 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:32.416713 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ebb2e17-8a02-4df2-ab6c-5420070ba537 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:32.444957 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4ebb2e17-8a02-4df2-ab6c-5420070ba537 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042039 Jul 27 20:26:32.445519 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 656/1323] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:32 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:32.543314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a39d5910-447d-41ab-a82d-5ff891484b35 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:32.545733 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a39d5910-447d-41ab-a82d-5ff891484b35 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:32.551892 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a39d5910-447d-41ab-a82d-5ff891484b35 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:32.552351 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a39d5910-447d-41ab-a82d-5ff891484b35 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:32.553155 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a39d5910-447d-41ab-a82d-5ff891484b35 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:32.553599 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a39d5910-447d-41ab-a82d-5ff891484b35 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:32.568859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-153627e8-2a26-48d6-9411-f8ba4bc5e549 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:32.569486 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-153627e8-2a26-48d6-9411-f8ba4bc5e549 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:32.576761 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-153627e8-2a26-48d6-9411-f8ba4bc5e549 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:32.577227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-153627e8-2a26-48d6-9411-f8ba4bc5e549 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:32.577981 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-153627e8-2a26-48d6-9411-f8ba4bc5e549 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:32.578415 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-153627e8-2a26-48d6-9411-f8ba4bc5e549 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:32.583877 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a39d5910-447d-41ab-a82d-5ff891484b35 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044531 Jul 27 20:26:32.584446 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 668/1324] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:32 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:32.589056 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6eb58ead-6371-483f-9d79-040024f9db13 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:32.591283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6eb58ead-6371-483f-9d79-040024f9db13 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:32.597264 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6eb58ead-6371-483f-9d79-040024f9db13 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:32.597720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6eb58ead-6371-483f-9d79-040024f9db13 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:32.598499 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6eb58ead-6371-483f-9d79-040024f9db13 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:32.598946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6eb58ead-6371-483f-9d79-040024f9db13 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:32.628616 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6eb58ead-6371-483f-9d79-040024f9db13 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043122 Jul 27 20:26:32.629221 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 669/1325] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:32 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:32.642943 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-153627e8-2a26-48d6-9411-f8ba4bc5e549 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:32.650427 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-153627e8-2a26-48d6-9411-f8ba4bc5e549 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.085387 Jul 27 20:26:32.650980 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 657/1326] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:32 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:26:33.457749 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5f4fb648-46cb-4209-956a-7bc99bbfc92d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:33.459931 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5f4fb648-46cb-4209-956a-7bc99bbfc92d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:33.466683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5f4fb648-46cb-4209-956a-7bc99bbfc92d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:33.467163 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5f4fb648-46cb-4209-956a-7bc99bbfc92d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:33.467932 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5f4fb648-46cb-4209-956a-7bc99bbfc92d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:33.468373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5f4fb648-46cb-4209-956a-7bc99bbfc92d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:33.496830 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5f4fb648-46cb-4209-956a-7bc99bbfc92d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043025 Jul 27 20:26:33.497477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 670/1327] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:33 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:33.596645 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7606dc99-b787-4cc8-8f66-9cf96a502e10 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:33.598811 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7606dc99-b787-4cc8-8f66-9cf96a502e10 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:33.605405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7606dc99-b787-4cc8-8f66-9cf96a502e10 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:33.605859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7606dc99-b787-4cc8-8f66-9cf96a502e10 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:33.606641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7606dc99-b787-4cc8-8f66-9cf96a502e10 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:33.607081 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7606dc99-b787-4cc8-8f66-9cf96a502e10 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:33.635155 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7606dc99-b787-4cc8-8f66-9cf96a502e10 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042499 Jul 27 20:26:33.635794 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 658/1328] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:33 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:26:33.641788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b30b526f-8a3c-43c0-9001-2e5441fbdc13 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:33.644774 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b30b526f-8a3c-43c0-9001-2e5441fbdc13 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:33.651288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b30b526f-8a3c-43c0-9001-2e5441fbdc13 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:33.651744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b30b526f-8a3c-43c0-9001-2e5441fbdc13 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:33.652513 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b30b526f-8a3c-43c0-9001-2e5441fbdc13 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:33.652956 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b30b526f-8a3c-43c0-9001-2e5441fbdc13 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:33.670651 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a0b60ef2-5935-45c9-bda0-7ed0c5163be5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:33.671249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a0b60ef2-5935-45c9-bda0-7ed0c5163be5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:33.677266 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0b60ef2-5935-45c9-bda0-7ed0c5163be5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:33.677711 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0b60ef2-5935-45c9-bda0-7ed0c5163be5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:33.678463 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0b60ef2-5935-45c9-bda0-7ed0c5163be5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:33.678891 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0b60ef2-5935-45c9-bda0-7ed0c5163be5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:33.682229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b30b526f-8a3c-43c0-9001-2e5441fbdc13 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044844 Jul 27 20:26:33.682802 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 671/1329] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:33 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:33.740124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a0b60ef2-5935-45c9-bda0-7ed0c5163be5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:33.747872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a0b60ef2-5935-45c9-bda0-7ed0c5163be5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080771 Jul 27 20:26:33.748433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 659/1330] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:33 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:26:34.509265 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-157a4cfb-8db3-42e6-84b9-ab417f41d2e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:34.511436 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-157a4cfb-8db3-42e6-84b9-ab417f41d2e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:34.517578 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-157a4cfb-8db3-42e6-84b9-ab417f41d2e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:34.518036 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-157a4cfb-8db3-42e6-84b9-ab417f41d2e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:34.518804 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-157a4cfb-8db3-42e6-84b9-ab417f41d2e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:34.519249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-157a4cfb-8db3-42e6-84b9-ab417f41d2e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:34.548741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-157a4cfb-8db3-42e6-84b9-ab417f41d2e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043500 Jul 27 20:26:34.549325 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 672/1331] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:34 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:34.647870 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7d90cf38-9ca9-4b35-9e2d-016e00854c75 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:34.650154 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7d90cf38-9ca9-4b35-9e2d-016e00854c75 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:34.657198 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d90cf38-9ca9-4b35-9e2d-016e00854c75 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:34.657640 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d90cf38-9ca9-4b35-9e2d-016e00854c75 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:34.658389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d90cf38-9ca9-4b35-9e2d-016e00854c75 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:34.658843 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d90cf38-9ca9-4b35-9e2d-016e00854c75 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:34.687225 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7d90cf38-9ca9-4b35-9e2d-016e00854c75 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043231 Jul 27 20:26:34.687764 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 660/1332] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:34 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:34.694571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0d3ebabd-314b-4384-99c4-a9592e3f6e1c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:34.696712 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0d3ebabd-314b-4384-99c4-a9592e3f6e1c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:34.703698 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0d3ebabd-314b-4384-99c4-a9592e3f6e1c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:34.704150 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0d3ebabd-314b-4384-99c4-a9592e3f6e1c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:34.704913 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0d3ebabd-314b-4384-99c4-a9592e3f6e1c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:34.705379 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0d3ebabd-314b-4384-99c4-a9592e3f6e1c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:34.734982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0d3ebabd-314b-4384-99c4-a9592e3f6e1c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044355 Jul 27 20:26:34.735531 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 673/1333] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:34 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:34.768564 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-60ef8575-3e18-4721-abf9-aa27bdf341fa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:34.769163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-60ef8575-3e18-4721-abf9-aa27bdf341fa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:34.776406 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60ef8575-3e18-4721-abf9-aa27bdf341fa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:34.776854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60ef8575-3e18-4721-abf9-aa27bdf341fa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:34.777665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60ef8575-3e18-4721-abf9-aa27bdf341fa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:34.778133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60ef8575-3e18-4721-abf9-aa27bdf341fa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:34.783891 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:34.840430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-60ef8575-3e18-4721-abf9-aa27bdf341fa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:34.848511 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-60ef8575-3e18-4721-abf9-aa27bdf341fa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083839 Jul 27 20:26:34.849105 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 661/1334] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:34 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:35.562058 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7fcbe7cc-9a5b-42d4-879e-198b122dfe08 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:35.564226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7fcbe7cc-9a5b-42d4-879e-198b122dfe08 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:35.570248 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7fcbe7cc-9a5b-42d4-879e-198b122dfe08 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:35.570706 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7fcbe7cc-9a5b-42d4-879e-198b122dfe08 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:35.571467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7fcbe7cc-9a5b-42d4-879e-198b122dfe08 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:35.571906 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7fcbe7cc-9a5b-42d4-879e-198b122dfe08 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:35.601096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7fcbe7cc-9a5b-42d4-879e-198b122dfe08 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043861 Jul 27 20:26:35.601582 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 674/1335] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:35 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:35.699903 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3688e7aa-7d29-4960-80c6-ad07e800497a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:35.702349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3688e7aa-7d29-4960-80c6-ad07e800497a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:35.708829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3688e7aa-7d29-4960-80c6-ad07e800497a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:35.709315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3688e7aa-7d29-4960-80c6-ad07e800497a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:35.710079 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3688e7aa-7d29-4960-80c6-ad07e800497a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:35.710517 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3688e7aa-7d29-4960-80c6-ad07e800497a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:35.739126 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3688e7aa-7d29-4960-80c6-ad07e800497a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043159 Jul 27 20:26:35.739666 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 662/1336] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:35 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:35.747327 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6751da4e-2206-4676-91b5-c41e5b87cc9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:35.750154 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6751da4e-2206-4676-91b5-c41e5b87cc9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:35.756657 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6751da4e-2206-4676-91b5-c41e5b87cc9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:35.757165 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6751da4e-2206-4676-91b5-c41e5b87cc9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:35.757937 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6751da4e-2206-4676-91b5-c41e5b87cc9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:35.758384 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6751da4e-2206-4676-91b5-c41e5b87cc9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:35.761952 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:35.788086 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6751da4e-2206-4676-91b5-c41e5b87cc9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044825 Jul 27 20:26:35.788639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 675/1337] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:35 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:35.869876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e815b6ad-ff31-4d6d-8643-64e634d272c0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:35.870422 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e815b6ad-ff31-4d6d-8643-64e634d272c0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:35.877202 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e815b6ad-ff31-4d6d-8643-64e634d272c0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:35.877651 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e815b6ad-ff31-4d6d-8643-64e634d272c0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:35.878405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e815b6ad-ff31-4d6d-8643-64e634d272c0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:35.878836 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e815b6ad-ff31-4d6d-8643-64e634d272c0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:35.937828 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e815b6ad-ff31-4d6d-8643-64e634d272c0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:35.945140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e815b6ad-ff31-4d6d-8643-64e634d272c0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.079082 Jul 27 20:26:35.945701 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 663/1338] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:35 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:36.613872 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a45a8662-5071-45ce-878f-ca94c89ff375 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:36.615989 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a45a8662-5071-45ce-878f-ca94c89ff375 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:36.621961 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a45a8662-5071-45ce-878f-ca94c89ff375 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:36.622405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a45a8662-5071-45ce-878f-ca94c89ff375 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:36.623760 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a45a8662-5071-45ce-878f-ca94c89ff375 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:36.624192 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a45a8662-5071-45ce-878f-ca94c89ff375 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:36.653118 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a45a8662-5071-45ce-878f-ca94c89ff375 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043093 Jul 27 20:26:36.653675 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 676/1339] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:36 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:36.752061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cd3fdf29-57df-4459-b960-56c52ad44e1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:36.754261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cd3fdf29-57df-4459-b960-56c52ad44e1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:36.760682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd3fdf29-57df-4459-b960-56c52ad44e1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:36.761167 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd3fdf29-57df-4459-b960-56c52ad44e1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:36.761927 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd3fdf29-57df-4459-b960-56c52ad44e1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:36.762358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd3fdf29-57df-4459-b960-56c52ad44e1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:36.792066 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cd3fdf29-57df-4459-b960-56c52ad44e1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044683 Jul 27 20:26:36.792627 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 664/1340] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:36 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:36.800490 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6fec9f6d-540d-48f6-badf-bd4a952bb070 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:36.802728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6fec9f6d-540d-48f6-badf-bd4a952bb070 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:36.809204 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6fec9f6d-540d-48f6-badf-bd4a952bb070 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:36.809652 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6fec9f6d-540d-48f6-badf-bd4a952bb070 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:36.810406 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6fec9f6d-540d-48f6-badf-bd4a952bb070 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:36.811068 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6fec9f6d-540d-48f6-badf-bd4a952bb070 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:36.840304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6fec9f6d-540d-48f6-badf-bd4a952bb070 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043751 Jul 27 20:26:36.840858 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 677/1341] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:36 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:36.966042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6bdbdd84-be2a-4208-9bd8-ef137a132061 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:36.966655 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6bdbdd84-be2a-4208-9bd8-ef137a132061 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:36.973638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6bdbdd84-be2a-4208-9bd8-ef137a132061 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:36.974113 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6bdbdd84-be2a-4208-9bd8-ef137a132061 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:36.974898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6bdbdd84-be2a-4208-9bd8-ef137a132061 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:36.975332 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6bdbdd84-be2a-4208-9bd8-ef137a132061 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:37.039429 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6bdbdd84-be2a-4208-9bd8-ef137a132061 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:37.049482 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6bdbdd84-be2a-4208-9bd8-ef137a132061 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.087197 Jul 27 20:26:37.050068 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 665/1342] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:36 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:37.665646 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0a0a91f6-edbd-408c-9103-9be2b5745bd7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:37.667777 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0a0a91f6-edbd-408c-9103-9be2b5745bd7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:37.674670 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a0a91f6-edbd-408c-9103-9be2b5745bd7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:37.675128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a0a91f6-edbd-408c-9103-9be2b5745bd7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:37.676215 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a0a91f6-edbd-408c-9103-9be2b5745bd7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:37.676334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a0a91f6-edbd-408c-9103-9be2b5745bd7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:37.706906 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0a0a91f6-edbd-408c-9103-9be2b5745bd7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045152 Jul 27 20:26:37.707469 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 678/1343] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:37 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:37.804681 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b6f1f121-e048-4b74-97ea-cebf2530e41c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:37.806853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b6f1f121-e048-4b74-97ea-cebf2530e41c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:37.813615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6f1f121-e048-4b74-97ea-cebf2530e41c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:37.814068 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6f1f121-e048-4b74-97ea-cebf2530e41c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:37.814829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6f1f121-e048-4b74-97ea-cebf2530e41c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:37.815266 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6f1f121-e048-4b74-97ea-cebf2530e41c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:37.843950 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b6f1f121-e048-4b74-97ea-cebf2530e41c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043170 Jul 27 20:26:37.844489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 666/1344] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:37 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:37.853260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4afe078c-a8c6-4ba3-9b43-ba463b1aacf1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:37.855379 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4afe078c-a8c6-4ba3-9b43-ba463b1aacf1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:37.862398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4afe078c-a8c6-4ba3-9b43-ba463b1aacf1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:37.862843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4afe078c-a8c6-4ba3-9b43-ba463b1aacf1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:37.863594 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4afe078c-a8c6-4ba3-9b43-ba463b1aacf1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:37.864026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4afe078c-a8c6-4ba3-9b43-ba463b1aacf1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:37.892460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4afe078c-a8c6-4ba3-9b43-ba463b1aacf1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043088 Jul 27 20:26:37.893022 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 679/1345] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:37 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:38.070239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d998697f-4f00-488c-beac-67d45f2fa068 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:38.070779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d998697f-4f00-488c-beac-67d45f2fa068 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:38.078266 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d998697f-4f00-488c-beac-67d45f2fa068 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:38.078709 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d998697f-4f00-488c-beac-67d45f2fa068 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:38.079468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d998697f-4f00-488c-beac-67d45f2fa068 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:38.079897 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d998697f-4f00-488c-beac-67d45f2fa068 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:38.366723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d998697f-4f00-488c-beac-67d45f2fa068 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:38.374165 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d998697f-4f00-488c-beac-67d45f2fa068 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.307846 Jul 27 20:26:38.374720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 667/1346] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:38 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:38.719772 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3deab1ff-58ad-4801-aa0d-2275134d92e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:38.721968 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3deab1ff-58ad-4801-aa0d-2275134d92e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:38.728048 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3deab1ff-58ad-4801-aa0d-2275134d92e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:38.728502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3deab1ff-58ad-4801-aa0d-2275134d92e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:38.729306 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3deab1ff-58ad-4801-aa0d-2275134d92e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:38.729750 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3deab1ff-58ad-4801-aa0d-2275134d92e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:38.757526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3deab1ff-58ad-4801-aa0d-2275134d92e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042444 Jul 27 20:26:38.758074 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 680/1347] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:38 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:38.855707 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-766466a3-1e52-4729-bbbc-5c7cdeb7ff3d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:38.858232 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-766466a3-1e52-4729-bbbc-5c7cdeb7ff3d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:38.864655 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-766466a3-1e52-4729-bbbc-5c7cdeb7ff3d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:38.865140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-766466a3-1e52-4729-bbbc-5c7cdeb7ff3d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:38.865908 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-766466a3-1e52-4729-bbbc-5c7cdeb7ff3d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:38.866345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-766466a3-1e52-4729-bbbc-5c7cdeb7ff3d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:38.895482 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-766466a3-1e52-4729-bbbc-5c7cdeb7ff3d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043752 Jul 27 20:26:38.896026 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 668/1348] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:38 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:38.904087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c62b4679-e04b-4bb3-bf4d-568fc3b99157 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:38.907068 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c62b4679-e04b-4bb3-bf4d-568fc3b99157 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:38.913506 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c62b4679-e04b-4bb3-bf4d-568fc3b99157 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:38.913964 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c62b4679-e04b-4bb3-bf4d-568fc3b99157 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:38.914738 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c62b4679-e04b-4bb3-bf4d-568fc3b99157 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:38.915181 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c62b4679-e04b-4bb3-bf4d-568fc3b99157 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:38.943057 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c62b4679-e04b-4bb3-bf4d-568fc3b99157 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042906 Jul 27 20:26:38.943606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 681/1349] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:38 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:39.395456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e4598a1d-af91-4fec-bdd0-948188398eee tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:39.396067 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e4598a1d-af91-4fec-bdd0-948188398eee tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:39.402122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4598a1d-af91-4fec-bdd0-948188398eee tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:39.402570 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4598a1d-af91-4fec-bdd0-948188398eee tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:39.403317 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4598a1d-af91-4fec-bdd0-948188398eee tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:39.403746 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4598a1d-af91-4fec-bdd0-948188398eee tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:39.465964 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e4598a1d-af91-4fec-bdd0-948188398eee tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:39.474261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e4598a1d-af91-4fec-bdd0-948188398eee tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082700 Jul 27 20:26:39.474815 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 669/1350] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:39 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:39.770201 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a5c84548-2307-46ee-aaf1-1fc07db91916 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:39.772313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a5c84548-2307-46ee-aaf1-1fc07db91916 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:39.778318 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a5c84548-2307-46ee-aaf1-1fc07db91916 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:39.778762 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a5c84548-2307-46ee-aaf1-1fc07db91916 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:39.780181 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a5c84548-2307-46ee-aaf1-1fc07db91916 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:39.780616 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a5c84548-2307-46ee-aaf1-1fc07db91916 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:39.808126 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a5c84548-2307-46ee-aaf1-1fc07db91916 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041878 Jul 27 20:26:39.808665 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 682/1351] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:39 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:39.907896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7ccdbf24-9a7e-442e-bb72-26fb7c70d6e6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:39.910092 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7ccdbf24-9a7e-442e-bb72-26fb7c70d6e6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:39.916536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ccdbf24-9a7e-442e-bb72-26fb7c70d6e6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:39.917001 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ccdbf24-9a7e-442e-bb72-26fb7c70d6e6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:39.917765 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ccdbf24-9a7e-442e-bb72-26fb7c70d6e6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:39.918195 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ccdbf24-9a7e-442e-bb72-26fb7c70d6e6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:39.946783 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7ccdbf24-9a7e-442e-bb72-26fb7c70d6e6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042921 Jul 27 20:26:39.947317 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 670/1352] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:39 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:39.955564 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fa247c63-ef2c-4bda-8e13-6227540fe844 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:39.957732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fa247c63-ef2c-4bda-8e13-6227540fe844 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:39.964304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa247c63-ef2c-4bda-8e13-6227540fe844 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:39.964759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa247c63-ef2c-4bda-8e13-6227540fe844 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:39.965565 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa247c63-ef2c-4bda-8e13-6227540fe844 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:39.966041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa247c63-ef2c-4bda-8e13-6227540fe844 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:39.994527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fa247c63-ef2c-4bda-8e13-6227540fe844 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043523 Jul 27 20:26:39.995083 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 683/1353] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:39 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:40.495065 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0edde9bc-4f50-45d0-a6d5-2de6d1004fb1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:40.495670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0edde9bc-4f50-45d0-a6d5-2de6d1004fb1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:40.501614 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0edde9bc-4f50-45d0-a6d5-2de6d1004fb1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:40.502058 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0edde9bc-4f50-45d0-a6d5-2de6d1004fb1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:40.502807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0edde9bc-4f50-45d0-a6d5-2de6d1004fb1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:40.503237 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0edde9bc-4f50-45d0-a6d5-2de6d1004fb1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:40.562987 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0edde9bc-4f50-45d0-a6d5-2de6d1004fb1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:40.570277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0edde9bc-4f50-45d0-a6d5-2de6d1004fb1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.079091 Jul 27 20:26:40.570833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 671/1354] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:40 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:40.727253 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:26:40.727486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:26:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:26:40.821235 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9bfc6c42-d426-45f3-a00b-c15bc0cea629 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:40.823294 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9bfc6c42-d426-45f3-a00b-c15bc0cea629 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:40.830322 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9bfc6c42-d426-45f3-a00b-c15bc0cea629 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:40.830761 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9bfc6c42-d426-45f3-a00b-c15bc0cea629 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:40.831530 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9bfc6c42-d426-45f3-a00b-c15bc0cea629 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:40.831970 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9bfc6c42-d426-45f3-a00b-c15bc0cea629 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:40.860212 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9bfc6c42-d426-45f3-a00b-c15bc0cea629 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043015 Jul 27 20:26:40.860754 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 684/1355] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:40 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:40.960343 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7f7aad1b-5430-4749-a4a1-345e3f7972dd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:40.962527 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7f7aad1b-5430-4749-a4a1-345e3f7972dd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:40.969231 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7f7aad1b-5430-4749-a4a1-345e3f7972dd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:40.969680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7f7aad1b-5430-4749-a4a1-345e3f7972dd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:40.970446 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7f7aad1b-5430-4749-a4a1-345e3f7972dd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:40.970881 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7f7aad1b-5430-4749-a4a1-345e3f7972dd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:41.000283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7f7aad1b-5430-4749-a4a1-345e3f7972dd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043868 Jul 27 20:26:41.000832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 672/1356] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:40 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:41.007693 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c5491448-56f8-4a83-837b-e6adafa6afd4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:41.009891 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c5491448-56f8-4a83-837b-e6adafa6afd4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:41.016460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c5491448-56f8-4a83-837b-e6adafa6afd4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:41.016913 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c5491448-56f8-4a83-837b-e6adafa6afd4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:41.017698 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c5491448-56f8-4a83-837b-e6adafa6afd4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:41.018138 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c5491448-56f8-4a83-837b-e6adafa6afd4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:41.046764 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c5491448-56f8-4a83-837b-e6adafa6afd4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042924 Jul 27 20:26:41.047305 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 685/1357] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:41 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:41.592453 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-76273f24-a965-410f-9563-27c0b8965f0a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:41.593100 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-76273f24-a965-410f-9563-27c0b8965f0a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:41.599218 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76273f24-a965-410f-9563-27c0b8965f0a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:41.599662 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76273f24-a965-410f-9563-27c0b8965f0a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:41.600411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76273f24-a965-410f-9563-27c0b8965f0a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:41.600836 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76273f24-a965-410f-9563-27c0b8965f0a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:41.664544 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-76273f24-a965-410f-9563-27c0b8965f0a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:41.672185 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-76273f24-a965-410f-9563-27c0b8965f0a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084236 Jul 27 20:26:41.672763 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 673/1358] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:41 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:41.871860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7bd0d2c8-379b-451f-af98-7d6ee9858001 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:41.873996 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7bd0d2c8-379b-451f-af98-7d6ee9858001 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:41.880051 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7bd0d2c8-379b-451f-af98-7d6ee9858001 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:41.880512 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7bd0d2c8-379b-451f-af98-7d6ee9858001 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:41.881304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7bd0d2c8-379b-451f-af98-7d6ee9858001 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:41.881748 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7bd0d2c8-379b-451f-af98-7d6ee9858001 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:41.912991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7bd0d2c8-379b-451f-af98-7d6ee9858001 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045121 Jul 27 20:26:41.913564 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 686/1359] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:41 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:42.012306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ed5502e7-22e5-46ae-b687-5c445ff005b1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:42.015391 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ed5502e7-22e5-46ae-b687-5c445ff005b1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:42.021754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed5502e7-22e5-46ae-b687-5c445ff005b1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:42.022199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed5502e7-22e5-46ae-b687-5c445ff005b1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:42.022952 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed5502e7-22e5-46ae-b687-5c445ff005b1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:42.023380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed5502e7-22e5-46ae-b687-5c445ff005b1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:42.052015 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ed5502e7-22e5-46ae-b687-5c445ff005b1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043667 Jul 27 20:26:42.052740 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 674/1360] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:42 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:42.059258 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-eb2e3dd7-8bc2-4931-b2b1-dec955bfd37b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:42.061996 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-eb2e3dd7-8bc2-4931-b2b1-dec955bfd37b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:42.068372 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eb2e3dd7-8bc2-4931-b2b1-dec955bfd37b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:42.068826 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eb2e3dd7-8bc2-4931-b2b1-dec955bfd37b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:42.069650 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eb2e3dd7-8bc2-4931-b2b1-dec955bfd37b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:42.070093 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eb2e3dd7-8bc2-4931-b2b1-dec955bfd37b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:42.100258 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-eb2e3dd7-8bc2-4931-b2b1-dec955bfd37b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044863 Jul 27 20:26:42.100810 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 687/1361] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:42 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:42.693000 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d298998b-015a-4b96-9426-677cec7e2bcd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:42.693606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d298998b-015a-4b96-9426-677cec7e2bcd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:42.699675 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d298998b-015a-4b96-9426-677cec7e2bcd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:42.700387 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d298998b-015a-4b96-9426-677cec7e2bcd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:42.701235 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d298998b-015a-4b96-9426-677cec7e2bcd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:42.701700 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d298998b-015a-4b96-9426-677cec7e2bcd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:42.765551 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d298998b-015a-4b96-9426-677cec7e2bcd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:42.772891 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d298998b-015a-4b96-9426-677cec7e2bcd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083833 Jul 27 20:26:42.773484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 675/1362] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:42 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:42.925783 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-35dc5be1-6b51-40c6-9389-2ad09bb7dd92 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:42.927893 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-35dc5be1-6b51-40c6-9389-2ad09bb7dd92 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:42.933877 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-35dc5be1-6b51-40c6-9389-2ad09bb7dd92 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:42.934321 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-35dc5be1-6b51-40c6-9389-2ad09bb7dd92 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:42.935072 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-35dc5be1-6b51-40c6-9389-2ad09bb7dd92 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:42.935503 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-35dc5be1-6b51-40c6-9389-2ad09bb7dd92 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:42.964416 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-35dc5be1-6b51-40c6-9389-2ad09bb7dd92 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042492 Jul 27 20:26:42.965076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 688/1363] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:42 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:43.064069 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9f0cad8b-1d73-4689-b145-384ed3ee275b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:43.066318 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9f0cad8b-1d73-4689-b145-384ed3ee275b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:43.072788 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f0cad8b-1d73-4689-b145-384ed3ee275b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:43.073276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f0cad8b-1d73-4689-b145-384ed3ee275b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:43.074042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f0cad8b-1d73-4689-b145-384ed3ee275b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:43.074475 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f0cad8b-1d73-4689-b145-384ed3ee275b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:43.104897 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9f0cad8b-1d73-4689-b145-384ed3ee275b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044796 Jul 27 20:26:43.105502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 676/1364] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:43 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:43.112678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fa92e96c-32b6-4cf8-a855-1dcd3fc6a608 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:43.114882 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fa92e96c-32b6-4cf8-a855-1dcd3fc6a608 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:43.121339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa92e96c-32b6-4cf8-a855-1dcd3fc6a608 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:43.121798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa92e96c-32b6-4cf8-a855-1dcd3fc6a608 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:43.122565 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa92e96c-32b6-4cf8-a855-1dcd3fc6a608 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:43.123122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa92e96c-32b6-4cf8-a855-1dcd3fc6a608 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:43.152599 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fa92e96c-32b6-4cf8-a855-1dcd3fc6a608 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044218 Jul 27 20:26:43.153181 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 689/1365] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:43 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:26:43.793849 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a56fbee8-ec90-4806-870b-8baa5ed1957f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:43.794467 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a56fbee8-ec90-4806-870b-8baa5ed1957f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:43.800628 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a56fbee8-ec90-4806-870b-8baa5ed1957f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:43.801112 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a56fbee8-ec90-4806-870b-8baa5ed1957f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:43.801875 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a56fbee8-ec90-4806-870b-8baa5ed1957f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:43.802320 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a56fbee8-ec90-4806-870b-8baa5ed1957f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:43.862041 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a56fbee8-ec90-4806-870b-8baa5ed1957f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:43.865384 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:43.870450 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a56fbee8-ec90-4806-870b-8baa5ed1957f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080485 Jul 27 20:26:43.871006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 677/1366] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:43 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:43.977201 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d45fb040-4a37-490c-8b2c-3274edb7598d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:43.979400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d45fb040-4a37-490c-8b2c-3274edb7598d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:43.986148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d45fb040-4a37-490c-8b2c-3274edb7598d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:43.986606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d45fb040-4a37-490c-8b2c-3274edb7598d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:43.987379 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d45fb040-4a37-490c-8b2c-3274edb7598d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:43.987821 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d45fb040-4a37-490c-8b2c-3274edb7598d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:44.023513 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d45fb040-4a37-490c-8b2c-3274edb7598d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050294 Jul 27 20:26:44.024072 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 690/1367] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:43 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:44.117998 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6103e1d9-2279-4ca7-b182-a2d122ca263c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:44.120160 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6103e1d9-2279-4ca7-b182-a2d122ca263c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:44.127571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6103e1d9-2279-4ca7-b182-a2d122ca263c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:44.128023 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6103e1d9-2279-4ca7-b182-a2d122ca263c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:44.128789 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6103e1d9-2279-4ca7-b182-a2d122ca263c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:44.129254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6103e1d9-2279-4ca7-b182-a2d122ca263c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:44.157730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6103e1d9-2279-4ca7-b182-a2d122ca263c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043685 Jul 27 20:26:44.158280 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 678/1368] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:44 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:44.165658 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7e0bc28e-7d02-48d5-9c1d-8085a57c3f00 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:44.167772 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7e0bc28e-7d02-48d5-9c1d-8085a57c3f00 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:44.174705 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7e0bc28e-7d02-48d5-9c1d-8085a57c3f00 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:44.175199 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7e0bc28e-7d02-48d5-9c1d-8085a57c3f00 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:44.175954 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7e0bc28e-7d02-48d5-9c1d-8085a57c3f00 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:44.176386 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7e0bc28e-7d02-48d5-9c1d-8085a57c3f00 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:44.201104 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:44.206188 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7e0bc28e-7d02-48d5-9c1d-8085a57c3f00 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044477 Jul 27 20:26:44.206740 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 691/1369] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:44 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:44.892006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e1526037-842d-468a-9c66-1768c983e814 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:44.892611 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e1526037-842d-468a-9c66-1768c983e814 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:44.898655 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1526037-842d-468a-9c66-1768c983e814 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:44.899101 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1526037-842d-468a-9c66-1768c983e814 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:44.899858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1526037-842d-468a-9c66-1768c983e814 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:44.900436 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1526037-842d-468a-9c66-1768c983e814 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:44.960133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e1526037-842d-468a-9c66-1768c983e814 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:44.968491 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e1526037-842d-468a-9c66-1768c983e814 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080811 Jul 27 20:26:44.969075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 679/1370] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:44 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:45.036577 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-04776e58-9aa9-43ce-93e8-c27f201ac36c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:45.038742 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-04776e58-9aa9-43ce-93e8-c27f201ac36c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:45.044820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-04776e58-9aa9-43ce-93e8-c27f201ac36c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:45.045370 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-04776e58-9aa9-43ce-93e8-c27f201ac36c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:45.046148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-04776e58-9aa9-43ce-93e8-c27f201ac36c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:45.046588 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-04776e58-9aa9-43ce-93e8-c27f201ac36c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:45.075893 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-04776e58-9aa9-43ce-93e8-c27f201ac36c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042979 Jul 27 20:26:45.076775 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 692/1371] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:45 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:45.169690 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-634d6285-de61-4277-a6c7-c8ba25b95b28 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:45.171791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-634d6285-de61-4277-a6c7-c8ba25b95b28 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:45.178329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-634d6285-de61-4277-a6c7-c8ba25b95b28 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:45.178783 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-634d6285-de61-4277-a6c7-c8ba25b95b28 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:45.179550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-634d6285-de61-4277-a6c7-c8ba25b95b28 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:45.179982 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-634d6285-de61-4277-a6c7-c8ba25b95b28 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:45.209947 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-634d6285-de61-4277-a6c7-c8ba25b95b28 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044289 Jul 27 20:26:45.210497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 680/1372] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:45 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:45.218626 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a9aa76f8-f3d4-44d7-bab3-a7e9119e82e5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:45.220784 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a9aa76f8-f3d4-44d7-bab3-a7e9119e82e5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:45.227328 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a9aa76f8-f3d4-44d7-bab3-a7e9119e82e5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:45.227782 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a9aa76f8-f3d4-44d7-bab3-a7e9119e82e5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:45.228546 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a9aa76f8-f3d4-44d7-bab3-a7e9119e82e5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:45.229016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a9aa76f8-f3d4-44d7-bab3-a7e9119e82e5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:45.257593 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a9aa76f8-f3d4-44d7-bab3-a7e9119e82e5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043067 Jul 27 20:26:45.258143 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 693/1373] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:45 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:45.989033 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-024d5ae0-15a2-44bf-8160-7d14017ae9ec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:45.989639 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-024d5ae0-15a2-44bf-8160-7d14017ae9ec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:45.995647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-024d5ae0-15a2-44bf-8160-7d14017ae9ec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:45.996091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-024d5ae0-15a2-44bf-8160-7d14017ae9ec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:45.996843 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-024d5ae0-15a2-44bf-8160-7d14017ae9ec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:45.997333 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-024d5ae0-15a2-44bf-8160-7d14017ae9ec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:46.058181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-024d5ae0-15a2-44bf-8160-7d14017ae9ec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:46.065718 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-024d5ae0-15a2-44bf-8160-7d14017ae9ec tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080627 Jul 27 20:26:46.066280 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 681/1374] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:45 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:46.087782 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f4c2203d-6dac-4962-bf76-f9a87b7e59b0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:46.090058 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f4c2203d-6dac-4962-bf76-f9a87b7e59b0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:46.096815 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f4c2203d-6dac-4962-bf76-f9a87b7e59b0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:46.097308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f4c2203d-6dac-4962-bf76-f9a87b7e59b0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:46.098088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f4c2203d-6dac-4962-bf76-f9a87b7e59b0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:46.098530 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f4c2203d-6dac-4962-bf76-f9a87b7e59b0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:46.127542 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f4c2203d-6dac-4962-bf76-f9a87b7e59b0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043725 Jul 27 20:26:46.128105 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 694/1375] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:46 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:46.222931 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-97a13536-9249-462f-9363-2cb729e92852 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:46.225175 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-97a13536-9249-462f-9363-2cb729e92852 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:46.231618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97a13536-9249-462f-9363-2cb729e92852 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:46.232083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97a13536-9249-462f-9363-2cb729e92852 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:46.233013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97a13536-9249-462f-9363-2cb729e92852 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:46.233452 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97a13536-9249-462f-9363-2cb729e92852 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:46.261471 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-97a13536-9249-462f-9363-2cb729e92852 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042423 Jul 27 20:26:46.261949 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 682/1376] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:46 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:46.270455 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ebca70ec-f338-44c4-8f87-8ed0b19a8603 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:46.272588 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ebca70ec-f338-44c4-8f87-8ed0b19a8603 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:46.278989 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ebca70ec-f338-44c4-8f87-8ed0b19a8603 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:46.280104 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ebca70ec-f338-44c4-8f87-8ed0b19a8603 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:46.280856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ebca70ec-f338-44c4-8f87-8ed0b19a8603 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:46.281410 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ebca70ec-f338-44c4-8f87-8ed0b19a8603 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:46.308989 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ebca70ec-f338-44c4-8f87-8ed0b19a8603 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042435 Jul 27 20:26:46.309546 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 695/1377] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:46 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:46.924878 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:26:46.925181 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:26:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:26:47.086564 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-058289a9-cf1c-43b9-aedf-91850032891d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:47.087173 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-058289a9-cf1c-43b9-aedf-91850032891d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:47.093285 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-058289a9-cf1c-43b9-aedf-91850032891d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:47.093729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-058289a9-cf1c-43b9-aedf-91850032891d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:47.094491 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-058289a9-cf1c-43b9-aedf-91850032891d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:47.094922 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-058289a9-cf1c-43b9-aedf-91850032891d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:47.139756 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c5aefea8-88b4-4b2b-817e-a1c2c0a0f672 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:47.141900 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c5aefea8-88b4-4b2b-817e-a1c2c0a0f672 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:47.148012 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c5aefea8-88b4-4b2b-817e-a1c2c0a0f672 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:47.148459 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c5aefea8-88b4-4b2b-817e-a1c2c0a0f672 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:47.149260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c5aefea8-88b4-4b2b-817e-a1c2c0a0f672 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:47.149694 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c5aefea8-88b4-4b2b-817e-a1c2c0a0f672 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:47.158585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-058289a9-cf1c-43b9-aedf-91850032891d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:47.166190 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-058289a9-cf1c-43b9-aedf-91850032891d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083396 Jul 27 20:26:47.166876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 683/1378] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:47 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:47.179056 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c5aefea8-88b4-4b2b-817e-a1c2c0a0f672 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043202 Jul 27 20:26:47.179530 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 696/1379] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:47 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:26:47.274756 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e93f024e-28f5-4c65-bb89-0f4ff0ef9d08 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:47.277096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e93f024e-28f5-4c65-bb89-0f4ff0ef9d08 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:47.284713 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e93f024e-28f5-4c65-bb89-0f4ff0ef9d08 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:47.285192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e93f024e-28f5-4c65-bb89-0f4ff0ef9d08 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:47.285954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e93f024e-28f5-4c65-bb89-0f4ff0ef9d08 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:47.286389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e93f024e-28f5-4c65-bb89-0f4ff0ef9d08 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:47.316293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e93f024e-28f5-4c65-bb89-0f4ff0ef9d08 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045990 Jul 27 20:26:47.316717 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 684/1380] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:47 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:47.321573 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1b9892b3-b77b-46a4-a18a-5f79c6ac2d41 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:47.323702 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1b9892b3-b77b-46a4-a18a-5f79c6ac2d41 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:47.330472 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1b9892b3-b77b-46a4-a18a-5f79c6ac2d41 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:47.330925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1b9892b3-b77b-46a4-a18a-5f79c6ac2d41 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:47.331688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1b9892b3-b77b-46a4-a18a-5f79c6ac2d41 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:47.332130 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1b9892b3-b77b-46a4-a18a-5f79c6ac2d41 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:47.361925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1b9892b3-b77b-46a4-a18a-5f79c6ac2d41 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044266 Jul 27 20:26:47.362482 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 697/1381] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:47 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:48.188427 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4e34b363-70cd-4df8-9081-f24e7e5c3319 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:48.189052 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4e34b363-70cd-4df8-9081-f24e7e5c3319 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:48.191396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bc282db8-3fb2-4aa6-adaa-75384b06a30e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:48.193694 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bc282db8-3fb2-4aa6-adaa-75384b06a30e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:48.195192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e34b363-70cd-4df8-9081-f24e7e5c3319 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:48.195635 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e34b363-70cd-4df8-9081-f24e7e5c3319 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:48.196388 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e34b363-70cd-4df8-9081-f24e7e5c3319 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:48.196814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e34b363-70cd-4df8-9081-f24e7e5c3319 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:48.199606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bc282db8-3fb2-4aa6-adaa-75384b06a30e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:48.200065 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bc282db8-3fb2-4aa6-adaa-75384b06a30e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:48.201805 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bc282db8-3fb2-4aa6-adaa-75384b06a30e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:48.202258 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bc282db8-3fb2-4aa6-adaa-75384b06a30e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:48.230843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bc282db8-3fb2-4aa6-adaa-75384b06a30e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043274 Jul 27 20:26:48.231412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 698/1382] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:48 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:26:48.257276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4e34b363-70cd-4df8-9081-f24e7e5c3319 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:48.265653 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4e34b363-70cd-4df8-9081-f24e7e5c3319 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081760 Jul 27 20:26:48.266206 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 685/1383] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:48 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:48.328582 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f86e5777-ed28-4a3e-ac9f-223bef251601 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:48.330701 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f86e5777-ed28-4a3e-ac9f-223bef251601 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:48.337260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f86e5777-ed28-4a3e-ac9f-223bef251601 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:48.337713 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f86e5777-ed28-4a3e-ac9f-223bef251601 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:48.338480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f86e5777-ed28-4a3e-ac9f-223bef251601 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:48.338924 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f86e5777-ed28-4a3e-ac9f-223bef251601 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:48.367232 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f86e5777-ed28-4a3e-ac9f-223bef251601 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043497 Jul 27 20:26:48.367985 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 699/1384] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:48 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:48.374763 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-91273a7d-d46f-407b-ac39-466b550cbc72 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:48.376891 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-91273a7d-d46f-407b-ac39-466b550cbc72 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:48.383402 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-91273a7d-d46f-407b-ac39-466b550cbc72 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:48.383847 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-91273a7d-d46f-407b-ac39-466b550cbc72 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:48.384608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-91273a7d-d46f-407b-ac39-466b550cbc72 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:48.385065 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-91273a7d-d46f-407b-ac39-466b550cbc72 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:48.413739 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-91273a7d-d46f-407b-ac39-466b550cbc72 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043586 Jul 27 20:26:48.414285 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 686/1385] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:48 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:49.243447 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9914743b-ced6-4001-9166-30b527ff854d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:49.245599 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9914743b-ced6-4001-9166-30b527ff854d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:49.251665 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9914743b-ced6-4001-9166-30b527ff854d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:49.252120 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9914743b-ced6-4001-9166-30b527ff854d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:49.252890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9914743b-ced6-4001-9166-30b527ff854d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:49.253360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9914743b-ced6-4001-9166-30b527ff854d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:49.282592 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9914743b-ced6-4001-9166-30b527ff854d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043195 Jul 27 20:26:49.283152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 700/1386] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:49 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:49.286210 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c1936bbd-ecea-44bb-a2af-401028df73d2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:49.286816 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c1936bbd-ecea-44bb-a2af-401028df73d2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:49.292751 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1936bbd-ecea-44bb-a2af-401028df73d2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:49.293243 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1936bbd-ecea-44bb-a2af-401028df73d2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:49.293993 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1936bbd-ecea-44bb-a2af-401028df73d2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:49.294421 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1936bbd-ecea-44bb-a2af-401028df73d2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:49.355476 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c1936bbd-ecea-44bb-a2af-401028df73d2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:49.363144 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c1936bbd-ecea-44bb-a2af-401028df73d2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080752 Jul 27 20:26:49.363707 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 687/1387] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:49 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:26:49.379518 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f8c29e28-1ee8-445f-89f4-745d81cbc6a6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:49.381704 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f8c29e28-1ee8-445f-89f4-745d81cbc6a6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:49.388040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f8c29e28-1ee8-445f-89f4-745d81cbc6a6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:49.389678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f8c29e28-1ee8-445f-89f4-745d81cbc6a6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:49.389923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f8c29e28-1ee8-445f-89f4-745d81cbc6a6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:49.390360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f8c29e28-1ee8-445f-89f4-745d81cbc6a6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:49.425386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f8928ccb-4b53-4d23-83df-a785a87fc608 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:49.426134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f8c29e28-1ee8-445f-89f4-745d81cbc6a6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050479 Jul 27 20:26:49.426697 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 701/1388] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:49 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:49.427551 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f8928ccb-4b53-4d23-83df-a785a87fc608 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:49.433997 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8928ccb-4b53-4d23-83df-a785a87fc608 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:49.434438 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8928ccb-4b53-4d23-83df-a785a87fc608 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:49.435217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8928ccb-4b53-4d23-83df-a785a87fc608 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:49.435689 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8928ccb-4b53-4d23-83df-a785a87fc608 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:49.464754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f8928ccb-4b53-4d23-83df-a785a87fc608 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043318 Jul 27 20:26:49.465329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 688/1389] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:49 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:26:50.294232 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6041881e-10ce-4df7-8fac-2c930b167bfe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:50.296956 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6041881e-10ce-4df7-8fac-2c930b167bfe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:50.303062 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6041881e-10ce-4df7-8fac-2c930b167bfe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:50.303519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6041881e-10ce-4df7-8fac-2c930b167bfe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:50.304282 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6041881e-10ce-4df7-8fac-2c930b167bfe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:50.304729 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6041881e-10ce-4df7-8fac-2c930b167bfe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:50.333418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6041881e-10ce-4df7-8fac-2c930b167bfe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043017 Jul 27 20:26:50.333902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 702/1390] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:50 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:50.383597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ac7223ad-35b8-4161-ad6a-1fe977363c06 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:50.384199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ac7223ad-35b8-4161-ad6a-1fe977363c06 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:50.390348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ac7223ad-35b8-4161-ad6a-1fe977363c06 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:50.390784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ac7223ad-35b8-4161-ad6a-1fe977363c06 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:50.391533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ac7223ad-35b8-4161-ad6a-1fe977363c06 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:50.391958 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ac7223ad-35b8-4161-ad6a-1fe977363c06 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:50.438514 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2527e494-f98a-4d3e-a98f-edf3e6edaeeb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:50.440709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2527e494-f98a-4d3e-a98f-edf3e6edaeeb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:50.447292 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2527e494-f98a-4d3e-a98f-edf3e6edaeeb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:50.447744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2527e494-f98a-4d3e-a98f-edf3e6edaeeb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:50.448511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2527e494-f98a-4d3e-a98f-edf3e6edaeeb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:50.448952 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2527e494-f98a-4d3e-a98f-edf3e6edaeeb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:50.452486 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ac7223ad-35b8-4161-ad6a-1fe977363c06 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:50.459904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ac7223ad-35b8-4161-ad6a-1fe977363c06 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080194 Jul 27 20:26:50.460658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 689/1391] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:50 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:50.477558 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d7bade1d-c214-469a-9c5e-450851c6a473 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:50.479682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d7bade1d-c214-469a-9c5e-450851c6a473 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:50.479790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2527e494-f98a-4d3e-a98f-edf3e6edaeeb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045419 Jul 27 20:26:50.480241 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 703/1392] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:50 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:26:50.486392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d7bade1d-c214-469a-9c5e-450851c6a473 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:50.486838 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d7bade1d-c214-469a-9c5e-450851c6a473 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:50.487597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d7bade1d-c214-469a-9c5e-450851c6a473 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:50.488028 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d7bade1d-c214-469a-9c5e-450851c6a473 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:50.516158 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d7bade1d-c214-469a-9c5e-450851c6a473 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042290 Jul 27 20:26:50.516698 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 690/1393] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:50 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:26:51.344865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-328795d5-e2d9-4ce9-9963-cd7b41913ccb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:51.347094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-328795d5-e2d9-4ce9-9963-cd7b41913ccb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:51.353213 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-328795d5-e2d9-4ce9-9963-cd7b41913ccb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:51.353661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-328795d5-e2d9-4ce9-9963-cd7b41913ccb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:51.354416 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-328795d5-e2d9-4ce9-9963-cd7b41913ccb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:51.354860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-328795d5-e2d9-4ce9-9963-cd7b41913ccb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:51.383221 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-328795d5-e2d9-4ce9-9963-cd7b41913ccb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042375 Jul 27 20:26:51.383766 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 704/1394] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:51 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:51.481169 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fe16185d-4a6f-450f-8f75-25113aac534f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:51.481817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fe16185d-4a6f-450f-8f75-25113aac534f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:51.488859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe16185d-4a6f-450f-8f75-25113aac534f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:51.489340 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe16185d-4a6f-450f-8f75-25113aac534f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:51.490105 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe16185d-4a6f-450f-8f75-25113aac534f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:51.490550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe16185d-4a6f-450f-8f75-25113aac534f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:51.492746 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e2acb553-3636-43ab-8b73-0e2fe1277b2d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:51.494973 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e2acb553-3636-43ab-8b73-0e2fe1277b2d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:51.507214 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e2acb553-3636-43ab-8b73-0e2fe1277b2d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:51.507674 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e2acb553-3636-43ab-8b73-0e2fe1277b2d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:51.508475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e2acb553-3636-43ab-8b73-0e2fe1277b2d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:51.508900 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e2acb553-3636-43ab-8b73-0e2fe1277b2d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:51.538845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e2acb553-3636-43ab-8b73-0e2fe1277b2d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049901 Jul 27 20:26:51.539422 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 705/1395] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:51 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:26:51.544165 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-868cf30e-7b80-4e19-95e7-b8ed7abbb05f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:51.546820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-868cf30e-7b80-4e19-95e7-b8ed7abbb05f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:51.552708 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-868cf30e-7b80-4e19-95e7-b8ed7abbb05f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:51.553199 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-868cf30e-7b80-4e19-95e7-b8ed7abbb05f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:51.553966 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-868cf30e-7b80-4e19-95e7-b8ed7abbb05f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:51.554683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-868cf30e-7b80-4e19-95e7-b8ed7abbb05f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:51.556531 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fe16185d-4a6f-450f-8f75-25113aac534f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:51.564654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fe16185d-4a6f-450f-8f75-25113aac534f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.087393 Jul 27 20:26:51.565248 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 691/1396] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:51 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:51.583982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-868cf30e-7b80-4e19-95e7-b8ed7abbb05f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043539 Jul 27 20:26:51.584537 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 706/1397] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:51 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:52.396047 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e2948c4f-3cd4-4b9d-bd21-9b7d088d8e86 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:52.398234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e2948c4f-3cd4-4b9d-bd21-9b7d088d8e86 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:52.406589 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2948c4f-3cd4-4b9d-bd21-9b7d088d8e86 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:52.407040 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2948c4f-3cd4-4b9d-bd21-9b7d088d8e86 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:52.407858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2948c4f-3cd4-4b9d-bd21-9b7d088d8e86 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:52.408583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2948c4f-3cd4-4b9d-bd21-9b7d088d8e86 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:52.446282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e2948c4f-3cd4-4b9d-bd21-9b7d088d8e86 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054143 Jul 27 20:26:52.446869 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 692/1398] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:52 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:52.550505 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2855b1b6-6e17-4e43-9154-feb948846569 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:52.552647 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2855b1b6-6e17-4e43-9154-feb948846569 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:52.559123 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2855b1b6-6e17-4e43-9154-feb948846569 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:52.559575 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2855b1b6-6e17-4e43-9154-feb948846569 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:52.560899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2855b1b6-6e17-4e43-9154-feb948846569 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:52.561373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2855b1b6-6e17-4e43-9154-feb948846569 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:52.585058 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ecc2c2c1-8577-47f2-9818-ed9cd76ac6ab tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:52.585670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ecc2c2c1-8577-47f2-9818-ed9cd76ac6ab tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:52.590857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2855b1b6-6e17-4e43-9154-feb948846569 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044242 Jul 27 20:26:52.591498 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 707/1399] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:52 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:52.592348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ecc2c2c1-8577-47f2-9818-ed9cd76ac6ab tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:52.592823 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ecc2c2c1-8577-47f2-9818-ed9cd76ac6ab tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:52.593729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ecc2c2c1-8577-47f2-9818-ed9cd76ac6ab tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:52.594161 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ecc2c2c1-8577-47f2-9818-ed9cd76ac6ab tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:52.596539 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-56de7735-2791-467c-b9d6-9b30114abc9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:52.598698 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-56de7735-2791-467c-b9d6-9b30114abc9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:52.604584 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56de7735-2791-467c-b9d6-9b30114abc9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:52.605068 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56de7735-2791-467c-b9d6-9b30114abc9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:52.605848 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56de7735-2791-467c-b9d6-9b30114abc9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:52.606291 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56de7735-2791-467c-b9d6-9b30114abc9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:52.624364 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:52.639198 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-56de7735-2791-467c-b9d6-9b30114abc9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045659 Jul 27 20:26:52.639781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 708/1400] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:52 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:52.656035 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ecc2c2c1-8577-47f2-9818-ed9cd76ac6ab tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:52.663553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ecc2c2c1-8577-47f2-9818-ed9cd76ac6ab tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082376 Jul 27 20:26:52.664105 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 693/1401] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:52 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:26:53.460031 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-80041a74-fcfe-42db-9fbb-82bf65d3428e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:53.462195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-80041a74-fcfe-42db-9fbb-82bf65d3428e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:53.468857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-80041a74-fcfe-42db-9fbb-82bf65d3428e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:53.469331 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-80041a74-fcfe-42db-9fbb-82bf65d3428e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:53.470091 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-80041a74-fcfe-42db-9fbb-82bf65d3428e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:53.470524 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-80041a74-fcfe-42db-9fbb-82bf65d3428e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:53.499083 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-80041a74-fcfe-42db-9fbb-82bf65d3428e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043101 Jul 27 20:26:53.499628 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 709/1402] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:53 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:53.603123 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e1f2e66e-90bd-4f77-8c0a-f6a87cb4e083 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:53.605225 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e1f2e66e-90bd-4f77-8c0a-f6a87cb4e083 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:53.609495 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:53.613387 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1f2e66e-90bd-4f77-8c0a-f6a87cb4e083 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:53.613835 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1f2e66e-90bd-4f77-8c0a-f6a87cb4e083 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:53.614595 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1f2e66e-90bd-4f77-8c0a-f6a87cb4e083 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:53.615033 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1f2e66e-90bd-4f77-8c0a-f6a87cb4e083 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:53.631261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:53.645018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e1f2e66e-90bd-4f77-8c0a-f6a87cb4e083 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045881 Jul 27 20:26:53.645579 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 694/1403] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:53 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:53.651528 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3ac8b7d1-f527-4857-a10c-766466db197c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:53.653684 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3ac8b7d1-f527-4857-a10c-766466db197c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:53.657767 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:26:53.661911 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3ac8b7d1-f527-4857-a10c-766466db197c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:53.662367 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3ac8b7d1-f527-4857-a10c-766466db197c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:53.663134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3ac8b7d1-f527-4857-a10c-766466db197c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:53.663575 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3ac8b7d1-f527-4857-a10c-766466db197c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:53.683544 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5a03f15f-2297-4397-a0ed-ef6d9909f42a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:53.684162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5a03f15f-2297-4397-a0ed-ef6d9909f42a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:53.690145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a03f15f-2297-4397-a0ed-ef6d9909f42a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:53.690602 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a03f15f-2297-4397-a0ed-ef6d9909f42a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:53.691373 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a03f15f-2297-4397-a0ed-ef6d9909f42a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:53.691811 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a03f15f-2297-4397-a0ed-ef6d9909f42a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:53.692522 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3ac8b7d1-f527-4857-a10c-766466db197c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044973 Jul 27 20:26:53.693112 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 710/1404] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:53 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:53.752551 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5a03f15f-2297-4397-a0ed-ef6d9909f42a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:53.759958 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5a03f15f-2297-4397-a0ed-ef6d9909f42a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080200 Jul 27 20:26:53.760515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 695/1405] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:53 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:26:54.511412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-40942c41-b9da-48b5-831e-97d541befbd1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:54.513608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-40942c41-b9da-48b5-831e-97d541befbd1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:54.519781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-40942c41-b9da-48b5-831e-97d541befbd1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:54.520232 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-40942c41-b9da-48b5-831e-97d541befbd1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:54.521024 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-40942c41-b9da-48b5-831e-97d541befbd1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:54.521465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-40942c41-b9da-48b5-831e-97d541befbd1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:54.550103 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-40942c41-b9da-48b5-831e-97d541befbd1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042639 Jul 27 20:26:54.550642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 711/1406] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:54 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:54.657223 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9304aec6-a612-4099-b785-c152a0a0b8ff tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:54.659373 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9304aec6-a612-4099-b785-c152a0a0b8ff tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:54.666003 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9304aec6-a612-4099-b785-c152a0a0b8ff tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:54.666449 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9304aec6-a612-4099-b785-c152a0a0b8ff tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:54.667213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9304aec6-a612-4099-b785-c152a0a0b8ff tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:54.667646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9304aec6-a612-4099-b785-c152a0a0b8ff tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:54.699201 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9304aec6-a612-4099-b785-c152a0a0b8ff tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046109 Jul 27 20:26:54.699754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 696/1407] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:54 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:54.705259 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ed150909-4c53-4c32-9c3e-fa83baf10a32 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:54.707467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ed150909-4c53-4c32-9c3e-fa83baf10a32 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:54.713902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ed150909-4c53-4c32-9c3e-fa83baf10a32 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:54.714351 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ed150909-4c53-4c32-9c3e-fa83baf10a32 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:54.715106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ed150909-4c53-4c32-9c3e-fa83baf10a32 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:54.715571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ed150909-4c53-4c32-9c3e-fa83baf10a32 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:54.744534 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ed150909-4c53-4c32-9c3e-fa83baf10a32 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043196 Jul 27 20:26:54.745112 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 712/1408] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:54 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:26:54.781343 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-89ae24ff-f48b-4673-bc1d-e372cfc489fc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:54.781908 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-89ae24ff-f48b-4673-bc1d-e372cfc489fc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:54.787802 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-89ae24ff-f48b-4673-bc1d-e372cfc489fc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:54.788217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-89ae24ff-f48b-4673-bc1d-e372cfc489fc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:54.788981 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-89ae24ff-f48b-4673-bc1d-e372cfc489fc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:54.789407 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-89ae24ff-f48b-4673-bc1d-e372cfc489fc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:54.850602 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-89ae24ff-f48b-4673-bc1d-e372cfc489fc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:54.858861 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-89ae24ff-f48b-4673-bc1d-e372cfc489fc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081927 Jul 27 20:26:54.859420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 697/1409] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:54 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:55.562572 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7064bc02-58db-4fa5-8ac2-3c4c453b9443 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:55.564717 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7064bc02-58db-4fa5-8ac2-3c4c453b9443 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:55.570899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7064bc02-58db-4fa5-8ac2-3c4c453b9443 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:55.571635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7064bc02-58db-4fa5-8ac2-3c4c453b9443 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:55.572391 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7064bc02-58db-4fa5-8ac2-3c4c453b9443 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:55.572828 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7064bc02-58db-4fa5-8ac2-3c4c453b9443 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:55.602740 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7064bc02-58db-4fa5-8ac2-3c4c453b9443 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044367 Jul 27 20:26:55.603228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 713/1410] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:55 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:55.711534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-60679e0a-0b15-4baa-a45b-fc15807fe68c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:55.713668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-60679e0a-0b15-4baa-a45b-fc15807fe68c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:55.720661 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60679e0a-0b15-4baa-a45b-fc15807fe68c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:55.721143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60679e0a-0b15-4baa-a45b-fc15807fe68c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:55.721894 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60679e0a-0b15-4baa-a45b-fc15807fe68c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:55.722322 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60679e0a-0b15-4baa-a45b-fc15807fe68c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:55.750573 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-60679e0a-0b15-4baa-a45b-fc15807fe68c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043082 Jul 27 20:26:55.751106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 698/1411] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:55 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:55.758473 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-90c23faa-5e3f-4ac3-8f79-26e51f890418 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:55.760605 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-90c23faa-5e3f-4ac3-8f79-26e51f890418 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:55.767948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90c23faa-5e3f-4ac3-8f79-26e51f890418 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:55.768389 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90c23faa-5e3f-4ac3-8f79-26e51f890418 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:55.769198 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90c23faa-5e3f-4ac3-8f79-26e51f890418 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:55.769640 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90c23faa-5e3f-4ac3-8f79-26e51f890418 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:55.799015 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-90c23faa-5e3f-4ac3-8f79-26e51f890418 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044450 Jul 27 20:26:55.799564 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 714/1412] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:55 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:55.879492 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-aaaa6bf8-abbc-4b6b-9dc6-d68cc9f17ac9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:55.880030 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-aaaa6bf8-abbc-4b6b-9dc6-d68cc9f17ac9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:55.886048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aaaa6bf8-abbc-4b6b-9dc6-d68cc9f17ac9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:55.886490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aaaa6bf8-abbc-4b6b-9dc6-d68cc9f17ac9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:55.887233 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aaaa6bf8-abbc-4b6b-9dc6-d68cc9f17ac9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:55.887659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aaaa6bf8-abbc-4b6b-9dc6-d68cc9f17ac9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:55.949643 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aaaa6bf8-abbc-4b6b-9dc6-d68cc9f17ac9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:55.957861 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-aaaa6bf8-abbc-4b6b-9dc6-d68cc9f17ac9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082248 Jul 27 20:26:55.958412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 699/1413] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:55 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:56.614743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-598a6d3d-4baa-4c72-9c16-d75ee85c883e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:56.616843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-598a6d3d-4baa-4c72-9c16-d75ee85c883e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:56.623447 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-598a6d3d-4baa-4c72-9c16-d75ee85c883e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:56.623897 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-598a6d3d-4baa-4c72-9c16-d75ee85c883e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:56.624665 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-598a6d3d-4baa-4c72-9c16-d75ee85c883e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:56.625106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-598a6d3d-4baa-4c72-9c16-d75ee85c883e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:56.653439 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-598a6d3d-4baa-4c72-9c16-d75ee85c883e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042605 Jul 27 20:26:56.654097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 715/1414] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:56 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:56.762608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4a9dfb41-2781-4eee-86f8-aa532dcbaef8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:56.764935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4a9dfb41-2781-4eee-86f8-aa532dcbaef8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:56.771448 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a9dfb41-2781-4eee-86f8-aa532dcbaef8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:56.771896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a9dfb41-2781-4eee-86f8-aa532dcbaef8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:56.772659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a9dfb41-2781-4eee-86f8-aa532dcbaef8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:56.773125 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a9dfb41-2781-4eee-86f8-aa532dcbaef8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:56.802171 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4a9dfb41-2781-4eee-86f8-aa532dcbaef8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043458 Jul 27 20:26:56.802723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 700/1415] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:56 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:56.813386 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3d57a9a9-427b-4c20-bd1a-2dee5e9be4bc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:56.815597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3d57a9a9-427b-4c20-bd1a-2dee5e9be4bc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:56.822264 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3d57a9a9-427b-4c20-bd1a-2dee5e9be4bc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:56.822710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3d57a9a9-427b-4c20-bd1a-2dee5e9be4bc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:56.823486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3d57a9a9-427b-4c20-bd1a-2dee5e9be4bc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:56.823903 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3d57a9a9-427b-4c20-bd1a-2dee5e9be4bc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:56.851950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3d57a9a9-427b-4c20-bd1a-2dee5e9be4bc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044289 Jul 27 20:26:56.852494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 716/1416] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:56 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:56.978576 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0879033a-489c-4dbf-bbae-2857c5fd7028 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:56.979191 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0879033a-489c-4dbf-bbae-2857c5fd7028 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:56.985868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0879033a-489c-4dbf-bbae-2857c5fd7028 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:56.986321 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0879033a-489c-4dbf-bbae-2857c5fd7028 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:56.987081 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0879033a-489c-4dbf-bbae-2857c5fd7028 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:56.987516 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0879033a-489c-4dbf-bbae-2857c5fd7028 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:57.048287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0879033a-489c-4dbf-bbae-2857c5fd7028 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:57.055895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0879033a-489c-4dbf-bbae-2857c5fd7028 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081231 Jul 27 20:26:57.056488 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 701/1417] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:56 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:57.666148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e4856b19-0689-44e2-a325-1a9a44209903 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:57.668301 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e4856b19-0689-44e2-a325-1a9a44209903 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:57.674445 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4856b19-0689-44e2-a325-1a9a44209903 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:57.674895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4856b19-0689-44e2-a325-1a9a44209903 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:57.675659 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4856b19-0689-44e2-a325-1a9a44209903 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:57.676095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4856b19-0689-44e2-a325-1a9a44209903 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:57.705627 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e4856b19-0689-44e2-a325-1a9a44209903 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043334 Jul 27 20:26:57.706179 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 717/1418] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:57 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:57.815257 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5cc06e6b-0407-449e-8bfe-84c31451c194 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:57.817433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5cc06e6b-0407-449e-8bfe-84c31451c194 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:57.823879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5cc06e6b-0407-449e-8bfe-84c31451c194 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:57.824328 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5cc06e6b-0407-449e-8bfe-84c31451c194 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:57.825122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5cc06e6b-0407-449e-8bfe-84c31451c194 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:57.826434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5cc06e6b-0407-449e-8bfe-84c31451c194 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:57.854676 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5cc06e6b-0407-449e-8bfe-84c31451c194 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043474 Jul 27 20:26:57.855222 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 702/1419] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:57 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:57.863744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d76590e6-2a77-452a-b4db-8255446d3978 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:57.865902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d76590e6-2a77-452a-b4db-8255446d3978 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:57.872298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d76590e6-2a77-452a-b4db-8255446d3978 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:57.873321 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d76590e6-2a77-452a-b4db-8255446d3978 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:57.874135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d76590e6-2a77-452a-b4db-8255446d3978 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:57.874584 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d76590e6-2a77-452a-b4db-8255446d3978 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:57.903761 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d76590e6-2a77-452a-b4db-8255446d3978 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043979 Jul 27 20:26:57.904332 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 718/1420] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:57 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:58.077285 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-39928014-e747-410f-9b99-12861d86a6bf tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:58.077891 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-39928014-e747-410f-9b99-12861d86a6bf tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:58.083823 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39928014-e747-410f-9b99-12861d86a6bf tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:58.084265 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39928014-e747-410f-9b99-12861d86a6bf tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:58.085046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39928014-e747-410f-9b99-12861d86a6bf tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:58.085476 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39928014-e747-410f-9b99-12861d86a6bf tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:58.147819 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-39928014-e747-410f-9b99-12861d86a6bf tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:58.155446 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-39928014-e747-410f-9b99-12861d86a6bf tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082922 Jul 27 20:26:58.156013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 703/1421] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:58 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:58.717164 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7e675455-ec7c-41f3-92ce-4ae4348df917 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:58.719328 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7e675455-ec7c-41f3-92ce-4ae4348df917 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:58.725396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7e675455-ec7c-41f3-92ce-4ae4348df917 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:58.725846 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7e675455-ec7c-41f3-92ce-4ae4348df917 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:58.726611 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7e675455-ec7c-41f3-92ce-4ae4348df917 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:58.727052 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7e675455-ec7c-41f3-92ce-4ae4348df917 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:58.755579 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7e675455-ec7c-41f3-92ce-4ae4348df917 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042506 Jul 27 20:26:58.756125 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 719/1422] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:58 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:26:58.866930 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-eaf3926b-9852-41ec-b9e2-5c06b04d856a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:58.869091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-eaf3926b-9852-41ec-b9e2-5c06b04d856a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:58.876138 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eaf3926b-9852-41ec-b9e2-5c06b04d856a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:58.876625 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eaf3926b-9852-41ec-b9e2-5c06b04d856a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:58.877427 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eaf3926b-9852-41ec-b9e2-5c06b04d856a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:58.877865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eaf3926b-9852-41ec-b9e2-5c06b04d856a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:58.907088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-eaf3926b-9852-41ec-b9e2-5c06b04d856a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044096 Jul 27 20:26:58.907639 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 704/1423] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:58 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:58.915654 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d7f448c3-7d03-41e0-9dc6-163247b34137 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:58.917909 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d7f448c3-7d03-41e0-9dc6-163247b34137 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:58.925038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d7f448c3-7d03-41e0-9dc6-163247b34137 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:58.925491 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d7f448c3-7d03-41e0-9dc6-163247b34137 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:58.926250 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d7f448c3-7d03-41e0-9dc6-163247b34137 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:58.926689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d7f448c3-7d03-41e0-9dc6-163247b34137 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:58.955411 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d7f448c3-7d03-41e0-9dc6-163247b34137 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043667 Jul 27 20:26:58.955958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 720/1424] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:58 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:26:59.176181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-98ba2641-83d2-4995-9ab5-baf9b0f1e741 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:59.176783 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-98ba2641-83d2-4995-9ab5-baf9b0f1e741 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:59.182767 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-98ba2641-83d2-4995-9ab5-baf9b0f1e741 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:59.183208 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-98ba2641-83d2-4995-9ab5-baf9b0f1e741 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:59.183963 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-98ba2641-83d2-4995-9ab5-baf9b0f1e741 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:59.184392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-98ba2641-83d2-4995-9ab5-baf9b0f1e741 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:59.245606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-98ba2641-83d2-4995-9ab5-baf9b0f1e741 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:26:59.253860 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-98ba2641-83d2-4995-9ab5-baf9b0f1e741 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081521 Jul 27 20:26:59.254435 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 705/1425] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:26:59 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:26:59.767334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-53c9b375-aaea-4b13-acde-ba98ebc19100 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:59.770003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-53c9b375-aaea-4b13-acde-ba98ebc19100 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:59.775492 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-53c9b375-aaea-4b13-acde-ba98ebc19100 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:59.775936 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-53c9b375-aaea-4b13-acde-ba98ebc19100 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:59.776685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-53c9b375-aaea-4b13-acde-ba98ebc19100 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:59.777143 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-53c9b375-aaea-4b13-acde-ba98ebc19100 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:59.805368 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-53c9b375-aaea-4b13-acde-ba98ebc19100 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042166 Jul 27 20:26:59.805903 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 721/1426] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:59 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:59.918589 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6b1c2480-9e27-4d77-80dd-da5f23f80857 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:59.921254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6b1c2480-9e27-4d77-80dd-da5f23f80857 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:59.927653 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b1c2480-9e27-4d77-80dd-da5f23f80857 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:59.928089 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b1c2480-9e27-4d77-80dd-da5f23f80857 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:59.928837 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b1c2480-9e27-4d77-80dd-da5f23f80857 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:59.929306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b1c2480-9e27-4d77-80dd-da5f23f80857 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:59.957829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6b1c2480-9e27-4d77-80dd-da5f23f80857 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043164 Jul 27 20:26:59.958362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 706/1427] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:26:59 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:26:59.967866 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2c4b8e3d-5219-4719-bcc3-e6c860e1a7bc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:26:59.970024 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2c4b8e3d-5219-4719-bcc3-e6c860e1a7bc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:26:59.976319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2c4b8e3d-5219-4719-bcc3-e6c860e1a7bc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:59.976762 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2c4b8e3d-5219-4719-bcc3-e6c860e1a7bc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:26:59.977567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2c4b8e3d-5219-4719-bcc3-e6c860e1a7bc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:26:59.977997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2c4b8e3d-5219-4719-bcc3-e6c860e1a7bc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:00.006654 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2c4b8e3d-5219-4719-bcc3-e6c860e1a7bc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042909 Jul 27 20:27:00.007195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 722/1428] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:26:59 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:00.275184 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b7d282a6-9c14-40c7-a964-732373797e39 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:00.275794 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b7d282a6-9c14-40c7-a964-732373797e39 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:00.282438 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7d282a6-9c14-40c7-a964-732373797e39 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:00.282883 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7d282a6-9c14-40c7-a964-732373797e39 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:00.283642 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7d282a6-9c14-40c7-a964-732373797e39 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:00.284082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7d282a6-9c14-40c7-a964-732373797e39 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:00.347549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b7d282a6-9c14-40c7-a964-732373797e39 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:00.354991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b7d282a6-9c14-40c7-a964-732373797e39 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083672 Jul 27 20:27:00.355546 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 707/1429] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:00 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:00.817726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c85621f3-67a4-4f37-b1ca-c02378cb2e69 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:00.819916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c85621f3-67a4-4f37-b1ca-c02378cb2e69 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:00.826998 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c85621f3-67a4-4f37-b1ca-c02378cb2e69 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:00.827450 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c85621f3-67a4-4f37-b1ca-c02378cb2e69 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:00.828218 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c85621f3-67a4-4f37-b1ca-c02378cb2e69 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:00.828660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c85621f3-67a4-4f37-b1ca-c02378cb2e69 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:00.857082 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c85621f3-67a4-4f37-b1ca-c02378cb2e69 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043289 Jul 27 20:27:00.857642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 723/1430] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:00 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:00.969870 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-207a0f93-b41e-41ea-bf05-773764cc6f1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:00.972073 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-207a0f93-b41e-41ea-bf05-773764cc6f1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:00.978534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-207a0f93-b41e-41ea-bf05-773764cc6f1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:00.978985 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-207a0f93-b41e-41ea-bf05-773764cc6f1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:00.979755 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-207a0f93-b41e-41ea-bf05-773764cc6f1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:00.980196 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-207a0f93-b41e-41ea-bf05-773764cc6f1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:01.009181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-207a0f93-b41e-41ea-bf05-773764cc6f1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043259 Jul 27 20:27:01.009730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 708/1431] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:00 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:01.019669 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1a10ae92-c9a5-4553-9638-b8cad8d53155 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:01.021802 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1a10ae92-c9a5-4553-9638-b8cad8d53155 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:01.028165 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1a10ae92-c9a5-4553-9638-b8cad8d53155 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:01.028614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1a10ae92-c9a5-4553-9638-b8cad8d53155 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:01.029649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1a10ae92-c9a5-4553-9638-b8cad8d53155 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:01.030090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1a10ae92-c9a5-4553-9638-b8cad8d53155 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:01.058277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1a10ae92-c9a5-4553-9638-b8cad8d53155 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042555 Jul 27 20:27:01.058823 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 724/1432] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:01 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:01.376802 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d4fa674a-d5d6-46be-893b-9402a9d58246 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:01.377429 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d4fa674a-d5d6-46be-893b-9402a9d58246 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:01.383390 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4fa674a-d5d6-46be-893b-9402a9d58246 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:01.383835 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4fa674a-d5d6-46be-893b-9402a9d58246 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:01.384590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4fa674a-d5d6-46be-893b-9402a9d58246 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:01.385048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4fa674a-d5d6-46be-893b-9402a9d58246 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:01.445254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d4fa674a-d5d6-46be-893b-9402a9d58246 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:01.453058 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d4fa674a-d5d6-46be-893b-9402a9d58246 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080637 Jul 27 20:27:01.453619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 709/1433] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:01 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:01.869782 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-267e8aef-7d91-47ff-8727-35c078e79864 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:01.871962 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-267e8aef-7d91-47ff-8727-35c078e79864 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:01.878203 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-267e8aef-7d91-47ff-8727-35c078e79864 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:01.878661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-267e8aef-7d91-47ff-8727-35c078e79864 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:01.879436 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-267e8aef-7d91-47ff-8727-35c078e79864 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:01.879883 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-267e8aef-7d91-47ff-8727-35c078e79864 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:01.883722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:27:01.911218 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-267e8aef-7d91-47ff-8727-35c078e79864 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046360 Jul 27 20:27:01.911778 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 725/1434] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:01 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:02.022034 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4e593ec1-2083-41f7-a2c7-2af03319d7e7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:02.024181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4e593ec1-2083-41f7-a2c7-2af03319d7e7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:02.031229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e593ec1-2083-41f7-a2c7-2af03319d7e7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:02.031684 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e593ec1-2083-41f7-a2c7-2af03319d7e7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:02.032459 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e593ec1-2083-41f7-a2c7-2af03319d7e7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:02.032894 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e593ec1-2083-41f7-a2c7-2af03319d7e7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:02.062372 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4e593ec1-2083-41f7-a2c7-2af03319d7e7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044127 Jul 27 20:27:02.063255 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 710/1435] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:02 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:02.071534 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9ffcb7a6-48ab-48e0-888f-d80d44ab58d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:02.074433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9ffcb7a6-48ab-48e0-888f-d80d44ab58d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:02.082112 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ffcb7a6-48ab-48e0-888f-d80d44ab58d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:02.082578 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ffcb7a6-48ab-48e0-888f-d80d44ab58d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:02.083430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ffcb7a6-48ab-48e0-888f-d80d44ab58d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:02.083947 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ffcb7a6-48ab-48e0-888f-d80d44ab58d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:02.114924 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9ffcb7a6-48ab-48e0-888f-d80d44ab58d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047865 Jul 27 20:27:02.115553 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 726/1436] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:02 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:02.473897 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b50794c6-ce1b-45a9-b14c-9979a0a78422 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:02.474513 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b50794c6-ce1b-45a9-b14c-9979a0a78422 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:02.480536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b50794c6-ce1b-45a9-b14c-9979a0a78422 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:02.481013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b50794c6-ce1b-45a9-b14c-9979a0a78422 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:02.481780 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b50794c6-ce1b-45a9-b14c-9979a0a78422 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:02.482764 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b50794c6-ce1b-45a9-b14c-9979a0a78422 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:02.486688 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:27:02.542480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b50794c6-ce1b-45a9-b14c-9979a0a78422 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:02.550654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b50794c6-ce1b-45a9-b14c-9979a0a78422 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080628 Jul 27 20:27:02.551222 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 711/1437] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:02 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:02.923099 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-21e7404d-2d37-4e3c-9983-605bda1c7ec8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:02.925248 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-21e7404d-2d37-4e3c-9983-605bda1c7ec8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:02.931535 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-21e7404d-2d37-4e3c-9983-605bda1c7ec8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:02.931995 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-21e7404d-2d37-4e3c-9983-605bda1c7ec8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:02.932820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-21e7404d-2d37-4e3c-9983-605bda1c7ec8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:02.933294 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-21e7404d-2d37-4e3c-9983-605bda1c7ec8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:02.962460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-21e7404d-2d37-4e3c-9983-605bda1c7ec8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043509 Jul 27 20:27:02.963010 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 727/1438] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:02 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:03.080977 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7c2ba373-b96e-4979-ac55-37e0a1dbe105 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:03.083142 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7c2ba373-b96e-4979-ac55-37e0a1dbe105 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:03.089614 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c2ba373-b96e-4979-ac55-37e0a1dbe105 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:03.090058 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c2ba373-b96e-4979-ac55-37e0a1dbe105 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:03.090815 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c2ba373-b96e-4979-ac55-37e0a1dbe105 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:03.091245 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c2ba373-b96e-4979-ac55-37e0a1dbe105 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:03.119601 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7c2ba373-b96e-4979-ac55-37e0a1dbe105 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042630 Jul 27 20:27:03.120140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 712/1439] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:03 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:03.127731 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-61addae1-4f78-4282-b8a3-7416be446890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:03.129948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-61addae1-4f78-4282-b8a3-7416be446890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:03.136016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-61addae1-4f78-4282-b8a3-7416be446890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:03.136472 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-61addae1-4f78-4282-b8a3-7416be446890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:03.137280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-61addae1-4f78-4282-b8a3-7416be446890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:03.137726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-61addae1-4f78-4282-b8a3-7416be446890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:03.168350 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-61addae1-4f78-4282-b8a3-7416be446890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044504 Jul 27 20:27:03.168919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 728/1440] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:03 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:03.570789 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-054c07b7-88a8-4567-a9d4-42b500da4911 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:03.571397 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-054c07b7-88a8-4567-a9d4-42b500da4911 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:03.577840 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-054c07b7-88a8-4567-a9d4-42b500da4911 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:03.578291 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-054c07b7-88a8-4567-a9d4-42b500da4911 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:03.579056 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-054c07b7-88a8-4567-a9d4-42b500da4911 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:03.579498 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-054c07b7-88a8-4567-a9d4-42b500da4911 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:03.639280 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-054c07b7-88a8-4567-a9d4-42b500da4911 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:03.646623 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-054c07b7-88a8-4567-a9d4-42b500da4911 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.079716 Jul 27 20:27:03.647193 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 713/1441] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:03 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:03.975505 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-274616cc-972b-4a38-afa8-9f1e198fae60 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:03.977584 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-274616cc-972b-4a38-afa8-9f1e198fae60 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:03.984759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-274616cc-972b-4a38-afa8-9f1e198fae60 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:03.985244 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-274616cc-972b-4a38-afa8-9f1e198fae60 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:03.986012 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-274616cc-972b-4a38-afa8-9f1e198fae60 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:03.986446 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-274616cc-972b-4a38-afa8-9f1e198fae60 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:04.014387 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-274616cc-972b-4a38-afa8-9f1e198fae60 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042934 Jul 27 20:27:04.014930 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 729/1442] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:03 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:04.132591 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6f290038-9d52-4a26-8159-7c2d562abc91 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:04.134761 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6f290038-9d52-4a26-8159-7c2d562abc91 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:04.141710 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f290038-9d52-4a26-8159-7c2d562abc91 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:04.142155 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f290038-9d52-4a26-8159-7c2d562abc91 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:04.142917 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f290038-9d52-4a26-8159-7c2d562abc91 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:04.143350 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f290038-9d52-4a26-8159-7c2d562abc91 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:04.173046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6f290038-9d52-4a26-8159-7c2d562abc91 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044337 Jul 27 20:27:04.173615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 714/1443] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:04 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:04.180879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-51cb73ec-b2a8-4ebd-8078-9ad2724b01ce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:04.183111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-51cb73ec-b2a8-4ebd-8078-9ad2724b01ce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:04.189279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-51cb73ec-b2a8-4ebd-8078-9ad2724b01ce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:04.189739 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-51cb73ec-b2a8-4ebd-8078-9ad2724b01ce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:04.190506 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-51cb73ec-b2a8-4ebd-8078-9ad2724b01ce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:04.190948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-51cb73ec-b2a8-4ebd-8078-9ad2724b01ce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:04.220394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-51cb73ec-b2a8-4ebd-8078-9ad2724b01ce tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043464 Jul 27 20:27:04.220939 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 730/1444] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:04 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:27:04.667422 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8f7922ef-cf85-4961-908a-eab8da488f43 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:04.668032 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8f7922ef-cf85-4961-908a-eab8da488f43 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:04.674994 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8f7922ef-cf85-4961-908a-eab8da488f43 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:04.675442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8f7922ef-cf85-4961-908a-eab8da488f43 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:04.676201 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8f7922ef-cf85-4961-908a-eab8da488f43 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:04.676656 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8f7922ef-cf85-4961-908a-eab8da488f43 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:04.739460 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8f7922ef-cf85-4961-908a-eab8da488f43 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:04.746951 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8f7922ef-cf85-4961-908a-eab8da488f43 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083449 Jul 27 20:27:04.747553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 715/1445] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:04 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:27:05.026693 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cfa4998f-577b-4469-8ecb-ca4bfaf4fd35 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:05.029577 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cfa4998f-577b-4469-8ecb-ca4bfaf4fd35 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:05.035932 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cfa4998f-577b-4469-8ecb-ca4bfaf4fd35 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:05.036376 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cfa4998f-577b-4469-8ecb-ca4bfaf4fd35 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:05.037166 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cfa4998f-577b-4469-8ecb-ca4bfaf4fd35 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:05.037598 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cfa4998f-577b-4469-8ecb-ca4bfaf4fd35 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:05.065404 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cfa4998f-577b-4469-8ecb-ca4bfaf4fd35 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042660 Jul 27 20:27:05.065949 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 731/1446] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:05 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:05.185529 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f577edca-c5a0-41fd-bc20-04ba04e3d69d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:05.187679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f577edca-c5a0-41fd-bc20-04ba04e3d69d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:05.194513 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f577edca-c5a0-41fd-bc20-04ba04e3d69d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:05.195025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f577edca-c5a0-41fd-bc20-04ba04e3d69d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:05.195803 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f577edca-c5a0-41fd-bc20-04ba04e3d69d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:05.196240 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f577edca-c5a0-41fd-bc20-04ba04e3d69d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:05.226113 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f577edca-c5a0-41fd-bc20-04ba04e3d69d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044560 Jul 27 20:27:05.226683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 716/1447] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:05 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:05.231898 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9e26cd76-e245-48ba-8781-1e6b8afb5446 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:05.234255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9e26cd76-e245-48ba-8781-1e6b8afb5446 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:05.240276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9e26cd76-e245-48ba-8781-1e6b8afb5446 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:05.240731 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9e26cd76-e245-48ba-8781-1e6b8afb5446 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:05.241536 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9e26cd76-e245-48ba-8781-1e6b8afb5446 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:05.241978 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9e26cd76-e245-48ba-8781-1e6b8afb5446 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:05.270853 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9e26cd76-e245-48ba-8781-1e6b8afb5446 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042960 Jul 27 20:27:05.271338 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 732/1448] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:05 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:27:05.767809 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c4bfc1ea-2d5e-4871-a265-ec33a0baaa59 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:05.768417 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c4bfc1ea-2d5e-4871-a265-ec33a0baaa59 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:05.774410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c4bfc1ea-2d5e-4871-a265-ec33a0baaa59 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:05.774854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c4bfc1ea-2d5e-4871-a265-ec33a0baaa59 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:05.775607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c4bfc1ea-2d5e-4871-a265-ec33a0baaa59 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:05.776040 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c4bfc1ea-2d5e-4871-a265-ec33a0baaa59 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:05.836773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c4bfc1ea-2d5e-4871-a265-ec33a0baaa59 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:05.844334 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c4bfc1ea-2d5e-4871-a265-ec33a0baaa59 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080747 Jul 27 20:27:05.844893 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 717/1449] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:05 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:06.078035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8393ce34-be58-4afe-a5d4-7f3d162967a0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:06.080161 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8393ce34-be58-4afe-a5d4-7f3d162967a0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:06.086671 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8393ce34-be58-4afe-a5d4-7f3d162967a0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:06.087121 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8393ce34-be58-4afe-a5d4-7f3d162967a0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:06.087879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8393ce34-be58-4afe-a5d4-7f3d162967a0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:06.088314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8393ce34-be58-4afe-a5d4-7f3d162967a0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:06.119420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8393ce34-be58-4afe-a5d4-7f3d162967a0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045161 Jul 27 20:27:06.119752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 733/1450] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:06 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:06.238305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-105c8138-eff1-4ccf-937d-d5b21a8d6202 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:06.240428 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-105c8138-eff1-4ccf-937d-d5b21a8d6202 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:06.246885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-105c8138-eff1-4ccf-937d-d5b21a8d6202 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:06.247358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-105c8138-eff1-4ccf-937d-d5b21a8d6202 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:06.248225 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-105c8138-eff1-4ccf-937d-d5b21a8d6202 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:06.248654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-105c8138-eff1-4ccf-937d-d5b21a8d6202 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:06.276443 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-105c8138-eff1-4ccf-937d-d5b21a8d6202 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042080 Jul 27 20:27:06.277007 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 718/1451] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:06 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:06.283638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c896b1c3-ebcd-46da-936e-cce9b6f73c2c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:06.285854 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c896b1c3-ebcd-46da-936e-cce9b6f73c2c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:06.291840 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c896b1c3-ebcd-46da-936e-cce9b6f73c2c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:06.292294 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c896b1c3-ebcd-46da-936e-cce9b6f73c2c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:06.293079 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c896b1c3-ebcd-46da-936e-cce9b6f73c2c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:06.293523 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c896b1c3-ebcd-46da-936e-cce9b6f73c2c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:06.322655 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c896b1c3-ebcd-46da-936e-cce9b6f73c2c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043587 Jul 27 20:27:06.323204 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 734/1452] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:06 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:06.865143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-95ed5c9a-2277-4273-a6d0-46054ab993b6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:06.865785 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-95ed5c9a-2277-4273-a6d0-46054ab993b6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:06.871734 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95ed5c9a-2277-4273-a6d0-46054ab993b6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:06.872890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95ed5c9a-2277-4273-a6d0-46054ab993b6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:06.873829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95ed5c9a-2277-4273-a6d0-46054ab993b6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:06.874410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95ed5c9a-2277-4273-a6d0-46054ab993b6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:06.934098 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-95ed5c9a-2277-4273-a6d0-46054ab993b6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:06.942162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-95ed5c9a-2277-4273-a6d0-46054ab993b6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080936 Jul 27 20:27:06.942728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 719/1453] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:06 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:07.131869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2286fd8f-600a-4c11-9231-1c3071f50b28 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:07.133935 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2286fd8f-600a-4c11-9231-1c3071f50b28 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:07.141537 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2286fd8f-600a-4c11-9231-1c3071f50b28 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:07.141995 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2286fd8f-600a-4c11-9231-1c3071f50b28 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:07.142765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2286fd8f-600a-4c11-9231-1c3071f50b28 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:07.143210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2286fd8f-600a-4c11-9231-1c3071f50b28 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:07.171982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2286fd8f-600a-4c11-9231-1c3071f50b28 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044158 Jul 27 20:27:07.172560 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 735/1454] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:07 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:07.289045 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-90ea4e8e-4458-44a8-8c18-cbac6545cc2a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:07.291174 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-90ea4e8e-4458-44a8-8c18-cbac6545cc2a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:07.298069 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-90ea4e8e-4458-44a8-8c18-cbac6545cc2a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:07.298512 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-90ea4e8e-4458-44a8-8c18-cbac6545cc2a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:07.299267 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-90ea4e8e-4458-44a8-8c18-cbac6545cc2a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:07.299729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-90ea4e8e-4458-44a8-8c18-cbac6545cc2a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:07.328844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-90ea4e8e-4458-44a8-8c18-cbac6545cc2a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043674 Jul 27 20:27:07.329406 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 720/1455] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:07 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:07.335380 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f922e706-ecdd-4b8f-b5e0-2947c47facd9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:07.337556 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f922e706-ecdd-4b8f-b5e0-2947c47facd9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:07.343544 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f922e706-ecdd-4b8f-b5e0-2947c47facd9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:07.343992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f922e706-ecdd-4b8f-b5e0-2947c47facd9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:07.344812 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f922e706-ecdd-4b8f-b5e0-2947c47facd9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:07.345214 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f922e706-ecdd-4b8f-b5e0-2947c47facd9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:07.375100 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f922e706-ecdd-4b8f-b5e0-2947c47facd9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043677 Jul 27 20:27:07.375662 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 736/1456] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:07 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:07.963246 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6bc4ff39-e841-4da3-a365-8018c49fc27e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:07.963797 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6bc4ff39-e841-4da3-a365-8018c49fc27e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:07.970668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6bc4ff39-e841-4da3-a365-8018c49fc27e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:07.971105 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6bc4ff39-e841-4da3-a365-8018c49fc27e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:07.971856 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6bc4ff39-e841-4da3-a365-8018c49fc27e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:07.972283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6bc4ff39-e841-4da3-a365-8018c49fc27e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:08.032154 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6bc4ff39-e841-4da3-a365-8018c49fc27e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:08.039465 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6bc4ff39-e841-4da3-a365-8018c49fc27e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080119 Jul 27 20:27:08.040017 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 721/1457] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:07 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:08.184029 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e00c16f6-154f-4096-bdd5-61c321c78624 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:08.187177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e00c16f6-154f-4096-bdd5-61c321c78624 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:08.194868 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e00c16f6-154f-4096-bdd5-61c321c78624 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:08.195645 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e00c16f6-154f-4096-bdd5-61c321c78624 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:08.196435 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e00c16f6-154f-4096-bdd5-61c321c78624 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:08.196880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e00c16f6-154f-4096-bdd5-61c321c78624 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:08.227549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e00c16f6-154f-4096-bdd5-61c321c78624 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047375 Jul 27 20:27:08.228037 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 737/1458] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:08 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:08.340843 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7ba7adff-f9cc-4c59-a22f-5b01193c0190 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:08.343236 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7ba7adff-f9cc-4c59-a22f-5b01193c0190 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:08.349733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ba7adff-f9cc-4c59-a22f-5b01193c0190 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:08.350175 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ba7adff-f9cc-4c59-a22f-5b01193c0190 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:08.350922 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ba7adff-f9cc-4c59-a22f-5b01193c0190 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:08.351352 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ba7adff-f9cc-4c59-a22f-5b01193c0190 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:08.379804 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7ba7adff-f9cc-4c59-a22f-5b01193c0190 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042891 Jul 27 20:27:08.380336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 722/1459] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:08 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:08.387208 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b6ef46b6-46bc-4b9f-b3e8-d1292b10981a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:08.390451 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b6ef46b6-46bc-4b9f-b3e8-d1292b10981a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:08.396532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b6ef46b6-46bc-4b9f-b3e8-d1292b10981a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:08.397023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b6ef46b6-46bc-4b9f-b3e8-d1292b10981a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:08.397798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b6ef46b6-46bc-4b9f-b3e8-d1292b10981a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:08.398239 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b6ef46b6-46bc-4b9f-b3e8-d1292b10981a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:08.426775 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b6ef46b6-46bc-4b9f-b3e8-d1292b10981a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043471 Jul 27 20:27:08.427325 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 738/1460] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:08 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:09.059608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6a7a3b75-0b6a-4b50-a0c8-1558b5943995 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:09.060328 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6a7a3b75-0b6a-4b50-a0c8-1558b5943995 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:09.066233 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6a7a3b75-0b6a-4b50-a0c8-1558b5943995 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:09.066676 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6a7a3b75-0b6a-4b50-a0c8-1558b5943995 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:09.067424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6a7a3b75-0b6a-4b50-a0c8-1558b5943995 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:09.067853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6a7a3b75-0b6a-4b50-a0c8-1558b5943995 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:09.133014 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6a7a3b75-0b6a-4b50-a0c8-1558b5943995 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:09.140525 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6a7a3b75-0b6a-4b50-a0c8-1558b5943995 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084767 Jul 27 20:27:09.141115 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 723/1461] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:09 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:09.239293 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-729b1b93-0970-4807-ba1d-c7de28017e93 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:09.241570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-729b1b93-0970-4807-ba1d-c7de28017e93 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:09.248419 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-729b1b93-0970-4807-ba1d-c7de28017e93 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:09.248882 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-729b1b93-0970-4807-ba1d-c7de28017e93 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:09.249680 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-729b1b93-0970-4807-ba1d-c7de28017e93 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:09.250125 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-729b1b93-0970-4807-ba1d-c7de28017e93 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:09.278393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-729b1b93-0970-4807-ba1d-c7de28017e93 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043042 Jul 27 20:27:09.279691 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 739/1462] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:09 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:09.392192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-aca881bc-35fe-4d06-a155-68939c530bb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:09.394402 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-aca881bc-35fe-4d06-a155-68939c530bb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:09.400838 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aca881bc-35fe-4d06-a155-68939c530bb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:09.401349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aca881bc-35fe-4d06-a155-68939c530bb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:09.402105 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aca881bc-35fe-4d06-a155-68939c530bb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:09.402556 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aca881bc-35fe-4d06-a155-68939c530bb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:09.431473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-aca881bc-35fe-4d06-a155-68939c530bb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043737 Jul 27 20:27:09.432017 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 724/1463] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:09 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:09.439247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a86b2c82-66a6-401d-a152-07d3305bad51 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:09.441519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a86b2c82-66a6-401d-a152-07d3305bad51 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:09.447587 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a86b2c82-66a6-401d-a152-07d3305bad51 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:09.448047 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a86b2c82-66a6-401d-a152-07d3305bad51 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:09.448814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a86b2c82-66a6-401d-a152-07d3305bad51 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:09.449350 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a86b2c82-66a6-401d-a152-07d3305bad51 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:09.479211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a86b2c82-66a6-401d-a152-07d3305bad51 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044009 Jul 27 20:27:09.479761 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 740/1464] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:09 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:10.160936 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3fa2cbd3-9195-48f3-b1cf-3d80bf4c89a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:10.161598 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3fa2cbd3-9195-48f3-b1cf-3d80bf4c89a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:10.167613 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3fa2cbd3-9195-48f3-b1cf-3d80bf4c89a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:10.168066 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3fa2cbd3-9195-48f3-b1cf-3d80bf4c89a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:10.168828 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3fa2cbd3-9195-48f3-b1cf-3d80bf4c89a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:10.169931 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3fa2cbd3-9195-48f3-b1cf-3d80bf4c89a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:10.229727 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3fa2cbd3-9195-48f3-b1cf-3d80bf4c89a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:10.237879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3fa2cbd3-9195-48f3-b1cf-3d80bf4c89a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080857 Jul 27 20:27:10.238443 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 725/1465] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:10 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:10.291243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8e93ef52-85ed-4dcb-aee7-1f8d00f6f872 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:10.293525 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8e93ef52-85ed-4dcb-aee7-1f8d00f6f872 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:10.300444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8e93ef52-85ed-4dcb-aee7-1f8d00f6f872 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:10.300888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8e93ef52-85ed-4dcb-aee7-1f8d00f6f872 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:10.301681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8e93ef52-85ed-4dcb-aee7-1f8d00f6f872 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:10.302114 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8e93ef52-85ed-4dcb-aee7-1f8d00f6f872 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:10.327172 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:27:10.332308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8e93ef52-85ed-4dcb-aee7-1f8d00f6f872 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044992 Jul 27 20:27:10.332889 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 741/1466] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:10 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:10.443853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ae344347-5b6d-4cc7-898f-1e62d1801bc6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:10.446036 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ae344347-5b6d-4cc7-898f-1e62d1801bc6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:10.452666 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae344347-5b6d-4cc7-898f-1e62d1801bc6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:10.453153 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae344347-5b6d-4cc7-898f-1e62d1801bc6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:10.453922 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae344347-5b6d-4cc7-898f-1e62d1801bc6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:10.454358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae344347-5b6d-4cc7-898f-1e62d1801bc6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:10.483276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ae344347-5b6d-4cc7-898f-1e62d1801bc6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043399 Jul 27 20:27:10.483830 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 726/1467] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:10 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:10.491785 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5a2dcd56-bc67-4b5c-b3c7-970f2bd3b4e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:10.494105 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5a2dcd56-bc67-4b5c-b3c7-970f2bd3b4e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:10.500688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5a2dcd56-bc67-4b5c-b3c7-970f2bd3b4e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:10.501167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5a2dcd56-bc67-4b5c-b3c7-970f2bd3b4e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:10.501928 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5a2dcd56-bc67-4b5c-b3c7-970f2bd3b4e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:10.502361 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5a2dcd56-bc67-4b5c-b3c7-970f2bd3b4e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:10.530966 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5a2dcd56-bc67-4b5c-b3c7-970f2bd3b4e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043310 Jul 27 20:27:10.531511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 742/1468] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:10 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:11.259071 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-aaf879ae-0fa1-4ae6-9379-a28ba792eb3f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:11.259683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-aaf879ae-0fa1-4ae6-9379-a28ba792eb3f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:11.265729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aaf879ae-0fa1-4ae6-9379-a28ba792eb3f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:11.266178 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aaf879ae-0fa1-4ae6-9379-a28ba792eb3f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:11.266937 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aaf879ae-0fa1-4ae6-9379-a28ba792eb3f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:11.267370 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aaf879ae-0fa1-4ae6-9379-a28ba792eb3f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:11.328181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aaf879ae-0fa1-4ae6-9379-a28ba792eb3f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:11.331447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:27:11.336636 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-aaf879ae-0fa1-4ae6-9379-a28ba792eb3f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081415 Jul 27 20:27:11.337234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 727/1469] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:11 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:11.344183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-60000750-9b8b-4f01-b413-01a5e8d61385 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:11.346532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-60000750-9b8b-4f01-b413-01a5e8d61385 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:11.353103 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-60000750-9b8b-4f01-b413-01a5e8d61385 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:11.353568 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-60000750-9b8b-4f01-b413-01a5e8d61385 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:11.354347 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-60000750-9b8b-4f01-b413-01a5e8d61385 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:11.354796 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-60000750-9b8b-4f01-b413-01a5e8d61385 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:11.385641 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-60000750-9b8b-4f01-b413-01a5e8d61385 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045850 Jul 27 20:27:11.386413 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 743/1470] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:11 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:11.495572 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7528bfc6-09d5-401a-b8d5-24d6b081b092 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:11.497751 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7528bfc6-09d5-401a-b8d5-24d6b081b092 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:11.504321 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7528bfc6-09d5-401a-b8d5-24d6b081b092 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:11.504773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7528bfc6-09d5-401a-b8d5-24d6b081b092 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:11.505594 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7528bfc6-09d5-401a-b8d5-24d6b081b092 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:11.506022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7528bfc6-09d5-401a-b8d5-24d6b081b092 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:11.535832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7528bfc6-09d5-401a-b8d5-24d6b081b092 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044161 Jul 27 20:27:11.536586 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 728/1471] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:11 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:11.543842 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9865cd15-ff8f-4efb-bcc6-79178fc26bdd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:11.547064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9865cd15-ff8f-4efb-bcc6-79178fc26bdd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:11.553151 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9865cd15-ff8f-4efb-bcc6-79178fc26bdd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:11.553604 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9865cd15-ff8f-4efb-bcc6-79178fc26bdd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:11.554377 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9865cd15-ff8f-4efb-bcc6-79178fc26bdd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:11.554820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9865cd15-ff8f-4efb-bcc6-79178fc26bdd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:11.584776 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9865cd15-ff8f-4efb-bcc6-79178fc26bdd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044674 Jul 27 20:27:11.585588 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 744/1472] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:11 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:27:12.357720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4961797b-3263-42c1-81a4-3a1fb7dc9b9a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:12.358225 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4961797b-3263-42c1-81a4-3a1fb7dc9b9a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:12.364176 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4961797b-3263-42c1-81a4-3a1fb7dc9b9a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:12.364619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4961797b-3263-42c1-81a4-3a1fb7dc9b9a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:12.365395 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4961797b-3263-42c1-81a4-3a1fb7dc9b9a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:12.365824 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4961797b-3263-42c1-81a4-3a1fb7dc9b9a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:12.398123 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-836afb97-3934-432f-8f28-6ed2d89abd7f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:12.400419 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-836afb97-3934-432f-8f28-6ed2d89abd7f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:12.407973 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-836afb97-3934-432f-8f28-6ed2d89abd7f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:12.408431 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-836afb97-3934-432f-8f28-6ed2d89abd7f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:12.409242 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-836afb97-3934-432f-8f28-6ed2d89abd7f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:12.409685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-836afb97-3934-432f-8f28-6ed2d89abd7f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:12.427000 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4961797b-3263-42c1-81a4-3a1fb7dc9b9a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:12.434625 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4961797b-3263-42c1-81a4-3a1fb7dc9b9a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081523 Jul 27 20:27:12.435529 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 729/1473] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:12 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:12.439730 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-836afb97-3934-432f-8f28-6ed2d89abd7f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045536 Jul 27 20:27:12.440280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 745/1474] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:12 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:27:12.547876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7cac48cd-c437-463f-8d80-42a6318eee1f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:27:12.550063 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7cac48cd-c437-463f-8d80-42a6318eee1f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:12.556525 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7cac48cd-c437-463f-8d80-42a6318eee1f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:12.556989 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7cac48cd-c437-463f-8d80-42a6318eee1f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:12.557776 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7cac48cd-c437-463f-8d80-42a6318eee1f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:12.558215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7cac48cd-c437-463f-8d80-42a6318eee1f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:12.598011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3bd4b140-f371-4b18-9316-11a9bfce7e56 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:12.600178 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3bd4b140-f371-4b18-9316-11a9bfce7e56 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:12.606155 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3bd4b140-f371-4b18-9316-11a9bfce7e56 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:12.606620 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3bd4b140-f371-4b18-9316-11a9bfce7e56 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:12.607472 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3bd4b140-f371-4b18-9316-11a9bfce7e56 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:12.607961 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3bd4b140-f371-4b18-9316-11a9bfce7e56 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:12.635773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3bd4b140-f371-4b18-9316-11a9bfce7e56 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041699 Jul 27 20:27:12.636330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 746/1475] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:12 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:27:12.650456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7cac48cd-c437-463f-8d80-42a6318eee1f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "POST /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/action" status: 200 len: 75965 microversion: 2.1 time: 0.106244 Jul 27 20:27:12.651108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 730/1476] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Jul 27 20:27:12 2022] POST /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a/action => generated 75965 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:13.452201 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5214d281-0362-41e3-8730-1aba67103542 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:13.454373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5214d281-0362-41e3-8730-1aba67103542 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:13.456547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a9ccb698-9331-4662-898f-fb48bea0548b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:13.457282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a9ccb698-9331-4662-898f-fb48bea0548b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:13.460950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5214d281-0362-41e3-8730-1aba67103542 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:13.461440 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5214d281-0362-41e3-8730-1aba67103542 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:13.462242 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5214d281-0362-41e3-8730-1aba67103542 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:13.462681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5214d281-0362-41e3-8730-1aba67103542 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:13.464106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a9ccb698-9331-4662-898f-fb48bea0548b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:13.464544 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a9ccb698-9331-4662-898f-fb48bea0548b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:13.465318 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a9ccb698-9331-4662-898f-fb48bea0548b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:13.465751 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a9ccb698-9331-4662-898f-fb48bea0548b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:13.492135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5214d281-0362-41e3-8730-1aba67103542 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044551 Jul 27 20:27:13.492697 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 747/1477] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:13 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:13.532720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a9ccb698-9331-4662-898f-fb48bea0548b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:13.543863 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a9ccb698-9331-4662-898f-fb48bea0548b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.091494 Jul 27 20:27:13.545224 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 731/1478] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:13 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:27:13.648952 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c8014ed1-e1d6-4d8a-91f1-4dbb74c6ff37 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:13.651138 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c8014ed1-e1d6-4d8a-91f1-4dbb74c6ff37 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:13.657790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c8014ed1-e1d6-4d8a-91f1-4dbb74c6ff37 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:13.658241 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c8014ed1-e1d6-4d8a-91f1-4dbb74c6ff37 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:13.659039 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c8014ed1-e1d6-4d8a-91f1-4dbb74c6ff37 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:13.659477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c8014ed1-e1d6-4d8a-91f1-4dbb74c6ff37 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:13.688307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c8014ed1-e1d6-4d8a-91f1-4dbb74c6ff37 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043400 Jul 27 20:27:13.688852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 748/1479] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:13 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:14.504740 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7c5c3217-c320-418b-be3b-d496a2e64830 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:14.506920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7c5c3217-c320-418b-be3b-d496a2e64830 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:14.514036 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c5c3217-c320-418b-be3b-d496a2e64830 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:14.514479 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c5c3217-c320-418b-be3b-d496a2e64830 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:14.515241 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c5c3217-c320-418b-be3b-d496a2e64830 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:14.515677 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c5c3217-c320-418b-be3b-d496a2e64830 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:14.543785 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7c5c3217-c320-418b-be3b-d496a2e64830 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043083 Jul 27 20:27:14.544331 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 732/1480] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:14 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:14.565706 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5d31ff6d-ae56-4e2a-b091-06c536028ed2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:14.566320 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5d31ff6d-ae56-4e2a-b091-06c536028ed2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:14.572973 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5d31ff6d-ae56-4e2a-b091-06c536028ed2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:14.573437 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5d31ff6d-ae56-4e2a-b091-06c536028ed2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:14.574234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5d31ff6d-ae56-4e2a-b091-06c536028ed2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:14.574671 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5d31ff6d-ae56-4e2a-b091-06c536028ed2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:14.635662 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5d31ff6d-ae56-4e2a-b091-06c536028ed2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:14.643704 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5d31ff6d-ae56-4e2a-b091-06c536028ed2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081844 Jul 27 20:27:14.644261 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 749/1481] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:14 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:14.699660 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-841c3983-1a63-4589-a557-86a165697ccb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:14.702235 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-841c3983-1a63-4589-a557-86a165697ccb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:14.708672 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-841c3983-1a63-4589-a557-86a165697ccb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:14.709148 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-841c3983-1a63-4589-a557-86a165697ccb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:14.709903 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-841c3983-1a63-4589-a557-86a165697ccb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:14.710332 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-841c3983-1a63-4589-a557-86a165697ccb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:14.738766 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-841c3983-1a63-4589-a557-86a165697ccb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043065 Jul 27 20:27:14.739309 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 733/1482] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:14 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:15.556125 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4e20a314-367c-4022-b99c-aba3cba0e713 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:15.558296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4e20a314-367c-4022-b99c-aba3cba0e713 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:15.564354 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4e20a314-367c-4022-b99c-aba3cba0e713 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:15.564808 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4e20a314-367c-4022-b99c-aba3cba0e713 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:15.565619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4e20a314-367c-4022-b99c-aba3cba0e713 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:15.566159 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4e20a314-367c-4022-b99c-aba3cba0e713 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:15.595362 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4e20a314-367c-4022-b99c-aba3cba0e713 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043157 Jul 27 20:27:15.595906 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 750/1483] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:15 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:15.664028 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c1c15fee-de83-4b31-a3df-3d593744aec0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:15.664642 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c1c15fee-de83-4b31-a3df-3d593744aec0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:15.671342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1c15fee-de83-4b31-a3df-3d593744aec0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:15.671795 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1c15fee-de83-4b31-a3df-3d593744aec0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:15.672557 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1c15fee-de83-4b31-a3df-3d593744aec0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:15.673024 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1c15fee-de83-4b31-a3df-3d593744aec0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:15.733142 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c1c15fee-de83-4b31-a3df-3d593744aec0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:15.740529 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c1c15fee-de83-4b31-a3df-3d593744aec0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080373 Jul 27 20:27:15.741110 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 734/1484] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:15 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:15.751077 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cdae3b8d-33f6-4a63-b9b7-87aaf35f2c23 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:15.753288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cdae3b8d-33f6-4a63-b9b7-87aaf35f2c23 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:15.759423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cdae3b8d-33f6-4a63-b9b7-87aaf35f2c23 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:15.759908 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cdae3b8d-33f6-4a63-b9b7-87aaf35f2c23 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:15.760702 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cdae3b8d-33f6-4a63-b9b7-87aaf35f2c23 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:15.761176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cdae3b8d-33f6-4a63-b9b7-87aaf35f2c23 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:15.790146 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cdae3b8d-33f6-4a63-b9b7-87aaf35f2c23 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043172 Jul 27 20:27:15.790699 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 751/1485] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:15 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:16.608356 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f35d5212-cda3-4b1f-ae0a-3d68c1d4a725 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:16.610550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f35d5212-cda3-4b1f-ae0a-3d68c1d4a725 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:16.617043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f35d5212-cda3-4b1f-ae0a-3d68c1d4a725 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:16.617498 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f35d5212-cda3-4b1f-ae0a-3d68c1d4a725 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:16.618268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f35d5212-cda3-4b1f-ae0a-3d68c1d4a725 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:16.618713 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f35d5212-cda3-4b1f-ae0a-3d68c1d4a725 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:16.646938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f35d5212-cda3-4b1f-ae0a-3d68c1d4a725 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043281 Jul 27 20:27:16.647480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 735/1486] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:16 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:16.760431 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-02541459-eaf2-4c6f-af6f-7d046d9eb831 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:16.761095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-02541459-eaf2-4c6f-af6f-7d046d9eb831 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:16.767758 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-02541459-eaf2-4c6f-af6f-7d046d9eb831 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:16.768203 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-02541459-eaf2-4c6f-af6f-7d046d9eb831 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:16.768953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-02541459-eaf2-4c6f-af6f-7d046d9eb831 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:16.769410 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-02541459-eaf2-4c6f-af6f-7d046d9eb831 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:16.802466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c33eca34-7945-4cb6-b3d0-ddf9115519ae tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:16.804638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c33eca34-7945-4cb6-b3d0-ddf9115519ae tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:16.811143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c33eca34-7945-4cb6-b3d0-ddf9115519ae tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:16.811592 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c33eca34-7945-4cb6-b3d0-ddf9115519ae tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:16.812364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c33eca34-7945-4cb6-b3d0-ddf9115519ae tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:16.812798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c33eca34-7945-4cb6-b3d0-ddf9115519ae tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:16.830842 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-02541459-eaf2-4c6f-af6f-7d046d9eb831 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:16.838407 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-02541459-eaf2-4c6f-af6f-7d046d9eb831 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081753 Jul 27 20:27:16.838965 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 752/1487] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:16 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:16.843087 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c33eca34-7945-4cb6-b3d0-ddf9115519ae tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044486 Jul 27 20:27:16.843646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 736/1488] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:16 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:27:17.659080 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-88171f78-3444-4d3c-8772-a05b7435905f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:17.661254 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-88171f78-3444-4d3c-8772-a05b7435905f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:17.667313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88171f78-3444-4d3c-8772-a05b7435905f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:17.667759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88171f78-3444-4d3c-8772-a05b7435905f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:17.668517 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88171f78-3444-4d3c-8772-a05b7435905f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:17.668951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88171f78-3444-4d3c-8772-a05b7435905f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:17.698937 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-88171f78-3444-4d3c-8772-a05b7435905f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043762 Jul 27 20:27:17.699502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 753/1489] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:17 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:17.855983 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9f21af78-bd01-4aa9-a703-8ad5e0a9c753 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:17.858654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9f21af78-bd01-4aa9-a703-8ad5e0a9c753 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:17.859590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-584cb5a4-1a8b-4e60-8b27-a65457c203ee tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:17.860212 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-584cb5a4-1a8b-4e60-8b27-a65457c203ee tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:17.864690 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f21af78-bd01-4aa9-a703-8ad5e0a9c753 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:17.865199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f21af78-bd01-4aa9-a703-8ad5e0a9c753 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:17.865962 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f21af78-bd01-4aa9-a703-8ad5e0a9c753 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:17.866399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f21af78-bd01-4aa9-a703-8ad5e0a9c753 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:17.866635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-584cb5a4-1a8b-4e60-8b27-a65457c203ee tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:17.867093 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-584cb5a4-1a8b-4e60-8b27-a65457c203ee tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:17.867862 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-584cb5a4-1a8b-4e60-8b27-a65457c203ee tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:17.868317 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-584cb5a4-1a8b-4e60-8b27-a65457c203ee tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:17.895779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9f21af78-bd01-4aa9-a703-8ad5e0a9c753 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044286 Jul 27 20:27:17.896351 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 737/1490] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:17 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:17.931440 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-584cb5a4-1a8b-4e60-8b27-a65457c203ee tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:17.939463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-584cb5a4-1a8b-4e60-8b27-a65457c203ee tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084278 Jul 27 20:27:17.940025 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 754/1491] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:17 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:27:18.711110 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a49245b9-87d4-406c-b15b-f8b58ae96328 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:18.713310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a49245b9-87d4-406c-b15b-f8b58ae96328 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:18.719273 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a49245b9-87d4-406c-b15b-f8b58ae96328 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:18.719711 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a49245b9-87d4-406c-b15b-f8b58ae96328 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:18.720464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a49245b9-87d4-406c-b15b-f8b58ae96328 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:18.720893 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a49245b9-87d4-406c-b15b-f8b58ae96328 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:18.749696 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a49245b9-87d4-406c-b15b-f8b58ae96328 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042509 Jul 27 20:27:18.750228 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 738/1492] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:18 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:18.908396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-96b639af-df56-406c-98dc-89fed36597a2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:18.910514 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-96b639af-df56-406c-98dc-89fed36597a2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:18.916917 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-96b639af-df56-406c-98dc-89fed36597a2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:18.917396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-96b639af-df56-406c-98dc-89fed36597a2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:18.918162 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-96b639af-df56-406c-98dc-89fed36597a2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:18.918600 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-96b639af-df56-406c-98dc-89fed36597a2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:18.947123 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-96b639af-df56-406c-98dc-89fed36597a2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043371 Jul 27 20:27:18.947641 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 755/1493] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:18 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:18.959388 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-984c2127-099d-419c-9380-5c03d970ca30 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:18.959992 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-984c2127-099d-419c-9380-5c03d970ca30 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:18.967209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-984c2127-099d-419c-9380-5c03d970ca30 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:18.967590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-984c2127-099d-419c-9380-5c03d970ca30 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:18.968348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-984c2127-099d-419c-9380-5c03d970ca30 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:18.968774 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-984c2127-099d-419c-9380-5c03d970ca30 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:19.030920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-984c2127-099d-419c-9380-5c03d970ca30 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:19.038379 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-984c2127-099d-419c-9380-5c03d970ca30 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082737 Jul 27 20:27:19.038960 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 739/1494] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:18 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:19.761926 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-96361f32-694e-43d2-9bc6-b7027678b91a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:19.764257 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-96361f32-694e-43d2-9bc6-b7027678b91a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:19.770215 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-96361f32-694e-43d2-9bc6-b7027678b91a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:19.770661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-96361f32-694e-43d2-9bc6-b7027678b91a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:19.771411 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-96361f32-694e-43d2-9bc6-b7027678b91a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:19.771850 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-96361f32-694e-43d2-9bc6-b7027678b91a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:19.800683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-96361f32-694e-43d2-9bc6-b7027678b91a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042659 Jul 27 20:27:19.801262 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 756/1495] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:19 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:19.960030 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0ef45d7f-9e93-4ca1-98f0-0b92457a6d91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:19.962205 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0ef45d7f-9e93-4ca1-98f0-0b92457a6d91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:19.969462 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ef45d7f-9e93-4ca1-98f0-0b92457a6d91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:19.969911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ef45d7f-9e93-4ca1-98f0-0b92457a6d91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:19.970681 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ef45d7f-9e93-4ca1-98f0-0b92457a6d91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:19.971127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ef45d7f-9e93-4ca1-98f0-0b92457a6d91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:19.999454 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0ef45d7f-9e93-4ca1-98f0-0b92457a6d91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043432 Jul 27 20:27:20.000010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 740/1496] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:19 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:20.059481 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e61a6b42-ae46-489e-b3bb-93183673eb05 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:20.060134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e61a6b42-ae46-489e-b3bb-93183673eb05 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:20.066620 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e61a6b42-ae46-489e-b3bb-93183673eb05 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:20.067069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e61a6b42-ae46-489e-b3bb-93183673eb05 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:20.067827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e61a6b42-ae46-489e-b3bb-93183673eb05 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:20.068262 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e61a6b42-ae46-489e-b3bb-93183673eb05 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:20.131632 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e61a6b42-ae46-489e-b3bb-93183673eb05 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:20.140237 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e61a6b42-ae46-489e-b3bb-93183673eb05 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084496 Jul 27 20:27:20.140806 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 757/1497] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:20 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:20.812257 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-62074d98-9686-4e21-9857-74dd34ba50cf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:20.814340 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-62074d98-9686-4e21-9857-74dd34ba50cf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:20.820231 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-62074d98-9686-4e21-9857-74dd34ba50cf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:20.820670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-62074d98-9686-4e21-9857-74dd34ba50cf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:20.821458 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-62074d98-9686-4e21-9857-74dd34ba50cf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:20.821889 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-62074d98-9686-4e21-9857-74dd34ba50cf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:20.852313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-62074d98-9686-4e21-9857-74dd34ba50cf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044099 Jul 27 20:27:20.852852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 741/1498] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:20 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:21.011704 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-644f52e5-b411-4782-988b-36f145f61c23 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:21.014404 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-644f52e5-b411-4782-988b-36f145f61c23 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:21.020331 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-644f52e5-b411-4782-988b-36f145f61c23 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:21.020787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-644f52e5-b411-4782-988b-36f145f61c23 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:21.021621 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-644f52e5-b411-4782-988b-36f145f61c23 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:21.022062 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-644f52e5-b411-4782-988b-36f145f61c23 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:21.038516 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:27:21.051649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-644f52e5-b411-4782-988b-36f145f61c23 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043901 Jul 27 20:27:21.052202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 758/1499] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:21 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:21.161046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-43a92094-cd9e-4948-bf40-d52fe20304dc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:21.161648 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-43a92094-cd9e-4948-bf40-d52fe20304dc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:21.168020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43a92094-cd9e-4948-bf40-d52fe20304dc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:21.168461 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43a92094-cd9e-4948-bf40-d52fe20304dc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:21.169256 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43a92094-cd9e-4948-bf40-d52fe20304dc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:21.169777 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43a92094-cd9e-4948-bf40-d52fe20304dc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:21.229525 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-43a92094-cd9e-4948-bf40-d52fe20304dc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:21.237084 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-43a92094-cd9e-4948-bf40-d52fe20304dc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.079834 Jul 27 20:27:21.237653 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 742/1500] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:21 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:21.864331 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-58f8a9c2-e69b-4631-b5f2-bc3fe68d0855 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:21.866527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-58f8a9c2-e69b-4631-b5f2-bc3fe68d0855 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:21.873581 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-58f8a9c2-e69b-4631-b5f2-bc3fe68d0855 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:21.874031 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-58f8a9c2-e69b-4631-b5f2-bc3fe68d0855 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:21.874784 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-58f8a9c2-e69b-4631-b5f2-bc3fe68d0855 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:21.875243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-58f8a9c2-e69b-4631-b5f2-bc3fe68d0855 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:21.904052 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-58f8a9c2-e69b-4631-b5f2-bc3fe68d0855 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043544 Jul 27 20:27:21.904597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 759/1501] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:21 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:22.064780 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e5a4d152-d25d-46d1-8338-1403b937d593 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:22.066943 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e5a4d152-d25d-46d1-8338-1403b937d593 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:22.073043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e5a4d152-d25d-46d1-8338-1403b937d593 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:22.073500 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e5a4d152-d25d-46d1-8338-1403b937d593 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:22.074269 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e5a4d152-d25d-46d1-8338-1403b937d593 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:22.074700 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e5a4d152-d25d-46d1-8338-1403b937d593 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:22.104654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e5a4d152-d25d-46d1-8338-1403b937d593 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044671 Jul 27 20:27:22.105249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 743/1502] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:22 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:22.257934 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d08aa619-152b-4970-9212-0b7fae0790dd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:22.258549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d08aa619-152b-4970-9212-0b7fae0790dd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:22.261471 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:27:22.265758 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d08aa619-152b-4970-9212-0b7fae0790dd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:22.266214 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d08aa619-152b-4970-9212-0b7fae0790dd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:22.266983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d08aa619-152b-4970-9212-0b7fae0790dd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:22.267429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d08aa619-152b-4970-9212-0b7fae0790dd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:22.330486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d08aa619-152b-4970-9212-0b7fae0790dd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:22.338234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d08aa619-152b-4970-9212-0b7fae0790dd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084119 Jul 27 20:27:22.338797 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 760/1503] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:22 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:22.916250 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4de4cdb4-3b5b-4a50-a5ef-92136920d8bc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:22.918449 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4de4cdb4-3b5b-4a50-a5ef-92136920d8bc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:22.922068 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:27:22.925873 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4de4cdb4-3b5b-4a50-a5ef-92136920d8bc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:22.926320 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4de4cdb4-3b5b-4a50-a5ef-92136920d8bc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:22.927090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4de4cdb4-3b5b-4a50-a5ef-92136920d8bc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:22.927528 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4de4cdb4-3b5b-4a50-a5ef-92136920d8bc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:22.953971 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:27:22.959097 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4de4cdb4-3b5b-4a50-a5ef-92136920d8bc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046806 Jul 27 20:27:22.959652 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 744/1504] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:22 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:23.117309 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-78713406-8cd2-4def-9fc5-6de1759203a9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:23.119423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-78713406-8cd2-4def-9fc5-6de1759203a9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:23.126633 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-78713406-8cd2-4def-9fc5-6de1759203a9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:23.127083 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-78713406-8cd2-4def-9fc5-6de1759203a9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:23.127842 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-78713406-8cd2-4def-9fc5-6de1759203a9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:23.128280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-78713406-8cd2-4def-9fc5-6de1759203a9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:23.157207 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-78713406-8cd2-4def-9fc5-6de1759203a9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043825 Jul 27 20:27:23.157757 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 761/1505] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:23 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:23.359246 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-12d71a75-fa2a-4702-a4ec-c755a3d2da70 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:23.360503 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-12d71a75-fa2a-4702-a4ec-c755a3d2da70 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:23.366661 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12d71a75-fa2a-4702-a4ec-c755a3d2da70 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:23.367100 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12d71a75-fa2a-4702-a4ec-c755a3d2da70 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:23.367848 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12d71a75-fa2a-4702-a4ec-c755a3d2da70 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:23.368276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12d71a75-fa2a-4702-a4ec-c755a3d2da70 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:23.432505 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-12d71a75-fa2a-4702-a4ec-c755a3d2da70 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:23.440018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-12d71a75-fa2a-4702-a4ec-c755a3d2da70 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.085362 Jul 27 20:27:23.440569 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 745/1506] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:23 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:23.972107 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-56934eb5-a400-4688-a584-23d1bdb93c0c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:23.974264 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-56934eb5-a400-4688-a584-23d1bdb93c0c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:23.980210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56934eb5-a400-4688-a584-23d1bdb93c0c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:23.980661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56934eb5-a400-4688-a584-23d1bdb93c0c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:23.981451 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56934eb5-a400-4688-a584-23d1bdb93c0c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:23.981889 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56934eb5-a400-4688-a584-23d1bdb93c0c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:24.009849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-56934eb5-a400-4688-a584-23d1bdb93c0c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041661 Jul 27 20:27:24.010398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 762/1507] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:23 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:24.169980 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-30a69f76-7249-4275-b4c6-e44d03345871 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:24.172180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-30a69f76-7249-4275-b4c6-e44d03345871 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:24.178674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30a69f76-7249-4275-b4c6-e44d03345871 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:24.179119 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30a69f76-7249-4275-b4c6-e44d03345871 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:24.179882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30a69f76-7249-4275-b4c6-e44d03345871 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:24.180318 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30a69f76-7249-4275-b4c6-e44d03345871 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:24.210033 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-30a69f76-7249-4275-b4c6-e44d03345871 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044222 Jul 27 20:27:24.210585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 746/1508] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:24 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:24.461944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fc69b85f-a56f-4d1f-b0d0-68cab683e2c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:24.462552 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fc69b85f-a56f-4d1f-b0d0-68cab683e2c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:24.469035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fc69b85f-a56f-4d1f-b0d0-68cab683e2c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:24.469505 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fc69b85f-a56f-4d1f-b0d0-68cab683e2c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:24.470243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fc69b85f-a56f-4d1f-b0d0-68cab683e2c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:24.470676 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fc69b85f-a56f-4d1f-b0d0-68cab683e2c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:24.531015 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fc69b85f-a56f-4d1f-b0d0-68cab683e2c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:24.538347 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fc69b85f-a56f-4d1f-b0d0-68cab683e2c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080265 Jul 27 20:27:24.538901 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 763/1509] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:24 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:25.021708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-70c885b9-5214-45c7-b5eb-951df981042e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:25.023928 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-70c885b9-5214-45c7-b5eb-951df981042e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:25.030648 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70c885b9-5214-45c7-b5eb-951df981042e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:25.032176 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70c885b9-5214-45c7-b5eb-951df981042e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:25.033006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70c885b9-5214-45c7-b5eb-951df981042e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:25.033443 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70c885b9-5214-45c7-b5eb-951df981042e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:25.068175 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-70c885b9-5214-45c7-b5eb-951df981042e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050291 Jul 27 20:27:25.068785 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 747/1510] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:25 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:25.224791 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-48c7c138-d400-4822-9aa5-19ff4a2be392 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:25.226989 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-48c7c138-d400-4822-9aa5-19ff4a2be392 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:25.233693 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48c7c138-d400-4822-9aa5-19ff4a2be392 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:25.234137 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48c7c138-d400-4822-9aa5-19ff4a2be392 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:25.234923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48c7c138-d400-4822-9aa5-19ff4a2be392 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:25.235353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48c7c138-d400-4822-9aa5-19ff4a2be392 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:25.262726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-48c7c138-d400-4822-9aa5-19ff4a2be392 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042058 Jul 27 20:27:25.263267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 764/1511] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:25 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:25.558751 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fffa81c5-ea94-42e0-b7b0-2520846269fd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:25.559323 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fffa81c5-ea94-42e0-b7b0-2520846269fd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:25.565769 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fffa81c5-ea94-42e0-b7b0-2520846269fd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:25.566224 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fffa81c5-ea94-42e0-b7b0-2520846269fd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:25.566992 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fffa81c5-ea94-42e0-b7b0-2520846269fd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:25.567431 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fffa81c5-ea94-42e0-b7b0-2520846269fd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:25.627977 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fffa81c5-ea94-42e0-b7b0-2520846269fd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:25.635448 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fffa81c5-ea94-42e0-b7b0-2520846269fd tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080631 Jul 27 20:27:25.636002 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 748/1512] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:25 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:26.080617 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-827dfa2e-c725-48b9-8dd3-b7f737baee23 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:26.082780 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-827dfa2e-c725-48b9-8dd3-b7f737baee23 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:26.089368 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-827dfa2e-c725-48b9-8dd3-b7f737baee23 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:26.089829 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-827dfa2e-c725-48b9-8dd3-b7f737baee23 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:26.090599 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-827dfa2e-c725-48b9-8dd3-b7f737baee23 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:26.091044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-827dfa2e-c725-48b9-8dd3-b7f737baee23 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:26.119629 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-827dfa2e-c725-48b9-8dd3-b7f737baee23 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043766 Jul 27 20:27:26.120185 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 765/1513] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:26 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:26.275298 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b1769818-1ed3-4466-847f-f147e9c19550 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:26.277530 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b1769818-1ed3-4466-847f-f147e9c19550 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:26.283575 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1769818-1ed3-4466-847f-f147e9c19550 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:26.284023 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1769818-1ed3-4466-847f-f147e9c19550 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:26.284791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1769818-1ed3-4466-847f-f147e9c19550 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:26.285281 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1769818-1ed3-4466-847f-f147e9c19550 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:26.314601 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b1769818-1ed3-4466-847f-f147e9c19550 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043087 Jul 27 20:27:26.318534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 749/1514] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:26 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:26.657097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-897db1d4-73d0-4227-b418-92082414942e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:26.657715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-897db1d4-73d0-4227-b418-92082414942e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:26.663653 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-897db1d4-73d0-4227-b418-92082414942e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:26.664108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-897db1d4-73d0-4227-b418-92082414942e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:26.664878 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-897db1d4-73d0-4227-b418-92082414942e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:26.665344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-897db1d4-73d0-4227-b418-92082414942e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:26.728012 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-897db1d4-73d0-4227-b418-92082414942e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:26.736238 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-897db1d4-73d0-4227-b418-92082414942e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083764 Jul 27 20:27:26.736793 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 766/1515] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:26 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:27.132524 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f79c3c0b-d4b5-4b53-930e-b4cc06974646 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:27.134713 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f79c3c0b-d4b5-4b53-930e-b4cc06974646 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:27.141709 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f79c3c0b-d4b5-4b53-930e-b4cc06974646 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:27.142159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f79c3c0b-d4b5-4b53-930e-b4cc06974646 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:27.142920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f79c3c0b-d4b5-4b53-930e-b4cc06974646 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:27.143354 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f79c3c0b-d4b5-4b53-930e-b4cc06974646 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:27.172257 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f79c3c0b-d4b5-4b53-930e-b4cc06974646 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043653 Jul 27 20:27:27.172820 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 750/1516] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:27 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:27.332766 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-00eb7135-ba00-4f3e-8bdd-7e0b45c44f0f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:27.334872 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-00eb7135-ba00-4f3e-8bdd-7e0b45c44f0f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:27.341540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00eb7135-ba00-4f3e-8bdd-7e0b45c44f0f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:27.342630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00eb7135-ba00-4f3e-8bdd-7e0b45c44f0f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:27.343414 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00eb7135-ba00-4f3e-8bdd-7e0b45c44f0f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:27.343855 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00eb7135-ba00-4f3e-8bdd-7e0b45c44f0f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:27.377321 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-00eb7135-ba00-4f3e-8bdd-7e0b45c44f0f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048493 Jul 27 20:27:27.377879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 767/1517] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:27 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:27.756515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a52847f3-b68a-40b2-8bc5-db325033f1e7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:27.757146 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a52847f3-b68a-40b2-8bc5-db325033f1e7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:27.763038 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a52847f3-b68a-40b2-8bc5-db325033f1e7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:27.763478 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a52847f3-b68a-40b2-8bc5-db325033f1e7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:27.764854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a52847f3-b68a-40b2-8bc5-db325033f1e7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:27.765302 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a52847f3-b68a-40b2-8bc5-db325033f1e7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:27.826180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a52847f3-b68a-40b2-8bc5-db325033f1e7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:27.833512 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a52847f3-b68a-40b2-8bc5-db325033f1e7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080904 Jul 27 20:27:27.834076 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 751/1518] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:27 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:28.183801 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c14bf9a3-a00d-481f-879f-e2e3b1028cd0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:28.186088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c14bf9a3-a00d-481f-879f-e2e3b1028cd0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:28.192024 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c14bf9a3-a00d-481f-879f-e2e3b1028cd0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:28.192480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c14bf9a3-a00d-481f-879f-e2e3b1028cd0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:28.193276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c14bf9a3-a00d-481f-879f-e2e3b1028cd0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:28.193720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c14bf9a3-a00d-481f-879f-e2e3b1028cd0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:28.223309 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c14bf9a3-a00d-481f-879f-e2e3b1028cd0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043536 Jul 27 20:27:28.223858 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 768/1519] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:28 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:28.389657 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c26ce288-322e-4aa7-a471-10c979d3cc2d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:28.391818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c26ce288-322e-4aa7-a471-10c979d3cc2d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:28.398686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c26ce288-322e-4aa7-a471-10c979d3cc2d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:28.399162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c26ce288-322e-4aa7-a471-10c979d3cc2d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:28.399920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c26ce288-322e-4aa7-a471-10c979d3cc2d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:28.400348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c26ce288-322e-4aa7-a471-10c979d3cc2d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:28.430386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c26ce288-322e-4aa7-a471-10c979d3cc2d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044730 Jul 27 20:27:28.430926 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 752/1520] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:28 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:28.853658 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2844b258-d06d-47cc-ba2e-f6cb4ac72d43 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:28.854271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2844b258-d06d-47cc-ba2e-f6cb4ac72d43 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:28.860653 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2844b258-d06d-47cc-ba2e-f6cb4ac72d43 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:28.861142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2844b258-d06d-47cc-ba2e-f6cb4ac72d43 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:28.861918 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2844b258-d06d-47cc-ba2e-f6cb4ac72d43 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:28.862357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2844b258-d06d-47cc-ba2e-f6cb4ac72d43 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:28.922168 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2844b258-d06d-47cc-ba2e-f6cb4ac72d43 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:28.929625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2844b258-d06d-47cc-ba2e-f6cb4ac72d43 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.079822 Jul 27 20:27:28.930183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 769/1521] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:28 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:29.235623 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-922a0b30-3d28-4b88-8769-e0e8d61acf56 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:29.237807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-922a0b30-3d28-4b88-8769-e0e8d61acf56 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:29.243818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-922a0b30-3d28-4b88-8769-e0e8d61acf56 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:29.244268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-922a0b30-3d28-4b88-8769-e0e8d61acf56 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:29.245059 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-922a0b30-3d28-4b88-8769-e0e8d61acf56 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:29.245500 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-922a0b30-3d28-4b88-8769-e0e8d61acf56 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:29.275263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-922a0b30-3d28-4b88-8769-e0e8d61acf56 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043666 Jul 27 20:27:29.275814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 753/1522] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:29 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:29.444034 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a61e9687-29e8-4a99-a2ae-d07cfcf6d4a6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:29.446222 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a61e9687-29e8-4a99-a2ae-d07cfcf6d4a6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:29.452560 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a61e9687-29e8-4a99-a2ae-d07cfcf6d4a6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:29.453034 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a61e9687-29e8-4a99-a2ae-d07cfcf6d4a6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:29.453803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a61e9687-29e8-4a99-a2ae-d07cfcf6d4a6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:29.454244 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a61e9687-29e8-4a99-a2ae-d07cfcf6d4a6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:29.482299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a61e9687-29e8-4a99-a2ae-d07cfcf6d4a6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042271 Jul 27 20:27:29.483404 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 770/1523] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:29 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:29.950000 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ad506322-fed2-4f44-9650-d647c9db8032 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:29.950889 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ad506322-fed2-4f44-9650-d647c9db8032 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:29.957281 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ad506322-fed2-4f44-9650-d647c9db8032 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:29.957722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ad506322-fed2-4f44-9650-d647c9db8032 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:29.958483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ad506322-fed2-4f44-9650-d647c9db8032 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:29.958907 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ad506322-fed2-4f44-9650-d647c9db8032 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:30.021199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ad506322-fed2-4f44-9650-d647c9db8032 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:30.028786 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ad506322-fed2-4f44-9650-d647c9db8032 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082702 Jul 27 20:27:30.030048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 754/1524] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:29 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:30.287845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bb919ee8-3504-4f9b-86ec-cd9debd7bdaf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:30.289893 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bb919ee8-3504-4f9b-86ec-cd9debd7bdaf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:30.296538 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb919ee8-3504-4f9b-86ec-cd9debd7bdaf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:30.297005 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb919ee8-3504-4f9b-86ec-cd9debd7bdaf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:30.297774 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb919ee8-3504-4f9b-86ec-cd9debd7bdaf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:30.298207 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb919ee8-3504-4f9b-86ec-cd9debd7bdaf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:30.326984 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bb919ee8-3504-4f9b-86ec-cd9debd7bdaf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042672 Jul 27 20:27:30.327659 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 771/1525] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:30 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:30.495454 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-180fd40b-e504-41df-a5ba-3da1705e402d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:30.497650 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-180fd40b-e504-41df-a5ba-3da1705e402d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:30.504108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-180fd40b-e504-41df-a5ba-3da1705e402d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:30.504554 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-180fd40b-e504-41df-a5ba-3da1705e402d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:30.505347 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-180fd40b-e504-41df-a5ba-3da1705e402d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:30.505778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-180fd40b-e504-41df-a5ba-3da1705e402d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:30.533899 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-180fd40b-e504-41df-a5ba-3da1705e402d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042416 Jul 27 20:27:30.534443 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 755/1526] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:30 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:31.050608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-01fa19b6-1fb0-408e-80de-bbcbf44c3813 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:31.051223 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-01fa19b6-1fb0-408e-80de-bbcbf44c3813 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:31.057261 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-01fa19b6-1fb0-408e-80de-bbcbf44c3813 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:31.057718 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-01fa19b6-1fb0-408e-80de-bbcbf44c3813 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:31.058480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-01fa19b6-1fb0-408e-80de-bbcbf44c3813 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:31.058921 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-01fa19b6-1fb0-408e-80de-bbcbf44c3813 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:31.119738 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-01fa19b6-1fb0-408e-80de-bbcbf44c3813 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:31.128158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-01fa19b6-1fb0-408e-80de-bbcbf44c3813 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081368 Jul 27 20:27:31.128722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 772/1527] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:31 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:31.339814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f41f65e3-2131-4746-9645-1d7bc90f6a4f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:31.342797 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f41f65e3-2131-4746-9645-1d7bc90f6a4f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:31.349324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f41f65e3-2131-4746-9645-1d7bc90f6a4f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:31.349775 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f41f65e3-2131-4746-9645-1d7bc90f6a4f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:31.350541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f41f65e3-2131-4746-9645-1d7bc90f6a4f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:31.350980 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f41f65e3-2131-4746-9645-1d7bc90f6a4f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:31.380545 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f41f65e3-2131-4746-9645-1d7bc90f6a4f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044797 Jul 27 20:27:31.381126 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 756/1528] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:31 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:31.546868 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-61c6a4ea-a694-46ec-84fa-791ded941e53 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:31.549055 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-61c6a4ea-a694-46ec-84fa-791ded941e53 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:31.555424 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-61c6a4ea-a694-46ec-84fa-791ded941e53 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:31.555873 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-61c6a4ea-a694-46ec-84fa-791ded941e53 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:31.556632 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-61c6a4ea-a694-46ec-84fa-791ded941e53 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:31.557101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-61c6a4ea-a694-46ec-84fa-791ded941e53 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:31.585787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-61c6a4ea-a694-46ec-84fa-791ded941e53 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043618 Jul 27 20:27:31.586330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 773/1529] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:31 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:27:32.148375 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e2980d88-eefc-4b5c-ae13-eab4c35336d8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:32.149117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e2980d88-eefc-4b5c-ae13-eab4c35336d8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:32.155732 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2980d88-eefc-4b5c-ae13-eab4c35336d8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:32.156225 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2980d88-eefc-4b5c-ae13-eab4c35336d8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:32.157051 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2980d88-eefc-4b5c-ae13-eab4c35336d8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:32.157494 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2980d88-eefc-4b5c-ae13-eab4c35336d8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:32.234211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e2980d88-eefc-4b5c-ae13-eab4c35336d8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:32.241873 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e2980d88-eefc-4b5c-ae13-eab4c35336d8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.097247 Jul 27 20:27:32.242449 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 757/1530] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:32 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:32.393229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7848fc87-6f21-48d3-9407-856153514078 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:32.395389 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7848fc87-6f21-48d3-9407-856153514078 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:32.401595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7848fc87-6f21-48d3-9407-856153514078 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:32.402053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7848fc87-6f21-48d3-9407-856153514078 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:32.402852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7848fc87-6f21-48d3-9407-856153514078 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:32.403296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7848fc87-6f21-48d3-9407-856153514078 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:32.432586 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7848fc87-6f21-48d3-9407-856153514078 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043906 Jul 27 20:27:32.433173 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 774/1531] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:32 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:32.598704 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ba410367-5f90-4863-ac82-c293aaaafc45 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:32.600828 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ba410367-5f90-4863-ac82-c293aaaafc45 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:32.607342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba410367-5f90-4863-ac82-c293aaaafc45 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:32.607941 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba410367-5f90-4863-ac82-c293aaaafc45 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:32.608698 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba410367-5f90-4863-ac82-c293aaaafc45 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:32.609170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba410367-5f90-4863-ac82-c293aaaafc45 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:32.638222 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ba410367-5f90-4863-ac82-c293aaaafc45 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043603 Jul 27 20:27:32.639419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 758/1532] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:32 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:33.262516 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f8e24f21-8adf-421b-b561-642ee75abe36 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:33.263117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f8e24f21-8adf-421b-b561-642ee75abe36 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:33.269168 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f8e24f21-8adf-421b-b561-642ee75abe36 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:33.269617 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f8e24f21-8adf-421b-b561-642ee75abe36 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:33.270375 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f8e24f21-8adf-421b-b561-642ee75abe36 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:33.270814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f8e24f21-8adf-421b-b561-642ee75abe36 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:33.274692 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:27:33.331416 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f8e24f21-8adf-421b-b561-642ee75abe36 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:33.338815 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f8e24f21-8adf-421b-b561-642ee75abe36 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080201 Jul 27 20:27:33.339406 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 775/1533] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:33 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:33.443885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-10645b80-2c1f-49a7-b2c9-39998bba0b38 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:33.446072 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-10645b80-2c1f-49a7-b2c9-39998bba0b38 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:33.452429 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10645b80-2c1f-49a7-b2c9-39998bba0b38 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:33.452990 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10645b80-2c1f-49a7-b2c9-39998bba0b38 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:33.453768 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10645b80-2c1f-49a7-b2c9-39998bba0b38 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:33.454202 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10645b80-2c1f-49a7-b2c9-39998bba0b38 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:33.483585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-10645b80-2c1f-49a7-b2c9-39998bba0b38 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043812 Jul 27 20:27:33.484130 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 759/1534] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:33 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:33.651147 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-144ffac3-d69a-4b46-b0b9-88352a00c934 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:33.653283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-144ffac3-d69a-4b46-b0b9-88352a00c934 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:33.660180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-144ffac3-d69a-4b46-b0b9-88352a00c934 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:33.660632 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-144ffac3-d69a-4b46-b0b9-88352a00c934 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:33.661425 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-144ffac3-d69a-4b46-b0b9-88352a00c934 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:33.661865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-144ffac3-d69a-4b46-b0b9-88352a00c934 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:33.691699 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-144ffac3-d69a-4b46-b0b9-88352a00c934 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044501 Jul 27 20:27:33.692261 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 776/1535] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:33 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:34.360762 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f107109c-80bd-435c-a778-3ebe2c608e09 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:34.361342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f107109c-80bd-435c-a778-3ebe2c608e09 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:34.367907 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f107109c-80bd-435c-a778-3ebe2c608e09 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:34.368351 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f107109c-80bd-435c-a778-3ebe2c608e09 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:34.369153 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f107109c-80bd-435c-a778-3ebe2c608e09 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:34.369589 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f107109c-80bd-435c-a778-3ebe2c608e09 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:34.430741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f107109c-80bd-435c-a778-3ebe2c608e09 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:34.438239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f107109c-80bd-435c-a778-3ebe2c608e09 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082185 Jul 27 20:27:34.438800 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 760/1536] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:34 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:34.494995 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8bf583e3-cb70-48cb-901e-0c3f97e91c24 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:34.497152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8bf583e3-cb70-48cb-901e-0c3f97e91c24 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:34.503141 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8bf583e3-cb70-48cb-901e-0c3f97e91c24 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:34.503587 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8bf583e3-cb70-48cb-901e-0c3f97e91c24 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:34.504344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8bf583e3-cb70-48cb-901e-0c3f97e91c24 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:34.504776 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8bf583e3-cb70-48cb-901e-0c3f97e91c24 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:34.534461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8bf583e3-cb70-48cb-901e-0c3f97e91c24 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043427 Jul 27 20:27:34.535020 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 777/1537] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:34 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:34.704987 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6debbd83-89c3-47ba-a999-c77669d412b8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:34.707139 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6debbd83-89c3-47ba-a999-c77669d412b8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:34.713067 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6debbd83-89c3-47ba-a999-c77669d412b8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:34.713508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6debbd83-89c3-47ba-a999-c77669d412b8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:34.714259 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6debbd83-89c3-47ba-a999-c77669d412b8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:34.714687 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6debbd83-89c3-47ba-a999-c77669d412b8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:34.732115 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:27:34.745140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6debbd83-89c3-47ba-a999-c77669d412b8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045045 Jul 27 20:27:34.745681 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 761/1538] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:34 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:35.459403 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c7454d11-a3e5-471d-8f60-f0f110fcb87d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:35.460033 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c7454d11-a3e5-471d-8f60-f0f110fcb87d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:35.466578 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c7454d11-a3e5-471d-8f60-f0f110fcb87d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:35.467034 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c7454d11-a3e5-471d-8f60-f0f110fcb87d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:35.467805 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c7454d11-a3e5-471d-8f60-f0f110fcb87d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:35.468246 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c7454d11-a3e5-471d-8f60-f0f110fcb87d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:35.532301 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c7454d11-a3e5-471d-8f60-f0f110fcb87d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:35.539761 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c7454d11-a3e5-471d-8f60-f0f110fcb87d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084230 Jul 27 20:27:35.540331 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 778/1539] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:35 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:35.546929 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1d586774-cee4-419f-815b-4c3c9c46d132 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:35.549105 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1d586774-cee4-419f-815b-4c3c9c46d132 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:35.555563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d586774-cee4-419f-815b-4c3c9c46d132 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:35.556012 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d586774-cee4-419f-815b-4c3c9c46d132 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:35.556775 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d586774-cee4-419f-815b-4c3c9c46d132 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:35.557248 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d586774-cee4-419f-815b-4c3c9c46d132 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:35.586352 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1d586774-cee4-419f-815b-4c3c9c46d132 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043861 Jul 27 20:27:35.586900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 762/1540] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:35 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:35.756990 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a6c401f5-1d06-4aab-b073-1e683e8b78d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:35.759164 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a6c401f5-1d06-4aab-b073-1e683e8b78d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:35.765932 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6c401f5-1d06-4aab-b073-1e683e8b78d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:35.766383 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6c401f5-1d06-4aab-b073-1e683e8b78d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:35.767142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6c401f5-1d06-4aab-b073-1e683e8b78d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:35.767589 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6c401f5-1d06-4aab-b073-1e683e8b78d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:35.796453 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a6c401f5-1d06-4aab-b073-1e683e8b78d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043454 Jul 27 20:27:35.797012 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 779/1541] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:35 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:36.560661 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5218adba-e335-4d49-bfe3-dd6eb8287736 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:36.561394 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5218adba-e335-4d49-bfe3-dd6eb8287736 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:36.567842 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5218adba-e335-4d49-bfe3-dd6eb8287736 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:36.568279 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5218adba-e335-4d49-bfe3-dd6eb8287736 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:36.569054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5218adba-e335-4d49-bfe3-dd6eb8287736 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:36.569483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5218adba-e335-4d49-bfe3-dd6eb8287736 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:36.598989 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2c28ee8a-aaad-42c3-abd6-33d8d3c24718 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:36.601139 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2c28ee8a-aaad-42c3-abd6-33d8d3c24718 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:36.608441 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2c28ee8a-aaad-42c3-abd6-33d8d3c24718 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:36.609080 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2c28ee8a-aaad-42c3-abd6-33d8d3c24718 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:36.609821 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2c28ee8a-aaad-42c3-abd6-33d8d3c24718 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:36.610266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2c28ee8a-aaad-42c3-abd6-33d8d3c24718 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:36.634580 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5218adba-e335-4d49-bfe3-dd6eb8287736 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:36.639628 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2c28ee8a-aaad-42c3-abd6-33d8d3c24718 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044488 Jul 27 20:27:36.640195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 780/1542] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:36 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:36.641965 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5218adba-e335-4d49-bfe3-dd6eb8287736 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.085104 Jul 27 20:27:36.642522 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 763/1543] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:36 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:36.807651 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8e81de66-c91e-4995-b245-71634c6ce8bd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:36.809809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8e81de66-c91e-4995-b245-71634c6ce8bd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:36.815873 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8e81de66-c91e-4995-b245-71634c6ce8bd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:36.816265 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8e81de66-c91e-4995-b245-71634c6ce8bd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:36.817047 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8e81de66-c91e-4995-b245-71634c6ce8bd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:36.817488 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8e81de66-c91e-4995-b245-71634c6ce8bd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:36.846600 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8e81de66-c91e-4995-b245-71634c6ce8bd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042881 Jul 27 20:27:36.847148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 781/1544] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:36 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:27:37.651828 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d36e2fc5-2de7-4b70-afb5-0c7ba3225833 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:37.654106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d36e2fc5-2de7-4b70-afb5-0c7ba3225833 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:37.660634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d36e2fc5-2de7-4b70-afb5-0c7ba3225833 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:37.661115 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d36e2fc5-2de7-4b70-afb5-0c7ba3225833 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:37.661890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d36e2fc5-2de7-4b70-afb5-0c7ba3225833 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:37.662328 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d36e2fc5-2de7-4b70-afb5-0c7ba3225833 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:37.662833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-dd4f9623-8ce7-4faa-9284-ae6dbe8ed7d8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:37.663451 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-dd4f9623-8ce7-4faa-9284-ae6dbe8ed7d8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:37.670439 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dd4f9623-8ce7-4faa-9284-ae6dbe8ed7d8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:37.670888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dd4f9623-8ce7-4faa-9284-ae6dbe8ed7d8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:37.671650 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dd4f9623-8ce7-4faa-9284-ae6dbe8ed7d8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:37.672090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dd4f9623-8ce7-4faa-9284-ae6dbe8ed7d8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:37.693854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d36e2fc5-2de7-4b70-afb5-0c7ba3225833 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045892 Jul 27 20:27:37.694421 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 764/1545] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:37 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:37.733538 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-dd4f9623-8ce7-4faa-9284-ae6dbe8ed7d8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:37.741123 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-dd4f9623-8ce7-4faa-9284-ae6dbe8ed7d8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082088 Jul 27 20:27:37.741699 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 782/1546] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:37 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:27:37.859675 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ded580a3-832b-49e6-a577-1df503b5189f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:37.861837 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ded580a3-832b-49e6-a577-1df503b5189f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:37.867854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ded580a3-832b-49e6-a577-1df503b5189f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:37.868296 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ded580a3-832b-49e6-a577-1df503b5189f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:37.869084 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ded580a3-832b-49e6-a577-1df503b5189f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:37.869517 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ded580a3-832b-49e6-a577-1df503b5189f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:37.898252 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ded580a3-832b-49e6-a577-1df503b5189f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043175 Jul 27 20:27:37.898804 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 765/1547] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:37 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:38.707288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ff514789-1db3-4427-b638-aa11c42c46ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:38.709510 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ff514789-1db3-4427-b638-aa11c42c46ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:38.715969 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ff514789-1db3-4427-b638-aa11c42c46ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:38.716423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ff514789-1db3-4427-b638-aa11c42c46ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:38.717223 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ff514789-1db3-4427-b638-aa11c42c46ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:38.717662 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ff514789-1db3-4427-b638-aa11c42c46ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:38.745542 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ff514789-1db3-4427-b638-aa11c42c46ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042459 Jul 27 20:27:38.746094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 783/1548] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:38 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:27:38.761869 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-12699f58-7835-448f-9da9-ab9a6db5c8b8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:38.762484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-12699f58-7835-448f-9da9-ab9a6db5c8b8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:38.769725 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12699f58-7835-448f-9da9-ab9a6db5c8b8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:38.770172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12699f58-7835-448f-9da9-ab9a6db5c8b8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:38.770937 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12699f58-7835-448f-9da9-ab9a6db5c8b8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:38.771375 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12699f58-7835-448f-9da9-ab9a6db5c8b8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:38.832208 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-12699f58-7835-448f-9da9-ab9a6db5c8b8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:38.839682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-12699f58-7835-448f-9da9-ab9a6db5c8b8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081697 Jul 27 20:27:38.840241 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 766/1549] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:38 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:38.910723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6f37613c-3d73-4a28-b255-e73a1c184f6c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:38.912878 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6f37613c-3d73-4a28-b255-e73a1c184f6c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:38.918907 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6f37613c-3d73-4a28-b255-e73a1c184f6c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:38.919363 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6f37613c-3d73-4a28-b255-e73a1c184f6c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:38.920288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6f37613c-3d73-4a28-b255-e73a1c184f6c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:38.920859 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6f37613c-3d73-4a28-b255-e73a1c184f6c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:38.959023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6f37613c-3d73-4a28-b255-e73a1c184f6c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052354 Jul 27 20:27:38.959506 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 784/1550] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:38 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:39.758560 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fb6db6c9-e6ce-4230-8ac7-f85134952134 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:39.760741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fb6db6c9-e6ce-4230-8ac7-f85134952134 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:39.767798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fb6db6c9-e6ce-4230-8ac7-f85134952134 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:39.768359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fb6db6c9-e6ce-4230-8ac7-f85134952134 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:39.769015 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fb6db6c9-e6ce-4230-8ac7-f85134952134 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:39.769459 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fb6db6c9-e6ce-4230-8ac7-f85134952134 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:39.798024 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fb6db6c9-e6ce-4230-8ac7-f85134952134 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043389 Jul 27 20:27:39.798566 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 767/1551] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:39 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:39.860045 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0441312c-b0a8-40ad-8bda-6e4c1e45219b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:39.860669 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0441312c-b0a8-40ad-8bda-6e4c1e45219b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:39.867128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0441312c-b0a8-40ad-8bda-6e4c1e45219b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:39.867584 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0441312c-b0a8-40ad-8bda-6e4c1e45219b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:39.868355 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0441312c-b0a8-40ad-8bda-6e4c1e45219b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:39.868795 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0441312c-b0a8-40ad-8bda-6e4c1e45219b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:39.930633 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0441312c-b0a8-40ad-8bda-6e4c1e45219b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:39.938475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0441312c-b0a8-40ad-8bda-6e4c1e45219b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082618 Jul 27 20:27:39.939041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 785/1552] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:39 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:39.971984 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4cbf487a-7964-4e23-9094-d744ae852804 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:39.974203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4cbf487a-7964-4e23-9094-d744ae852804 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:39.980167 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4cbf487a-7964-4e23-9094-d744ae852804 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:39.980621 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4cbf487a-7964-4e23-9094-d744ae852804 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:39.981417 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4cbf487a-7964-4e23-9094-d744ae852804 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:39.981853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4cbf487a-7964-4e23-9094-d744ae852804 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:40.010203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4cbf487a-7964-4e23-9094-d744ae852804 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042145 Jul 27 20:27:40.010674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 768/1553] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:39 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:40.811348 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a61503ee-7f17-4f9e-a8ee-a22294e65262 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:40.813484 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a61503ee-7f17-4f9e-a8ee-a22294e65262 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:40.819479 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a61503ee-7f17-4f9e-a8ee-a22294e65262 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:40.819936 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a61503ee-7f17-4f9e-a8ee-a22294e65262 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:40.820703 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a61503ee-7f17-4f9e-a8ee-a22294e65262 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:40.821181 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a61503ee-7f17-4f9e-a8ee-a22294e65262 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:40.849274 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a61503ee-7f17-4f9e-a8ee-a22294e65262 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042623 Jul 27 20:27:40.849827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 786/1554] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:40 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:40.959818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4ec8f600-3bc4-4163-adfd-c61c314e727d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:40.960438 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4ec8f600-3bc4-4163-adfd-c61c314e727d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:40.967645 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ec8f600-3bc4-4163-adfd-c61c314e727d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:40.968100 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ec8f600-3bc4-4163-adfd-c61c314e727d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:40.968868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ec8f600-3bc4-4163-adfd-c61c314e727d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:40.969349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ec8f600-3bc4-4163-adfd-c61c314e727d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:41.023822 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8c80bb5d-5143-40df-8ac0-5380ed259fef tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:41.026088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8c80bb5d-5143-40df-8ac0-5380ed259fef tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:41.029980 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4ec8f600-3bc4-4163-adfd-c61c314e727d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:41.033650 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8c80bb5d-5143-40df-8ac0-5380ed259fef tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:41.034106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8c80bb5d-5143-40df-8ac0-5380ed259fef tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:41.034889 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8c80bb5d-5143-40df-8ac0-5380ed259fef tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:41.035330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8c80bb5d-5143-40df-8ac0-5380ed259fef tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:41.037507 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4ec8f600-3bc4-4163-adfd-c61c314e727d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081542 Jul 27 20:27:41.038065 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 769/1555] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:40 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:41.071094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8c80bb5d-5143-40df-8ac0-5380ed259fef tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051126 Jul 27 20:27:41.071561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 787/1556] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:41 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:27:41.862274 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-679ae2f3-29cb-4c61-b621-fb07ffbd4239 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:41.864432 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-679ae2f3-29cb-4c61-b621-fb07ffbd4239 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:41.870474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-679ae2f3-29cb-4c61-b621-fb07ffbd4239 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:41.870926 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-679ae2f3-29cb-4c61-b621-fb07ffbd4239 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:41.871697 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-679ae2f3-29cb-4c61-b621-fb07ffbd4239 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:41.872144 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-679ae2f3-29cb-4c61-b621-fb07ffbd4239 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:41.901655 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-679ae2f3-29cb-4c61-b621-fb07ffbd4239 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043923 Jul 27 20:27:41.902203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 770/1557] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:41 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:42.058212 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-48779d6a-a33a-49d6-a107-96fe0985ca64 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:42.058826 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-48779d6a-a33a-49d6-a107-96fe0985ca64 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:42.065652 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48779d6a-a33a-49d6-a107-96fe0985ca64 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:42.066103 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48779d6a-a33a-49d6-a107-96fe0985ca64 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:42.066867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48779d6a-a33a-49d6-a107-96fe0985ca64 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:42.067303 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48779d6a-a33a-49d6-a107-96fe0985ca64 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:42.083425 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-11de4186-1ff6-459a-b223-6c7aff40406e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:42.085619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-11de4186-1ff6-459a-b223-6c7aff40406e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:42.092784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11de4186-1ff6-459a-b223-6c7aff40406e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:42.093278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11de4186-1ff6-459a-b223-6c7aff40406e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:42.094083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11de4186-1ff6-459a-b223-6c7aff40406e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:42.094502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11de4186-1ff6-459a-b223-6c7aff40406e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:42.124376 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-11de4186-1ff6-459a-b223-6c7aff40406e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044742 Jul 27 20:27:42.124856 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 771/1558] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:42 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:27:42.134121 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-48779d6a-a33a-49d6-a107-96fe0985ca64 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:42.142241 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-48779d6a-a33a-49d6-a107-96fe0985ca64 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.087900 Jul 27 20:27:42.142793 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 788/1559] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:42 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:42.914456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5a54a56d-468f-4250-b73a-a84fe1bc0ff4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:42.916637 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5a54a56d-468f-4250-b73a-a84fe1bc0ff4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:42.923444 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a54a56d-468f-4250-b73a-a84fe1bc0ff4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:42.923894 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a54a56d-468f-4250-b73a-a84fe1bc0ff4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:42.924661 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a54a56d-468f-4250-b73a-a84fe1bc0ff4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:42.925140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a54a56d-468f-4250-b73a-a84fe1bc0ff4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:42.954570 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5a54a56d-468f-4250-b73a-a84fe1bc0ff4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044037 Jul 27 20:27:42.955122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 772/1560] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:42 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:43.137521 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cb6cc2aa-9c91-408e-9e74-1cd216b4fb84 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:43.139977 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cb6cc2aa-9c91-408e-9e74-1cd216b4fb84 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:43.146726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb6cc2aa-9c91-408e-9e74-1cd216b4fb84 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:43.147177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb6cc2aa-9c91-408e-9e74-1cd216b4fb84 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:43.147955 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb6cc2aa-9c91-408e-9e74-1cd216b4fb84 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:43.148404 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb6cc2aa-9c91-408e-9e74-1cd216b4fb84 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:43.164077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5b03f905-546c-41d8-ae2d-655c7002dc27 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:43.165077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5b03f905-546c-41d8-ae2d-655c7002dc27 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:43.172861 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b03f905-546c-41d8-ae2d-655c7002dc27 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:43.173500 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b03f905-546c-41d8-ae2d-655c7002dc27 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:43.174356 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b03f905-546c-41d8-ae2d-655c7002dc27 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:43.175022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b03f905-546c-41d8-ae2d-655c7002dc27 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:43.187637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cb6cc2aa-9c91-408e-9e74-1cd216b4fb84 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054038 Jul 27 20:27:43.188411 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 789/1561] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:43 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:43.236468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5b03f905-546c-41d8-ae2d-655c7002dc27 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:43.243998 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5b03f905-546c-41d8-ae2d-655c7002dc27 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083930 Jul 27 20:27:43.244565 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 773/1562] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:43 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:43.967164 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-334e4253-46c4-4206-bbc6-35a53f0d6a5e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:43.969377 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-334e4253-46c4-4206-bbc6-35a53f0d6a5e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:43.975412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-334e4253-46c4-4206-bbc6-35a53f0d6a5e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:43.975868 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-334e4253-46c4-4206-bbc6-35a53f0d6a5e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:43.976641 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-334e4253-46c4-4206-bbc6-35a53f0d6a5e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:43.977132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-334e4253-46c4-4206-bbc6-35a53f0d6a5e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:44.005827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-334e4253-46c4-4206-bbc6-35a53f0d6a5e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042726 Jul 27 20:27:44.006387 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 790/1563] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:43 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:44.200044 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-af6ddb58-2e4d-4aba-a651-794e8ebb735c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:44.202870 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-af6ddb58-2e4d-4aba-a651-794e8ebb735c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:44.209273 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af6ddb58-2e4d-4aba-a651-794e8ebb735c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:44.209720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af6ddb58-2e4d-4aba-a651-794e8ebb735c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:44.210478 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af6ddb58-2e4d-4aba-a651-794e8ebb735c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:44.210909 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af6ddb58-2e4d-4aba-a651-794e8ebb735c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:44.241389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-af6ddb58-2e4d-4aba-a651-794e8ebb735c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045190 Jul 27 20:27:44.241908 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 774/1564] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:44 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:44.265242 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8801c2d2-0e39-4570-9803-268d80e4b89b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:44.265862 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8801c2d2-0e39-4570-9803-268d80e4b89b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:44.272268 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8801c2d2-0e39-4570-9803-268d80e4b89b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:44.272726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8801c2d2-0e39-4570-9803-268d80e4b89b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:44.273530 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8801c2d2-0e39-4570-9803-268d80e4b89b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:44.273971 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8801c2d2-0e39-4570-9803-268d80e4b89b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:44.337410 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8801c2d2-0e39-4570-9803-268d80e4b89b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:44.340777 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:27:44.346896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8801c2d2-0e39-4570-9803-268d80e4b89b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.086029 Jul 27 20:27:44.347470 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 791/1565] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:44 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:45.017968 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b8435017-21fd-4839-8971-bbb3c144d4ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:45.020140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b8435017-21fd-4839-8971-bbb3c144d4ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:45.026135 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b8435017-21fd-4839-8971-bbb3c144d4ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:45.026577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b8435017-21fd-4839-8971-bbb3c144d4ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:45.027323 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b8435017-21fd-4839-8971-bbb3c144d4ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:45.027808 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b8435017-21fd-4839-8971-bbb3c144d4ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:45.056623 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b8435017-21fd-4839-8971-bbb3c144d4ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043309 Jul 27 20:27:45.057203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 775/1566] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:45 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:45.254525 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c02663b0-2b5d-4030-8f7e-623fa569e589 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:45.256642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c02663b0-2b5d-4030-8f7e-623fa569e589 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:45.262692 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c02663b0-2b5d-4030-8f7e-623fa569e589 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:45.263145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c02663b0-2b5d-4030-8f7e-623fa569e589 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:45.263964 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c02663b0-2b5d-4030-8f7e-623fa569e589 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:45.264408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c02663b0-2b5d-4030-8f7e-623fa569e589 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:45.292876 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c02663b0-2b5d-4030-8f7e-623fa569e589 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042474 Jul 27 20:27:45.293500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 792/1567] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:45 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:45.367525 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7b81dbd7-f6ca-4e65-978c-e75970468657 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:45.368144 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7b81dbd7-f6ca-4e65-978c-e75970468657 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:45.375402 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b81dbd7-f6ca-4e65-978c-e75970468657 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:45.375855 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b81dbd7-f6ca-4e65-978c-e75970468657 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:45.376622 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b81dbd7-f6ca-4e65-978c-e75970468657 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:45.377109 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b81dbd7-f6ca-4e65-978c-e75970468657 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:45.441169 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7b81dbd7-f6ca-4e65-978c-e75970468657 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:45.448672 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7b81dbd7-f6ca-4e65-978c-e75970468657 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.085044 Jul 27 20:27:45.449270 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 776/1568] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:45 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:46.069323 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6da89a3c-d150-4187-bfba-71c70c9d35de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:46.071476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6da89a3c-d150-4187-bfba-71c70c9d35de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:46.078465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6da89a3c-d150-4187-bfba-71c70c9d35de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:46.078925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6da89a3c-d150-4187-bfba-71c70c9d35de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:46.079695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6da89a3c-d150-4187-bfba-71c70c9d35de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:46.080137 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6da89a3c-d150-4187-bfba-71c70c9d35de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:46.109326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6da89a3c-d150-4187-bfba-71c70c9d35de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043954 Jul 27 20:27:46.109886 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 793/1569] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:46 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:46.305737 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8f95675d-b9f9-41d8-b095-f501d471a647 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:46.307868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8f95675d-b9f9-41d8-b095-f501d471a647 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:46.314081 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8f95675d-b9f9-41d8-b095-f501d471a647 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:46.314525 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8f95675d-b9f9-41d8-b095-f501d471a647 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:46.315279 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8f95675d-b9f9-41d8-b095-f501d471a647 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:46.315711 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8f95675d-b9f9-41d8-b095-f501d471a647 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:46.345508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8f95675d-b9f9-41d8-b095-f501d471a647 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043595 Jul 27 20:27:46.345987 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 777/1570] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:46 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:46.470632 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e4116d2d-a2ca-4d8a-86fb-71368f1eecb4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:46.471242 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e4116d2d-a2ca-4d8a-86fb-71368f1eecb4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:46.477819 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4116d2d-a2ca-4d8a-86fb-71368f1eecb4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:46.478267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4116d2d-a2ca-4d8a-86fb-71368f1eecb4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:46.479028 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4116d2d-a2ca-4d8a-86fb-71368f1eecb4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:46.479463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4116d2d-a2ca-4d8a-86fb-71368f1eecb4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:46.540344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e4116d2d-a2ca-4d8a-86fb-71368f1eecb4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:46.548894 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e4116d2d-a2ca-4d8a-86fb-71368f1eecb4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082640 Jul 27 20:27:46.549499 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 794/1571] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:46 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:27:47.121522 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b498c2ee-6e04-455a-8091-f75164db5380 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:47.123858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b498c2ee-6e04-455a-8091-f75164db5380 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:47.130296 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b498c2ee-6e04-455a-8091-f75164db5380 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:47.130734 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b498c2ee-6e04-455a-8091-f75164db5380 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:47.131495 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b498c2ee-6e04-455a-8091-f75164db5380 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:47.131925 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b498c2ee-6e04-455a-8091-f75164db5380 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:47.135555 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:27:47.160613 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b498c2ee-6e04-455a-8091-f75164db5380 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042970 Jul 27 20:27:47.161183 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 778/1572] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:47 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:47.357271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-111dbbdd-1f9e-4df6-8d03-0ffd95d368b3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:47.359342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-111dbbdd-1f9e-4df6-8d03-0ffd95d368b3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:47.365333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-111dbbdd-1f9e-4df6-8d03-0ffd95d368b3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:47.365792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-111dbbdd-1f9e-4df6-8d03-0ffd95d368b3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:47.366566 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-111dbbdd-1f9e-4df6-8d03-0ffd95d368b3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:47.367001 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-111dbbdd-1f9e-4df6-8d03-0ffd95d368b3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:47.396123 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-111dbbdd-1f9e-4df6-8d03-0ffd95d368b3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042966 Jul 27 20:27:47.396664 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 795/1573] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:47 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:47.569516 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-093f6e86-ed0d-4415-bbf9-0d140440ff78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:47.570118 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-093f6e86-ed0d-4415-bbf9-0d140440ff78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:47.576866 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-093f6e86-ed0d-4415-bbf9-0d140440ff78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:47.577346 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-093f6e86-ed0d-4415-bbf9-0d140440ff78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:47.578118 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-093f6e86-ed0d-4415-bbf9-0d140440ff78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:47.578556 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-093f6e86-ed0d-4415-bbf9-0d140440ff78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:47.639860 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-093f6e86-ed0d-4415-bbf9-0d140440ff78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:47.647341 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-093f6e86-ed0d-4415-bbf9-0d140440ff78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081808 Jul 27 20:27:47.647903 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 779/1574] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:47 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:48.173835 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-769a8b75-7dbc-48ce-8f48-1f9defa9e08c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:48.176020 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-769a8b75-7dbc-48ce-8f48-1f9defa9e08c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:48.182585 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-769a8b75-7dbc-48ce-8f48-1f9defa9e08c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:48.183041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-769a8b75-7dbc-48ce-8f48-1f9defa9e08c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:48.183808 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-769a8b75-7dbc-48ce-8f48-1f9defa9e08c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:48.184247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-769a8b75-7dbc-48ce-8f48-1f9defa9e08c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:48.213747 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-769a8b75-7dbc-48ce-8f48-1f9defa9e08c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044464 Jul 27 20:27:48.214320 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 796/1575] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:48 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:48.409426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6868530a-1da7-45a8-941c-90fe6d9a82bb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:48.411583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6868530a-1da7-45a8-941c-90fe6d9a82bb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:48.417683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6868530a-1da7-45a8-941c-90fe6d9a82bb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:48.418133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6868530a-1da7-45a8-941c-90fe6d9a82bb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:48.418900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6868530a-1da7-45a8-941c-90fe6d9a82bb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:48.419337 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6868530a-1da7-45a8-941c-90fe6d9a82bb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:48.449455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6868530a-1da7-45a8-941c-90fe6d9a82bb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044305 Jul 27 20:27:48.450002 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 780/1576] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:48 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:48.667530 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a73eda74-8b4a-4d78-b4b3-c16629d7b023 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:48.668070 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a73eda74-8b4a-4d78-b4b3-c16629d7b023 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:48.674705 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a73eda74-8b4a-4d78-b4b3-c16629d7b023 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:48.675159 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a73eda74-8b4a-4d78-b4b3-c16629d7b023 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:48.675924 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a73eda74-8b4a-4d78-b4b3-c16629d7b023 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:48.676364 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a73eda74-8b4a-4d78-b4b3-c16629d7b023 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:48.738017 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a73eda74-8b4a-4d78-b4b3-c16629d7b023 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:48.745505 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a73eda74-8b4a-4d78-b4b3-c16629d7b023 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081909 Jul 27 20:27:48.746077 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 797/1577] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:48 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:49.225702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b0b97e27-8f52-4d39-a7e7-a452cccbae5a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:49.227866 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b0b97e27-8f52-4d39-a7e7-a452cccbae5a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:49.235252 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0b97e27-8f52-4d39-a7e7-a452cccbae5a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:49.235699 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0b97e27-8f52-4d39-a7e7-a452cccbae5a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:49.236456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0b97e27-8f52-4d39-a7e7-a452cccbae5a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:49.236887 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0b97e27-8f52-4d39-a7e7-a452cccbae5a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:49.266204 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b0b97e27-8f52-4d39-a7e7-a452cccbae5a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044446 Jul 27 20:27:49.266759 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 781/1578] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:49 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:49.462787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e0d899a5-876b-42c2-958f-5b7c42c0ea68 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:49.464897 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e0d899a5-876b-42c2-958f-5b7c42c0ea68 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:49.472201 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e0d899a5-876b-42c2-958f-5b7c42c0ea68 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:49.472657 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e0d899a5-876b-42c2-958f-5b7c42c0ea68 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:49.473456 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e0d899a5-876b-42c2-958f-5b7c42c0ea68 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:49.473899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e0d899a5-876b-42c2-958f-5b7c42c0ea68 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:49.503235 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e0d899a5-876b-42c2-958f-5b7c42c0ea68 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044738 Jul 27 20:27:49.503798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 798/1579] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:49 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:49.766905 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3d8e7bc4-09e5-47b7-bda5-094e4c06b8c1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:49.767671 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3d8e7bc4-09e5-47b7-bda5-094e4c06b8c1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:49.773717 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d8e7bc4-09e5-47b7-bda5-094e4c06b8c1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:49.774166 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d8e7bc4-09e5-47b7-bda5-094e4c06b8c1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:49.774931 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d8e7bc4-09e5-47b7-bda5-094e4c06b8c1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:49.775370 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d8e7bc4-09e5-47b7-bda5-094e4c06b8c1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:49.842512 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3d8e7bc4-09e5-47b7-bda5-094e4c06b8c1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:49.850412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3d8e7bc4-09e5-47b7-bda5-094e4c06b8c1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.087829 Jul 27 20:27:49.851195 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 782/1580] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:49 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:50.278428 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6c351582-3116-4f01-ab13-b290a415430b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:50.280568 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6c351582-3116-4f01-ab13-b290a415430b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:50.286623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6c351582-3116-4f01-ab13-b290a415430b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:50.287081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6c351582-3116-4f01-ab13-b290a415430b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:50.287853 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6c351582-3116-4f01-ab13-b290a415430b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:50.288300 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6c351582-3116-4f01-ab13-b290a415430b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:50.317498 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6c351582-3116-4f01-ab13-b290a415430b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043003 Jul 27 20:27:50.318046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 799/1581] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:50 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:50.515634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ef902383-ad8a-482a-9405-043cc3b3b204 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:50.517816 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ef902383-ad8a-482a-9405-043cc3b3b204 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:50.524269 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef902383-ad8a-482a-9405-043cc3b3b204 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:50.524711 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef902383-ad8a-482a-9405-043cc3b3b204 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:50.525494 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef902383-ad8a-482a-9405-043cc3b3b204 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:50.525921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef902383-ad8a-482a-9405-043cc3b3b204 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:50.554193 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ef902383-ad8a-482a-9405-043cc3b3b204 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042551 Jul 27 20:27:50.554736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 783/1582] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:50 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:50.871806 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-36188cf3-aebe-4249-a3fe-bf5dbf894030 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:50.872345 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-36188cf3-aebe-4249-a3fe-bf5dbf894030 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:50.878831 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-36188cf3-aebe-4249-a3fe-bf5dbf894030 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:50.879282 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-36188cf3-aebe-4249-a3fe-bf5dbf894030 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:50.880047 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-36188cf3-aebe-4249-a3fe-bf5dbf894030 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:50.880493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-36188cf3-aebe-4249-a3fe-bf5dbf894030 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:50.940932 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-36188cf3-aebe-4249-a3fe-bf5dbf894030 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:50.948461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-36188cf3-aebe-4249-a3fe-bf5dbf894030 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080575 Jul 27 20:27:50.949046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 800/1583] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:50 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:51.330142 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ee2a8ce7-f76f-4e93-91d4-3d30dfe50435 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:51.332296 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ee2a8ce7-f76f-4e93-91d4-3d30dfe50435 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:51.338322 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee2a8ce7-f76f-4e93-91d4-3d30dfe50435 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:51.338773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee2a8ce7-f76f-4e93-91d4-3d30dfe50435 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:51.339535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee2a8ce7-f76f-4e93-91d4-3d30dfe50435 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:51.339971 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee2a8ce7-f76f-4e93-91d4-3d30dfe50435 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:51.368977 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ee2a8ce7-f76f-4e93-91d4-3d30dfe50435 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043493 Jul 27 20:27:51.369537 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 784/1584] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:51 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:51.566268 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-962b193a-2870-478f-b070-fa0796a62c7d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:51.568429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-962b193a-2870-478f-b070-fa0796a62c7d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:51.574532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-962b193a-2870-478f-b070-fa0796a62c7d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:51.574990 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-962b193a-2870-478f-b070-fa0796a62c7d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:51.576043 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-962b193a-2870-478f-b070-fa0796a62c7d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:51.576490 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-962b193a-2870-478f-b070-fa0796a62c7d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:51.605029 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-962b193a-2870-478f-b070-fa0796a62c7d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042667 Jul 27 20:27:51.605517 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 801/1585] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:51 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:51.970476 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c182ec5c-1ed4-4f0f-adad-76296ae4d96c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:51.971096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c182ec5c-1ed4-4f0f-adad-76296ae4d96c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:51.977659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c182ec5c-1ed4-4f0f-adad-76296ae4d96c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:51.978273 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c182ec5c-1ed4-4f0f-adad-76296ae4d96c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:51.979163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c182ec5c-1ed4-4f0f-adad-76296ae4d96c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:51.979604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c182ec5c-1ed4-4f0f-adad-76296ae4d96c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:52.045815 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c182ec5c-1ed4-4f0f-adad-76296ae4d96c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:52.053494 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c182ec5c-1ed4-4f0f-adad-76296ae4d96c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.087642 Jul 27 20:27:52.054074 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 785/1586] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:51 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:52.382537 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-be9f6cd1-d026-4093-9a6b-db3f2ec53398 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:52.384677 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-be9f6cd1-d026-4093-9a6b-db3f2ec53398 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:52.387305 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=83 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:27:52.394014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-be9f6cd1-d026-4093-9a6b-db3f2ec53398 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:52.394472 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-be9f6cd1-d026-4093-9a6b-db3f2ec53398 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:52.395761 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-be9f6cd1-d026-4093-9a6b-db3f2ec53398 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:52.396299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-be9f6cd1-d026-4093-9a6b-db3f2ec53398 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:52.437243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-be9f6cd1-d026-4093-9a6b-db3f2ec53398 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059446 Jul 27 20:27:52.437815 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 802/1587] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:52 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:52.618604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-adbd1110-e55e-4fbd-9ebf-13e922fa6192 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:52.620654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-adbd1110-e55e-4fbd-9ebf-13e922fa6192 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:52.627337 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-adbd1110-e55e-4fbd-9ebf-13e922fa6192 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:52.627775 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-adbd1110-e55e-4fbd-9ebf-13e922fa6192 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:52.628526 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-adbd1110-e55e-4fbd-9ebf-13e922fa6192 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:52.628955 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-adbd1110-e55e-4fbd-9ebf-13e922fa6192 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:52.659133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-adbd1110-e55e-4fbd-9ebf-13e922fa6192 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044504 Jul 27 20:27:52.659697 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 786/1588] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:52 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:53.074077 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5e48713c-47ec-43d5-8e58-8de9b164292d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:53.074695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5e48713c-47ec-43d5-8e58-8de9b164292d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:53.081668 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5e48713c-47ec-43d5-8e58-8de9b164292d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:53.082119 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5e48713c-47ec-43d5-8e58-8de9b164292d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:53.082887 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5e48713c-47ec-43d5-8e58-8de9b164292d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:53.083328 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5e48713c-47ec-43d5-8e58-8de9b164292d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:53.145602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5e48713c-47ec-43d5-8e58-8de9b164292d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:53.153007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5e48713c-47ec-43d5-8e58-8de9b164292d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082798 Jul 27 20:27:53.153571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 803/1589] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:53 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:53.449425 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b6f854d4-7a90-45da-a7c2-2f691ceced0d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:53.451859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b6f854d4-7a90-45da-a7c2-2f691ceced0d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:53.454146 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=85 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:27:53.459184 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6f854d4-7a90-45da-a7c2-2f691ceced0d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:53.459670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6f854d4-7a90-45da-a7c2-2f691ceced0d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:53.460430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6f854d4-7a90-45da-a7c2-2f691ceced0d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:53.460862 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6f854d4-7a90-45da-a7c2-2f691ceced0d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:53.490038 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b6f854d4-7a90-45da-a7c2-2f691ceced0d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044511 Jul 27 20:27:53.490588 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 787/1590] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:53 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:53.672479 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-67f74f91-f4d9-4598-8deb-617592bd5e1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:53.674680 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-67f74f91-f4d9-4598-8deb-617592bd5e1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:53.681233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-67f74f91-f4d9-4598-8deb-617592bd5e1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:53.681689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-67f74f91-f4d9-4598-8deb-617592bd5e1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:53.682457 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-67f74f91-f4d9-4598-8deb-617592bd5e1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:53.682897 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-67f74f91-f4d9-4598-8deb-617592bd5e1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:53.711131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-67f74f91-f4d9-4598-8deb-617592bd5e1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043386 Jul 27 20:27:53.711679 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 804/1591] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:53 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:54.174363 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-52f49038-9604-4207-bb4d-b8c903cfa257 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:54.174976 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-52f49038-9604-4207-bb4d-b8c903cfa257 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:54.181254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-52f49038-9604-4207-bb4d-b8c903cfa257 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:54.181702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-52f49038-9604-4207-bb4d-b8c903cfa257 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:54.182468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-52f49038-9604-4207-bb4d-b8c903cfa257 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:54.182905 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-52f49038-9604-4207-bb4d-b8c903cfa257 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:54.246453 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-52f49038-9604-4207-bb4d-b8c903cfa257 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:54.253917 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-52f49038-9604-4207-bb4d-b8c903cfa257 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.085094 Jul 27 20:27:54.254474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 788/1592] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:54 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:54.502738 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-44f0554c-ec68-4180-a5f5-d2dc6b821f6b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:54.504880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-44f0554c-ec68-4180-a5f5-d2dc6b821f6b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:54.511311 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-44f0554c-ec68-4180-a5f5-d2dc6b821f6b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:54.511765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-44f0554c-ec68-4180-a5f5-d2dc6b821f6b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:54.512530 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-44f0554c-ec68-4180-a5f5-d2dc6b821f6b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:54.512985 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-44f0554c-ec68-4180-a5f5-d2dc6b821f6b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:54.541494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-44f0554c-ec68-4180-a5f5-d2dc6b821f6b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042643 Jul 27 20:27:54.542049 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 805/1593] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:54 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:54.723530 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dfb5099b-0cd6-4e6e-a2ed-24dfc041a206 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:54.725722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dfb5099b-0cd6-4e6e-a2ed-24dfc041a206 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:54.732148 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dfb5099b-0cd6-4e6e-a2ed-24dfc041a206 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:54.732759 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dfb5099b-0cd6-4e6e-a2ed-24dfc041a206 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:54.733550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dfb5099b-0cd6-4e6e-a2ed-24dfc041a206 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:54.733985 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dfb5099b-0cd6-4e6e-a2ed-24dfc041a206 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:54.763179 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dfb5099b-0cd6-4e6e-a2ed-24dfc041a206 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043591 Jul 27 20:27:54.764235 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 789/1594] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:54 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:55.275280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-83a44355-050f-4c41-883c-a92cab347b71 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:55.275913 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-83a44355-050f-4c41-883c-a92cab347b71 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:55.283003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-83a44355-050f-4c41-883c-a92cab347b71 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:55.283448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-83a44355-050f-4c41-883c-a92cab347b71 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:55.284204 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-83a44355-050f-4c41-883c-a92cab347b71 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:55.284634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-83a44355-050f-4c41-883c-a92cab347b71 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:55.344579 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-83a44355-050f-4c41-883c-a92cab347b71 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:55.351872 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-83a44355-050f-4c41-883c-a92cab347b71 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080565 Jul 27 20:27:55.352444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 806/1595] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:55 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:55.553694 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6716c20b-f4f9-4b23-a7a0-83d07be318ca tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:55.555852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6716c20b-f4f9-4b23-a7a0-83d07be318ca tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:55.562100 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6716c20b-f4f9-4b23-a7a0-83d07be318ca tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:55.562545 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6716c20b-f4f9-4b23-a7a0-83d07be318ca tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:55.563301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6716c20b-f4f9-4b23-a7a0-83d07be318ca tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:55.563731 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6716c20b-f4f9-4b23-a7a0-83d07be318ca tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:55.593423 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6716c20b-f4f9-4b23-a7a0-83d07be318ca tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043554 Jul 27 20:27:55.593906 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 790/1596] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:55 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:55.776000 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a9096556-f135-4f52-b341-e92983a0850c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:55.778180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a9096556-f135-4f52-b341-e92983a0850c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:55.784896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a9096556-f135-4f52-b341-e92983a0850c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:55.785382 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a9096556-f135-4f52-b341-e92983a0850c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:55.786150 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a9096556-f135-4f52-b341-e92983a0850c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:55.786589 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a9096556-f135-4f52-b341-e92983a0850c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:55.817857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a9096556-f135-4f52-b341-e92983a0850c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045851 Jul 27 20:27:55.818431 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 807/1597] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:55 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:56.373895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bf71f5ea-d336-4a1c-bfb6-ace29c3c490c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:56.374427 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bf71f5ea-d336-4a1c-bfb6-ace29c3c490c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:56.381018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf71f5ea-d336-4a1c-bfb6-ace29c3c490c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:56.381475 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf71f5ea-d336-4a1c-bfb6-ace29c3c490c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:56.382232 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf71f5ea-d336-4a1c-bfb6-ace29c3c490c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:56.382669 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf71f5ea-d336-4a1c-bfb6-ace29c3c490c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:56.444634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bf71f5ea-d336-4a1c-bfb6-ace29c3c490c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:56.453488 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bf71f5ea-d336-4a1c-bfb6-ace29c3c490c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084357 Jul 27 20:27:56.454047 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 791/1598] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:56 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:56.605450 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6a78ef53-1cbe-4283-802c-fa9c2e635ab7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:56.608232 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6a78ef53-1cbe-4283-802c-fa9c2e635ab7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:56.614632 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6a78ef53-1cbe-4283-802c-fa9c2e635ab7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:56.615075 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6a78ef53-1cbe-4283-802c-fa9c2e635ab7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:56.615828 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6a78ef53-1cbe-4283-802c-fa9c2e635ab7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:56.616260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6a78ef53-1cbe-4283-802c-fa9c2e635ab7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:56.633078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:27:56.645783 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6a78ef53-1cbe-4283-802c-fa9c2e635ab7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044293 Jul 27 20:27:56.646353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 808/1599] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:56 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:56.831052 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0196e35a-b015-46fc-abfc-b6cd4d0a426b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:56.833228 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0196e35a-b015-46fc-abfc-b6cd4d0a426b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:56.839199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0196e35a-b015-46fc-abfc-b6cd4d0a426b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:56.839649 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0196e35a-b015-46fc-abfc-b6cd4d0a426b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:56.840407 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0196e35a-b015-46fc-abfc-b6cd4d0a426b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:56.840840 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0196e35a-b015-46fc-abfc-b6cd4d0a426b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:56.869495 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0196e35a-b015-46fc-abfc-b6cd4d0a426b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042420 Jul 27 20:27:56.870047 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 792/1600] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:56 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:57.474326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ba2ed1d1-7d26-402f-a1b8-2b7bc2ef6aaa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:57.474945 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ba2ed1d1-7d26-402f-a1b8-2b7bc2ef6aaa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:57.480919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ba2ed1d1-7d26-402f-a1b8-2b7bc2ef6aaa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:57.481404 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ba2ed1d1-7d26-402f-a1b8-2b7bc2ef6aaa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:57.482847 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ba2ed1d1-7d26-402f-a1b8-2b7bc2ef6aaa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:57.483285 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ba2ed1d1-7d26-402f-a1b8-2b7bc2ef6aaa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:57.543213 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ba2ed1d1-7d26-402f-a1b8-2b7bc2ef6aaa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:57.551369 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ba2ed1d1-7d26-402f-a1b8-2b7bc2ef6aaa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080955 Jul 27 20:27:57.551936 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 809/1601] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:57 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:57.657665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-487e1af3-e2fb-496f-9251-ce97e551d496 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:57.659825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-487e1af3-e2fb-496f-9251-ce97e551d496 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:57.666203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-487e1af3-e2fb-496f-9251-ce97e551d496 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:57.666647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-487e1af3-e2fb-496f-9251-ce97e551d496 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:57.667399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-487e1af3-e2fb-496f-9251-ce97e551d496 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:57.667826 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-487e1af3-e2fb-496f-9251-ce97e551d496 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:57.697432 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-487e1af3-e2fb-496f-9251-ce97e551d496 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044105 Jul 27 20:27:57.697977 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 793/1602] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:57 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:57.882409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-daa2299e-265c-4412-ba1f-39447a0af767 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:57.884451 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-daa2299e-265c-4412-ba1f-39447a0af767 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:57.891539 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-daa2299e-265c-4412-ba1f-39447a0af767 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:57.891981 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-daa2299e-265c-4412-ba1f-39447a0af767 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:57.892731 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-daa2299e-265c-4412-ba1f-39447a0af767 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:57.893198 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-daa2299e-265c-4412-ba1f-39447a0af767 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:57.922064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-daa2299e-265c-4412-ba1f-39447a0af767 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043688 Jul 27 20:27:57.922610 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 810/1603] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:57 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:58.571818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cafb64b8-7eff-4471-8a56-b4a0214c5ea6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:58.572461 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cafb64b8-7eff-4471-8a56-b4a0214c5ea6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:58.579096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cafb64b8-7eff-4471-8a56-b4a0214c5ea6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:58.579549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cafb64b8-7eff-4471-8a56-b4a0214c5ea6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:58.580311 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cafb64b8-7eff-4471-8a56-b4a0214c5ea6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:58.580749 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cafb64b8-7eff-4471-8a56-b4a0214c5ea6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:58.641287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cafb64b8-7eff-4471-8a56-b4a0214c5ea6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:58.644617 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:27:58.649803 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cafb64b8-7eff-4471-8a56-b4a0214c5ea6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081896 Jul 27 20:27:58.650360 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 794/1604] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:58 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:58.709860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0829ae66-40ce-417f-a427-1d477acf4ff7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:58.712017 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0829ae66-40ce-417f-a427-1d477acf4ff7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:58.718197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0829ae66-40ce-417f-a427-1d477acf4ff7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:58.718646 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0829ae66-40ce-417f-a427-1d477acf4ff7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:58.719405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0829ae66-40ce-417f-a427-1d477acf4ff7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:58.719841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0829ae66-40ce-417f-a427-1d477acf4ff7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:58.750488 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0829ae66-40ce-417f-a427-1d477acf4ff7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044585 Jul 27 20:27:58.751039 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 811/1605] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:58 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:58.934501 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-af984669-53cb-4785-9f61-c083b5277f9e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:58.936935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-af984669-53cb-4785-9f61-c083b5277f9e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:58.943286 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af984669-53cb-4785-9f61-c083b5277f9e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:58.943730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af984669-53cb-4785-9f61-c083b5277f9e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:58.944489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af984669-53cb-4785-9f61-c083b5277f9e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:58.944922 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af984669-53cb-4785-9f61-c083b5277f9e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:58.975583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-af984669-53cb-4785-9f61-c083b5277f9e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045195 Jul 27 20:27:58.976334 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 795/1606] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:58 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:27:59.670255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ea7c0fb1-b8be-4539-9dfb-22175fb12cbb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:59.670879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ea7c0fb1-b8be-4539-9dfb-22175fb12cbb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:59.677500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ea7c0fb1-b8be-4539-9dfb-22175fb12cbb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:59.677959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ea7c0fb1-b8be-4539-9dfb-22175fb12cbb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:59.678729 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ea7c0fb1-b8be-4539-9dfb-22175fb12cbb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:59.679173 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ea7c0fb1-b8be-4539-9dfb-22175fb12cbb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:59.739729 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ea7c0fb1-b8be-4539-9dfb-22175fb12cbb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:27:59.747138 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ea7c0fb1-b8be-4539-9dfb-22175fb12cbb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080834 Jul 27 20:27:59.748301 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 812/1607] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:27:59 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:27:59.762501 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-aba590e7-7591-44e5-88dd-54cf003b5ebf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:59.765515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-aba590e7-7591-44e5-88dd-54cf003b5ebf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:59.771768 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aba590e7-7591-44e5-88dd-54cf003b5ebf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:59.772339 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aba590e7-7591-44e5-88dd-54cf003b5ebf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:59.773251 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aba590e7-7591-44e5-88dd-54cf003b5ebf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:59.773690 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aba590e7-7591-44e5-88dd-54cf003b5ebf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:59.802545 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-aba590e7-7591-44e5-88dd-54cf003b5ebf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043942 Jul 27 20:27:59.803096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 796/1608] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:27:59 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:27:59.988626 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0c95efbc-4174-4612-afc9-8a1d671d1f46 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:27:59.990716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0c95efbc-4174-4612-afc9-8a1d671d1f46 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:27:59.996794 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0c95efbc-4174-4612-afc9-8a1d671d1f46 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:59.997275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0c95efbc-4174-4612-afc9-8a1d671d1f46 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:27:59.998648 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0c95efbc-4174-4612-afc9-8a1d671d1f46 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:27:59.999084 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0c95efbc-4174-4612-afc9-8a1d671d1f46 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:00.027752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0c95efbc-4174-4612-afc9-8a1d671d1f46 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043190 Jul 27 20:28:00.028300 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 813/1609] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:27:59 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:00.768438 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-79956676-e956-47cb-b344-390967116893 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:00.769080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-79956676-e956-47cb-b344-390967116893 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:00.775598 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79956676-e956-47cb-b344-390967116893 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:00.776057 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79956676-e956-47cb-b344-390967116893 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:00.776822 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79956676-e956-47cb-b344-390967116893 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:00.777360 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79956676-e956-47cb-b344-390967116893 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:00.814888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-04f666c1-cc02-4260-8095-3dae2e8c7d15 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:00.817415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-04f666c1-cc02-4260-8095-3dae2e8c7d15 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:00.824463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-04f666c1-cc02-4260-8095-3dae2e8c7d15 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:00.824919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-04f666c1-cc02-4260-8095-3dae2e8c7d15 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:00.826817 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-04f666c1-cc02-4260-8095-3dae2e8c7d15 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:00.827271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-04f666c1-cc02-4260-8095-3dae2e8c7d15 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:00.846051 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-79956676-e956-47cb-b344-390967116893 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:00.853482 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-79956676-e956-47cb-b344-390967116893 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.088949 Jul 27 20:28:00.854042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 797/1610] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:00 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:00.857341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-04f666c1-cc02-4260-8095-3dae2e8c7d15 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045964 Jul 27 20:28:00.857909 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 814/1611] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:00 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:28:01.040014 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4890184b-9f34-418d-847a-76c68e55803c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:01.042126 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4890184b-9f34-418d-847a-76c68e55803c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:01.048152 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4890184b-9f34-418d-847a-76c68e55803c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:01.048605 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4890184b-9f34-418d-847a-76c68e55803c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:01.049407 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4890184b-9f34-418d-847a-76c68e55803c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:01.049846 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4890184b-9f34-418d-847a-76c68e55803c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:01.079169 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4890184b-9f34-418d-847a-76c68e55803c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043283 Jul 27 20:28:01.079736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 798/1612] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:01 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:01.869518 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a72dce3a-0a6e-4217-bf62-40aa57ece57e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:01.871664 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a72dce3a-0a6e-4217-bf62-40aa57ece57e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:01.873790 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-41d22232-8dee-4060-bef6-b11ba313478c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:01.874413 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-41d22232-8dee-4060-bef6-b11ba313478c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:01.882520 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-41d22232-8dee-4060-bef6-b11ba313478c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:01.882970 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-41d22232-8dee-4060-bef6-b11ba313478c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:01.883599 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a72dce3a-0a6e-4217-bf62-40aa57ece57e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:01.883747 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-41d22232-8dee-4060-bef6-b11ba313478c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:01.884054 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a72dce3a-0a6e-4217-bf62-40aa57ece57e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:01.884167 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-41d22232-8dee-4060-bef6-b11ba313478c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:01.884833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a72dce3a-0a6e-4217-bf62-40aa57ece57e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:01.885302 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a72dce3a-0a6e-4217-bf62-40aa57ece57e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:01.915037 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a72dce3a-0a6e-4217-bf62-40aa57ece57e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049443 Jul 27 20:28:01.915606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 815/1613] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:01 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:01.949508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-41d22232-8dee-4060-bef6-b11ba313478c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:01.957687 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-41d22232-8dee-4060-bef6-b11ba313478c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.088474 Jul 27 20:28:01.958249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 799/1614] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:01 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:28:02.092326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-aa52aa91-040c-4332-891d-35128c09b7db tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:02.094514 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-aa52aa91-040c-4332-891d-35128c09b7db tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:02.100516 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aa52aa91-040c-4332-891d-35128c09b7db tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:02.100998 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aa52aa91-040c-4332-891d-35128c09b7db tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:02.101784 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aa52aa91-040c-4332-891d-35128c09b7db tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:02.102230 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aa52aa91-040c-4332-891d-35128c09b7db tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:02.130994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-aa52aa91-040c-4332-891d-35128c09b7db tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043323 Jul 27 20:28:02.131478 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 816/1615] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:02 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:02.927314 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-65b32b2f-640c-4929-994d-44443997bc41 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:02.929550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-65b32b2f-640c-4929-994d-44443997bc41 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:02.936559 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65b32b2f-640c-4929-994d-44443997bc41 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:02.937035 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65b32b2f-640c-4929-994d-44443997bc41 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:02.937807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65b32b2f-640c-4929-994d-44443997bc41 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:02.938243 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65b32b2f-640c-4929-994d-44443997bc41 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:02.967993 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-65b32b2f-640c-4929-994d-44443997bc41 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044639 Jul 27 20:28:02.968537 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 800/1616] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:02 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:02.978174 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8b9bfebf-5a04-4e79-b625-b70759fd4b78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:02.978800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8b9bfebf-5a04-4e79-b625-b70759fd4b78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:02.985340 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8b9bfebf-5a04-4e79-b625-b70759fd4b78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:02.985799 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8b9bfebf-5a04-4e79-b625-b70759fd4b78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:02.986570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8b9bfebf-5a04-4e79-b625-b70759fd4b78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:02.987017 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8b9bfebf-5a04-4e79-b625-b70759fd4b78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:03.051340 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8b9bfebf-5a04-4e79-b625-b70759fd4b78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:03.059245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8b9bfebf-5a04-4e79-b625-b70759fd4b78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084908 Jul 27 20:28:03.059830 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 817/1617] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:02 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:03.143435 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f4b291d0-de42-4cb0-b41d-7e2d9f93e759 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:03.145647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f4b291d0-de42-4cb0-b41d-7e2d9f93e759 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:03.151643 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f4b291d0-de42-4cb0-b41d-7e2d9f93e759 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:03.152093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f4b291d0-de42-4cb0-b41d-7e2d9f93e759 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:03.152854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f4b291d0-de42-4cb0-b41d-7e2d9f93e759 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:03.153317 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f4b291d0-de42-4cb0-b41d-7e2d9f93e759 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:03.183465 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f4b291d0-de42-4cb0-b41d-7e2d9f93e759 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043917 Jul 27 20:28:03.183930 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 801/1618] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:03 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:03.979865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-517d7408-73f6-40e4-9cea-c4b2619645d7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:03.982291 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-517d7408-73f6-40e4-9cea-c4b2619645d7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:03.988860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-517d7408-73f6-40e4-9cea-c4b2619645d7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:03.989353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-517d7408-73f6-40e4-9cea-c4b2619645d7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:03.990126 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-517d7408-73f6-40e4-9cea-c4b2619645d7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:03.990573 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-517d7408-73f6-40e4-9cea-c4b2619645d7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:04.020585 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-517d7408-73f6-40e4-9cea-c4b2619645d7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044768 Jul 27 20:28:04.021173 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 818/1619] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:03 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:04.080409 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-15e25b43-2354-4b44-99df-48aa4d0db4df tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:04.081079 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-15e25b43-2354-4b44-99df-48aa4d0db4df tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:04.087543 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-15e25b43-2354-4b44-99df-48aa4d0db4df tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:04.087989 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-15e25b43-2354-4b44-99df-48aa4d0db4df tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:04.088754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-15e25b43-2354-4b44-99df-48aa4d0db4df tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:04.089218 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-15e25b43-2354-4b44-99df-48aa4d0db4df tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:04.150260 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-15e25b43-2354-4b44-99df-48aa4d0db4df tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:04.158552 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-15e25b43-2354-4b44-99df-48aa4d0db4df tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082738 Jul 27 20:28:04.159138 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 802/1620] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:04 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:04.196269 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e9d7dd60-57ff-404a-bb4c-abac58c0189f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:04.198413 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e9d7dd60-57ff-404a-bb4c-abac58c0189f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:04.204540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e9d7dd60-57ff-404a-bb4c-abac58c0189f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:04.205014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e9d7dd60-57ff-404a-bb4c-abac58c0189f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:04.205770 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e9d7dd60-57ff-404a-bb4c-abac58c0189f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:04.206202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e9d7dd60-57ff-404a-bb4c-abac58c0189f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:04.235591 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e9d7dd60-57ff-404a-bb4c-abac58c0189f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043229 Jul 27 20:28:04.236072 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 819/1621] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:04 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:05.033257 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6dd09383-e3cc-4216-9add-4629ab9a11d7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:05.035419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6dd09383-e3cc-4216-9add-4629ab9a11d7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:05.041529 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6dd09383-e3cc-4216-9add-4629ab9a11d7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:05.041983 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6dd09383-e3cc-4216-9add-4629ab9a11d7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:05.042754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6dd09383-e3cc-4216-9add-4629ab9a11d7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:05.043199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6dd09383-e3cc-4216-9add-4629ab9a11d7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:05.072393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6dd09383-e3cc-4216-9add-4629ab9a11d7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042722 Jul 27 20:28:05.072393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 803/1622] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:05 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:05.179972 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bf56920d-48d5-42b5-93c7-57c7ef79ee0b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:05.180576 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bf56920d-48d5-42b5-93c7-57c7ef79ee0b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:05.187529 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bf56920d-48d5-42b5-93c7-57c7ef79ee0b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:05.187986 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bf56920d-48d5-42b5-93c7-57c7ef79ee0b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:05.188750 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bf56920d-48d5-42b5-93c7-57c7ef79ee0b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:05.189219 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bf56920d-48d5-42b5-93c7-57c7ef79ee0b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:05.249367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6d2429b0-25b7-40e3-9298-6c1a6f7ab539 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:05.251024 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bf56920d-48d5-42b5-93c7-57c7ef79ee0b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:05.251507 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6d2429b0-25b7-40e3-9298-6c1a6f7ab539 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:05.257948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6d2429b0-25b7-40e3-9298-6c1a6f7ab539 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:05.258391 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6d2429b0-25b7-40e3-9298-6c1a6f7ab539 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:05.258769 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bf56920d-48d5-42b5-93c7-57c7ef79ee0b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082942 Jul 27 20:28:05.259150 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6d2429b0-25b7-40e3-9298-6c1a6f7ab539 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:05.259623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 820/1623] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:05 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:05.259753 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6d2429b0-25b7-40e3-9298-6c1a6f7ab539 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:05.288712 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6d2429b0-25b7-40e3-9298-6c1a6f7ab539 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044727 Jul 27 20:28:05.289353 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 804/1624] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:05 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:06.084776 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7af4656c-e1ce-4aef-a797-106c26dc815c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:06.086941 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7af4656c-e1ce-4aef-a797-106c26dc815c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:06.093881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7af4656c-e1ce-4aef-a797-106c26dc815c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:06.094333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7af4656c-e1ce-4aef-a797-106c26dc815c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:06.095110 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7af4656c-e1ce-4aef-a797-106c26dc815c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:06.095551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7af4656c-e1ce-4aef-a797-106c26dc815c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:06.124538 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7af4656c-e1ce-4aef-a797-106c26dc815c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043672 Jul 27 20:28:06.125112 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 821/1625] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:06 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:06.281192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0997ab11-39bf-4751-a108-bd350a203aeb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:06.281812 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0997ab11-39bf-4751-a108-bd350a203aeb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:06.288247 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0997ab11-39bf-4751-a108-bd350a203aeb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:06.288698 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0997ab11-39bf-4751-a108-bd350a203aeb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:06.289497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0997ab11-39bf-4751-a108-bd350a203aeb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:06.289938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0997ab11-39bf-4751-a108-bd350a203aeb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:06.301066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d44461f4-b62f-4801-910f-2ba090891a48 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:06.303199 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d44461f4-b62f-4801-910f-2ba090891a48 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:06.309575 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d44461f4-b62f-4801-910f-2ba090891a48 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:06.310031 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d44461f4-b62f-4801-910f-2ba090891a48 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:06.310808 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d44461f4-b62f-4801-910f-2ba090891a48 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:06.311245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d44461f4-b62f-4801-910f-2ba090891a48 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:06.341948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d44461f4-b62f-4801-910f-2ba090891a48 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043926 Jul 27 20:28:06.342610 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 822/1626] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:06 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:28:06.351947 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0997ab11-39bf-4751-a108-bd350a203aeb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:06.359713 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0997ab11-39bf-4751-a108-bd350a203aeb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083145 Jul 27 20:28:06.360292 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 805/1627] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:06 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:07.136820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-baa047cf-bbe9-40ad-9f9c-4ca67140c488 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:07.139959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-baa047cf-bbe9-40ad-9f9c-4ca67140c488 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:07.146027 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-baa047cf-bbe9-40ad-9f9c-4ca67140c488 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:07.146484 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-baa047cf-bbe9-40ad-9f9c-4ca67140c488 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:07.147253 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-baa047cf-bbe9-40ad-9f9c-4ca67140c488 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:07.147699 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-baa047cf-bbe9-40ad-9f9c-4ca67140c488 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:07.176042 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-baa047cf-bbe9-40ad-9f9c-4ca67140c488 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043235 Jul 27 20:28:07.176589 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 823/1628] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:07 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:07.354910 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-66d6d17d-a861-4b35-85ad-1e5bf17e8b4d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:07.357547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-66d6d17d-a861-4b35-85ad-1e5bf17e8b4d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:07.364119 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-66d6d17d-a861-4b35-85ad-1e5bf17e8b4d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:07.364570 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-66d6d17d-a861-4b35-85ad-1e5bf17e8b4d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:07.365361 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-66d6d17d-a861-4b35-85ad-1e5bf17e8b4d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:07.365802 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-66d6d17d-a861-4b35-85ad-1e5bf17e8b4d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:07.380638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-09261e32-0c1c-48dd-9eef-ac7c56ade005 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:07.381293 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-09261e32-0c1c-48dd-9eef-ac7c56ade005 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:07.387692 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-09261e32-0c1c-48dd-9eef-ac7c56ade005 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:07.388825 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-09261e32-0c1c-48dd-9eef-ac7c56ade005 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:07.389890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-09261e32-0c1c-48dd-9eef-ac7c56ade005 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:07.390333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-09261e32-0c1c-48dd-9eef-ac7c56ade005 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:07.396532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-66d6d17d-a861-4b35-85ad-1e5bf17e8b4d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045753 Jul 27 20:28:07.397121 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 806/1629] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:07 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:07.451343 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-09261e32-0c1c-48dd-9eef-ac7c56ade005 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:07.459465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-09261e32-0c1c-48dd-9eef-ac7c56ade005 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082842 Jul 27 20:28:07.460031 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 824/1630] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:07 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:08.188487 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9524cf08-f28f-49ff-a9e1-2e3d400fea9c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:08.190668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9524cf08-f28f-49ff-a9e1-2e3d400fea9c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:08.196635 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9524cf08-f28f-49ff-a9e1-2e3d400fea9c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:08.197122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9524cf08-f28f-49ff-a9e1-2e3d400fea9c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:08.197885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9524cf08-f28f-49ff-a9e1-2e3d400fea9c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:08.198317 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9524cf08-f28f-49ff-a9e1-2e3d400fea9c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:08.227080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9524cf08-f28f-49ff-a9e1-2e3d400fea9c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042810 Jul 27 20:28:08.227623 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 807/1631] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:08 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:08.409859 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-874610ed-7e30-4fec-8942-bbbeb1b730ac tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:08.412009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-874610ed-7e30-4fec-8942-bbbeb1b730ac tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:08.418444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-874610ed-7e30-4fec-8942-bbbeb1b730ac tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:08.418884 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-874610ed-7e30-4fec-8942-bbbeb1b730ac tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:08.419837 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-874610ed-7e30-4fec-8942-bbbeb1b730ac tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:08.420272 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-874610ed-7e30-4fec-8942-bbbeb1b730ac tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:08.423771 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:28:08.448066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-874610ed-7e30-4fec-8942-bbbeb1b730ac tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042178 Jul 27 20:28:08.448614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 825/1632] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:08 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:08.480306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-455234d5-c86c-4b24-b03a-38d9e0bc38c1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:08.480918 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-455234d5-c86c-4b24-b03a-38d9e0bc38c1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:08.487494 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-455234d5-c86c-4b24-b03a-38d9e0bc38c1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:08.487940 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-455234d5-c86c-4b24-b03a-38d9e0bc38c1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:08.488701 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-455234d5-c86c-4b24-b03a-38d9e0bc38c1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:08.489319 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-455234d5-c86c-4b24-b03a-38d9e0bc38c1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:08.550116 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-455234d5-c86c-4b24-b03a-38d9e0bc38c1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:08.557601 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-455234d5-c86c-4b24-b03a-38d9e0bc38c1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081193 Jul 27 20:28:08.558164 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 808/1633] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:08 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:09.239283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0daac4e5-2773-40e7-847f-337e6b28ad5e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:09.241355 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0daac4e5-2773-40e7-847f-337e6b28ad5e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:09.248097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0daac4e5-2773-40e7-847f-337e6b28ad5e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:09.248578 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0daac4e5-2773-40e7-847f-337e6b28ad5e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:09.249367 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0daac4e5-2773-40e7-847f-337e6b28ad5e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:09.249806 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0daac4e5-2773-40e7-847f-337e6b28ad5e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:09.277742 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0daac4e5-2773-40e7-847f-337e6b28ad5e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042592 Jul 27 20:28:09.278295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 826/1634] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:09 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:09.461254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a949bd49-3af3-431a-a32f-f837188b492b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:09.463419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a949bd49-3af3-431a-a32f-f837188b492b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:09.470069 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a949bd49-3af3-431a-a32f-f837188b492b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:09.470509 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a949bd49-3af3-431a-a32f-f837188b492b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:09.471312 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a949bd49-3af3-431a-a32f-f837188b492b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:09.471740 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a949bd49-3af3-431a-a32f-f837188b492b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:09.502224 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a949bd49-3af3-431a-a32f-f837188b492b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044924 Jul 27 20:28:09.502817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 809/1635] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:09 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:09.577588 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-356ceeff-9dbd-4cdc-a174-b8f3de28a9b6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:09.578205 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-356ceeff-9dbd-4cdc-a174-b8f3de28a9b6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:09.584856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-356ceeff-9dbd-4cdc-a174-b8f3de28a9b6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:09.585345 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-356ceeff-9dbd-4cdc-a174-b8f3de28a9b6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:09.586115 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-356ceeff-9dbd-4cdc-a174-b8f3de28a9b6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:09.586556 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-356ceeff-9dbd-4cdc-a174-b8f3de28a9b6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:09.647953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-356ceeff-9dbd-4cdc-a174-b8f3de28a9b6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:09.659548 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-356ceeff-9dbd-4cdc-a174-b8f3de28a9b6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.086004 Jul 27 20:28:09.660128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 827/1636] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:09 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:10.290072 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e0f731a5-d50b-4306-bc41-3845622ff62b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:10.292251 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e0f731a5-d50b-4306-bc41-3845622ff62b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:10.299761 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0f731a5-d50b-4306-bc41-3845622ff62b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:10.300238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0f731a5-d50b-4306-bc41-3845622ff62b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:10.301021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0f731a5-d50b-4306-bc41-3845622ff62b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:10.301465 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0f731a5-d50b-4306-bc41-3845622ff62b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:10.330386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e0f731a5-d50b-4306-bc41-3845622ff62b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044267 Jul 27 20:28:10.330865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 810/1637] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:10 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:10.515171 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1eecffb8-8021-438c-b724-a272127ea46d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:10.517302 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1eecffb8-8021-438c-b724-a272127ea46d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:10.523225 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1eecffb8-8021-438c-b724-a272127ea46d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:10.523705 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1eecffb8-8021-438c-b724-a272127ea46d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:10.524456 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1eecffb8-8021-438c-b724-a272127ea46d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:10.524890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1eecffb8-8021-438c-b724-a272127ea46d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:10.552926 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1eecffb8-8021-438c-b724-a272127ea46d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042322 Jul 27 20:28:10.553485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 828/1638] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:10 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:10.687454 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7823757a-2ef8-4222-a32d-9edea86d0c02 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:10.688067 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7823757a-2ef8-4222-a32d-9edea86d0c02 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:10.694454 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7823757a-2ef8-4222-a32d-9edea86d0c02 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:10.694903 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7823757a-2ef8-4222-a32d-9edea86d0c02 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:10.695665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7823757a-2ef8-4222-a32d-9edea86d0c02 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:10.696098 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7823757a-2ef8-4222-a32d-9edea86d0c02 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:10.714171 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:28:10.760182 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7823757a-2ef8-4222-a32d-9edea86d0c02 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:10.768308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7823757a-2ef8-4222-a32d-9edea86d0c02 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084871 Jul 27 20:28:10.768866 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 811/1639] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:10 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:11.343057 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d63257c4-b566-445c-a919-dfd2a0112b86 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:11.345140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d63257c4-b566-445c-a919-dfd2a0112b86 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:11.351552 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d63257c4-b566-445c-a919-dfd2a0112b86 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:11.352035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d63257c4-b566-445c-a919-dfd2a0112b86 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:11.352799 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d63257c4-b566-445c-a919-dfd2a0112b86 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:11.353262 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d63257c4-b566-445c-a919-dfd2a0112b86 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:11.382511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d63257c4-b566-445c-a919-dfd2a0112b86 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043562 Jul 27 20:28:11.383235 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 829/1640] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:11 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:28:11.565956 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c1cb4692-c3b1-4ac8-80b3-3561ec1583ed tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:11.568139 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c1cb4692-c3b1-4ac8-80b3-3561ec1583ed tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:11.575127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1cb4692-c3b1-4ac8-80b3-3561ec1583ed tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:11.575578 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1cb4692-c3b1-4ac8-80b3-3561ec1583ed tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:11.576599 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1cb4692-c3b1-4ac8-80b3-3561ec1583ed tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:11.577071 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1cb4692-c3b1-4ac8-80b3-3561ec1583ed tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:11.605011 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c1cb4692-c3b1-4ac8-80b3-3561ec1583ed tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042938 Jul 27 20:28:11.605504 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 812/1641] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:11 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:11.789710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-adbdd62c-d0ee-494e-a03f-76f2b5ffe30b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:11.790331 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-adbdd62c-d0ee-494e-a03f-76f2b5ffe30b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:11.797218 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-adbdd62c-d0ee-494e-a03f-76f2b5ffe30b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:11.797681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-adbdd62c-d0ee-494e-a03f-76f2b5ffe30b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:11.798457 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-adbdd62c-d0ee-494e-a03f-76f2b5ffe30b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:11.798900 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-adbdd62c-d0ee-494e-a03f-76f2b5ffe30b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:11.863700 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-adbdd62c-d0ee-494e-a03f-76f2b5ffe30b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:11.871212 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-adbdd62c-d0ee-494e-a03f-76f2b5ffe30b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.085325 Jul 27 20:28:11.871782 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 830/1642] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:11 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:12.395348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b1c72e0d-f434-48ef-89fa-dca0cef9f5ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:12.397563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b1c72e0d-f434-48ef-89fa-dca0cef9f5ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:12.404171 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1c72e0d-f434-48ef-89fa-dca0cef9f5ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:12.404622 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1c72e0d-f434-48ef-89fa-dca0cef9f5ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:12.405419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1c72e0d-f434-48ef-89fa-dca0cef9f5ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:12.405855 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1c72e0d-f434-48ef-89fa-dca0cef9f5ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:12.436383 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b1c72e0d-f434-48ef-89fa-dca0cef9f5ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045029 Jul 27 20:28:12.436914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 813/1643] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:12 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:12.617704 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3734f37a-f8ad-46f2-8d7b-c65f4c88f7de tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:12.619833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3734f37a-f8ad-46f2-8d7b-c65f4c88f7de tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:12.626960 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3734f37a-f8ad-46f2-8d7b-c65f4c88f7de tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:12.627416 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3734f37a-f8ad-46f2-8d7b-c65f4c88f7de tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:12.628184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3734f37a-f8ad-46f2-8d7b-c65f4c88f7de tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:12.628626 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3734f37a-f8ad-46f2-8d7b-c65f4c88f7de tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:12.657856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3734f37a-f8ad-46f2-8d7b-c65f4c88f7de tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044031 Jul 27 20:28:12.658340 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 831/1644] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:12 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:12.891714 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-78fec564-45be-4b29-9b76-4713a2d15794 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:12.892353 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-78fec564-45be-4b29-9b76-4713a2d15794 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:12.898338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-78fec564-45be-4b29-9b76-4713a2d15794 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:12.898787 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-78fec564-45be-4b29-9b76-4713a2d15794 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:12.899549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-78fec564-45be-4b29-9b76-4713a2d15794 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:12.899991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-78fec564-45be-4b29-9b76-4713a2d15794 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:12.960780 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-78fec564-45be-4b29-9b76-4713a2d15794 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:12.968495 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-78fec564-45be-4b29-9b76-4713a2d15794 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080696 Jul 27 20:28:12.969140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 814/1645] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:12 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:13.448545 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-895e6d71-d6ea-4871-b603-46be877bf3af tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:13.451485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-895e6d71-d6ea-4871-b603-46be877bf3af tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:13.457767 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-895e6d71-d6ea-4871-b603-46be877bf3af tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:13.458230 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-895e6d71-d6ea-4871-b603-46be877bf3af tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:13.458999 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-895e6d71-d6ea-4871-b603-46be877bf3af tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:13.459439 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-895e6d71-d6ea-4871-b603-46be877bf3af tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:13.489148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-895e6d71-d6ea-4871-b603-46be877bf3af tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044573 Jul 27 20:28:13.489700 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 832/1646] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:13 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:13.670293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fcd1574e-937a-4fbd-ae3c-febd161a6155 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:13.672444 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fcd1574e-937a-4fbd-ae3c-febd161a6155 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:13.679139 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fcd1574e-937a-4fbd-ae3c-febd161a6155 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:13.679590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fcd1574e-937a-4fbd-ae3c-febd161a6155 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:13.680350 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fcd1574e-937a-4fbd-ae3c-febd161a6155 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:13.680785 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fcd1574e-937a-4fbd-ae3c-febd161a6155 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:13.709927 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fcd1574e-937a-4fbd-ae3c-febd161a6155 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043877 Jul 27 20:28:13.710466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 815/1647] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:13 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:13.989126 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-280bf551-c864-4f2f-8e00-c03be475455d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:13.989684 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-280bf551-c864-4f2f-8e00-c03be475455d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:13.996142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-280bf551-c864-4f2f-8e00-c03be475455d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:13.996622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-280bf551-c864-4f2f-8e00-c03be475455d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:13.997978 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-280bf551-c864-4f2f-8e00-c03be475455d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:13.998516 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-280bf551-c864-4f2f-8e00-c03be475455d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:14.059939 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-280bf551-c864-4f2f-8e00-c03be475455d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:14.067524 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-280bf551-c864-4f2f-8e00-c03be475455d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082330 Jul 27 20:28:14.068080 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 833/1648] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:13 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:14.501388 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ff9847a3-820a-4455-b65f-1f87a735cc52 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:14.503559 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ff9847a3-820a-4455-b65f-1f87a735cc52 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:14.509721 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff9847a3-820a-4455-b65f-1f87a735cc52 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:14.510113 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff9847a3-820a-4455-b65f-1f87a735cc52 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:14.510870 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff9847a3-820a-4455-b65f-1f87a735cc52 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:14.511300 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff9847a3-820a-4455-b65f-1f87a735cc52 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:14.540743 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ff9847a3-820a-4455-b65f-1f87a735cc52 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043337 Jul 27 20:28:14.541320 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 816/1649] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:14 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:14.722243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5f8e5591-c079-4638-b61e-7eefe665bbd5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:14.724356 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5f8e5591-c079-4638-b61e-7eefe665bbd5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:14.730349 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5f8e5591-c079-4638-b61e-7eefe665bbd5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:14.730796 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5f8e5591-c079-4638-b61e-7eefe665bbd5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:14.731555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5f8e5591-c079-4638-b61e-7eefe665bbd5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:14.731984 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5f8e5591-c079-4638-b61e-7eefe665bbd5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:14.759960 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5f8e5591-c079-4638-b61e-7eefe665bbd5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041676 Jul 27 20:28:14.760435 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 834/1650] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:14 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:15.087604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-daa2e956-5a87-4cdb-ad4a-fc2b707a5c69 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:15.088214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-daa2e956-5a87-4cdb-ad4a-fc2b707a5c69 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:15.095502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-daa2e956-5a87-4cdb-ad4a-fc2b707a5c69 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:15.096011 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-daa2e956-5a87-4cdb-ad4a-fc2b707a5c69 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:15.096774 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-daa2e956-5a87-4cdb-ad4a-fc2b707a5c69 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:15.097313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-daa2e956-5a87-4cdb-ad4a-fc2b707a5c69 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:15.158195 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-daa2e956-5a87-4cdb-ad4a-fc2b707a5c69 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:15.165605 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-daa2e956-5a87-4cdb-ad4a-fc2b707a5c69 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081827 Jul 27 20:28:15.166154 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 817/1651] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:15 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:15.553055 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7f3cbb21-bfc0-4cb9-9fd1-1950c0d83d89 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:15.555237 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7f3cbb21-bfc0-4cb9-9fd1-1950c0d83d89 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:15.562385 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7f3cbb21-bfc0-4cb9-9fd1-1950c0d83d89 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:15.562838 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7f3cbb21-bfc0-4cb9-9fd1-1950c0d83d89 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:15.563607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7f3cbb21-bfc0-4cb9-9fd1-1950c0d83d89 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:15.564048 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7f3cbb21-bfc0-4cb9-9fd1-1950c0d83d89 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:15.593199 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7f3cbb21-bfc0-4cb9-9fd1-1950c0d83d89 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044057 Jul 27 20:28:15.593748 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 835/1652] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:15 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:15.773039 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b4a5b232-e703-4ccd-9fe4-36d0a5748a1d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:15.775170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b4a5b232-e703-4ccd-9fe4-36d0a5748a1d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:15.781386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b4a5b232-e703-4ccd-9fe4-36d0a5748a1d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:15.781830 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b4a5b232-e703-4ccd-9fe4-36d0a5748a1d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:15.782585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b4a5b232-e703-4ccd-9fe4-36d0a5748a1d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:15.783020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b4a5b232-e703-4ccd-9fe4-36d0a5748a1d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:15.812008 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b4a5b232-e703-4ccd-9fe4-36d0a5748a1d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043013 Jul 27 20:28:15.812549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 818/1653] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:15 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:16.186229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-df784621-e39f-4006-8584-22dcc13830d9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:16.186848 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-df784621-e39f-4006-8584-22dcc13830d9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:16.192799 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-df784621-e39f-4006-8584-22dcc13830d9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:16.193291 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-df784621-e39f-4006-8584-22dcc13830d9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:16.194050 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-df784621-e39f-4006-8584-22dcc13830d9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:16.194491 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-df784621-e39f-4006-8584-22dcc13830d9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:16.254519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-df784621-e39f-4006-8584-22dcc13830d9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:16.261960 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-df784621-e39f-4006-8584-22dcc13830d9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.079623 Jul 27 20:28:16.262524 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 836/1654] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:16 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:16.605399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1c4c5cfb-869c-43e0-9124-84c7466b503a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:16.607549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1c4c5cfb-869c-43e0-9124-84c7466b503a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:16.614061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c4c5cfb-869c-43e0-9124-84c7466b503a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:16.614515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c4c5cfb-869c-43e0-9124-84c7466b503a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:16.615278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c4c5cfb-869c-43e0-9124-84c7466b503a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:16.615715 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c4c5cfb-869c-43e0-9124-84c7466b503a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:16.649215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1c4c5cfb-869c-43e0-9124-84c7466b503a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047749 Jul 27 20:28:16.649784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 819/1655] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:16 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:16.823776 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-58691506-7a73-46b1-8f68-9a07add32213 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:16.826849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-58691506-7a73-46b1-8f68-9a07add32213 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:16.833366 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-58691506-7a73-46b1-8f68-9a07add32213 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:16.833817 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-58691506-7a73-46b1-8f68-9a07add32213 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:16.834593 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-58691506-7a73-46b1-8f68-9a07add32213 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:16.835034 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-58691506-7a73-46b1-8f68-9a07add32213 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:16.863528 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-58691506-7a73-46b1-8f68-9a07add32213 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043662 Jul 27 20:28:16.864022 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 837/1656] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:16 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:17.282781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-30ad3f13-ccd9-4636-995e-74b1201639a7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:17.283387 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-30ad3f13-ccd9-4636-995e-74b1201639a7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:17.289374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30ad3f13-ccd9-4636-995e-74b1201639a7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:17.289847 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30ad3f13-ccd9-4636-995e-74b1201639a7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:17.290599 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30ad3f13-ccd9-4636-995e-74b1201639a7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:17.291040 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30ad3f13-ccd9-4636-995e-74b1201639a7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:17.352276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-30ad3f13-ccd9-4636-995e-74b1201639a7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:17.360538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-30ad3f13-ccd9-4636-995e-74b1201639a7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081614 Jul 27 20:28:17.361128 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 820/1657] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:17 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:17.662641 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e4fddffc-8fda-451f-b3c8-1b8381e6ca9e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:17.664824 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e4fddffc-8fda-451f-b3c8-1b8381e6ca9e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:17.671505 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4fddffc-8fda-451f-b3c8-1b8381e6ca9e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:17.671964 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4fddffc-8fda-451f-b3c8-1b8381e6ca9e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:17.672734 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4fddffc-8fda-451f-b3c8-1b8381e6ca9e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:17.673214 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4fddffc-8fda-451f-b3c8-1b8381e6ca9e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:17.704501 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e4fddffc-8fda-451f-b3c8-1b8381e6ca9e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045824 Jul 27 20:28:17.705078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 838/1658] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:17 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:17.875854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5648aca2-5f00-46e2-8c2d-38a7c245e730 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:17.878050 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5648aca2-5f00-46e2-8c2d-38a7c245e730 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:17.884057 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5648aca2-5f00-46e2-8c2d-38a7c245e730 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:17.884503 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5648aca2-5f00-46e2-8c2d-38a7c245e730 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:17.885299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5648aca2-5f00-46e2-8c2d-38a7c245e730 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:17.885735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5648aca2-5f00-46e2-8c2d-38a7c245e730 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:17.914261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5648aca2-5f00-46e2-8c2d-38a7c245e730 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042457 Jul 27 20:28:17.914725 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 821/1659] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:17 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:18.381692 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d0f0355c-5847-4e44-ab2e-959889e3c596 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:18.382255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d0f0355c-5847-4e44-ab2e-959889e3c596 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:18.389301 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d0f0355c-5847-4e44-ab2e-959889e3c596 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:18.389748 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d0f0355c-5847-4e44-ab2e-959889e3c596 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:18.390509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d0f0355c-5847-4e44-ab2e-959889e3c596 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:18.390943 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d0f0355c-5847-4e44-ab2e-959889e3c596 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:18.452431 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d0f0355c-5847-4e44-ab2e-959889e3c596 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:18.459967 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d0f0355c-5847-4e44-ab2e-959889e3c596 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082243 Jul 27 20:28:18.460535 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 839/1660] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:18 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:28:18.716547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-77471b13-dc86-4146-806c-3ebcadb2d457 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:18.718696 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-77471b13-dc86-4146-806c-3ebcadb2d457 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:18.725053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-77471b13-dc86-4146-806c-3ebcadb2d457 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:18.725506 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-77471b13-dc86-4146-806c-3ebcadb2d457 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:18.726252 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-77471b13-dc86-4146-806c-3ebcadb2d457 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:18.726683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-77471b13-dc86-4146-806c-3ebcadb2d457 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:18.754955 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-77471b13-dc86-4146-806c-3ebcadb2d457 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042579 Jul 27 20:28:18.755484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 822/1661] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:18 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:18.926449 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-dd694ad7-4c19-4de8-85d4-445bcc61ed4a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:18.928614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-dd694ad7-4c19-4de8-85d4-445bcc61ed4a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:18.935190 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dd694ad7-4c19-4de8-85d4-445bcc61ed4a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:18.935651 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dd694ad7-4c19-4de8-85d4-445bcc61ed4a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:18.936420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dd694ad7-4c19-4de8-85d4-445bcc61ed4a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:18.936861 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dd694ad7-4c19-4de8-85d4-445bcc61ed4a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:18.964948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-dd694ad7-4c19-4de8-85d4-445bcc61ed4a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042498 Jul 27 20:28:18.965518 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 840/1662] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:18 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:19.480209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bef1dc5b-e75a-4788-9d3a-3c3b42637e60 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:19.480848 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bef1dc5b-e75a-4788-9d3a-3c3b42637e60 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:19.487432 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bef1dc5b-e75a-4788-9d3a-3c3b42637e60 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:19.487877 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bef1dc5b-e75a-4788-9d3a-3c3b42637e60 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:19.488634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bef1dc5b-e75a-4788-9d3a-3c3b42637e60 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:19.489101 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bef1dc5b-e75a-4788-9d3a-3c3b42637e60 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:19.552220 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bef1dc5b-e75a-4788-9d3a-3c3b42637e60 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:19.559638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bef1dc5b-e75a-4788-9d3a-3c3b42637e60 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083259 Jul 27 20:28:19.560187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 823/1663] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:19 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:19.767377 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4a701723-e728-40c3-9a7b-0c2879ca7c6b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:19.769543 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4a701723-e728-40c3-9a7b-0c2879ca7c6b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:19.776060 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4a701723-e728-40c3-9a7b-0c2879ca7c6b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:19.776507 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4a701723-e728-40c3-9a7b-0c2879ca7c6b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:19.777288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4a701723-e728-40c3-9a7b-0c2879ca7c6b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:19.777723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4a701723-e728-40c3-9a7b-0c2879ca7c6b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:19.802392 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:28:19.807483 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4a701723-e728-40c3-9a7b-0c2879ca7c6b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044798 Jul 27 20:28:19.808035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 841/1664] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:19 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:19.977626 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2e7dc192-7fa5-447d-8ed4-cf1586c1951b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:19.979772 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2e7dc192-7fa5-447d-8ed4-cf1586c1951b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:19.986259 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e7dc192-7fa5-447d-8ed4-cf1586c1951b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:19.986692 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e7dc192-7fa5-447d-8ed4-cf1586c1951b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:19.987457 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e7dc192-7fa5-447d-8ed4-cf1586c1951b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:19.987894 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e7dc192-7fa5-447d-8ed4-cf1586c1951b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:20.017282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2e7dc192-7fa5-447d-8ed4-cf1586c1951b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043636 Jul 27 20:28:20.017898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 824/1665] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:19 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:28:20.580801 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d0e8696f-22ba-4036-888b-d97f1def9e24 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:20.581459 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d0e8696f-22ba-4036-888b-d97f1def9e24 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:20.587720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d0e8696f-22ba-4036-888b-d97f1def9e24 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:20.588186 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d0e8696f-22ba-4036-888b-d97f1def9e24 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:20.588957 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d0e8696f-22ba-4036-888b-d97f1def9e24 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:20.589418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d0e8696f-22ba-4036-888b-d97f1def9e24 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:20.652390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d0e8696f-22ba-4036-888b-d97f1def9e24 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:20.660564 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d0e8696f-22ba-4036-888b-d97f1def9e24 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084539 Jul 27 20:28:20.661164 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 842/1666] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:20 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:20.819792 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f05706f9-b870-40ee-8fdc-f344e0a85fee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:20.821961 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f05706f9-b870-40ee-8fdc-f344e0a85fee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:20.828744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f05706f9-b870-40ee-8fdc-f344e0a85fee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:20.829217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f05706f9-b870-40ee-8fdc-f344e0a85fee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:20.829974 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f05706f9-b870-40ee-8fdc-f344e0a85fee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:20.830404 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f05706f9-b870-40ee-8fdc-f344e0a85fee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:20.858922 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f05706f9-b870-40ee-8fdc-f344e0a85fee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042964 Jul 27 20:28:20.859401 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 825/1667] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:20 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:21.032134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d090f8a4-494d-4a40-bca6-b624546c8475 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:21.034340 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d090f8a4-494d-4a40-bca6-b624546c8475 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:21.040859 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d090f8a4-494d-4a40-bca6-b624546c8475 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:21.041344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d090f8a4-494d-4a40-bca6-b624546c8475 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:21.042117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d090f8a4-494d-4a40-bca6-b624546c8475 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:21.042572 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d090f8a4-494d-4a40-bca6-b624546c8475 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:21.072251 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d090f8a4-494d-4a40-bca6-b624546c8475 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044742 Jul 27 20:28:21.072818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 843/1668] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:21 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:21.681238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a3a934a2-f007-4d6d-8604-d302466af105 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:21.681772 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a3a934a2-f007-4d6d-8604-d302466af105 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:21.688828 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a3a934a2-f007-4d6d-8604-d302466af105 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:21.689299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a3a934a2-f007-4d6d-8604-d302466af105 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:21.690056 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a3a934a2-f007-4d6d-8604-d302466af105 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:21.690490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a3a934a2-f007-4d6d-8604-d302466af105 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:21.756264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a3a934a2-f007-4d6d-8604-d302466af105 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:21.764039 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a3a934a2-f007-4d6d-8604-d302466af105 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.086694 Jul 27 20:28:21.764597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 826/1669] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:21 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:21.872487 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-30d3592c-f65c-467b-b6f3-fd793cf0f5ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:21.874674 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-30d3592c-f65c-467b-b6f3-fd793cf0f5ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:21.880758 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-30d3592c-f65c-467b-b6f3-fd793cf0f5ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:21.881250 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-30d3592c-f65c-467b-b6f3-fd793cf0f5ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:21.882021 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-30d3592c-f65c-467b-b6f3-fd793cf0f5ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:21.882462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-30d3592c-f65c-467b-b6f3-fd793cf0f5ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:21.910900 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-30d3592c-f65c-467b-b6f3-fd793cf0f5ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042383 Jul 27 20:28:21.911452 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 844/1670] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:21 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:22.085917 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1ba8e06c-dd52-4c69-aa58-c1b762636357 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:22.088054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1ba8e06c-dd52-4c69-aa58-c1b762636357 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:22.094397 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1ba8e06c-dd52-4c69-aa58-c1b762636357 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:22.094850 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1ba8e06c-dd52-4c69-aa58-c1b762636357 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:22.095630 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1ba8e06c-dd52-4c69-aa58-c1b762636357 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:22.096075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1ba8e06c-dd52-4c69-aa58-c1b762636357 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:22.124919 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1ba8e06c-dd52-4c69-aa58-c1b762636357 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042996 Jul 27 20:28:22.125495 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 827/1671] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:22 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:22.784735 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-978e88ae-3b78-4cc7-9ba9-718f6bd09e63 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:22.785331 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-978e88ae-3b78-4cc7-9ba9-718f6bd09e63 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:22.787554 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=86 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:28:22.792828 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-978e88ae-3b78-4cc7-9ba9-718f6bd09e63 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:22.793306 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-978e88ae-3b78-4cc7-9ba9-718f6bd09e63 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:22.794060 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-978e88ae-3b78-4cc7-9ba9-718f6bd09e63 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:22.794494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-978e88ae-3b78-4cc7-9ba9-718f6bd09e63 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:22.924357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c3d594b5-b846-4543-b8d8-1bcdc7654e90 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:22.926547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c3d594b5-b846-4543-b8d8-1bcdc7654e90 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:22.933421 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3d594b5-b846-4543-b8d8-1bcdc7654e90 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:22.933872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3d594b5-b846-4543-b8d8-1bcdc7654e90 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:22.934686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3d594b5-b846-4543-b8d8-1bcdc7654e90 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:22.935122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3d594b5-b846-4543-b8d8-1bcdc7654e90 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:22.940296 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:28:22.968394 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c3d594b5-b846-4543-b8d8-1bcdc7654e90 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048708 Jul 27 20:28:22.969001 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 828/1672] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:22 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:28:23.052523 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:28:23.052767 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:28:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:28:23.095611 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-978e88ae-3b78-4cc7-9ba9-718f6bd09e63 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:23.103387 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-978e88ae-3b78-4cc7-9ba9-718f6bd09e63 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.322537 Jul 27 20:28:23.103953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 845/1673] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:22 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:23.137350 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b7a88c8a-2c43-40a1-b82d-fb1f394ef662 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:23.139881 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b7a88c8a-2c43-40a1-b82d-fb1f394ef662 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:23.145889 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7a88c8a-2c43-40a1-b82d-fb1f394ef662 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:23.146333 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7a88c8a-2c43-40a1-b82d-fb1f394ef662 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:23.147087 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7a88c8a-2c43-40a1-b82d-fb1f394ef662 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:23.147519 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7a88c8a-2c43-40a1-b82d-fb1f394ef662 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:23.177924 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b7a88c8a-2c43-40a1-b82d-fb1f394ef662 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044538 Jul 27 20:28:23.178577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 829/1674] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:23 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:23.980065 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2bc14e08-cefc-4791-860d-22e4b29232e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:23.982296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2bc14e08-cefc-4791-860d-22e4b29232e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:23.989052 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2bc14e08-cefc-4791-860d-22e4b29232e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:23.989509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2bc14e08-cefc-4791-860d-22e4b29232e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:23.990280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2bc14e08-cefc-4791-860d-22e4b29232e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:23.990724 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2bc14e08-cefc-4791-860d-22e4b29232e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:24.020652 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2bc14e08-cefc-4791-860d-22e4b29232e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044528 Jul 27 20:28:24.021236 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 846/1675] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:23 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:24.124707 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1e66c9f6-5950-436e-b95d-ab982b769227 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:24.125346 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1e66c9f6-5950-436e-b95d-ab982b769227 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:24.127665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=86 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:28:24.133344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1e66c9f6-5950-436e-b95d-ab982b769227 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:24.133801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1e66c9f6-5950-436e-b95d-ab982b769227 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:24.134574 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1e66c9f6-5950-436e-b95d-ab982b769227 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:24.135019 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1e66c9f6-5950-436e-b95d-ab982b769227 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:24.190266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-dc170e7b-46b8-4c85-8e4e-5fc202b671e8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:24.192500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-dc170e7b-46b8-4c85-8e4e-5fc202b671e8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:24.197861 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1e66c9f6-5950-436e-b95d-ab982b769227 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:24.198907 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc170e7b-46b8-4c85-8e4e-5fc202b671e8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:24.199422 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc170e7b-46b8-4c85-8e4e-5fc202b671e8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:24.200287 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc170e7b-46b8-4c85-8e4e-5fc202b671e8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:24.200809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc170e7b-46b8-4c85-8e4e-5fc202b671e8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:24.206534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1e66c9f6-5950-436e-b95d-ab982b769227 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.086323 Jul 27 20:28:24.207091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 830/1676] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:24 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:24.230132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-dc170e7b-46b8-4c85-8e4e-5fc202b671e8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044395 Jul 27 20:28:24.230608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 847/1677] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:24 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:28:25.033830 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c3340d86-dd5b-4fff-9d58-817be4097b80 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:25.035963 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c3340d86-dd5b-4fff-9d58-817be4097b80 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:25.042166 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3340d86-dd5b-4fff-9d58-817be4097b80 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:25.042618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3340d86-dd5b-4fff-9d58-817be4097b80 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:25.043385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3340d86-dd5b-4fff-9d58-817be4097b80 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:25.043821 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3340d86-dd5b-4fff-9d58-817be4097b80 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:25.077920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c3340d86-dd5b-4fff-9d58-817be4097b80 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049285 Jul 27 20:28:25.078507 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 831/1678] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:25 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:25.227464 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9e8c9377-003e-4201-9346-8faeda93f788 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:25.228076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9e8c9377-003e-4201-9346-8faeda93f788 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:25.234640 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9e8c9377-003e-4201-9346-8faeda93f788 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:25.235084 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9e8c9377-003e-4201-9346-8faeda93f788 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:25.235872 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9e8c9377-003e-4201-9346-8faeda93f788 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:25.236302 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9e8c9377-003e-4201-9346-8faeda93f788 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:25.242184 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a145cd59-57d2-4ac1-9a17-a18a3f9862ba tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:25.244325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a145cd59-57d2-4ac1-9a17-a18a3f9862ba tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:25.255915 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a145cd59-57d2-4ac1-9a17-a18a3f9862ba tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:25.256358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a145cd59-57d2-4ac1-9a17-a18a3f9862ba tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:25.257146 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a145cd59-57d2-4ac1-9a17-a18a3f9862ba tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:25.257643 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a145cd59-57d2-4ac1-9a17-a18a3f9862ba tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:25.288481 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a145cd59-57d2-4ac1-9a17-a18a3f9862ba tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050121 Jul 27 20:28:25.289069 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 832/1679] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:25 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:28:25.304137 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9e8c9377-003e-4201-9346-8faeda93f788 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:25.311719 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9e8c9377-003e-4201-9346-8faeda93f788 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.088186 Jul 27 20:28:25.312285 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 848/1680] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:25 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:26.091995 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9de63ae6-b756-4037-b8c3-de341ad618f5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:26.094275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9de63ae6-b756-4037-b8c3-de341ad618f5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:26.100217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9de63ae6-b756-4037-b8c3-de341ad618f5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:26.100657 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9de63ae6-b756-4037-b8c3-de341ad618f5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:26.101494 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9de63ae6-b756-4037-b8c3-de341ad618f5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:26.101929 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9de63ae6-b756-4037-b8c3-de341ad618f5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:26.131196 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9de63ae6-b756-4037-b8c3-de341ad618f5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043308 Jul 27 20:28:26.131738 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 833/1681] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:26 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:26.301665 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5077c5e1-4126-4662-aa7b-102169a77605 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:26.303842 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5077c5e1-4126-4662-aa7b-102169a77605 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:26.310345 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5077c5e1-4126-4662-aa7b-102169a77605 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:26.310799 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5077c5e1-4126-4662-aa7b-102169a77605 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:26.311572 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5077c5e1-4126-4662-aa7b-102169a77605 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:26.312013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5077c5e1-4126-4662-aa7b-102169a77605 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:26.331950 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8d38f12d-61dd-4250-a642-3156e024add4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:26.332491 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8d38f12d-61dd-4250-a642-3156e024add4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:26.339086 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d38f12d-61dd-4250-a642-3156e024add4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:26.339532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d38f12d-61dd-4250-a642-3156e024add4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:26.340297 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d38f12d-61dd-4250-a642-3156e024add4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:26.340730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d38f12d-61dd-4250-a642-3156e024add4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:26.340831 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5077c5e1-4126-4662-aa7b-102169a77605 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043093 Jul 27 20:28:26.341396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 849/1682] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:26 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:26.401954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8d38f12d-61dd-4250-a642-3156e024add4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:26.410050 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8d38f12d-61dd-4250-a642-3156e024add4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081960 Jul 27 20:28:26.410607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 834/1683] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:26 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:28:27.144032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ecb2f591-16ee-465c-8fa4-fd3ea75c9a21 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:27.146210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ecb2f591-16ee-465c-8fa4-fd3ea75c9a21 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:27.152249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ecb2f591-16ee-465c-8fa4-fd3ea75c9a21 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:27.152637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ecb2f591-16ee-465c-8fa4-fd3ea75c9a21 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:27.153422 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ecb2f591-16ee-465c-8fa4-fd3ea75c9a21 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:27.153858 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ecb2f591-16ee-465c-8fa4-fd3ea75c9a21 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:27.182495 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ecb2f591-16ee-465c-8fa4-fd3ea75c9a21 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042380 Jul 27 20:28:27.183039 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 850/1684] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:27 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:27.275577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:28:27.275730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:28:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:28:27.353710 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5bd9f1d6-6044-472e-ba02-59f998f5f3ac tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:27.355882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5bd9f1d6-6044-472e-ba02-59f998f5f3ac tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:27.362544 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5bd9f1d6-6044-472e-ba02-59f998f5f3ac tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:27.362985 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5bd9f1d6-6044-472e-ba02-59f998f5f3ac tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:27.363742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5bd9f1d6-6044-472e-ba02-59f998f5f3ac tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:27.364172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5bd9f1d6-6044-472e-ba02-59f998f5f3ac tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:27.393676 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5bd9f1d6-6044-472e-ba02-59f998f5f3ac tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043807 Jul 27 20:28:27.394217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 835/1685] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:27 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:27.430823 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c7fa8d0e-0637-4024-9678-366f9f4f35a6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:27.431385 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c7fa8d0e-0637-4024-9678-366f9f4f35a6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:27.438510 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c7fa8d0e-0637-4024-9678-366f9f4f35a6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:27.438953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c7fa8d0e-0637-4024-9678-366f9f4f35a6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:27.439734 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c7fa8d0e-0637-4024-9678-366f9f4f35a6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:27.440170 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c7fa8d0e-0637-4024-9678-366f9f4f35a6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:27.501247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c7fa8d0e-0637-4024-9678-366f9f4f35a6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:27.508822 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c7fa8d0e-0637-4024-9678-366f9f4f35a6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081897 Jul 27 20:28:27.509425 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 851/1686] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:27 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:28.194601 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-41b8110b-c26b-40f3-b3ba-6868f4070e0a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:28.196792 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-41b8110b-c26b-40f3-b3ba-6868f4070e0a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:28.203293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-41b8110b-c26b-40f3-b3ba-6868f4070e0a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:28.203734 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-41b8110b-c26b-40f3-b3ba-6868f4070e0a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:28.204485 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-41b8110b-c26b-40f3-b3ba-6868f4070e0a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:28.204914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-41b8110b-c26b-40f3-b3ba-6868f4070e0a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:28.233469 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-41b8110b-c26b-40f3-b3ba-6868f4070e0a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042233 Jul 27 20:28:28.234006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 836/1687] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:28 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:28.406216 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9eab607b-20b2-4cdb-a429-b98211d68b7b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:28.408487 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9eab607b-20b2-4cdb-a429-b98211d68b7b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:28.414587 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9eab607b-20b2-4cdb-a429-b98211d68b7b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:28.415036 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9eab607b-20b2-4cdb-a429-b98211d68b7b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:28.415795 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9eab607b-20b2-4cdb-a429-b98211d68b7b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:28.416231 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9eab607b-20b2-4cdb-a429-b98211d68b7b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:28.445554 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9eab607b-20b2-4cdb-a429-b98211d68b7b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043566 Jul 27 20:28:28.446171 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 852/1688] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:28 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:28:28.529191 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-beb8e476-02c5-4dc0-996a-2b0f444d3b0d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:28.530379 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-beb8e476-02c5-4dc0-996a-2b0f444d3b0d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:28.536753 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-beb8e476-02c5-4dc0-996a-2b0f444d3b0d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:28.537224 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-beb8e476-02c5-4dc0-996a-2b0f444d3b0d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:28.537974 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-beb8e476-02c5-4dc0-996a-2b0f444d3b0d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:28.538400 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-beb8e476-02c5-4dc0-996a-2b0f444d3b0d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:28.602255 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-beb8e476-02c5-4dc0-996a-2b0f444d3b0d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:28.610215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-beb8e476-02c5-4dc0-996a-2b0f444d3b0d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084858 Jul 27 20:28:28.610767 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 837/1689] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:28 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:29.245878 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-42a21aa4-2335-4988-841c-2b08977991de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:29.247966 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-42a21aa4-2335-4988-841c-2b08977991de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:29.254553 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-42a21aa4-2335-4988-841c-2b08977991de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:29.255011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-42a21aa4-2335-4988-841c-2b08977991de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:29.255782 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-42a21aa4-2335-4988-841c-2b08977991de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:29.256225 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-42a21aa4-2335-4988-841c-2b08977991de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:29.285229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-42a21aa4-2335-4988-841c-2b08977991de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043394 Jul 27 20:28:29.285781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 853/1690] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:29 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:29.458845 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f4778a93-c226-4a15-a847-c3279bb5f1a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:29.461043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f4778a93-c226-4a15-a847-c3279bb5f1a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:29.467258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f4778a93-c226-4a15-a847-c3279bb5f1a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:29.467710 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f4778a93-c226-4a15-a847-c3279bb5f1a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:29.468483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f4778a93-c226-4a15-a847-c3279bb5f1a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:29.468919 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f4778a93-c226-4a15-a847-c3279bb5f1a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:29.498871 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f4778a93-c226-4a15-a847-c3279bb5f1a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043442 Jul 27 20:28:29.499533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 838/1691] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:29 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:29.630398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fa82f23a-bad2-49d3-a988-2405b6cf67d7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:29.631013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fa82f23a-bad2-49d3-a988-2405b6cf67d7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:29.637550 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa82f23a-bad2-49d3-a988-2405b6cf67d7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:29.637994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa82f23a-bad2-49d3-a988-2405b6cf67d7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:29.639460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa82f23a-bad2-49d3-a988-2405b6cf67d7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:29.639972 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa82f23a-bad2-49d3-a988-2405b6cf67d7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:29.700486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fa82f23a-bad2-49d3-a988-2405b6cf67d7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:29.709289 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fa82f23a-bad2-49d3-a988-2405b6cf67d7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082700 Jul 27 20:28:29.709860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 854/1692] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:29 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:30.297606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9733e092-849e-418c-9188-ce17a3bdccd6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:30.299658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9733e092-849e-418c-9188-ce17a3bdccd6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:30.306130 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9733e092-849e-418c-9188-ce17a3bdccd6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:30.306578 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9733e092-849e-418c-9188-ce17a3bdccd6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:30.307339 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9733e092-849e-418c-9188-ce17a3bdccd6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:30.307775 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9733e092-849e-418c-9188-ce17a3bdccd6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:30.337278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9733e092-849e-418c-9188-ce17a3bdccd6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043661 Jul 27 20:28:30.337821 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 839/1693] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:30 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:30.510836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cb900fe7-afc6-4433-b1d1-cf254abfb180 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:30.512982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cb900fe7-afc6-4433-b1d1-cf254abfb180 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:30.519135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb900fe7-afc6-4433-b1d1-cf254abfb180 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:30.519590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb900fe7-afc6-4433-b1d1-cf254abfb180 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:30.520362 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb900fe7-afc6-4433-b1d1-cf254abfb180 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:30.520806 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb900fe7-afc6-4433-b1d1-cf254abfb180 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:30.549622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cb900fe7-afc6-4433-b1d1-cf254abfb180 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042761 Jul 27 20:28:30.550106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 855/1694] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:30 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:30.731297 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-81cd3551-8707-41a4-9029-528b5e5c3b24 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:30.731909 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-81cd3551-8707-41a4-9029-528b5e5c3b24 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:30.739877 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81cd3551-8707-41a4-9029-528b5e5c3b24 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:30.740696 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81cd3551-8707-41a4-9029-528b5e5c3b24 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:30.741551 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81cd3551-8707-41a4-9029-528b5e5c3b24 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:30.741988 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81cd3551-8707-41a4-9029-528b5e5c3b24 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:30.803967 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-81cd3551-8707-41a4-9029-528b5e5c3b24 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:30.811447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-81cd3551-8707-41a4-9029-528b5e5c3b24 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084065 Jul 27 20:28:30.811990 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 840/1695] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:30 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:31.349627 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fbbe1e34-4cf0-4091-90d5-8fe4d822e2b1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:31.351779 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fbbe1e34-4cf0-4091-90d5-8fe4d822e2b1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:31.358803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fbbe1e34-4cf0-4091-90d5-8fe4d822e2b1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:31.359258 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fbbe1e34-4cf0-4091-90d5-8fe4d822e2b1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:31.360022 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fbbe1e34-4cf0-4091-90d5-8fe4d822e2b1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:31.360465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fbbe1e34-4cf0-4091-90d5-8fe4d822e2b1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:31.389586 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fbbe1e34-4cf0-4091-90d5-8fe4d822e2b1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043941 Jul 27 20:28:31.390152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 856/1696] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:31 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:31.562004 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c70b4d60-4e42-4788-bdbb-581077d06f4c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:31.564184 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c70b4d60-4e42-4788-bdbb-581077d06f4c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:31.570580 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c70b4d60-4e42-4788-bdbb-581077d06f4c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:31.571019 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c70b4d60-4e42-4788-bdbb-581077d06f4c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:31.571767 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c70b4d60-4e42-4788-bdbb-581077d06f4c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:31.572193 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c70b4d60-4e42-4788-bdbb-581077d06f4c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:31.601042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c70b4d60-4e42-4788-bdbb-581077d06f4c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043045 Jul 27 20:28:31.601519 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 841/1697] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:31 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:31.831340 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-064f807d-41ba-425b-95fa-1d9a859e2a67 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:31.831958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-064f807d-41ba-425b-95fa-1d9a859e2a67 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:31.837964 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-064f807d-41ba-425b-95fa-1d9a859e2a67 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:31.838416 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-064f807d-41ba-425b-95fa-1d9a859e2a67 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:31.839183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-064f807d-41ba-425b-95fa-1d9a859e2a67 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:31.839620 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-064f807d-41ba-425b-95fa-1d9a859e2a67 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:31.905462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-064f807d-41ba-425b-95fa-1d9a859e2a67 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:31.912903 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-064f807d-41ba-425b-95fa-1d9a859e2a67 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.085398 Jul 27 20:28:31.913492 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 857/1698] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:31 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:32.402791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-43c14c96-2102-4b62-8fa1-0fc33380bdfd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:32.405824 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-43c14c96-2102-4b62-8fa1-0fc33380bdfd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:32.412013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43c14c96-2102-4b62-8fa1-0fc33380bdfd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:32.412462 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43c14c96-2102-4b62-8fa1-0fc33380bdfd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:32.413257 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43c14c96-2102-4b62-8fa1-0fc33380bdfd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:32.413696 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43c14c96-2102-4b62-8fa1-0fc33380bdfd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:32.444067 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-43c14c96-2102-4b62-8fa1-0fc33380bdfd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045652 Jul 27 20:28:32.444614 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 842/1699] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:32 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:32.614013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4d525d36-ddfa-4f5b-95e6-73dfb4930fd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:32.616136 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4d525d36-ddfa-4f5b-95e6-73dfb4930fd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:32.622415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4d525d36-ddfa-4f5b-95e6-73dfb4930fd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:32.622873 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4d525d36-ddfa-4f5b-95e6-73dfb4930fd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:32.623644 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4d525d36-ddfa-4f5b-95e6-73dfb4930fd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:32.624080 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4d525d36-ddfa-4f5b-95e6-73dfb4930fd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:32.641361 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:28:32.655266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4d525d36-ddfa-4f5b-95e6-73dfb4930fd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044545 Jul 27 20:28:32.655756 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 858/1700] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:32 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:28:32.933550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-27e83a63-1694-4a2a-8407-2a8de92046e0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:32.934066 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-27e83a63-1694-4a2a-8407-2a8de92046e0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:32.940663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-27e83a63-1694-4a2a-8407-2a8de92046e0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:32.941144 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-27e83a63-1694-4a2a-8407-2a8de92046e0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:32.941896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-27e83a63-1694-4a2a-8407-2a8de92046e0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:32.942328 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-27e83a63-1694-4a2a-8407-2a8de92046e0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:33.004870 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-27e83a63-1694-4a2a-8407-2a8de92046e0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:33.012318 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-27e83a63-1694-4a2a-8407-2a8de92046e0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082708 Jul 27 20:28:33.012880 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 843/1701] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:32 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:33.456307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-dcd8c32a-4556-4379-a7b7-5dc33517bb44 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:33.458521 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-dcd8c32a-4556-4379-a7b7-5dc33517bb44 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:33.464571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dcd8c32a-4556-4379-a7b7-5dc33517bb44 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:33.465042 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dcd8c32a-4556-4379-a7b7-5dc33517bb44 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:33.465797 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dcd8c32a-4556-4379-a7b7-5dc33517bb44 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:33.466227 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dcd8c32a-4556-4379-a7b7-5dc33517bb44 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:33.494948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-dcd8c32a-4556-4379-a7b7-5dc33517bb44 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042887 Jul 27 20:28:33.495488 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 859/1702] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:33 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:33.667195 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f6c0fc66-d890-4761-8846-eb5de1c8f54d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:33.669323 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f6c0fc66-d890-4761-8846-eb5de1c8f54d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:33.676061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f6c0fc66-d890-4761-8846-eb5de1c8f54d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:33.676504 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f6c0fc66-d890-4761-8846-eb5de1c8f54d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:33.677322 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f6c0fc66-d890-4761-8846-eb5de1c8f54d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:33.677755 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f6c0fc66-d890-4761-8846-eb5de1c8f54d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:33.703521 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:28:33.708828 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f6c0fc66-d890-4761-8846-eb5de1c8f54d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045627 Jul 27 20:28:33.709430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 844/1703] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:33 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:34.034123 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3c302c12-0a88-4e81-970c-a6ba59ea7fba tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:34.034826 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3c302c12-0a88-4e81-970c-a6ba59ea7fba tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:34.040988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c302c12-0a88-4e81-970c-a6ba59ea7fba tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:34.041448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c302c12-0a88-4e81-970c-a6ba59ea7fba tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:34.042211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c302c12-0a88-4e81-970c-a6ba59ea7fba tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:34.042651 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c302c12-0a88-4e81-970c-a6ba59ea7fba tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:34.105206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3c302c12-0a88-4e81-970c-a6ba59ea7fba tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:34.112852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3c302c12-0a88-4e81-970c-a6ba59ea7fba tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083202 Jul 27 20:28:34.113769 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 860/1704] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:34 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:34.508004 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-03fb4602-d0e6-4458-988d-123a129b50ac tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:34.510184 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-03fb4602-d0e6-4458-988d-123a129b50ac tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:34.516861 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03fb4602-d0e6-4458-988d-123a129b50ac tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:34.517286 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03fb4602-d0e6-4458-988d-123a129b50ac tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:34.518046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03fb4602-d0e6-4458-988d-123a129b50ac tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:34.518479 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03fb4602-d0e6-4458-988d-123a129b50ac tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:34.547677 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-03fb4602-d0e6-4458-988d-123a129b50ac tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043897 Jul 27 20:28:34.548220 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 845/1705] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:34 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:34.721896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-986e22c0-583a-4f7b-a690-529f9efa2be0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:34.724078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-986e22c0-583a-4f7b-a690-529f9efa2be0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:34.730108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-986e22c0-583a-4f7b-a690-529f9efa2be0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:34.730551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-986e22c0-583a-4f7b-a690-529f9efa2be0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:34.731319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-986e22c0-583a-4f7b-a690-529f9efa2be0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:34.731752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-986e22c0-583a-4f7b-a690-529f9efa2be0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:34.760065 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-986e22c0-583a-4f7b-a690-529f9efa2be0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042242 Jul 27 20:28:34.760603 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 861/1706] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:34 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:35.133432 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a791f840-0451-405e-8cbc-c5b97441be75 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:35.134043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a791f840-0451-405e-8cbc-c5b97441be75 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:35.140575 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a791f840-0451-405e-8cbc-c5b97441be75 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:35.141044 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a791f840-0451-405e-8cbc-c5b97441be75 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:35.141803 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a791f840-0451-405e-8cbc-c5b97441be75 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:35.142239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a791f840-0451-405e-8cbc-c5b97441be75 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:35.202413 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a791f840-0451-405e-8cbc-c5b97441be75 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:35.209888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a791f840-0451-405e-8cbc-c5b97441be75 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080253 Jul 27 20:28:35.210445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 846/1707] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:35 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:28:35.559245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-78684538-bbd8-4889-afce-bbed769dc6c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:35.561895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-78684538-bbd8-4889-afce-bbed769dc6c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:35.568309 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-78684538-bbd8-4889-afce-bbed769dc6c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:35.568759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-78684538-bbd8-4889-afce-bbed769dc6c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:35.569554 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-78684538-bbd8-4889-afce-bbed769dc6c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:35.569994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-78684538-bbd8-4889-afce-bbed769dc6c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:35.599179 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-78684538-bbd8-4889-afce-bbed769dc6c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043860 Jul 27 20:28:35.599720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 862/1708] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:35 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:35.771809 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8955f0ca-319e-427f-a217-b0958faab386 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:35.773893 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8955f0ca-319e-427f-a217-b0958faab386 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:35.780286 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8955f0ca-319e-427f-a217-b0958faab386 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:35.780722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8955f0ca-319e-427f-a217-b0958faab386 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:35.781602 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8955f0ca-319e-427f-a217-b0958faab386 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:35.782035 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8955f0ca-319e-427f-a217-b0958faab386 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:35.810533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8955f0ca-319e-427f-a217-b0958faab386 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042757 Jul 27 20:28:35.811070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 847/1709] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:35 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:36.230986 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e2a52f8a-70c0-4244-92c8-45777565ff73 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:36.231606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e2a52f8a-70c0-4244-92c8-45777565ff73 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:36.238255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e2a52f8a-70c0-4244-92c8-45777565ff73 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:36.238706 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e2a52f8a-70c0-4244-92c8-45777565ff73 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:36.239467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e2a52f8a-70c0-4244-92c8-45777565ff73 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:36.239905 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e2a52f8a-70c0-4244-92c8-45777565ff73 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:36.299968 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e2a52f8a-70c0-4244-92c8-45777565ff73 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:36.307359 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e2a52f8a-70c0-4244-92c8-45777565ff73 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080252 Jul 27 20:28:36.307918 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 863/1710] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:36 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:36.611582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bcc3cd7a-5e3b-4b9a-80d2-dbbb362c8846 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:36.613763 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bcc3cd7a-5e3b-4b9a-80d2-dbbb362c8846 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:36.619760 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bcc3cd7a-5e3b-4b9a-80d2-dbbb362c8846 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:36.620213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bcc3cd7a-5e3b-4b9a-80d2-dbbb362c8846 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:36.620985 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bcc3cd7a-5e3b-4b9a-80d2-dbbb362c8846 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:36.621440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bcc3cd7a-5e3b-4b9a-80d2-dbbb362c8846 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:36.650236 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bcc3cd7a-5e3b-4b9a-80d2-dbbb362c8846 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043450 Jul 27 20:28:36.650791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 848/1711] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:36 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:36.823570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1bf1a84b-8d72-4a24-bd18-e2547c654ed7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:36.825735 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1bf1a84b-8d72-4a24-bd18-e2547c654ed7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:36.832572 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1bf1a84b-8d72-4a24-bd18-e2547c654ed7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:36.833082 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1bf1a84b-8d72-4a24-bd18-e2547c654ed7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:36.833852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1bf1a84b-8d72-4a24-bd18-e2547c654ed7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:36.834296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1bf1a84b-8d72-4a24-bd18-e2547c654ed7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:36.863681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1bf1a84b-8d72-4a24-bd18-e2547c654ed7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044010 Jul 27 20:28:36.864162 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 864/1712] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:36 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:37.328946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9a477216-1ee7-4fea-b724-96c62cfc02b4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:37.329689 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9a477216-1ee7-4fea-b724-96c62cfc02b4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:37.336131 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a477216-1ee7-4fea-b724-96c62cfc02b4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:37.336579 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a477216-1ee7-4fea-b724-96c62cfc02b4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:37.337372 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a477216-1ee7-4fea-b724-96c62cfc02b4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:37.337808 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a477216-1ee7-4fea-b724-96c62cfc02b4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:37.402659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9a477216-1ee7-4fea-b724-96c62cfc02b4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:37.410852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9a477216-1ee7-4fea-b724-96c62cfc02b4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.087095 Jul 27 20:28:37.411667 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 849/1713] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:37 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:37.662470 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5069f830-df84-4e85-94de-4f7aed8ef3fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:37.664571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5069f830-df84-4e85-94de-4f7aed8ef3fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:37.670613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5069f830-df84-4e85-94de-4f7aed8ef3fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:37.671058 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5069f830-df84-4e85-94de-4f7aed8ef3fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:37.671805 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5069f830-df84-4e85-94de-4f7aed8ef3fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:37.672236 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5069f830-df84-4e85-94de-4f7aed8ef3fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:37.703540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5069f830-df84-4e85-94de-4f7aed8ef3fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044959 Jul 27 20:28:37.704109 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 865/1714] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:37 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:37.875538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ea195364-742e-4dda-8bac-40588bcae671 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:37.877695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ea195364-742e-4dda-8bac-40588bcae671 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:37.883748 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ea195364-742e-4dda-8bac-40588bcae671 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:37.884196 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ea195364-742e-4dda-8bac-40588bcae671 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:37.884978 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ea195364-742e-4dda-8bac-40588bcae671 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:37.885412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ea195364-742e-4dda-8bac-40588bcae671 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:37.914546 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ea195364-742e-4dda-8bac-40588bcae671 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042964 Jul 27 20:28:37.915021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 850/1715] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:37 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:38.431614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6b92832d-5672-4759-b67a-2998934173ef tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:38.432255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6b92832d-5672-4759-b67a-2998934173ef tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:38.438701 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6b92832d-5672-4759-b67a-2998934173ef tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:38.439145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6b92832d-5672-4759-b67a-2998934173ef tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:38.439902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6b92832d-5672-4759-b67a-2998934173ef tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:38.440335 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6b92832d-5672-4759-b67a-2998934173ef tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:38.501336 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6b92832d-5672-4759-b67a-2998934173ef tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:38.508674 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6b92832d-5672-4759-b67a-2998934173ef tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080971 Jul 27 20:28:38.509271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 866/1716] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:38 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:38.715863 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0d7090bf-af04-48d5-8a4f-dd62ca028c53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:38.718187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0d7090bf-af04-48d5-8a4f-dd62ca028c53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:38.725053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d7090bf-af04-48d5-8a4f-dd62ca028c53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:38.725511 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d7090bf-af04-48d5-8a4f-dd62ca028c53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:38.726310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d7090bf-af04-48d5-8a4f-dd62ca028c53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:38.726736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d7090bf-af04-48d5-8a4f-dd62ca028c53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:38.758803 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0d7090bf-af04-48d5-8a4f-dd62ca028c53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046953 Jul 27 20:28:38.759362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 851/1717] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:38 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:38.926229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-77281fe7-e497-441b-824b-6d715875c089 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:38.928333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-77281fe7-e497-441b-824b-6d715875c089 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:38.934280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-77281fe7-e497-441b-824b-6d715875c089 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:38.934724 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-77281fe7-e497-441b-824b-6d715875c089 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:38.935471 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-77281fe7-e497-441b-824b-6d715875c089 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:38.935905 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-77281fe7-e497-441b-824b-6d715875c089 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:38.965210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-77281fe7-e497-441b-824b-6d715875c089 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042986 Jul 27 20:28:38.965748 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 867/1718] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:38 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:39.530756 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-684fa72c-9b90-4ac3-a78e-0ccc576a664f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:39.531360 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-684fa72c-9b90-4ac3-a78e-0ccc576a664f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:39.537359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-684fa72c-9b90-4ac3-a78e-0ccc576a664f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:39.537801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-684fa72c-9b90-4ac3-a78e-0ccc576a664f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:39.538551 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-684fa72c-9b90-4ac3-a78e-0ccc576a664f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:39.538979 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-684fa72c-9b90-4ac3-a78e-0ccc576a664f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:39.598297 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-684fa72c-9b90-4ac3-a78e-0ccc576a664f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:39.605726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-684fa72c-9b90-4ac3-a78e-0ccc576a664f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.079480 Jul 27 20:28:39.606283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 852/1719] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:39 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:39.770883 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d533399f-b3e3-4ab2-a637-abc59605017c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:39.772908 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d533399f-b3e3-4ab2-a637-abc59605017c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:39.779376 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d533399f-b3e3-4ab2-a637-abc59605017c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:39.779862 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d533399f-b3e3-4ab2-a637-abc59605017c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:39.780630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d533399f-b3e3-4ab2-a637-abc59605017c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:39.781090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d533399f-b3e3-4ab2-a637-abc59605017c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:39.808867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d533399f-b3e3-4ab2-a637-abc59605017c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042032 Jul 27 20:28:39.809435 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 868/1720] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:39 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:39.978130 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3d35827c-39ea-4ab3-b701-16a9dfd243a6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:39.980274 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3d35827c-39ea-4ab3-b701-16a9dfd243a6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:39.986926 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d35827c-39ea-4ab3-b701-16a9dfd243a6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:39.987370 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d35827c-39ea-4ab3-b701-16a9dfd243a6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:39.988120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d35827c-39ea-4ab3-b701-16a9dfd243a6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:39.988551 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d35827c-39ea-4ab3-b701-16a9dfd243a6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:40.017831 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3d35827c-39ea-4ab3-b701-16a9dfd243a6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043715 Jul 27 20:28:40.018382 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 853/1721] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:39 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:40.625307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9137ca13-5424-4932-ae4f-fccf90c8924d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:40.625917 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9137ca13-5424-4932-ae4f-fccf90c8924d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:40.631956 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9137ca13-5424-4932-ae4f-fccf90c8924d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:40.632404 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9137ca13-5424-4932-ae4f-fccf90c8924d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:40.633188 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9137ca13-5424-4932-ae4f-fccf90c8924d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:40.633624 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9137ca13-5424-4932-ae4f-fccf90c8924d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:40.696083 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9137ca13-5424-4932-ae4f-fccf90c8924d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:40.704436 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9137ca13-5424-4932-ae4f-fccf90c8924d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083056 Jul 27 20:28:40.705223 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 869/1722] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:40 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:40.822111 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-79b166b6-684d-407a-8151-e81efab8b6d9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:40.824253 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-79b166b6-684d-407a-8151-e81efab8b6d9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:40.831236 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79b166b6-684d-407a-8151-e81efab8b6d9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:40.831687 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79b166b6-684d-407a-8151-e81efab8b6d9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:40.832452 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79b166b6-684d-407a-8151-e81efab8b6d9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:40.832889 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79b166b6-684d-407a-8151-e81efab8b6d9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:40.861708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-79b166b6-684d-407a-8151-e81efab8b6d9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043537 Jul 27 20:28:40.862246 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 854/1723] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:40 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:41.030141 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-04749d3a-0f83-4bec-8654-67baab6966e8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:41.032296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-04749d3a-0f83-4bec-8654-67baab6966e8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:41.038790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-04749d3a-0f83-4bec-8654-67baab6966e8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:41.039239 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-04749d3a-0f83-4bec-8654-67baab6966e8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:41.039995 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-04749d3a-0f83-4bec-8654-67baab6966e8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:41.040435 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-04749d3a-0f83-4bec-8654-67baab6966e8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:41.069979 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-04749d3a-0f83-4bec-8654-67baab6966e8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043867 Jul 27 20:28:41.070534 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 870/1724] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:41 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:41.725305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3618014e-ef85-4512-9570-bd23afab6e65 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:41.725870 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3618014e-ef85-4512-9570-bd23afab6e65 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:41.732395 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3618014e-ef85-4512-9570-bd23afab6e65 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:41.732860 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3618014e-ef85-4512-9570-bd23afab6e65 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:41.733825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3618014e-ef85-4512-9570-bd23afab6e65 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:41.734285 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3618014e-ef85-4512-9570-bd23afab6e65 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:41.795629 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3618014e-ef85-4512-9570-bd23afab6e65 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:41.803394 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3618014e-ef85-4512-9570-bd23afab6e65 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082060 Jul 27 20:28:41.803944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 855/1725] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:41 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:41.873718 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-176e229a-18b7-4c1d-be21-53790ab2a83e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:41.875901 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-176e229a-18b7-4c1d-be21-53790ab2a83e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:41.881983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-176e229a-18b7-4c1d-be21-53790ab2a83e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:41.882447 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-176e229a-18b7-4c1d-be21-53790ab2a83e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:41.883214 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-176e229a-18b7-4c1d-be21-53790ab2a83e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:41.883657 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-176e229a-18b7-4c1d-be21-53790ab2a83e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:41.913567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-176e229a-18b7-4c1d-be21-53790ab2a83e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043737 Jul 27 20:28:41.914111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 871/1726] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:41 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:42.083323 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-15557789-b82c-4f94-b980-647f56e61c44 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:42.085477 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-15557789-b82c-4f94-b980-647f56e61c44 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:42.091550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-15557789-b82c-4f94-b980-647f56e61c44 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:42.091995 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-15557789-b82c-4f94-b980-647f56e61c44 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:42.092860 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-15557789-b82c-4f94-b980-647f56e61c44 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:42.093319 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-15557789-b82c-4f94-b980-647f56e61c44 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:42.121247 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-15557789-b82c-4f94-b980-647f56e61c44 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041901 Jul 27 20:28:42.121788 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 856/1727] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:42 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:42.823813 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2be34d39-0323-455e-9fa5-5008b8bd1dc7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:42.824417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2be34d39-0323-455e-9fa5-5008b8bd1dc7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:42.832017 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2be34d39-0323-455e-9fa5-5008b8bd1dc7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:42.832472 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2be34d39-0323-455e-9fa5-5008b8bd1dc7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:42.833267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2be34d39-0323-455e-9fa5-5008b8bd1dc7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:42.833712 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2be34d39-0323-455e-9fa5-5008b8bd1dc7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:42.898475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2be34d39-0323-455e-9fa5-5008b8bd1dc7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:42.906170 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2be34d39-0323-455e-9fa5-5008b8bd1dc7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.086227 Jul 27 20:28:42.906738 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 872/1728] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:42 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:42.925934 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-14ed2b26-c82e-48dd-9d79-1c550685c9a7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:42.928062 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-14ed2b26-c82e-48dd-9d79-1c550685c9a7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:42.934410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14ed2b26-c82e-48dd-9d79-1c550685c9a7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:42.934851 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14ed2b26-c82e-48dd-9d79-1c550685c9a7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:42.935599 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14ed2b26-c82e-48dd-9d79-1c550685c9a7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:42.936533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14ed2b26-c82e-48dd-9d79-1c550685c9a7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:42.965177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-14ed2b26-c82e-48dd-9d79-1c550685c9a7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043248 Jul 27 20:28:42.965719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 857/1729] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:42 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:43.134202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-917c46ab-a6eb-4191-a136-fb4271c4c3a2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:43.136353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-917c46ab-a6eb-4191-a136-fb4271c4c3a2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:43.142480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-917c46ab-a6eb-4191-a136-fb4271c4c3a2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:43.142925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-917c46ab-a6eb-4191-a136-fb4271c4c3a2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:43.143695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-917c46ab-a6eb-4191-a136-fb4271c4c3a2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:43.144134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-917c46ab-a6eb-4191-a136-fb4271c4c3a2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:43.174705 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-917c46ab-a6eb-4191-a136-fb4271c4c3a2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044479 Jul 27 20:28:43.175266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 873/1730] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:43 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:43.926686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8d01036a-4b71-40b6-8f1d-cb0ca9ce59c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:43.927298 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8d01036a-4b71-40b6-8f1d-cb0ca9ce59c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:43.933767 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d01036a-4b71-40b6-8f1d-cb0ca9ce59c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:43.934213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d01036a-4b71-40b6-8f1d-cb0ca9ce59c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:43.934976 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d01036a-4b71-40b6-8f1d-cb0ca9ce59c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:43.935412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d01036a-4b71-40b6-8f1d-cb0ca9ce59c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:43.980213 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b01b8552-80a4-4a04-9f92-8f2ba2894959 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:43.982535 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b01b8552-80a4-4a04-9f92-8f2ba2894959 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:43.989855 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b01b8552-80a4-4a04-9f92-8f2ba2894959 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:43.990313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b01b8552-80a4-4a04-9f92-8f2ba2894959 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:43.991094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b01b8552-80a4-4a04-9f92-8f2ba2894959 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:43.991539 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b01b8552-80a4-4a04-9f92-8f2ba2894959 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:44.000656 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8d01036a-4b71-40b6-8f1d-cb0ca9ce59c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:44.008185 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8d01036a-4b71-40b6-8f1d-cb0ca9ce59c8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.085348 Jul 27 20:28:44.008746 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 858/1731] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:43 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:44.022400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b01b8552-80a4-4a04-9f92-8f2ba2894959 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046248 Jul 27 20:28:44.022960 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 874/1732] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:43 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:28:44.187537 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-92cb5908-ebb4-48f4-84db-c5444a5dbdeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:44.189673 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-92cb5908-ebb4-48f4-84db-c5444a5dbdeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:44.195679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-92cb5908-ebb4-48f4-84db-c5444a5dbdeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:44.196129 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-92cb5908-ebb4-48f4-84db-c5444a5dbdeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:44.196888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-92cb5908-ebb4-48f4-84db-c5444a5dbdeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:44.197352 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-92cb5908-ebb4-48f4-84db-c5444a5dbdeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:44.226201 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-92cb5908-ebb4-48f4-84db-c5444a5dbdeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043329 Jul 27 20:28:44.226737 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 859/1733] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:44 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:45.029437 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-604ef988-e8b7-4a98-b9b2-2cc9ba09d810 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:45.030062 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-604ef988-e8b7-4a98-b9b2-2cc9ba09d810 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:45.034462 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dc2cf0d6-1dbc-44c7-b9ec-8cb11951d605 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:45.036609 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dc2cf0d6-1dbc-44c7-b9ec-8cb11951d605 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:45.036823 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-604ef988-e8b7-4a98-b9b2-2cc9ba09d810 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:45.037429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-604ef988-e8b7-4a98-b9b2-2cc9ba09d810 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:45.038203 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-604ef988-e8b7-4a98-b9b2-2cc9ba09d810 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:45.038644 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-604ef988-e8b7-4a98-b9b2-2cc9ba09d810 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:45.042851 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:28:45.043072 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc2cf0d6-1dbc-44c7-b9ec-8cb11951d605 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:45.043476 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc2cf0d6-1dbc-44c7-b9ec-8cb11951d605 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:45.044473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc2cf0d6-1dbc-44c7-b9ec-8cb11951d605 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:45.045085 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc2cf0d6-1dbc-44c7-b9ec-8cb11951d605 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:45.074664 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dc2cf0d6-1dbc-44c7-b9ec-8cb11951d605 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044089 Jul 27 20:28:45.075483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 860/1734] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:45 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:28:45.101210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-604ef988-e8b7-4a98-b9b2-2cc9ba09d810 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:45.108915 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-604ef988-e8b7-4a98-b9b2-2cc9ba09d810 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083214 Jul 27 20:28:45.109496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 875/1735] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:45 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:45.238768 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-562e186b-ed02-415a-84d6-7f506ac1076e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:45.240851 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-562e186b-ed02-415a-84d6-7f506ac1076e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:45.246850 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-562e186b-ed02-415a-84d6-7f506ac1076e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:45.247294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-562e186b-ed02-415a-84d6-7f506ac1076e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:45.248044 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-562e186b-ed02-415a-84d6-7f506ac1076e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:45.249004 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-562e186b-ed02-415a-84d6-7f506ac1076e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:45.265809 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:28:45.280665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-562e186b-ed02-415a-84d6-7f506ac1076e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045233 Jul 27 20:28:45.281258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 861/1736] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:45 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:46.087819 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7a54490f-af5b-472d-8303-91c05566579e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:46.090031 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7a54490f-af5b-472d-8303-91c05566579e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:46.096710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7a54490f-af5b-472d-8303-91c05566579e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:46.097200 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7a54490f-af5b-472d-8303-91c05566579e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:46.097975 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7a54490f-af5b-472d-8303-91c05566579e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:46.098420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7a54490f-af5b-472d-8303-91c05566579e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:46.127415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7a54490f-af5b-472d-8303-91c05566579e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043529 Jul 27 20:28:46.127975 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 876/1737] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:46 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:46.130695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0caf6a20-0ca3-4d71-a980-be99e653f095 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:46.131448 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0caf6a20-0ca3-4d71-a980-be99e653f095 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:46.142470 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0caf6a20-0ca3-4d71-a980-be99e653f095 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:46.142929 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0caf6a20-0ca3-4d71-a980-be99e653f095 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:46.143701 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0caf6a20-0ca3-4d71-a980-be99e653f095 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:46.144140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0caf6a20-0ca3-4d71-a980-be99e653f095 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:46.208183 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0caf6a20-0ca3-4d71-a980-be99e653f095 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:46.215642 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0caf6a20-0ca3-4d71-a980-be99e653f095 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.088768 Jul 27 20:28:46.216196 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 862/1738] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:46 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:28:46.293064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8c203424-527a-4162-95c7-720be37df664 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:46.295181 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8c203424-527a-4162-95c7-720be37df664 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:46.301720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8c203424-527a-4162-95c7-720be37df664 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:46.302172 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8c203424-527a-4162-95c7-720be37df664 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:46.302931 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8c203424-527a-4162-95c7-720be37df664 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:46.303369 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8c203424-527a-4162-95c7-720be37df664 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:46.333289 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8c203424-527a-4162-95c7-720be37df664 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044113 Jul 27 20:28:46.333771 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 877/1739] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:46 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:47.141639 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2c7b2445-f028-465d-91e9-2b4e3a6ee69b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:47.143756 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2c7b2445-f028-465d-91e9-2b4e3a6ee69b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:47.150116 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c7b2445-f028-465d-91e9-2b4e3a6ee69b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:47.150560 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c7b2445-f028-465d-91e9-2b4e3a6ee69b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:47.151307 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c7b2445-f028-465d-91e9-2b4e3a6ee69b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:47.151736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c7b2445-f028-465d-91e9-2b4e3a6ee69b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:47.180428 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2c7b2445-f028-465d-91e9-2b4e3a6ee69b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043198 Jul 27 20:28:47.180967 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 863/1740] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:47 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:47.235539 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b4d9f062-1500-450a-9870-a07b0224817c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:47.236156 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b4d9f062-1500-450a-9870-a07b0224817c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:47.242796 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4d9f062-1500-450a-9870-a07b0224817c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:47.243253 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4d9f062-1500-450a-9870-a07b0224817c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:47.244023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4d9f062-1500-450a-9870-a07b0224817c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:47.244466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4d9f062-1500-450a-9870-a07b0224817c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:47.304452 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b4d9f062-1500-450a-9870-a07b0224817c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:47.312520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b4d9f062-1500-450a-9870-a07b0224817c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080854 Jul 27 20:28:47.313098 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 878/1741] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:47 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:47.345455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-aa040e1a-27a5-4bbc-aebf-54e790259d34 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:47.347558 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-aa040e1a-27a5-4bbc-aebf-54e790259d34 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:47.353768 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa040e1a-27a5-4bbc-aebf-54e790259d34 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:47.354212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa040e1a-27a5-4bbc-aebf-54e790259d34 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:47.354979 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa040e1a-27a5-4bbc-aebf-54e790259d34 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:47.355420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa040e1a-27a5-4bbc-aebf-54e790259d34 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:47.385041 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-aa040e1a-27a5-4bbc-aebf-54e790259d34 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043584 Jul 27 20:28:47.385589 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 864/1742] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:47 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:48.192134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4889b4d3-8cee-4e44-bd23-3b9f69d075df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:48.194294 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4889b4d3-8cee-4e44-bd23-3b9f69d075df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:48.200221 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4889b4d3-8cee-4e44-bd23-3b9f69d075df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:48.200668 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4889b4d3-8cee-4e44-bd23-3b9f69d075df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:48.201910 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4889b4d3-8cee-4e44-bd23-3b9f69d075df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:48.202538 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4889b4d3-8cee-4e44-bd23-3b9f69d075df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:48.231195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4889b4d3-8cee-4e44-bd23-3b9f69d075df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043028 Jul 27 20:28:48.231735 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 879/1743] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:48 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:48.333781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c11545f0-472a-4a81-84db-6a1a2a02c772 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:48.334310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c11545f0-472a-4a81-84db-6a1a2a02c772 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:48.340339 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c11545f0-472a-4a81-84db-6a1a2a02c772 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:48.340784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c11545f0-472a-4a81-84db-6a1a2a02c772 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:48.341568 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c11545f0-472a-4a81-84db-6a1a2a02c772 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:48.342002 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c11545f0-472a-4a81-84db-6a1a2a02c772 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:48.397349 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a772b5d5-6988-4183-9345-aed972b1d82c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:48.399587 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a772b5d5-6988-4183-9345-aed972b1d82c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:48.403556 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c11545f0-472a-4a81-84db-6a1a2a02c772 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:48.406645 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a772b5d5-6988-4183-9345-aed972b1d82c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:48.407097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a772b5d5-6988-4183-9345-aed972b1d82c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:48.407869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a772b5d5-6988-4183-9345-aed972b1d82c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:48.408313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a772b5d5-6988-4183-9345-aed972b1d82c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:48.411875 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c11545f0-472a-4a81-84db-6a1a2a02c772 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082016 Jul 27 20:28:48.412434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 865/1744] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:48 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:48.437496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a772b5d5-6988-4183-9345-aed972b1d82c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044082 Jul 27 20:28:48.438046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 880/1745] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:48 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:49.243263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-636528c6-a0ad-4372-bd36-6b563ec6449c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:49.245461 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-636528c6-a0ad-4372-bd36-6b563ec6449c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:49.252153 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-636528c6-a0ad-4372-bd36-6b563ec6449c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:49.252601 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-636528c6-a0ad-4372-bd36-6b563ec6449c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:49.253397 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-636528c6-a0ad-4372-bd36-6b563ec6449c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:49.253837 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-636528c6-a0ad-4372-bd36-6b563ec6449c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:49.283114 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-636528c6-a0ad-4372-bd36-6b563ec6449c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043842 Jul 27 20:28:49.283663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 866/1746] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:49 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:49.432821 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ef8b95e3-d007-4609-b46b-39919b5fe7fe tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:49.433468 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ef8b95e3-d007-4609-b46b-39919b5fe7fe tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:49.440154 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ef8b95e3-d007-4609-b46b-39919b5fe7fe tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:49.440611 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ef8b95e3-d007-4609-b46b-39919b5fe7fe tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:49.441496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ef8b95e3-d007-4609-b46b-39919b5fe7fe tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:49.441946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ef8b95e3-d007-4609-b46b-39919b5fe7fe tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:49.449673 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6b6b6e13-e30b-4898-9965-9c6d2529cc6e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:49.452780 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6b6b6e13-e30b-4898-9965-9c6d2529cc6e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:49.459316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b6b6e13-e30b-4898-9965-9c6d2529cc6e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:49.459753 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b6b6e13-e30b-4898-9965-9c6d2529cc6e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:49.460515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b6b6e13-e30b-4898-9965-9c6d2529cc6e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:49.460948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b6b6e13-e30b-4898-9965-9c6d2529cc6e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:49.490316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6b6b6e13-e30b-4898-9965-9c6d2529cc6e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044438 Jul 27 20:28:49.490876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 867/1747] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:49 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:28:49.508775 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ef8b95e3-d007-4609-b46b-39919b5fe7fe tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:49.517766 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ef8b95e3-d007-4609-b46b-39919b5fe7fe tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.088799 Jul 27 20:28:49.518337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 881/1748] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:49 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:50.296027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0f50d442-a16f-49a4-af0f-befc4875d790 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:50.298367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0f50d442-a16f-49a4-af0f-befc4875d790 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:50.304340 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f50d442-a16f-49a4-af0f-befc4875d790 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:50.304784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f50d442-a16f-49a4-af0f-befc4875d790 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:50.305583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f50d442-a16f-49a4-af0f-befc4875d790 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:50.306203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f50d442-a16f-49a4-af0f-befc4875d790 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:50.335637 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0f50d442-a16f-49a4-af0f-befc4875d790 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044253 Jul 27 20:28:50.336106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 868/1749] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:50 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:50.502827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ebfa9e42-73a1-4011-9bd6-3f28ff4a7a8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:50.505002 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ebfa9e42-73a1-4011-9bd6-3f28ff4a7a8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:50.511416 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ebfa9e42-73a1-4011-9bd6-3f28ff4a7a8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:50.511869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ebfa9e42-73a1-4011-9bd6-3f28ff4a7a8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:50.512629 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ebfa9e42-73a1-4011-9bd6-3f28ff4a7a8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:50.513102 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ebfa9e42-73a1-4011-9bd6-3f28ff4a7a8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:50.538448 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-863bfa8b-39a9-429f-9878-8e6ce347777a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:50.539061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-863bfa8b-39a9-429f-9878-8e6ce347777a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:50.543288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ebfa9e42-73a1-4011-9bd6-3f28ff4a7a8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044412 Jul 27 20:28:50.543879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 882/1750] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:50 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:50.546009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-863bfa8b-39a9-429f-9878-8e6ce347777a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:50.546649 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-863bfa8b-39a9-429f-9878-8e6ce347777a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:50.547419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-863bfa8b-39a9-429f-9878-8e6ce347777a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:50.547858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-863bfa8b-39a9-429f-9878-8e6ce347777a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:50.609170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-863bfa8b-39a9-429f-9878-8e6ce347777a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:50.616675 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-863bfa8b-39a9-429f-9878-8e6ce347777a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082096 Jul 27 20:28:50.617271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 869/1751] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:50 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:28:51.348378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bd124d01-869f-4aea-b3df-087384b86e8e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:51.350464 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bd124d01-869f-4aea-b3df-087384b86e8e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:51.356594 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bd124d01-869f-4aea-b3df-087384b86e8e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:51.357082 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bd124d01-869f-4aea-b3df-087384b86e8e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:51.358498 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bd124d01-869f-4aea-b3df-087384b86e8e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:51.358939 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bd124d01-869f-4aea-b3df-087384b86e8e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:51.386733 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bd124d01-869f-4aea-b3df-087384b86e8e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042361 Jul 27 20:28:51.387274 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 883/1752] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:51 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:51.555925 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-319f5f18-864b-4bb8-8954-a4d6d685de27 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:51.558086 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-319f5f18-864b-4bb8-8954-a4d6d685de27 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:51.564721 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-319f5f18-864b-4bb8-8954-a4d6d685de27 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:51.565215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-319f5f18-864b-4bb8-8954-a4d6d685de27 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:51.565983 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-319f5f18-864b-4bb8-8954-a4d6d685de27 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:51.566420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-319f5f18-864b-4bb8-8954-a4d6d685de27 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:51.596399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-319f5f18-864b-4bb8-8954-a4d6d685de27 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044489 Jul 27 20:28:51.596936 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 870/1753] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:51 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:51.636880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ea9513ef-4f47-4feb-a278-3dd50a452408 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:51.637551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ea9513ef-4f47-4feb-a278-3dd50a452408 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:51.644564 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ea9513ef-4f47-4feb-a278-3dd50a452408 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:51.645043 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ea9513ef-4f47-4feb-a278-3dd50a452408 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:51.645809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ea9513ef-4f47-4feb-a278-3dd50a452408 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:51.646248 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ea9513ef-4f47-4feb-a278-3dd50a452408 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:51.706635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ea9513ef-4f47-4feb-a278-3dd50a452408 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:51.714412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ea9513ef-4f47-4feb-a278-3dd50a452408 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080966 Jul 27 20:28:51.714636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 884/1754] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:51 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:52.399637 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-95fc3318-4e2c-4727-a401-f3d9cb50d26d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:52.401929 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-95fc3318-4e2c-4727-a401-f3d9cb50d26d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:52.407999 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95fc3318-4e2c-4727-a401-f3d9cb50d26d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:52.408442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95fc3318-4e2c-4727-a401-f3d9cb50d26d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:52.409230 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95fc3318-4e2c-4727-a401-f3d9cb50d26d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:52.409666 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95fc3318-4e2c-4727-a401-f3d9cb50d26d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:52.438927 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-95fc3318-4e2c-4727-a401-f3d9cb50d26d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043224 Jul 27 20:28:52.439482 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 871/1755] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:52 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:52.608838 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-dafc5f0c-ab75-446e-be42-40401394c44b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:52.610931 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-dafc5f0c-ab75-446e-be42-40401394c44b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:52.616929 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dafc5f0c-ab75-446e-be42-40401394c44b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:52.617415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dafc5f0c-ab75-446e-be42-40401394c44b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:52.618182 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dafc5f0c-ab75-446e-be42-40401394c44b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:52.618625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dafc5f0c-ab75-446e-be42-40401394c44b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:52.647025 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-dafc5f0c-ab75-446e-be42-40401394c44b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042989 Jul 27 20:28:52.647637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 885/1756] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:52 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:52.735714 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c154f172-6e76-4f63-861b-ab4a73fe2a2f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:52.736321 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c154f172-6e76-4f63-861b-ab4a73fe2a2f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:52.742758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c154f172-6e76-4f63-861b-ab4a73fe2a2f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:52.743201 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c154f172-6e76-4f63-861b-ab4a73fe2a2f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:52.743981 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c154f172-6e76-4f63-861b-ab4a73fe2a2f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:52.744414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c154f172-6e76-4f63-861b-ab4a73fe2a2f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:52.805522 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c154f172-6e76-4f63-861b-ab4a73fe2a2f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:52.812819 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c154f172-6e76-4f63-861b-ab4a73fe2a2f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081567 Jul 27 20:28:52.813401 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 872/1757] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:52 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:53.451575 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d03d229a-6448-4ba1-a94e-6facd99a14e7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:53.453739 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d03d229a-6448-4ba1-a94e-6facd99a14e7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:53.455597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=82 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:28:53.461334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d03d229a-6448-4ba1-a94e-6facd99a14e7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:53.461786 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d03d229a-6448-4ba1-a94e-6facd99a14e7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:53.462549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d03d229a-6448-4ba1-a94e-6facd99a14e7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:53.462988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d03d229a-6448-4ba1-a94e-6facd99a14e7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:53.494293 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d03d229a-6448-4ba1-a94e-6facd99a14e7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046988 Jul 27 20:28:53.494843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 886/1758] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:53 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:53.661421 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1d17b508-2049-4563-bb60-e1438399602e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:53.663507 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1d17b508-2049-4563-bb60-e1438399602e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:53.669574 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d17b508-2049-4563-bb60-e1438399602e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:53.670027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d17b508-2049-4563-bb60-e1438399602e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:53.671203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d17b508-2049-4563-bb60-e1438399602e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:53.671740 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d17b508-2049-4563-bb60-e1438399602e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:53.702716 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1d17b508-2049-4563-bb60-e1438399602e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045559 Jul 27 20:28:53.703270 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 873/1759] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:53 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:28:53.833810 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-06b18f0e-f188-48ee-8a86-00a58992504a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:53.834464 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-06b18f0e-f188-48ee-8a86-00a58992504a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:53.843787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-06b18f0e-f188-48ee-8a86-00a58992504a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:53.844568 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-06b18f0e-f188-48ee-8a86-00a58992504a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:53.845978 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-06b18f0e-f188-48ee-8a86-00a58992504a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:53.846672 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-06b18f0e-f188-48ee-8a86-00a58992504a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:53.912575 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-06b18f0e-f188-48ee-8a86-00a58992504a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:53.922463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-06b18f0e-f188-48ee-8a86-00a58992504a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.092521 Jul 27 20:28:53.923035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 887/1760] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:53 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:54.506649 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-44584056-f6c9-498f-acb5-963033779abe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:54.508828 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-44584056-f6c9-498f-acb5-963033779abe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:54.511180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=88 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:28:54.516556 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44584056-f6c9-498f-acb5-963033779abe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:54.517039 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44584056-f6c9-498f-acb5-963033779abe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:54.517812 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44584056-f6c9-498f-acb5-963033779abe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:54.518250 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44584056-f6c9-498f-acb5-963033779abe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:54.547346 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-44584056-f6c9-498f-acb5-963033779abe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044718 Jul 27 20:28:54.547900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 874/1761] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:54 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:54.714493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7dd607c6-84d1-4072-9fd6-092456076ee2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:54.716618 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7dd607c6-84d1-4072-9fd6-092456076ee2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:54.723506 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7dd607c6-84d1-4072-9fd6-092456076ee2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:54.723950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7dd607c6-84d1-4072-9fd6-092456076ee2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:54.724843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7dd607c6-84d1-4072-9fd6-092456076ee2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:54.725317 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7dd607c6-84d1-4072-9fd6-092456076ee2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:54.753934 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7dd607c6-84d1-4072-9fd6-092456076ee2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043389 Jul 27 20:28:54.754473 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 888/1762] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:54 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:54.942944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7ebb3448-0342-42b4-89fb-b53de96fcbd5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:54.943576 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7ebb3448-0342-42b4-89fb-b53de96fcbd5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:54.949536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ebb3448-0342-42b4-89fb-b53de96fcbd5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:54.949986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ebb3448-0342-42b4-89fb-b53de96fcbd5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:54.950738 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ebb3448-0342-42b4-89fb-b53de96fcbd5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:54.951171 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ebb3448-0342-42b4-89fb-b53de96fcbd5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:55.015893 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7ebb3448-0342-42b4-89fb-b53de96fcbd5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:55.025537 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7ebb3448-0342-42b4-89fb-b53de96fcbd5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.086365 Jul 27 20:28:55.026109 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 875/1763] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:54 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:55.559016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4b413f7d-0397-4ba0-a788-18e3f3f4edfc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:55.561667 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4b413f7d-0397-4ba0-a788-18e3f3f4edfc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:55.568277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4b413f7d-0397-4ba0-a788-18e3f3f4edfc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:55.568729 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4b413f7d-0397-4ba0-a788-18e3f3f4edfc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:55.569537 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4b413f7d-0397-4ba0-a788-18e3f3f4edfc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:55.569979 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4b413f7d-0397-4ba0-a788-18e3f3f4edfc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:55.599717 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4b413f7d-0397-4ba0-a788-18e3f3f4edfc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044676 Jul 27 20:28:55.600262 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 889/1764] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:55 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:55.767074 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2cdb3a06-c67b-469a-90c8-a928e4ac5b27 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:55.769353 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2cdb3a06-c67b-469a-90c8-a928e4ac5b27 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:55.775833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2cdb3a06-c67b-469a-90c8-a928e4ac5b27 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:55.776279 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2cdb3a06-c67b-469a-90c8-a928e4ac5b27 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:55.777070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2cdb3a06-c67b-469a-90c8-a928e4ac5b27 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:55.777505 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2cdb3a06-c67b-469a-90c8-a928e4ac5b27 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:55.808405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2cdb3a06-c67b-469a-90c8-a928e4ac5b27 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046114 Jul 27 20:28:55.808942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 876/1765] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:55 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:56.049790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0f94465a-9e7b-4190-a2df-a0e718c42e5f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:56.050323 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0f94465a-9e7b-4190-a2df-a0e718c42e5f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:56.056339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0f94465a-9e7b-4190-a2df-a0e718c42e5f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:56.056784 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0f94465a-9e7b-4190-a2df-a0e718c42e5f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:56.057584 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0f94465a-9e7b-4190-a2df-a0e718c42e5f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:56.058020 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0f94465a-9e7b-4190-a2df-a0e718c42e5f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:56.119210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0f94465a-9e7b-4190-a2df-a0e718c42e5f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:56.127396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0f94465a-9e7b-4190-a2df-a0e718c42e5f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081665 Jul 27 20:28:56.127960 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 890/1766] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:56 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:56.612724 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-188bd299-706f-4c43-9f3a-930e0ec425d0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:56.614924 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-188bd299-706f-4c43-9f3a-930e0ec425d0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:56.621159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-188bd299-706f-4c43-9f3a-930e0ec425d0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:56.621619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-188bd299-706f-4c43-9f3a-930e0ec425d0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:56.622385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-188bd299-706f-4c43-9f3a-930e0ec425d0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:56.622823 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-188bd299-706f-4c43-9f3a-930e0ec425d0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:56.651596 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-188bd299-706f-4c43-9f3a-930e0ec425d0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043746 Jul 27 20:28:56.652148 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 877/1767] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:56 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:56.822018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d53bc4e9-828a-40f8-bd18-2f209c7fcd4e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:56.824268 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d53bc4e9-828a-40f8-bd18-2f209c7fcd4e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:56.831829 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d53bc4e9-828a-40f8-bd18-2f209c7fcd4e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:56.832286 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d53bc4e9-828a-40f8-bd18-2f209c7fcd4e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:56.833081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d53bc4e9-828a-40f8-bd18-2f209c7fcd4e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:56.833527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d53bc4e9-828a-40f8-bd18-2f209c7fcd4e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:56.858662 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:28:56.863862 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d53bc4e9-828a-40f8-bd18-2f209c7fcd4e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045788 Jul 27 20:28:56.864352 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 891/1768] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:56 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:57.148022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-babea260-6e89-42e9-adc6-1792bcb4e611 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:57.148628 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-babea260-6e89-42e9-adc6-1792bcb4e611 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:57.155176 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-babea260-6e89-42e9-adc6-1792bcb4e611 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:57.155624 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-babea260-6e89-42e9-adc6-1792bcb4e611 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:57.156380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-babea260-6e89-42e9-adc6-1792bcb4e611 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:57.156807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-babea260-6e89-42e9-adc6-1792bcb4e611 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:57.160640 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:28:57.217597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-babea260-6e89-42e9-adc6-1792bcb4e611 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:57.224909 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-babea260-6e89-42e9-adc6-1792bcb4e611 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080777 Jul 27 20:28:57.225484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 878/1769] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:57 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:57.664855 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-38374a30-6e53-470d-bdf3-8592ab80059c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:57.666948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-38374a30-6e53-470d-bdf3-8592ab80059c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:57.674060 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-38374a30-6e53-470d-bdf3-8592ab80059c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:57.674517 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-38374a30-6e53-470d-bdf3-8592ab80059c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:57.675289 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-38374a30-6e53-470d-bdf3-8592ab80059c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:57.675734 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-38374a30-6e53-470d-bdf3-8592ab80059c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:57.707633 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-38374a30-6e53-470d-bdf3-8592ab80059c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046760 Jul 27 20:28:57.708198 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 892/1770] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:57 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:57.875919 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7087149c-a0fb-4382-8411-071f63cd5ae8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:57.878137 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7087149c-a0fb-4382-8411-071f63cd5ae8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:57.884109 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7087149c-a0fb-4382-8411-071f63cd5ae8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:57.884561 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7087149c-a0fb-4382-8411-071f63cd5ae8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:57.885352 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7087149c-a0fb-4382-8411-071f63cd5ae8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:57.885790 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7087149c-a0fb-4382-8411-071f63cd5ae8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:57.914317 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7087149c-a0fb-4382-8411-071f63cd5ae8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042692 Jul 27 20:28:57.914924 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 879/1771] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:57 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:58.245869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ce27e1f2-84e9-45a0-9f24-f1fe6619b596 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:58.246396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ce27e1f2-84e9-45a0-9f24-f1fe6619b596 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:58.252872 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ce27e1f2-84e9-45a0-9f24-f1fe6619b596 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:58.253359 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ce27e1f2-84e9-45a0-9f24-f1fe6619b596 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:58.254132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ce27e1f2-84e9-45a0-9f24-f1fe6619b596 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:58.254578 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ce27e1f2-84e9-45a0-9f24-f1fe6619b596 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:58.317746 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ce27e1f2-84e9-45a0-9f24-f1fe6619b596 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:58.325393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ce27e1f2-84e9-45a0-9f24-f1fe6619b596 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083446 Jul 27 20:28:58.325953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 893/1772] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:58 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:28:58.719828 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9eb6171d-23c5-4af3-b08d-7737b886822f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:58.722100 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9eb6171d-23c5-4af3-b08d-7737b886822f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:58.728589 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9eb6171d-23c5-4af3-b08d-7737b886822f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:58.729083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9eb6171d-23c5-4af3-b08d-7737b886822f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:58.729854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9eb6171d-23c5-4af3-b08d-7737b886822f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:58.730291 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9eb6171d-23c5-4af3-b08d-7737b886822f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:58.759051 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9eb6171d-23c5-4af3-b08d-7737b886822f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043212 Jul 27 20:28:58.759596 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 880/1773] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:58 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:58.927248 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-22c79794-fc16-4547-95fd-0d28cc15c592 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:58.929433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-22c79794-fc16-4547-95fd-0d28cc15c592 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:58.935440 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-22c79794-fc16-4547-95fd-0d28cc15c592 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:58.936486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-22c79794-fc16-4547-95fd-0d28cc15c592 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:58.937296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-22c79794-fc16-4547-95fd-0d28cc15c592 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:58.937743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-22c79794-fc16-4547-95fd-0d28cc15c592 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:58.966049 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-22c79794-fc16-4547-95fd-0d28cc15c592 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042779 Jul 27 20:28:58.966599 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 894/1774] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:58 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:28:59.346680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-853d3188-0fb6-41cd-ace9-a2eae375cb6c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:59.347213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-853d3188-0fb6-41cd-ace9-a2eae375cb6c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:59.353338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-853d3188-0fb6-41cd-ace9-a2eae375cb6c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:59.353797 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-853d3188-0fb6-41cd-ace9-a2eae375cb6c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:59.354552 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-853d3188-0fb6-41cd-ace9-a2eae375cb6c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:59.354989 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-853d3188-0fb6-41cd-ace9-a2eae375cb6c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:59.415769 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-853d3188-0fb6-41cd-ace9-a2eae375cb6c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:28:59.424411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-853d3188-0fb6-41cd-ace9-a2eae375cb6c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082130 Jul 27 20:28:59.425003 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 881/1775] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:28:59 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:28:59.771799 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6fa8e0df-116f-46b4-98ff-3fe504c44aa1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:59.773997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6fa8e0df-116f-46b4-98ff-3fe504c44aa1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:59.781564 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6fa8e0df-116f-46b4-98ff-3fe504c44aa1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:59.782013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6fa8e0df-116f-46b4-98ff-3fe504c44aa1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:59.782777 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6fa8e0df-116f-46b4-98ff-3fe504c44aa1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:59.783213 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6fa8e0df-116f-46b4-98ff-3fe504c44aa1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:59.811229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6fa8e0df-116f-46b4-98ff-3fe504c44aa1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043431 Jul 27 20:28:59.811772 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 895/1776] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:28:59 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:28:59.978615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-172b37c2-9a7e-48e9-ad26-e10030c23412 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:28:59.980801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-172b37c2-9a7e-48e9-ad26-e10030c23412 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:28:59.987384 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-172b37c2-9a7e-48e9-ad26-e10030c23412 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:59.987834 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-172b37c2-9a7e-48e9-ad26-e10030c23412 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:28:59.988600 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-172b37c2-9a7e-48e9-ad26-e10030c23412 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:28:59.989073 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-172b37c2-9a7e-48e9-ad26-e10030c23412 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:00.018570 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-172b37c2-9a7e-48e9-ad26-e10030c23412 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043958 Jul 27 20:29:00.019119 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 882/1777] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:28:59 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:00.445610 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2a88f067-cbee-4f8c-89b7-b871456c82fa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:00.446218 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2a88f067-cbee-4f8c-89b7-b871456c82fa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:00.452549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2a88f067-cbee-4f8c-89b7-b871456c82fa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:00.453103 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2a88f067-cbee-4f8c-89b7-b871456c82fa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:00.454052 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2a88f067-cbee-4f8c-89b7-b871456c82fa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:00.454598 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2a88f067-cbee-4f8c-89b7-b871456c82fa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:00.516760 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2a88f067-cbee-4f8c-89b7-b871456c82fa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:00.524351 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2a88f067-cbee-4f8c-89b7-b871456c82fa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082639 Jul 27 20:29:00.524916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 896/1778] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:00 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:00.822721 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-04879db2-f9c5-413a-b606-f81072e17c06 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:00.824765 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-04879db2-f9c5-413a-b606-f81072e17c06 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:00.831153 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04879db2-f9c5-413a-b606-f81072e17c06 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:00.831606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04879db2-f9c5-413a-b606-f81072e17c06 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:00.832367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04879db2-f9c5-413a-b606-f81072e17c06 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:00.832799 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04879db2-f9c5-413a-b606-f81072e17c06 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:00.861741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-04879db2-f9c5-413a-b606-f81072e17c06 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043078 Jul 27 20:29:00.862280 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 883/1779] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:00 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:01.030728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9ec8f724-11d9-49f4-9681-ce5672aebf58 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:01.032883 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9ec8f724-11d9-49f4-9681-ce5672aebf58 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:01.039315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ec8f724-11d9-49f4-9681-ce5672aebf58 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:01.039763 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ec8f724-11d9-49f4-9681-ce5672aebf58 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:01.040524 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ec8f724-11d9-49f4-9681-ce5672aebf58 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:01.040975 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ec8f724-11d9-49f4-9681-ce5672aebf58 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:01.069914 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9ec8f724-11d9-49f4-9681-ce5672aebf58 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043829 Jul 27 20:29:01.070475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 897/1780] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:01 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:01.544901 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-25b0f84f-0c62-4940-b85e-80094bcf9b5a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:01.545640 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-25b0f84f-0c62-4940-b85e-80094bcf9b5a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:01.552058 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-25b0f84f-0c62-4940-b85e-80094bcf9b5a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:01.552507 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-25b0f84f-0c62-4940-b85e-80094bcf9b5a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:01.553296 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-25b0f84f-0c62-4940-b85e-80094bcf9b5a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:01.553740 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-25b0f84f-0c62-4940-b85e-80094bcf9b5a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:01.614066 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-25b0f84f-0c62-4940-b85e-80094bcf9b5a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:01.621483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-25b0f84f-0c62-4940-b85e-80094bcf9b5a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080460 Jul 27 20:29:01.622041 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 884/1781] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:01 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:01.874871 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e76ba962-839c-4fa0-8d23-fa611916b7ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:01.876914 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e76ba962-839c-4fa0-8d23-fa611916b7ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:01.883018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e76ba962-839c-4fa0-8d23-fa611916b7ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:01.883475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e76ba962-839c-4fa0-8d23-fa611916b7ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:01.884234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e76ba962-839c-4fa0-8d23-fa611916b7ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:01.884676 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e76ba962-839c-4fa0-8d23-fa611916b7ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:01.912812 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e76ba962-839c-4fa0-8d23-fa611916b7ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042644 Jul 27 20:29:01.913394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 898/1782] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:01 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:02.081785 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1a57154c-1756-4c8a-9c36-95c66afcc5b5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:02.083998 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1a57154c-1756-4c8a-9c36-95c66afcc5b5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:02.090015 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1a57154c-1756-4c8a-9c36-95c66afcc5b5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:02.090460 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1a57154c-1756-4c8a-9c36-95c66afcc5b5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:02.091216 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1a57154c-1756-4c8a-9c36-95c66afcc5b5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:02.091645 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1a57154c-1756-4c8a-9c36-95c66afcc5b5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:02.120581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1a57154c-1756-4c8a-9c36-95c66afcc5b5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042701 Jul 27 20:29:02.121144 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 885/1783] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:02 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:02.642898 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-79a086d5-a5f5-4ade-9291-5982a1ee4cd4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:02.643512 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-79a086d5-a5f5-4ade-9291-5982a1ee4cd4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:02.649735 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-79a086d5-a5f5-4ade-9291-5982a1ee4cd4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:02.650137 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-79a086d5-a5f5-4ade-9291-5982a1ee4cd4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:02.650897 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-79a086d5-a5f5-4ade-9291-5982a1ee4cd4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:02.651339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-79a086d5-a5f5-4ade-9291-5982a1ee4cd4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:02.712629 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-79a086d5-a5f5-4ade-9291-5982a1ee4cd4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:02.721907 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-79a086d5-a5f5-4ade-9291-5982a1ee4cd4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083216 Jul 27 20:29:02.722498 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 899/1784] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:02 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:02.924913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-794c5e3a-c65e-4a7b-9142-c87e60848145 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:02.927069 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-794c5e3a-c65e-4a7b-9142-c87e60848145 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:02.933555 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-794c5e3a-c65e-4a7b-9142-c87e60848145 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:02.934008 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-794c5e3a-c65e-4a7b-9142-c87e60848145 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:02.934773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-794c5e3a-c65e-4a7b-9142-c87e60848145 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:02.935211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-794c5e3a-c65e-4a7b-9142-c87e60848145 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:02.965620 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-794c5e3a-c65e-4a7b-9142-c87e60848145 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044834 Jul 27 20:29:02.966170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 886/1785] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:02 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:03.132761 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6366a5fe-5c44-49c9-ac69-2bd19b72d648 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:03.135098 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6366a5fe-5c44-49c9-ac69-2bd19b72d648 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:03.141866 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6366a5fe-5c44-49c9-ac69-2bd19b72d648 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:03.142313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6366a5fe-5c44-49c9-ac69-2bd19b72d648 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:03.143066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6366a5fe-5c44-49c9-ac69-2bd19b72d648 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:03.143500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6366a5fe-5c44-49c9-ac69-2bd19b72d648 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:03.177229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6366a5fe-5c44-49c9-ac69-2bd19b72d648 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048316 Jul 27 20:29:03.177730 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 900/1786] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:03 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:03.743139 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dbee528e-4ced-4c5c-91a3-b76376d0176c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:03.743739 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dbee528e-4ced-4c5c-91a3-b76376d0176c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:03.749874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dbee528e-4ced-4c5c-91a3-b76376d0176c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:03.750315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dbee528e-4ced-4c5c-91a3-b76376d0176c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:03.751063 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dbee528e-4ced-4c5c-91a3-b76376d0176c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:03.751494 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dbee528e-4ced-4c5c-91a3-b76376d0176c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:03.815813 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dbee528e-4ced-4c5c-91a3-b76376d0176c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:03.823190 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dbee528e-4ced-4c5c-91a3-b76376d0176c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083864 Jul 27 20:29:03.823776 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 887/1787] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:03 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:03.978557 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3797832f-cf53-41a2-9fc0-b8cc14b0aabf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:03.980706 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3797832f-cf53-41a2-9fc0-b8cc14b0aabf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:03.987836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3797832f-cf53-41a2-9fc0-b8cc14b0aabf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:03.988287 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3797832f-cf53-41a2-9fc0-b8cc14b0aabf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:03.989080 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3797832f-cf53-41a2-9fc0-b8cc14b0aabf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:03.989525 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3797832f-cf53-41a2-9fc0-b8cc14b0aabf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:04.017715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3797832f-cf53-41a2-9fc0-b8cc14b0aabf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043089 Jul 27 20:29:04.018191 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 901/1788] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:03 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:04.189865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-87ff916d-1222-4d70-872f-aa2f6a39bd78 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:04.192037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-87ff916d-1222-4d70-872f-aa2f6a39bd78 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:04.198472 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87ff916d-1222-4d70-872f-aa2f6a39bd78 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:04.198916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87ff916d-1222-4d70-872f-aa2f6a39bd78 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:04.199680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87ff916d-1222-4d70-872f-aa2f6a39bd78 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:04.200117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87ff916d-1222-4d70-872f-aa2f6a39bd78 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:04.229310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-87ff916d-1222-4d70-872f-aa2f6a39bd78 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043365 Jul 27 20:29:04.229853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 888/1789] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:04 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:04.844450 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1f731a73-19ab-4a75-8349-d2eb3296af78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:04.845084 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1f731a73-19ab-4a75-8349-d2eb3296af78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:04.851048 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f731a73-19ab-4a75-8349-d2eb3296af78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:04.851492 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f731a73-19ab-4a75-8349-d2eb3296af78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:04.852244 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f731a73-19ab-4a75-8349-d2eb3296af78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:04.852677 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f731a73-19ab-4a75-8349-d2eb3296af78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:04.912615 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1f731a73-19ab-4a75-8349-d2eb3296af78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:04.920033 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1f731a73-19ab-4a75-8349-d2eb3296af78 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080531 Jul 27 20:29:04.920695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 902/1790] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:04 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:05.030516 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a1006924-029e-4071-9f60-e82b9fb23329 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:05.032672 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a1006924-029e-4071-9f60-e82b9fb23329 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:05.038720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a1006924-029e-4071-9f60-e82b9fb23329 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:05.039205 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a1006924-029e-4071-9f60-e82b9fb23329 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:05.040009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a1006924-029e-4071-9f60-e82b9fb23329 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:05.040450 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a1006924-029e-4071-9f60-e82b9fb23329 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:05.069266 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a1006924-029e-4071-9f60-e82b9fb23329 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043199 Jul 27 20:29:05.069816 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 889/1791] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:05 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:05.242334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9ac2abd1-d969-42dd-83cb-4ccb77697d62 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:05.244496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9ac2abd1-d969-42dd-83cb-4ccb77697d62 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:05.251492 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ac2abd1-d969-42dd-83cb-4ccb77697d62 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:05.251944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ac2abd1-d969-42dd-83cb-4ccb77697d62 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:05.252713 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ac2abd1-d969-42dd-83cb-4ccb77697d62 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:05.253184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ac2abd1-d969-42dd-83cb-4ccb77697d62 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:05.282344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9ac2abd1-d969-42dd-83cb-4ccb77697d62 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043967 Jul 27 20:29:05.283085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 903/1792] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:05 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:05.940131 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bdbdf585-7ef4-4d5f-9019-5c4e90691618 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:05.940764 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bdbdf585-7ef4-4d5f-9019-5c4e90691618 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:05.947496 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bdbdf585-7ef4-4d5f-9019-5c4e90691618 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:05.947952 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bdbdf585-7ef4-4d5f-9019-5c4e90691618 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:05.948725 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bdbdf585-7ef4-4d5f-9019-5c4e90691618 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:05.949200 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bdbdf585-7ef4-4d5f-9019-5c4e90691618 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:06.010363 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bdbdf585-7ef4-4d5f-9019-5c4e90691618 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:06.018714 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bdbdf585-7ef4-4d5f-9019-5c4e90691618 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082479 Jul 27 20:29:06.019276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 890/1793] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:05 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:06.082786 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7db72b84-92f2-4577-ab88-843869b24879 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:06.084941 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7db72b84-92f2-4577-ab88-843869b24879 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:06.091327 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7db72b84-92f2-4577-ab88-843869b24879 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:06.091801 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7db72b84-92f2-4577-ab88-843869b24879 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:06.092591 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7db72b84-92f2-4577-ab88-843869b24879 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:06.093050 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7db72b84-92f2-4577-ab88-843869b24879 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:06.121745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7db72b84-92f2-4577-ab88-843869b24879 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042861 Jul 27 20:29:06.122294 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 904/1794] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:06 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:06.294696 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-134b9342-2726-4081-8aaa-f2eea2c319d5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:06.296991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-134b9342-2726-4081-8aaa-f2eea2c319d5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:06.303068 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-134b9342-2726-4081-8aaa-f2eea2c319d5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:06.303515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-134b9342-2726-4081-8aaa-f2eea2c319d5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:06.304272 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-134b9342-2726-4081-8aaa-f2eea2c319d5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:06.304704 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-134b9342-2726-4081-8aaa-f2eea2c319d5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:06.333404 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-134b9342-2726-4081-8aaa-f2eea2c319d5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042659 Jul 27 20:29:06.333942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 891/1795] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:06 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:07.039131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f0a836fa-e47f-4642-a317-36383546d228 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:07.039746 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f0a836fa-e47f-4642-a317-36383546d228 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:07.046861 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0a836fa-e47f-4642-a317-36383546d228 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:07.047318 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0a836fa-e47f-4642-a317-36383546d228 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:07.048095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0a836fa-e47f-4642-a317-36383546d228 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:07.048526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0a836fa-e47f-4642-a317-36383546d228 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:07.112162 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f0a836fa-e47f-4642-a317-36383546d228 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:07.119691 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f0a836fa-e47f-4642-a317-36383546d228 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084405 Jul 27 20:29:07.120249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 905/1796] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:07 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:07.134391 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fe02475f-693d-465c-901c-8a135fbebc7e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:07.136554 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fe02475f-693d-465c-901c-8a135fbebc7e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:07.143719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe02475f-693d-465c-901c-8a135fbebc7e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:07.144162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe02475f-693d-465c-901c-8a135fbebc7e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:07.144916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe02475f-693d-465c-901c-8a135fbebc7e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:07.145367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe02475f-693d-465c-901c-8a135fbebc7e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:07.174199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fe02475f-693d-465c-901c-8a135fbebc7e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043726 Jul 27 20:29:07.174742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 892/1797] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:07 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:07.346601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3349a8de-91d6-4d8d-9a32-a0e7b763269b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:07.348651 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3349a8de-91d6-4d8d-9a32-a0e7b763269b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:07.354685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3349a8de-91d6-4d8d-9a32-a0e7b763269b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:07.355140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3349a8de-91d6-4d8d-9a32-a0e7b763269b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:07.355908 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3349a8de-91d6-4d8d-9a32-a0e7b763269b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:07.356349 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3349a8de-91d6-4d8d-9a32-a0e7b763269b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:07.384546 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3349a8de-91d6-4d8d-9a32-a0e7b763269b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042765 Jul 27 20:29:07.385118 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 906/1798] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:07 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:08.139999 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-27739951-33f9-4f22-b1f4-3ae160a7feb2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:08.140631 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-27739951-33f9-4f22-b1f4-3ae160a7feb2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:08.147120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-27739951-33f9-4f22-b1f4-3ae160a7feb2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:08.147568 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-27739951-33f9-4f22-b1f4-3ae160a7feb2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:08.148325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-27739951-33f9-4f22-b1f4-3ae160a7feb2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:08.148759 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-27739951-33f9-4f22-b1f4-3ae160a7feb2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:08.187089 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b2006037-7221-4f7a-8336-7de7f7476666 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:08.189398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b2006037-7221-4f7a-8336-7de7f7476666 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:08.195997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b2006037-7221-4f7a-8336-7de7f7476666 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:08.196455 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b2006037-7221-4f7a-8336-7de7f7476666 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:08.197266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b2006037-7221-4f7a-8336-7de7f7476666 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:08.197712 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b2006037-7221-4f7a-8336-7de7f7476666 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:08.210390 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-27739951-33f9-4f22-b1f4-3ae160a7feb2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:08.218551 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-27739951-33f9-4f22-b1f4-3ae160a7feb2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082492 Jul 27 20:29:08.219124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 893/1799] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:08 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:08.236787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b2006037-7221-4f7a-8336-7de7f7476666 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053607 Jul 27 20:29:08.237403 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 907/1800] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:08 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:29:08.397449 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-969f0e69-163d-4c37-a55f-b13f055aeafe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:08.399618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-969f0e69-163d-4c37-a55f-b13f055aeafe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:08.406277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-969f0e69-163d-4c37-a55f-b13f055aeafe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:08.406735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-969f0e69-163d-4c37-a55f-b13f055aeafe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:08.407474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-969f0e69-163d-4c37-a55f-b13f055aeafe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:08.407923 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-969f0e69-163d-4c37-a55f-b13f055aeafe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:08.432440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:29:08.437485 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-969f0e69-163d-4c37-a55f-b13f055aeafe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044121 Jul 27 20:29:08.438029 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 894/1801] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:08 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:09.238961 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0ef19dcf-75e8-4c4f-8f57-4619712b953a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:09.239566 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0ef19dcf-75e8-4c4f-8f57-4619712b953a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:09.246081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0ef19dcf-75e8-4c4f-8f57-4619712b953a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:09.246525 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0ef19dcf-75e8-4c4f-8f57-4619712b953a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:09.247283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0ef19dcf-75e8-4c4f-8f57-4619712b953a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:09.247714 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0ef19dcf-75e8-4c4f-8f57-4619712b953a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:09.249650 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d652ce98-cc67-43ea-b915-6791d76c2865 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:09.251810 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d652ce98-cc67-43ea-b915-6791d76c2865 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:09.258170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d652ce98-cc67-43ea-b915-6791d76c2865 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:09.258622 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d652ce98-cc67-43ea-b915-6791d76c2865 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:09.259392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d652ce98-cc67-43ea-b915-6791d76c2865 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:09.259834 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d652ce98-cc67-43ea-b915-6791d76c2865 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:09.267313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:29:09.289808 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d652ce98-cc67-43ea-b915-6791d76c2865 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044798 Jul 27 20:29:09.290375 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 895/1802] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:09 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:09.311469 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0ef19dcf-75e8-4c4f-8f57-4619712b953a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:09.319006 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0ef19dcf-75e8-4c4f-8f57-4619712b953a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083959 Jul 27 20:29:09.319566 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 908/1803] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:09 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:29:09.449733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d8e988af-49bb-44d8-b4f1-b28df3998351 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:09.452449 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d8e988af-49bb-44d8-b4f1-b28df3998351 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:09.458541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8e988af-49bb-44d8-b4f1-b28df3998351 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:09.458984 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8e988af-49bb-44d8-b4f1-b28df3998351 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:09.459778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8e988af-49bb-44d8-b4f1-b28df3998351 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:09.460208 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8e988af-49bb-44d8-b4f1-b28df3998351 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:09.490766 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d8e988af-49bb-44d8-b4f1-b28df3998351 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044877 Jul 27 20:29:09.491243 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 896/1804] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:09 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:10.302276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3ce051fe-fbde-4876-aba6-6357e7bc325a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:10.304390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3ce051fe-fbde-4876-aba6-6357e7bc325a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:10.311049 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3ce051fe-fbde-4876-aba6-6357e7bc325a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:10.311500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3ce051fe-fbde-4876-aba6-6357e7bc325a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:10.312261 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3ce051fe-fbde-4876-aba6-6357e7bc325a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:10.312696 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3ce051fe-fbde-4876-aba6-6357e7bc325a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:10.339666 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f8135a64-455d-4358-939e-948dbafb04ea tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:10.340300 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f8135a64-455d-4358-939e-948dbafb04ea tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:10.342632 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3ce051fe-fbde-4876-aba6-6357e7bc325a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043800 Jul 27 20:29:10.343199 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 909/1805] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:10 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:29:10.347638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8135a64-455d-4358-939e-948dbafb04ea tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:10.348086 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8135a64-455d-4358-939e-948dbafb04ea tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:10.348889 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8135a64-455d-4358-939e-948dbafb04ea tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:10.349354 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8135a64-455d-4358-939e-948dbafb04ea tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:10.410707 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f8135a64-455d-4358-939e-948dbafb04ea tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:10.418058 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f8135a64-455d-4358-939e-948dbafb04ea tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082337 Jul 27 20:29:10.418609 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 897/1806] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:10 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:29:10.503472 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-14de0a4b-5ec3-430f-b8c9-afb8d9e432b4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:10.505692 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-14de0a4b-5ec3-430f-b8c9-afb8d9e432b4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:10.511706 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-14de0a4b-5ec3-430f-b8c9-afb8d9e432b4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:10.512158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-14de0a4b-5ec3-430f-b8c9-afb8d9e432b4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:10.512926 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-14de0a4b-5ec3-430f-b8c9-afb8d9e432b4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:10.513426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-14de0a4b-5ec3-430f-b8c9-afb8d9e432b4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:10.542267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-14de0a4b-5ec3-430f-b8c9-afb8d9e432b4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042747 Jul 27 20:29:10.542816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 910/1807] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:10 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:11.355029 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-562459c5-45dc-4d3f-b9ff-d361f4f32baf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:11.357147 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-562459c5-45dc-4d3f-b9ff-d361f4f32baf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:11.364278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-562459c5-45dc-4d3f-b9ff-d361f4f32baf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:11.364728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-562459c5-45dc-4d3f-b9ff-d361f4f32baf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:11.365529 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-562459c5-45dc-4d3f-b9ff-d361f4f32baf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:11.365966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-562459c5-45dc-4d3f-b9ff-d361f4f32baf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:11.393994 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-562459c5-45dc-4d3f-b9ff-d361f4f32baf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042981 Jul 27 20:29:11.394539 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 898/1808] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:11 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:11.438747 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e1ffb8fa-f844-48c8-8f64-54390162a6ac tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:11.439368 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e1ffb8fa-f844-48c8-8f64-54390162a6ac tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:11.445857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1ffb8fa-f844-48c8-8f64-54390162a6ac tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:11.446316 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1ffb8fa-f844-48c8-8f64-54390162a6ac tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:11.447080 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1ffb8fa-f844-48c8-8f64-54390162a6ac tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:11.447529 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1ffb8fa-f844-48c8-8f64-54390162a6ac tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:11.509272 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e1ffb8fa-f844-48c8-8f64-54390162a6ac tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:11.516870 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e1ffb8fa-f844-48c8-8f64-54390162a6ac tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082023 Jul 27 20:29:11.517461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 911/1809] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:11 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:11.554532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bd569697-62df-4ba2-9cfa-433516c4b946 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:11.556675 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bd569697-62df-4ba2-9cfa-433516c4b946 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:11.563221 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bd569697-62df-4ba2-9cfa-433516c4b946 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:11.563663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bd569697-62df-4ba2-9cfa-433516c4b946 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:11.564418 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bd569697-62df-4ba2-9cfa-433516c4b946 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:11.564852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bd569697-62df-4ba2-9cfa-433516c4b946 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:11.593720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bd569697-62df-4ba2-9cfa-433516c4b946 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043119 Jul 27 20:29:11.594272 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 899/1810] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:11 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:12.406864 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7457bcf8-227e-4952-970f-e47a1b6f433d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:12.409022 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7457bcf8-227e-4952-970f-e47a1b6f433d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:12.415106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7457bcf8-227e-4952-970f-e47a1b6f433d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:12.415559 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7457bcf8-227e-4952-970f-e47a1b6f433d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:12.416319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7457bcf8-227e-4952-970f-e47a1b6f433d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:12.416759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7457bcf8-227e-4952-970f-e47a1b6f433d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:12.444849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7457bcf8-227e-4952-970f-e47a1b6f433d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042623 Jul 27 20:29:12.445487 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 912/1811] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:12 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:12.537972 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-eef522f5-7efd-4a38-8dee-f1b5e89c9485 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:12.538607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-eef522f5-7efd-4a38-8dee-f1b5e89c9485 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:12.545423 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eef522f5-7efd-4a38-8dee-f1b5e89c9485 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:12.545868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eef522f5-7efd-4a38-8dee-f1b5e89c9485 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:12.546616 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eef522f5-7efd-4a38-8dee-f1b5e89c9485 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:12.547046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eef522f5-7efd-4a38-8dee-f1b5e89c9485 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:12.605731 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-789f3009-1cfd-4032-87e3-a91a4a6ff80a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:12.608729 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-789f3009-1cfd-4032-87e3-a91a4a6ff80a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:12.610906 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eef522f5-7efd-4a38-8dee-f1b5e89c9485 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:12.614526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-789f3009-1cfd-4032-87e3-a91a4a6ff80a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:12.614985 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-789f3009-1cfd-4032-87e3-a91a4a6ff80a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:12.615760 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-789f3009-1cfd-4032-87e3-a91a4a6ff80a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:12.616238 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-789f3009-1cfd-4032-87e3-a91a4a6ff80a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:12.618336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-eef522f5-7efd-4a38-8dee-f1b5e89c9485 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084320 Jul 27 20:29:12.618896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 900/1812] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:12 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:12.645474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-789f3009-1cfd-4032-87e3-a91a4a6ff80a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043552 Jul 27 20:29:12.645959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 913/1813] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:12 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:29:13.457548 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-99f4a101-8643-4db1-8aeb-696e574042ec tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:13.459744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-99f4a101-8643-4db1-8aeb-696e574042ec tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:13.465767 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99f4a101-8643-4db1-8aeb-696e574042ec tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:13.466211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99f4a101-8643-4db1-8aeb-696e574042ec tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:13.467509 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99f4a101-8643-4db1-8aeb-696e574042ec tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:13.467934 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99f4a101-8643-4db1-8aeb-696e574042ec tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:13.496277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-99f4a101-8643-4db1-8aeb-696e574042ec tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042753 Jul 27 20:29:13.496810 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 901/1814] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:13 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:13.638050 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f7989462-b896-462d-9ff1-5d58a57ee142 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:13.638672 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f7989462-b896-462d-9ff1-5d58a57ee142 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:13.645198 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f7989462-b896-462d-9ff1-5d58a57ee142 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:13.645665 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f7989462-b896-462d-9ff1-5d58a57ee142 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:13.646431 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f7989462-b896-462d-9ff1-5d58a57ee142 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:13.646877 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f7989462-b896-462d-9ff1-5d58a57ee142 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:13.658631 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d95a978e-dce7-44a5-bc02-9cea1869f925 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:13.660736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d95a978e-dce7-44a5-bc02-9cea1869f925 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:13.667149 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d95a978e-dce7-44a5-bc02-9cea1869f925 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:13.667601 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d95a978e-dce7-44a5-bc02-9cea1869f925 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:13.668371 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d95a978e-dce7-44a5-bc02-9cea1869f925 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:13.668809 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d95a978e-dce7-44a5-bc02-9cea1869f925 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:13.699429 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d95a978e-dce7-44a5-bc02-9cea1869f925 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045533 Jul 27 20:29:13.699991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 902/1815] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:13 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:29:13.710055 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f7989462-b896-462d-9ff1-5d58a57ee142 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:13.718195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f7989462-b896-462d-9ff1-5d58a57ee142 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083940 Jul 27 20:29:13.718754 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 914/1816] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:13 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:14.508720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-45bc1999-8725-452b-b2d5-6f4a190073d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:14.510898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-45bc1999-8725-452b-b2d5-6f4a190073d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:14.516997 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-45bc1999-8725-452b-b2d5-6f4a190073d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:14.517445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-45bc1999-8725-452b-b2d5-6f4a190073d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:14.518198 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-45bc1999-8725-452b-b2d5-6f4a190073d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:14.518635 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-45bc1999-8725-452b-b2d5-6f4a190073d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:14.548132 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-45bc1999-8725-452b-b2d5-6f4a190073d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043356 Jul 27 20:29:14.548673 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 903/1817] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:14 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:14.711787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-eba5b745-0b84-4471-9309-8f266e90f300 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:14.713926 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-eba5b745-0b84-4471-9309-8f266e90f300 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:14.721076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eba5b745-0b84-4471-9309-8f266e90f300 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:14.721523 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eba5b745-0b84-4471-9309-8f266e90f300 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:14.722305 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eba5b745-0b84-4471-9309-8f266e90f300 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:14.722736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eba5b745-0b84-4471-9309-8f266e90f300 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:14.738820 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7118b2fe-4403-42db-8b7c-768a5274b559 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:14.739437 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7118b2fe-4403-42db-8b7c-768a5274b559 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:14.745824 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7118b2fe-4403-42db-8b7c-768a5274b559 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:14.746291 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7118b2fe-4403-42db-8b7c-768a5274b559 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:14.747046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7118b2fe-4403-42db-8b7c-768a5274b559 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:14.747480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7118b2fe-4403-42db-8b7c-768a5274b559 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:14.751097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-eba5b745-0b84-4471-9309-8f266e90f300 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043239 Jul 27 20:29:14.751664 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 915/1818] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:14 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:14.808986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7118b2fe-4403-42db-8b7c-768a5274b559 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:14.817157 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7118b2fe-4403-42db-8b7c-768a5274b559 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082174 Jul 27 20:29:14.817728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 904/1819] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:14 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:15.560957 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c488fcd5-2455-4092-9b84-2f30e96d571d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:15.563214 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c488fcd5-2455-4092-9b84-2f30e96d571d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:15.569353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c488fcd5-2455-4092-9b84-2f30e96d571d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:15.569813 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c488fcd5-2455-4092-9b84-2f30e96d571d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:15.570578 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c488fcd5-2455-4092-9b84-2f30e96d571d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:15.571021 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c488fcd5-2455-4092-9b84-2f30e96d571d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:15.601010 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c488fcd5-2455-4092-9b84-2f30e96d571d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044642 Jul 27 20:29:15.601565 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 916/1820] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:15 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:15.763529 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c153d922-4020-4998-b92b-154e17bad13f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:15.765875 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c153d922-4020-4998-b92b-154e17bad13f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:15.772355 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c153d922-4020-4998-b92b-154e17bad13f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:15.772798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c153d922-4020-4998-b92b-154e17bad13f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:15.773591 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c153d922-4020-4998-b92b-154e17bad13f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:15.774022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c153d922-4020-4998-b92b-154e17bad13f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:15.804254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c153d922-4020-4998-b92b-154e17bad13f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044777 Jul 27 20:29:15.804793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 905/1821] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:15 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:15.838668 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bace44fe-b7e1-4dd1-9b47-242b30501214 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:15.839278 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bace44fe-b7e1-4dd1-9b47-242b30501214 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:15.846302 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bace44fe-b7e1-4dd1-9b47-242b30501214 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:15.846751 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bace44fe-b7e1-4dd1-9b47-242b30501214 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:15.847528 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bace44fe-b7e1-4dd1-9b47-242b30501214 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:15.847961 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bace44fe-b7e1-4dd1-9b47-242b30501214 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:15.912228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bace44fe-b7e1-4dd1-9b47-242b30501214 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:15.920942 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bace44fe-b7e1-4dd1-9b47-242b30501214 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.085005 Jul 27 20:29:15.921547 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 917/1822] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:15 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:16.613048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-62821ada-074e-48dc-8ed7-2867ec9ec815 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:16.615215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-62821ada-074e-48dc-8ed7-2867ec9ec815 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:16.621239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-62821ada-074e-48dc-8ed7-2867ec9ec815 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:16.621687 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-62821ada-074e-48dc-8ed7-2867ec9ec815 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:16.622440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-62821ada-074e-48dc-8ed7-2867ec9ec815 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:16.623703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-62821ada-074e-48dc-8ed7-2867ec9ec815 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:16.652152 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-62821ada-074e-48dc-8ed7-2867ec9ec815 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043066 Jul 27 20:29:16.652693 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 906/1823] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:16 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:16.817062 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fdaba508-5f93-4a26-9f16-9d519d4b3896 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:16.819188 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fdaba508-5f93-4a26-9f16-9d519d4b3896 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:16.825235 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fdaba508-5f93-4a26-9f16-9d519d4b3896 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:16.825691 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fdaba508-5f93-4a26-9f16-9d519d4b3896 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:16.827328 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fdaba508-5f93-4a26-9f16-9d519d4b3896 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:16.827773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fdaba508-5f93-4a26-9f16-9d519d4b3896 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:16.855596 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fdaba508-5f93-4a26-9f16-9d519d4b3896 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042537 Jul 27 20:29:16.856196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 918/1824] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:16 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:16.943024 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-94b409c3-4b47-4a51-9770-39b2b01b2150 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:16.943631 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-94b409c3-4b47-4a51-9770-39b2b01b2150 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:16.950156 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-94b409c3-4b47-4a51-9770-39b2b01b2150 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:16.950601 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-94b409c3-4b47-4a51-9770-39b2b01b2150 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:16.951658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-94b409c3-4b47-4a51-9770-39b2b01b2150 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:16.952097 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-94b409c3-4b47-4a51-9770-39b2b01b2150 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:17.012695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-94b409c3-4b47-4a51-9770-39b2b01b2150 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:17.020359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-94b409c3-4b47-4a51-9770-39b2b01b2150 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081646 Jul 27 20:29:17.021120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 907/1825] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:16 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:17.664247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-dc5f1e24-21a6-4cb3-a0c3-a478845e1423 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:17.666439 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-dc5f1e24-21a6-4cb3-a0c3-a478845e1423 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:17.672755 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc5f1e24-21a6-4cb3-a0c3-a478845e1423 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:17.673237 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc5f1e24-21a6-4cb3-a0c3-a478845e1423 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:17.674005 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc5f1e24-21a6-4cb3-a0c3-a478845e1423 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:17.674446 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc5f1e24-21a6-4cb3-a0c3-a478845e1423 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:17.705361 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-dc5f1e24-21a6-4cb3-a0c3-a478845e1423 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044906 Jul 27 20:29:17.705922 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 919/1826] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:17 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:17.868715 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-46a024e7-7fe2-4907-8a32-5b0199305256 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:17.870905 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-46a024e7-7fe2-4907-8a32-5b0199305256 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:17.876991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-46a024e7-7fe2-4907-8a32-5b0199305256 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:17.877452 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-46a024e7-7fe2-4907-8a32-5b0199305256 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:17.878209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-46a024e7-7fe2-4907-8a32-5b0199305256 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:17.878642 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-46a024e7-7fe2-4907-8a32-5b0199305256 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:17.908098 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-46a024e7-7fe2-4907-8a32-5b0199305256 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043602 Jul 27 20:29:17.908644 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 908/1827] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:17 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:18.041347 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3a02ac6d-47d2-4bd3-9e6f-6290a76ac249 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:18.041887 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3a02ac6d-47d2-4bd3-9e6f-6290a76ac249 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:18.048560 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3a02ac6d-47d2-4bd3-9e6f-6290a76ac249 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:18.049033 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3a02ac6d-47d2-4bd3-9e6f-6290a76ac249 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:18.049815 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3a02ac6d-47d2-4bd3-9e6f-6290a76ac249 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:18.050337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3a02ac6d-47d2-4bd3-9e6f-6290a76ac249 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:18.116785 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3a02ac6d-47d2-4bd3-9e6f-6290a76ac249 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:18.125047 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3a02ac6d-47d2-4bd3-9e6f-6290a76ac249 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.087691 Jul 27 20:29:18.125602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 920/1828] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:18 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:18.718355 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-90b83cb9-c08f-4f8c-bddb-fb9f5295a179 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:18.720518 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-90b83cb9-c08f-4f8c-bddb-fb9f5295a179 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:18.726570 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-90b83cb9-c08f-4f8c-bddb-fb9f5295a179 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:18.727022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-90b83cb9-c08f-4f8c-bddb-fb9f5295a179 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:18.727790 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-90b83cb9-c08f-4f8c-bddb-fb9f5295a179 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:18.728229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-90b83cb9-c08f-4f8c-bddb-fb9f5295a179 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:18.756832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-90b83cb9-c08f-4f8c-bddb-fb9f5295a179 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043142 Jul 27 20:29:18.757407 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 909/1829] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:18 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:18.920683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-af5518f9-e2c6-4b88-b29d-e499ad0a1c9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:18.922824 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-af5518f9-e2c6-4b88-b29d-e499ad0a1c9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:18.929402 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-af5518f9-e2c6-4b88-b29d-e499ad0a1c9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:18.929851 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-af5518f9-e2c6-4b88-b29d-e499ad0a1c9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:18.930610 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-af5518f9-e2c6-4b88-b29d-e499ad0a1c9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:18.931049 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-af5518f9-e2c6-4b88-b29d-e499ad0a1c9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:18.960249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-af5518f9-e2c6-4b88-b29d-e499ad0a1c9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044140 Jul 27 20:29:18.960802 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 921/1830] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:18 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:19.145440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0ed2c849-7e40-4927-9f9f-d24f7a7355f8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:19.146073 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0ed2c849-7e40-4927-9f9f-d24f7a7355f8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:19.152569 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ed2c849-7e40-4927-9f9f-d24f7a7355f8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:19.153044 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ed2c849-7e40-4927-9f9f-d24f7a7355f8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:19.153812 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ed2c849-7e40-4927-9f9f-d24f7a7355f8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:19.155029 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ed2c849-7e40-4927-9f9f-d24f7a7355f8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:19.214984 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0ed2c849-7e40-4927-9f9f-d24f7a7355f8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:19.223315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0ed2c849-7e40-4927-9f9f-d24f7a7355f8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081723 Jul 27 20:29:19.223878 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 910/1831] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:19 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:19.769806 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a530b173-29ed-4ff6-bb89-e3f63f8571e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:19.771883 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a530b173-29ed-4ff6-bb89-e3f63f8571e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:19.778287 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a530b173-29ed-4ff6-bb89-e3f63f8571e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:19.778739 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a530b173-29ed-4ff6-bb89-e3f63f8571e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:19.779670 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a530b173-29ed-4ff6-bb89-e3f63f8571e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:19.780290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a530b173-29ed-4ff6-bb89-e3f63f8571e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:19.808205 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a530b173-29ed-4ff6-bb89-e3f63f8571e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042490 Jul 27 20:29:19.808748 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 922/1832] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:19 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:19.972933 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4b1692a4-3349-4748-b750-900d8dcd441e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:19.975156 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4b1692a4-3349-4748-b750-900d8dcd441e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:19.981348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b1692a4-3349-4748-b750-900d8dcd441e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:19.981780 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b1692a4-3349-4748-b750-900d8dcd441e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:19.983522 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b1692a4-3349-4748-b750-900d8dcd441e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:19.983978 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b1692a4-3349-4748-b750-900d8dcd441e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:20.001459 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:29:20.014510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4b1692a4-3349-4748-b750-900d8dcd441e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045500 Jul 27 20:29:20.015064 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 911/1833] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:19 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:20.244075 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-17d4c292-d259-4035-af72-d52d83f1cb15 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:20.244687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-17d4c292-d259-4035-af72-d52d83f1cb15 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:20.250965 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-17d4c292-d259-4035-af72-d52d83f1cb15 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:20.251415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-17d4c292-d259-4035-af72-d52d83f1cb15 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:20.252177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-17d4c292-d259-4035-af72-d52d83f1cb15 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:20.252619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-17d4c292-d259-4035-af72-d52d83f1cb15 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:20.312815 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-17d4c292-d259-4035-af72-d52d83f1cb15 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:20.320334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-17d4c292-d259-4035-af72-d52d83f1cb15 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080118 Jul 27 20:29:20.320888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 923/1834] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:20 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:20.821096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ae020125-2b35-40a1-8d34-583064282cbd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:20.823248 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ae020125-2b35-40a1-8d34-583064282cbd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:20.830573 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae020125-2b35-40a1-8d34-583064282cbd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:20.831013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae020125-2b35-40a1-8d34-583064282cbd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:20.831763 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae020125-2b35-40a1-8d34-583064282cbd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:20.832192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae020125-2b35-40a1-8d34-583064282cbd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:20.861060 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ae020125-2b35-40a1-8d34-583064282cbd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044010 Jul 27 20:29:20.861601 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 912/1835] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:20 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:21.026978 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1ed45c74-3022-4038-81ae-ad0664119a49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:21.029412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1ed45c74-3022-4038-81ae-ad0664119a49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:21.035888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1ed45c74-3022-4038-81ae-ad0664119a49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:21.036346 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1ed45c74-3022-4038-81ae-ad0664119a49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:21.037155 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1ed45c74-3022-4038-81ae-ad0664119a49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:21.037603 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1ed45c74-3022-4038-81ae-ad0664119a49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:21.067092 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1ed45c74-3022-4038-81ae-ad0664119a49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044091 Jul 27 20:29:21.067667 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 924/1836] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:21 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:21.341557 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-441fadf6-4cde-4548-9367-b334df9e182a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:21.342193 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-441fadf6-4cde-4548-9367-b334df9e182a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:21.348177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-441fadf6-4cde-4548-9367-b334df9e182a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:21.348626 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-441fadf6-4cde-4548-9367-b334df9e182a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:21.349423 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-441fadf6-4cde-4548-9367-b334df9e182a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:21.349860 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-441fadf6-4cde-4548-9367-b334df9e182a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:21.412366 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-441fadf6-4cde-4548-9367-b334df9e182a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:21.420493 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-441fadf6-4cde-4548-9367-b334df9e182a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082555 Jul 27 20:29:21.421067 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 913/1837] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:21 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:21.873405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bd3dacb1-b266-4511-a15c-0794dcd95d5a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:21.875574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bd3dacb1-b266-4511-a15c-0794dcd95d5a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:21.881512 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bd3dacb1-b266-4511-a15c-0794dcd95d5a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:21.881961 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bd3dacb1-b266-4511-a15c-0794dcd95d5a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:21.882722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bd3dacb1-b266-4511-a15c-0794dcd95d5a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:21.883157 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bd3dacb1-b266-4511-a15c-0794dcd95d5a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:21.886725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:29:21.912474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bd3dacb1-b266-4511-a15c-0794dcd95d5a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043203 Jul 27 20:29:21.913065 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 925/1838] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:21 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:22.079916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2e004b3d-88ab-4d69-b550-8b1134601a10 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:22.082128 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2e004b3d-88ab-4d69-b550-8b1134601a10 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:22.088609 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e004b3d-88ab-4d69-b550-8b1134601a10 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:22.089152 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e004b3d-88ab-4d69-b550-8b1134601a10 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:22.089906 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e004b3d-88ab-4d69-b550-8b1134601a10 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:22.090333 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e004b3d-88ab-4d69-b550-8b1134601a10 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:22.124530 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2e004b3d-88ab-4d69-b550-8b1134601a10 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048925 Jul 27 20:29:22.125129 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 914/1839] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:22 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:22.440668 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c49de53b-88f0-4f1d-8cb8-bed57f7a1a85 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:22.441332 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c49de53b-88f0-4f1d-8cb8-bed57f7a1a85 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:22.447828 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c49de53b-88f0-4f1d-8cb8-bed57f7a1a85 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:22.448279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c49de53b-88f0-4f1d-8cb8-bed57f7a1a85 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:22.449069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c49de53b-88f0-4f1d-8cb8-bed57f7a1a85 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:22.449510 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c49de53b-88f0-4f1d-8cb8-bed57f7a1a85 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:22.511718 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c49de53b-88f0-4f1d-8cb8-bed57f7a1a85 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:22.519968 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c49de53b-88f0-4f1d-8cb8-bed57f7a1a85 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083166 Jul 27 20:29:22.520526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 926/1840] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:22 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:22.925160 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f667ad88-dea6-4b7d-ac5b-fc63385f56a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:22.927318 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f667ad88-dea6-4b7d-ac5b-fc63385f56a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:22.933413 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f667ad88-dea6-4b7d-ac5b-fc63385f56a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:22.933867 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f667ad88-dea6-4b7d-ac5b-fc63385f56a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:22.934631 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f667ad88-dea6-4b7d-ac5b-fc63385f56a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:22.935073 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f667ad88-dea6-4b7d-ac5b-fc63385f56a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:22.965984 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f667ad88-dea6-4b7d-ac5b-fc63385f56a3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044780 Jul 27 20:29:22.966659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 915/1841] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:22 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:23.136415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7acf3e41-a4de-4f40-acb6-5e6cc58ae1b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:23.138710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7acf3e41-a4de-4f40-acb6-5e6cc58ae1b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:23.144736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7acf3e41-a4de-4f40-acb6-5e6cc58ae1b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:23.145230 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7acf3e41-a4de-4f40-acb6-5e6cc58ae1b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:23.146001 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7acf3e41-a4de-4f40-acb6-5e6cc58ae1b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:23.146442 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7acf3e41-a4de-4f40-acb6-5e6cc58ae1b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:23.176197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7acf3e41-a4de-4f40-acb6-5e6cc58ae1b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043672 Jul 27 20:29:23.176687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 927/1842] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:23 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:23.540512 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d5ccba7d-8ac4-4185-a5c7-7fecb86af5fb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:23.541098 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d5ccba7d-8ac4-4185-a5c7-7fecb86af5fb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:23.548111 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5ccba7d-8ac4-4185-a5c7-7fecb86af5fb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:23.548549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5ccba7d-8ac4-4185-a5c7-7fecb86af5fb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:23.549336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5ccba7d-8ac4-4185-a5c7-7fecb86af5fb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:23.549765 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5ccba7d-8ac4-4185-a5c7-7fecb86af5fb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:23.610405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d5ccba7d-8ac4-4185-a5c7-7fecb86af5fb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:23.617879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d5ccba7d-8ac4-4185-a5c7-7fecb86af5fb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081252 Jul 27 20:29:23.618441 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 916/1843] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:23 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:23.978183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1c3e73b3-1e8b-4d27-987e-b03269b87a0c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:23.980309 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1c3e73b3-1e8b-4d27-987e-b03269b87a0c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:23.982710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=84 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:29:23.987971 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1c3e73b3-1e8b-4d27-987e-b03269b87a0c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:23.988417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1c3e73b3-1e8b-4d27-987e-b03269b87a0c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:23.989201 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1c3e73b3-1e8b-4d27-987e-b03269b87a0c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:23.989636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1c3e73b3-1e8b-4d27-987e-b03269b87a0c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:24.018994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1c3e73b3-1e8b-4d27-987e-b03269b87a0c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044721 Jul 27 20:29:24.019534 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 928/1844] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:23 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:24.188333 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3ea69f6f-1242-4992-be80-4d774b3cf386 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:24.190570 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3ea69f6f-1242-4992-be80-4d774b3cf386 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:24.196616 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ea69f6f-1242-4992-be80-4d774b3cf386 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:24.197097 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ea69f6f-1242-4992-be80-4d774b3cf386 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:24.197873 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ea69f6f-1242-4992-be80-4d774b3cf386 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:24.198310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ea69f6f-1242-4992-be80-4d774b3cf386 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:24.227366 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3ea69f6f-1242-4992-be80-4d774b3cf386 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043522 Jul 27 20:29:24.227917 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 917/1845] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:24 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:24.638770 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9d1e757b-a297-4625-a4fb-9f229d90cd4b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:24.639488 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9d1e757b-a297-4625-a4fb-9f229d90cd4b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:24.645498 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d1e757b-a297-4625-a4fb-9f229d90cd4b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:24.645948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d1e757b-a297-4625-a4fb-9f229d90cd4b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:24.646711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d1e757b-a297-4625-a4fb-9f229d90cd4b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:24.647148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d1e757b-a297-4625-a4fb-9f229d90cd4b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:24.711076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9d1e757b-a297-4625-a4fb-9f229d90cd4b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:24.719334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9d1e757b-a297-4625-a4fb-9f229d90cd4b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084638 Jul 27 20:29:24.719894 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 929/1846] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:24 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:25.031305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b7b96851-0738-4c04-be90-a8e930ef1e47 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:25.033478 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b7b96851-0738-4c04-be90-a8e930ef1e47 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:25.035739 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=88 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:29:25.040928 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7b96851-0738-4c04-be90-a8e930ef1e47 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:25.041396 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7b96851-0738-4c04-be90-a8e930ef1e47 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:25.042152 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7b96851-0738-4c04-be90-a8e930ef1e47 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:25.042579 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7b96851-0738-4c04-be90-a8e930ef1e47 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:25.071745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b7b96851-0738-4c04-be90-a8e930ef1e47 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044902 Jul 27 20:29:25.072298 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 918/1847] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:25 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:25.239899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-63681ae8-b50b-403e-968f-fcb172747918 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:25.242101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-63681ae8-b50b-403e-968f-fcb172747918 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:25.248790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63681ae8-b50b-403e-968f-fcb172747918 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:25.249288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63681ae8-b50b-403e-968f-fcb172747918 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:25.250095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63681ae8-b50b-403e-968f-fcb172747918 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:25.250542 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63681ae8-b50b-403e-968f-fcb172747918 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:25.280402 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-63681ae8-b50b-403e-968f-fcb172747918 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044426 Jul 27 20:29:25.280885 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 930/1848] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:25 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:25.742235 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5aaeb85e-01f9-49c9-8cdc-e807007a96d0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:25.742855 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5aaeb85e-01f9-49c9-8cdc-e807007a96d0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:25.749499 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5aaeb85e-01f9-49c9-8cdc-e807007a96d0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:25.749955 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5aaeb85e-01f9-49c9-8cdc-e807007a96d0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:25.750745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5aaeb85e-01f9-49c9-8cdc-e807007a96d0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:25.751182 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5aaeb85e-01f9-49c9-8cdc-e807007a96d0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:25.810682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5aaeb85e-01f9-49c9-8cdc-e807007a96d0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:25.818089 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5aaeb85e-01f9-49c9-8cdc-e807007a96d0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.079790 Jul 27 20:29:25.818648 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 919/1849] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:25 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:26.083797 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e17520bd-ba86-4c93-a9b1-496a3052fc16 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:26.085967 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e17520bd-ba86-4c93-a9b1-496a3052fc16 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:26.092285 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e17520bd-ba86-4c93-a9b1-496a3052fc16 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:26.092814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e17520bd-ba86-4c93-a9b1-496a3052fc16 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:26.093634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e17520bd-ba86-4c93-a9b1-496a3052fc16 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:26.094077 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e17520bd-ba86-4c93-a9b1-496a3052fc16 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:26.123995 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e17520bd-ba86-4c93-a9b1-496a3052fc16 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043957 Jul 27 20:29:26.124579 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 931/1850] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:26 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:26.291765 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9ad366ce-efd0-4ba1-b4ea-fd67cae9b572 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:26.293996 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9ad366ce-efd0-4ba1-b4ea-fd67cae9b572 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:26.301168 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9ad366ce-efd0-4ba1-b4ea-fd67cae9b572 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:26.301619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9ad366ce-efd0-4ba1-b4ea-fd67cae9b572 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:26.302381 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9ad366ce-efd0-4ba1-b4ea-fd67cae9b572 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:26.302820 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9ad366ce-efd0-4ba1-b4ea-fd67cae9b572 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:26.331723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9ad366ce-efd0-4ba1-b4ea-fd67cae9b572 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043855 Jul 27 20:29:26.332206 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 920/1851] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:26 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:26.839583 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bbdaf0da-a104-4ffa-8687-b8997e3095d8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:26.840204 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bbdaf0da-a104-4ffa-8687-b8997e3095d8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:26.846753 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bbdaf0da-a104-4ffa-8687-b8997e3095d8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:26.847205 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bbdaf0da-a104-4ffa-8687-b8997e3095d8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:26.847973 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bbdaf0da-a104-4ffa-8687-b8997e3095d8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:26.848417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bbdaf0da-a104-4ffa-8687-b8997e3095d8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:26.908545 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bbdaf0da-a104-4ffa-8687-b8997e3095d8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:26.916868 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bbdaf0da-a104-4ffa-8687-b8997e3095d8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081131 Jul 27 20:29:26.917477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 932/1852] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:26 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:27.140096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c5134862-a365-4a99-91b9-c0fe10b14bd6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:27.142337 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c5134862-a365-4a99-91b9-c0fe10b14bd6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:27.148384 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5134862-a365-4a99-91b9-c0fe10b14bd6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:27.148832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5134862-a365-4a99-91b9-c0fe10b14bd6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:27.149632 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5134862-a365-4a99-91b9-c0fe10b14bd6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:27.150070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5134862-a365-4a99-91b9-c0fe10b14bd6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:27.178960 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c5134862-a365-4a99-91b9-c0fe10b14bd6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042983 Jul 27 20:29:27.179497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 921/1853] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:27 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:27.344549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1034f6fc-fafb-4a3c-890c-8d6f5f64a048 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:27.346714 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1034f6fc-fafb-4a3c-890c-8d6f5f64a048 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:27.352693 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1034f6fc-fafb-4a3c-890c-8d6f5f64a048 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:27.353180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1034f6fc-fafb-4a3c-890c-8d6f5f64a048 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:27.353934 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1034f6fc-fafb-4a3c-890c-8d6f5f64a048 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:27.354366 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1034f6fc-fafb-4a3c-890c-8d6f5f64a048 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:27.383490 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1034f6fc-fafb-4a3c-890c-8d6f5f64a048 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043379 Jul 27 20:29:27.384034 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 933/1854] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:27 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:27.939662 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-93a4936e-b1bd-46ae-9f5f-e1d86b9848c5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:27.940301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-93a4936e-b1bd-46ae-9f5f-e1d86b9848c5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:27.946792 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93a4936e-b1bd-46ae-9f5f-e1d86b9848c5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:27.947242 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93a4936e-b1bd-46ae-9f5f-e1d86b9848c5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:27.948002 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93a4936e-b1bd-46ae-9f5f-e1d86b9848c5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:27.948442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93a4936e-b1bd-46ae-9f5f-e1d86b9848c5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:28.009294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-93a4936e-b1bd-46ae-9f5f-e1d86b9848c5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:28.017645 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-93a4936e-b1bd-46ae-9f5f-e1d86b9848c5 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081981 Jul 27 20:29:28.018208 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 922/1855] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:27 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:28.191579 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5807a0db-5671-4f43-9d86-3fd67ca46c01 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:28.193675 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5807a0db-5671-4f43-9d86-3fd67ca46c01 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:28.200444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5807a0db-5671-4f43-9d86-3fd67ca46c01 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:28.200907 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5807a0db-5671-4f43-9d86-3fd67ca46c01 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:28.202627 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5807a0db-5671-4f43-9d86-3fd67ca46c01 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:28.203156 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5807a0db-5671-4f43-9d86-3fd67ca46c01 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:28.231229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5807a0db-5671-4f43-9d86-3fd67ca46c01 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043701 Jul 27 20:29:28.231780 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 934/1856] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:28 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:28.396511 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c562951c-aff8-415e-8867-9b67b3ef8407 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:28.398715 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c562951c-aff8-415e-8867-9b67b3ef8407 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:28.404862 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c562951c-aff8-415e-8867-9b67b3ef8407 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:28.405416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c562951c-aff8-415e-8867-9b67b3ef8407 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:28.406188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c562951c-aff8-415e-8867-9b67b3ef8407 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:28.406627 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c562951c-aff8-415e-8867-9b67b3ef8407 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:28.434908 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c562951c-aff8-415e-8867-9b67b3ef8407 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042548 Jul 27 20:29:28.435470 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 923/1857] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:28 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:29.039785 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f9ec587c-7c40-49bc-b5da-a479518bfbca tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:29.040403 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f9ec587c-7c40-49bc-b5da-a479518bfbca tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:29.047109 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f9ec587c-7c40-49bc-b5da-a479518bfbca tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:29.047566 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f9ec587c-7c40-49bc-b5da-a479518bfbca tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:29.048363 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f9ec587c-7c40-49bc-b5da-a479518bfbca tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:29.048807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f9ec587c-7c40-49bc-b5da-a479518bfbca tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:29.109057 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f9ec587c-7c40-49bc-b5da-a479518bfbca tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:29.117345 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f9ec587c-7c40-49bc-b5da-a479518bfbca tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082220 Jul 27 20:29:29.117913 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 935/1858] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:29 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:29.243510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a1469001-3bf1-4096-9741-19773cb47075 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:29.245651 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a1469001-3bf1-4096-9741-19773cb47075 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:29.252149 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a1469001-3bf1-4096-9741-19773cb47075 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:29.252602 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a1469001-3bf1-4096-9741-19773cb47075 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:29.253402 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a1469001-3bf1-4096-9741-19773cb47075 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:29.253841 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a1469001-3bf1-4096-9741-19773cb47075 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:29.282986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a1469001-3bf1-4096-9741-19773cb47075 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043468 Jul 27 20:29:29.283533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 924/1859] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:29 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:29.447430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-992b6647-6624-4205-92b9-79e422567ac9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:29.449606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-992b6647-6624-4205-92b9-79e422567ac9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:29.456374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-992b6647-6624-4205-92b9-79e422567ac9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:29.456824 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-992b6647-6624-4205-92b9-79e422567ac9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:29.457634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-992b6647-6624-4205-92b9-79e422567ac9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:29.458075 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-992b6647-6624-4205-92b9-79e422567ac9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:29.488070 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-992b6647-6624-4205-92b9-79e422567ac9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044627 Jul 27 20:29:29.488629 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 936/1860] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:29 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:30.138400 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-294038fc-e1ce-4790-8073-aa09dfab9c58 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:30.139542 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-294038fc-e1ce-4790-8073-aa09dfab9c58 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:30.146718 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-294038fc-e1ce-4790-8073-aa09dfab9c58 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:30.147164 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-294038fc-e1ce-4790-8073-aa09dfab9c58 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:30.147939 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-294038fc-e1ce-4790-8073-aa09dfab9c58 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:30.148373 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-294038fc-e1ce-4790-8073-aa09dfab9c58 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:30.212309 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-294038fc-e1ce-4790-8073-aa09dfab9c58 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:30.220439 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-294038fc-e1ce-4790-8073-aa09dfab9c58 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.085989 Jul 27 20:29:30.221018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 925/1861] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:30 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:30.295266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c32d0479-c9e3-466a-9bf4-9e4c8090e0db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:30.297507 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c32d0479-c9e3-466a-9bf4-9e4c8090e0db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:30.303640 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c32d0479-c9e3-466a-9bf4-9e4c8090e0db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:30.304092 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c32d0479-c9e3-466a-9bf4-9e4c8090e0db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:30.304865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c32d0479-c9e3-466a-9bf4-9e4c8090e0db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:30.305331 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c32d0479-c9e3-466a-9bf4-9e4c8090e0db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:30.492189 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c32d0479-c9e3-466a-9bf4-9e4c8090e0db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.200913 Jul 27 20:29:30.493096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 937/1862] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:30 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:30.500448 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-af135352-e5b4-4a6f-a9fa-e27c12f4ce38 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:30.502654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-af135352-e5b4-4a6f-a9fa-e27c12f4ce38 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:30.509032 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af135352-e5b4-4a6f-a9fa-e27c12f4ce38 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:30.509475 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af135352-e5b4-4a6f-a9fa-e27c12f4ce38 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:30.510226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af135352-e5b4-4a6f-a9fa-e27c12f4ce38 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:30.510656 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af135352-e5b4-4a6f-a9fa-e27c12f4ce38 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:30.539487 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-af135352-e5b4-4a6f-a9fa-e27c12f4ce38 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043538 Jul 27 20:29:30.540029 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 926/1863] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:30 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:29:31.240991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4b495ff5-b93f-46e9-ad6e-5229508df126 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:31.241616 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4b495ff5-b93f-46e9-ad6e-5229508df126 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:31.247582 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4b495ff5-b93f-46e9-ad6e-5229508df126 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:31.248038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4b495ff5-b93f-46e9-ad6e-5229508df126 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:31.248835 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4b495ff5-b93f-46e9-ad6e-5229508df126 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:31.249300 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4b495ff5-b93f-46e9-ad6e-5229508df126 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:31.309415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4b495ff5-b93f-46e9-ad6e-5229508df126 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:31.316894 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4b495ff5-b93f-46e9-ad6e-5229508df126 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.079774 Jul 27 20:29:31.317477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 938/1864] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:31 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:31.505065 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9342ae77-cfa7-4b2d-98d0-80e797c36c37 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:31.507240 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9342ae77-cfa7-4b2d-98d0-80e797c36c37 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:31.513746 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9342ae77-cfa7-4b2d-98d0-80e797c36c37 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:31.515618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9342ae77-cfa7-4b2d-98d0-80e797c36c37 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:31.516396 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9342ae77-cfa7-4b2d-98d0-80e797c36c37 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:31.516840 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9342ae77-cfa7-4b2d-98d0-80e797c36c37 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:31.546536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9342ae77-cfa7-4b2d-98d0-80e797c36c37 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045427 Jul 27 20:29:31.547239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 927/1865] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:31 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:31.551960 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-62c5aa78-7f19-41b5-bdf2-efb34e6fba9f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:31.554098 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-62c5aa78-7f19-41b5-bdf2-efb34e6fba9f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:31.560453 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-62c5aa78-7f19-41b5-bdf2-efb34e6fba9f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:31.560934 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-62c5aa78-7f19-41b5-bdf2-efb34e6fba9f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:31.561724 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-62c5aa78-7f19-41b5-bdf2-efb34e6fba9f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:31.562161 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-62c5aa78-7f19-41b5-bdf2-efb34e6fba9f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:31.591057 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-62c5aa78-7f19-41b5-bdf2-efb34e6fba9f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043082 Jul 27 20:29:31.591588 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 939/1866] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:31 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:32.338263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9ddab38e-170b-4eec-93c1-78f32807f405 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:32.338804 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9ddab38e-170b-4eec-93c1-78f32807f405 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:32.345354 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9ddab38e-170b-4eec-93c1-78f32807f405 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:32.345806 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9ddab38e-170b-4eec-93c1-78f32807f405 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:32.346576 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9ddab38e-170b-4eec-93c1-78f32807f405 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:32.347018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9ddab38e-170b-4eec-93c1-78f32807f405 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:32.351064 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:29:32.407685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9ddab38e-170b-4eec-93c1-78f32807f405 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:32.415666 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9ddab38e-170b-4eec-93c1-78f32807f405 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081351 Jul 27 20:29:32.416225 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 928/1867] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:32 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:32.558855 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-64282d75-cbdf-4f9d-b8c3-a7de5473bf9d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:32.561561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-64282d75-cbdf-4f9d-b8c3-a7de5473bf9d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:32.567651 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-64282d75-cbdf-4f9d-b8c3-a7de5473bf9d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:32.568127 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-64282d75-cbdf-4f9d-b8c3-a7de5473bf9d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:32.568901 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-64282d75-cbdf-4f9d-b8c3-a7de5473bf9d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:32.569355 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-64282d75-cbdf-4f9d-b8c3-a7de5473bf9d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:32.600451 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-64282d75-cbdf-4f9d-b8c3-a7de5473bf9d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045577 Jul 27 20:29:32.600920 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 940/1868] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:32 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:32.603781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d646ab90-d2bd-49fd-84a4-67c0e03b9c1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:32.606010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d646ab90-d2bd-49fd-84a4-67c0e03b9c1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:32.613093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d646ab90-d2bd-49fd-84a4-67c0e03b9c1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:32.613546 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d646ab90-d2bd-49fd-84a4-67c0e03b9c1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:32.614308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d646ab90-d2bd-49fd-84a4-67c0e03b9c1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:32.614748 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d646ab90-d2bd-49fd-84a4-67c0e03b9c1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:32.646262 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d646ab90-d2bd-49fd-84a4-67c0e03b9c1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046359 Jul 27 20:29:32.647312 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 929/1869] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:32 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:29:33.438231 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-41c162fe-edbe-4d74-bbec-313ad9048d3e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:33.438901 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-41c162fe-edbe-4d74-bbec-313ad9048d3e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:33.445033 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41c162fe-edbe-4d74-bbec-313ad9048d3e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:33.445498 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41c162fe-edbe-4d74-bbec-313ad9048d3e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:33.446273 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41c162fe-edbe-4d74-bbec-313ad9048d3e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:33.446720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41c162fe-edbe-4d74-bbec-313ad9048d3e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:33.510733 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-41c162fe-edbe-4d74-bbec-313ad9048d3e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:33.514760 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:29:33.520061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-41c162fe-edbe-4d74-bbec-313ad9048d3e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.086467 Jul 27 20:29:33.520619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 941/1870] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:33 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:33.612256 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5ed1c6b8-3b68-4113-94ca-186cc229016e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:33.614429 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5ed1c6b8-3b68-4113-94ca-186cc229016e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:33.621788 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5ed1c6b8-3b68-4113-94ca-186cc229016e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:33.622238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5ed1c6b8-3b68-4113-94ca-186cc229016e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:33.623003 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5ed1c6b8-3b68-4113-94ca-186cc229016e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:33.624054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5ed1c6b8-3b68-4113-94ca-186cc229016e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:33.653266 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5ed1c6b8-3b68-4113-94ca-186cc229016e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044948 Jul 27 20:29:33.653849 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 930/1871] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:33 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:33.659007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ac9c5043-259d-4b69-9302-6da3db390d89 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:33.661208 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ac9c5043-259d-4b69-9302-6da3db390d89 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:33.667520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ac9c5043-259d-4b69-9302-6da3db390d89 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:33.667914 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ac9c5043-259d-4b69-9302-6da3db390d89 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:33.668680 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ac9c5043-259d-4b69-9302-6da3db390d89 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:33.669161 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ac9c5043-259d-4b69-9302-6da3db390d89 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:33.699345 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ac9c5043-259d-4b69-9302-6da3db390d89 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043710 Jul 27 20:29:33.699594 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 942/1872] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:33 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:34.540634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d4361332-359b-4f67-bc22-96f30d4eb176 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:34.541275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d4361332-359b-4f67-bc22-96f30d4eb176 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:34.547265 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4361332-359b-4f67-bc22-96f30d4eb176 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:34.547704 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4361332-359b-4f67-bc22-96f30d4eb176 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:34.548451 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4361332-359b-4f67-bc22-96f30d4eb176 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:34.548876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4361332-359b-4f67-bc22-96f30d4eb176 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:34.608544 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d4361332-359b-4f67-bc22-96f30d4eb176 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:34.615929 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d4361332-359b-4f67-bc22-96f30d4eb176 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.079253 Jul 27 20:29:34.616487 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 931/1873] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:34 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:34.664611 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f2a8fd2f-cf46-4b6f-8cfe-5223011bb1f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:34.666841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f2a8fd2f-cf46-4b6f-8cfe-5223011bb1f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:34.673489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2a8fd2f-cf46-4b6f-8cfe-5223011bb1f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:34.673948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2a8fd2f-cf46-4b6f-8cfe-5223011bb1f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:34.674717 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2a8fd2f-cf46-4b6f-8cfe-5223011bb1f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:34.675162 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2a8fd2f-cf46-4b6f-8cfe-5223011bb1f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:34.705596 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f2a8fd2f-cf46-4b6f-8cfe-5223011bb1f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044916 Jul 27 20:29:34.706146 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 943/1874] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:34 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:34.711774 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-03e95c2d-61f4-4070-a6fa-7577c67b547b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:34.713954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-03e95c2d-61f4-4070-a6fa-7577c67b547b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:34.720990 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03e95c2d-61f4-4070-a6fa-7577c67b547b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:34.721455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03e95c2d-61f4-4070-a6fa-7577c67b547b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:34.722219 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03e95c2d-61f4-4070-a6fa-7577c67b547b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:34.722653 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03e95c2d-61f4-4070-a6fa-7577c67b547b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:34.750726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-03e95c2d-61f4-4070-a6fa-7577c67b547b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042961 Jul 27 20:29:34.751265 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 932/1875] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:34 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:35.636726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-698fc8e3-0f4a-4dce-aee1-8a35061880a1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:35.637360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-698fc8e3-0f4a-4dce-aee1-8a35061880a1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:35.643404 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-698fc8e3-0f4a-4dce-aee1-8a35061880a1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:35.643853 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-698fc8e3-0f4a-4dce-aee1-8a35061880a1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:35.644606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-698fc8e3-0f4a-4dce-aee1-8a35061880a1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:35.645064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-698fc8e3-0f4a-4dce-aee1-8a35061880a1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:35.705736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-698fc8e3-0f4a-4dce-aee1-8a35061880a1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:35.713311 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-698fc8e3-0f4a-4dce-aee1-8a35061880a1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080652 Jul 27 20:29:35.713856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 944/1876] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:35 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:35.718491 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d000fcda-d2ae-42a3-af07-e0818e6e94ea tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:35.720675 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d000fcda-d2ae-42a3-af07-e0818e6e94ea tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:35.727237 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d000fcda-d2ae-42a3-af07-e0818e6e94ea tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:35.727680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d000fcda-d2ae-42a3-af07-e0818e6e94ea tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:35.728441 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d000fcda-d2ae-42a3-af07-e0818e6e94ea tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:35.728872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d000fcda-d2ae-42a3-af07-e0818e6e94ea tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:35.757830 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d000fcda-d2ae-42a3-af07-e0818e6e94ea tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043937 Jul 27 20:29:35.758380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 933/1877] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:35 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:29:35.763264 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3aa4b82c-461f-4435-ad42-b14cf334e153 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:35.765681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3aa4b82c-461f-4435-ad42-b14cf334e153 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:35.771644 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3aa4b82c-461f-4435-ad42-b14cf334e153 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:35.772089 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3aa4b82c-461f-4435-ad42-b14cf334e153 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:35.772840 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3aa4b82c-461f-4435-ad42-b14cf334e153 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:35.773300 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3aa4b82c-461f-4435-ad42-b14cf334e153 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:35.802176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3aa4b82c-461f-4435-ad42-b14cf334e153 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042950 Jul 27 20:29:35.802719 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 945/1878] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:35 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:36.736056 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-31acd288-7b7e-4921-b8d6-6b366a076a2f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:36.736646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-31acd288-7b7e-4921-b8d6-6b366a076a2f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:36.743088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-31acd288-7b7e-4921-b8d6-6b366a076a2f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:36.743527 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-31acd288-7b7e-4921-b8d6-6b366a076a2f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:36.744284 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-31acd288-7b7e-4921-b8d6-6b366a076a2f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:36.744710 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-31acd288-7b7e-4921-b8d6-6b366a076a2f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:36.770486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2c02c08f-fa9a-4eb2-b165-f8ce9101e6cf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:36.772644 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2c02c08f-fa9a-4eb2-b165-f8ce9101e6cf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:36.779306 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2c02c08f-fa9a-4eb2-b165-f8ce9101e6cf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:36.780476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2c02c08f-fa9a-4eb2-b165-f8ce9101e6cf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:36.781274 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2c02c08f-fa9a-4eb2-b165-f8ce9101e6cf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:36.781721 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2c02c08f-fa9a-4eb2-b165-f8ce9101e6cf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:36.808403 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-31acd288-7b7e-4921-b8d6-6b366a076a2f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:36.811924 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2c02c08f-fa9a-4eb2-b165-f8ce9101e6cf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045259 Jul 27 20:29:36.812494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 946/1879] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:36 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:29:36.816118 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-31acd288-7b7e-4921-b8d6-6b366a076a2f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084418 Jul 27 20:29:36.816684 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 934/1880] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:36 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:36.817411 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0977154a-c6ac-4114-a747-7222c3cea572 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:36.819525 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0977154a-c6ac-4114-a747-7222c3cea572 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:36.825361 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0977154a-c6ac-4114-a747-7222c3cea572 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:36.825829 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0977154a-c6ac-4114-a747-7222c3cea572 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:36.827093 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0977154a-c6ac-4114-a747-7222c3cea572 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:36.827531 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0977154a-c6ac-4114-a747-7222c3cea572 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:36.856051 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0977154a-c6ac-4114-a747-7222c3cea572 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042544 Jul 27 20:29:36.856591 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 947/1881] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:36 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:37.824124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7d681ffb-2cc7-496a-a96e-3310390be88a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:37.826386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7d681ffb-2cc7-496a-a96e-3310390be88a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:37.833223 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d681ffb-2cc7-496a-a96e-3310390be88a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:37.833671 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d681ffb-2cc7-496a-a96e-3310390be88a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:37.834433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d681ffb-2cc7-496a-a96e-3310390be88a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:37.834870 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d681ffb-2cc7-496a-a96e-3310390be88a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:37.836852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b90da97f-593e-4c35-8f7f-5959e756e234 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:37.837497 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b90da97f-593e-4c35-8f7f-5959e756e234 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:37.844379 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b90da97f-593e-4c35-8f7f-5959e756e234 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:37.844829 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b90da97f-593e-4c35-8f7f-5959e756e234 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:37.845619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b90da97f-593e-4c35-8f7f-5959e756e234 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:37.846064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b90da97f-593e-4c35-8f7f-5959e756e234 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:37.864872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7d681ffb-2cc7-496a-a96e-3310390be88a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044734 Jul 27 20:29:37.865467 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 935/1882] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:37 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:37.869990 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f80f27aa-0a00-4bcb-bd86-0cd7a5eb2bae tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:37.872117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f80f27aa-0a00-4bcb-bd86-0cd7a5eb2bae tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:37.878010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f80f27aa-0a00-4bcb-bd86-0cd7a5eb2bae tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:37.878462 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f80f27aa-0a00-4bcb-bd86-0cd7a5eb2bae tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:37.879228 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f80f27aa-0a00-4bcb-bd86-0cd7a5eb2bae tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:37.879664 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f80f27aa-0a00-4bcb-bd86-0cd7a5eb2bae tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:37.907910 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b90da97f-593e-4c35-8f7f-5959e756e234 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:37.910283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f80f27aa-0a00-4bcb-bd86-0cd7a5eb2bae tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043797 Jul 27 20:29:37.910856 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 936/1883] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:37 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:37.915450 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b90da97f-593e-4c35-8f7f-5959e756e234 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082330 Jul 27 20:29:37.916003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 948/1884] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:37 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:29:38.877665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cf95dcaf-d9ef-4f39-aef0-6e37c733c55e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:38.879777 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cf95dcaf-d9ef-4f39-aef0-6e37c733c55e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:38.885724 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cf95dcaf-d9ef-4f39-aef0-6e37c733c55e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:38.886169 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cf95dcaf-d9ef-4f39-aef0-6e37c733c55e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:38.886925 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cf95dcaf-d9ef-4f39-aef0-6e37c733c55e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:38.887360 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cf95dcaf-d9ef-4f39-aef0-6e37c733c55e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:38.915896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cf95dcaf-d9ef-4f39-aef0-6e37c733c55e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042794 Jul 27 20:29:38.916440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 937/1885] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:38 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:38.922471 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-202e6c62-06c7-4d9b-b698-473e75578730 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:38.924595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-202e6c62-06c7-4d9b-b698-473e75578730 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:38.931124 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-202e6c62-06c7-4d9b-b698-473e75578730 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:38.931576 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-202e6c62-06c7-4d9b-b698-473e75578730 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:38.932343 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-202e6c62-06c7-4d9b-b698-473e75578730 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:38.932782 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-202e6c62-06c7-4d9b-b698-473e75578730 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:38.935342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-706172f1-4374-40c2-a114-d7a50553f43d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:38.935983 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-706172f1-4374-40c2-a114-d7a50553f43d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:38.941962 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-706172f1-4374-40c2-a114-d7a50553f43d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:38.942414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-706172f1-4374-40c2-a114-d7a50553f43d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:38.943183 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-706172f1-4374-40c2-a114-d7a50553f43d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:38.943625 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-706172f1-4374-40c2-a114-d7a50553f43d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:38.962186 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-202e6c62-06c7-4d9b-b698-473e75578730 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044215 Jul 27 20:29:38.962745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 949/1886] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:38 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:39.005694 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-706172f1-4374-40c2-a114-d7a50553f43d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:39.013253 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-706172f1-4374-40c2-a114-d7a50553f43d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081613 Jul 27 20:29:39.014349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 938/1887] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:38 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:29:39.928626 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fb22b934-68eb-43a4-8a64-b8cc790334d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:39.930830 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fb22b934-68eb-43a4-8a64-b8cc790334d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:39.937577 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fb22b934-68eb-43a4-8a64-b8cc790334d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:39.938037 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fb22b934-68eb-43a4-8a64-b8cc790334d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:39.938807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fb22b934-68eb-43a4-8a64-b8cc790334d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:39.939250 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fb22b934-68eb-43a4-8a64-b8cc790334d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:39.968881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fb22b934-68eb-43a4-8a64-b8cc790334d3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044268 Jul 27 20:29:39.969465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 950/1888] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:39 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:39.974488 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b3aec225-3fbc-4fc6-b97f-8717df629e62 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:39.976633 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b3aec225-3fbc-4fc6-b97f-8717df629e62 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:39.983220 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3aec225-3fbc-4fc6-b97f-8717df629e62 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:39.983670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3aec225-3fbc-4fc6-b97f-8717df629e62 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:39.984437 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3aec225-3fbc-4fc6-b97f-8717df629e62 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:39.984874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3aec225-3fbc-4fc6-b97f-8717df629e62 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:40.012945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b3aec225-3fbc-4fc6-b97f-8717df629e62 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042331 Jul 27 20:29:40.013519 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 939/1889] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:39 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:40.034942 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7ab68c0b-6a25-4187-bb6c-e4719fd0c3c3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:40.035564 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7ab68c0b-6a25-4187-bb6c-e4719fd0c3c3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:40.041640 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7ab68c0b-6a25-4187-bb6c-e4719fd0c3c3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:40.042092 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7ab68c0b-6a25-4187-bb6c-e4719fd0c3c3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:40.042861 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7ab68c0b-6a25-4187-bb6c-e4719fd0c3c3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:40.043306 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7ab68c0b-6a25-4187-bb6c-e4719fd0c3c3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:40.104407 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7ab68c0b-6a25-4187-bb6c-e4719fd0c3c3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:40.112506 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7ab68c0b-6a25-4187-bb6c-e4719fd0c3c3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081406 Jul 27 20:29:40.113096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 951/1890] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:40 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:40.981067 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c47a65d0-3acc-4ee5-8a29-c14e26c804c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:40.983218 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c47a65d0-3acc-4ee5-8a29-c14e26c804c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:40.989838 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c47a65d0-3acc-4ee5-8a29-c14e26c804c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:40.990283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c47a65d0-3acc-4ee5-8a29-c14e26c804c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:40.991043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c47a65d0-3acc-4ee5-8a29-c14e26c804c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:40.991478 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c47a65d0-3acc-4ee5-8a29-c14e26c804c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:41.021091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c47a65d0-3acc-4ee5-8a29-c14e26c804c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044008 Jul 27 20:29:41.021648 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 940/1891] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:40 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:41.024971 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7a61916a-581a-4013-9903-77f2fee66a7c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:41.027409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7a61916a-581a-4013-9903-77f2fee66a7c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:41.033665 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7a61916a-581a-4013-9903-77f2fee66a7c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:41.034119 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7a61916a-581a-4013-9903-77f2fee66a7c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:41.034888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7a61916a-581a-4013-9903-77f2fee66a7c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:41.035328 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7a61916a-581a-4013-9903-77f2fee66a7c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:41.065505 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7a61916a-581a-4013-9903-77f2fee66a7c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044313 Jul 27 20:29:41.066073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 952/1892] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:41 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:29:41.134468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fa4e8a0b-323a-46fd-bd95-28e782dd71d9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:41.135087 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fa4e8a0b-323a-46fd-bd95-28e782dd71d9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:41.141995 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fa4e8a0b-323a-46fd-bd95-28e782dd71d9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:41.142449 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fa4e8a0b-323a-46fd-bd95-28e782dd71d9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:41.143206 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fa4e8a0b-323a-46fd-bd95-28e782dd71d9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:41.143642 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fa4e8a0b-323a-46fd-bd95-28e782dd71d9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:41.203972 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fa4e8a0b-323a-46fd-bd95-28e782dd71d9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:41.211448 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fa4e8a0b-323a-46fd-bd95-28e782dd71d9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081391 Jul 27 20:29:41.212020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 941/1893] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:41 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:42.033850 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-80052121-945d-421d-8028-515dd21d0e68 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:42.036021 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-80052121-945d-421d-8028-515dd21d0e68 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:42.042820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-80052121-945d-421d-8028-515dd21d0e68 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:42.043280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-80052121-945d-421d-8028-515dd21d0e68 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:42.044054 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-80052121-945d-421d-8028-515dd21d0e68 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:42.044500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-80052121-945d-421d-8028-515dd21d0e68 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:42.072835 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-80052121-945d-421d-8028-515dd21d0e68 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043479 Jul 27 20:29:42.073614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 953/1894] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:42 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:42.079676 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f5d37cc1-460a-4225-b0ac-2fc4825b7f95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:42.081877 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f5d37cc1-460a-4225-b0ac-2fc4825b7f95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:42.088446 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f5d37cc1-460a-4225-b0ac-2fc4825b7f95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:42.088901 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f5d37cc1-460a-4225-b0ac-2fc4825b7f95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:42.089714 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f5d37cc1-460a-4225-b0ac-2fc4825b7f95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:42.090155 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f5d37cc1-460a-4225-b0ac-2fc4825b7f95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:42.119495 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f5d37cc1-460a-4225-b0ac-2fc4825b7f95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044652 Jul 27 20:29:42.120040 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 942/1895] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:42 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:42.232319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c846626e-01f8-4c73-ac33-21adb282da9d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:42.233441 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c846626e-01f8-4c73-ac33-21adb282da9d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:42.239468 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c846626e-01f8-4c73-ac33-21adb282da9d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:42.239918 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c846626e-01f8-4c73-ac33-21adb282da9d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:42.240681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c846626e-01f8-4c73-ac33-21adb282da9d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:42.241148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c846626e-01f8-4c73-ac33-21adb282da9d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:42.305262 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c846626e-01f8-4c73-ac33-21adb282da9d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:42.313028 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c846626e-01f8-4c73-ac33-21adb282da9d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084594 Jul 27 20:29:42.313583 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 954/1896] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:42 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:43.085342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-87c8dc36-4544-4dad-b84b-351f897324b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:43.087526 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-87c8dc36-4544-4dad-b84b-351f897324b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:43.094827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87c8dc36-4544-4dad-b84b-351f897324b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:43.095281 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87c8dc36-4544-4dad-b84b-351f897324b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:43.096068 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87c8dc36-4544-4dad-b84b-351f897324b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:43.096512 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87c8dc36-4544-4dad-b84b-351f897324b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:43.126562 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-87c8dc36-4544-4dad-b84b-351f897324b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045172 Jul 27 20:29:43.127117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 943/1897] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:43 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:43.132182 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-48455689-fd2e-40df-9f39-b9da4f23aae1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:43.134351 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-48455689-fd2e-40df-9f39-b9da4f23aae1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:43.141113 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48455689-fd2e-40df-9f39-b9da4f23aae1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:43.141562 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48455689-fd2e-40df-9f39-b9da4f23aae1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:43.142325 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48455689-fd2e-40df-9f39-b9da4f23aae1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:43.142767 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48455689-fd2e-40df-9f39-b9da4f23aae1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:43.173461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-48455689-fd2e-40df-9f39-b9da4f23aae1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045179 Jul 27 20:29:43.174061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 955/1898] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:43 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:29:43.333778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-701c0aaf-e872-4211-b92f-14cd27fed299 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:43.334326 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-701c0aaf-e872-4211-b92f-14cd27fed299 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:43.340313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-701c0aaf-e872-4211-b92f-14cd27fed299 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:43.340755 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-701c0aaf-e872-4211-b92f-14cd27fed299 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:43.341891 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-701c0aaf-e872-4211-b92f-14cd27fed299 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:43.342326 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-701c0aaf-e872-4211-b92f-14cd27fed299 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:43.403994 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-701c0aaf-e872-4211-b92f-14cd27fed299 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:43.407888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:29:43.412895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-701c0aaf-e872-4211-b92f-14cd27fed299 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083057 Jul 27 20:29:43.413489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 944/1899] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:43 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:44.138247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f84eccf9-6262-429d-b88f-0f33e1979334 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:44.141150 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f84eccf9-6262-429d-b88f-0f33e1979334 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:44.147619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f84eccf9-6262-429d-b88f-0f33e1979334 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:44.148072 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f84eccf9-6262-429d-b88f-0f33e1979334 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:44.148837 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f84eccf9-6262-429d-b88f-0f33e1979334 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:44.149303 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f84eccf9-6262-429d-b88f-0f33e1979334 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:44.177034 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f84eccf9-6262-429d-b88f-0f33e1979334 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042807 Jul 27 20:29:44.177586 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 956/1900] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:44 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:44.185994 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e6539027-f814-4025-9fcc-1619aaa0dcb4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:44.188802 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e6539027-f814-4025-9fcc-1619aaa0dcb4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:44.195415 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e6539027-f814-4025-9fcc-1619aaa0dcb4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:44.195864 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e6539027-f814-4025-9fcc-1619aaa0dcb4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:44.196628 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e6539027-f814-4025-9fcc-1619aaa0dcb4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:44.197103 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e6539027-f814-4025-9fcc-1619aaa0dcb4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:44.228701 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e6539027-f814-4025-9fcc-1619aaa0dcb4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046652 Jul 27 20:29:44.229294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 945/1901] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:44 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:44.433196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-78648cac-51b8-4ff9-a649-f78388927c1e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:44.433816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-78648cac-51b8-4ff9-a649-f78388927c1e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:44.440374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-78648cac-51b8-4ff9-a649-f78388927c1e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:44.440831 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-78648cac-51b8-4ff9-a649-f78388927c1e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:44.441650 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-78648cac-51b8-4ff9-a649-f78388927c1e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:44.442096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-78648cac-51b8-4ff9-a649-f78388927c1e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:44.504452 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-78648cac-51b8-4ff9-a649-f78388927c1e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:44.512417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-78648cac-51b8-4ff9-a649-f78388927c1e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082713 Jul 27 20:29:44.512987 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 957/1902] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:44 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:45.189081 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f03da6d8-f5af-4df7-8026-3b847384f657 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:45.191211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f03da6d8-f5af-4df7-8026-3b847384f657 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:45.197554 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f03da6d8-f5af-4df7-8026-3b847384f657 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:45.197991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f03da6d8-f5af-4df7-8026-3b847384f657 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:45.198741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f03da6d8-f5af-4df7-8026-3b847384f657 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:45.199169 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f03da6d8-f5af-4df7-8026-3b847384f657 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:45.228534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f03da6d8-f5af-4df7-8026-3b847384f657 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043535 Jul 27 20:29:45.229097 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 946/1903] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:45 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:45.241880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ab0de959-2a64-47fc-a1cc-bfb259c56ab5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:45.244030 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ab0de959-2a64-47fc-a1cc-bfb259c56ab5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:45.250607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ab0de959-2a64-47fc-a1cc-bfb259c56ab5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:45.251064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ab0de959-2a64-47fc-a1cc-bfb259c56ab5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:45.251843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ab0de959-2a64-47fc-a1cc-bfb259c56ab5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:45.252285 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ab0de959-2a64-47fc-a1cc-bfb259c56ab5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:45.269946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:29:45.284001 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ab0de959-2a64-47fc-a1cc-bfb259c56ab5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046191 Jul 27 20:29:45.284553 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 958/1904] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:45 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:45.532935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3474e667-d15b-4d48-a55f-cc83ba3cb755 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:45.533569 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3474e667-d15b-4d48-a55f-cc83ba3cb755 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:45.539535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3474e667-d15b-4d48-a55f-cc83ba3cb755 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:45.539986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3474e667-d15b-4d48-a55f-cc83ba3cb755 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:45.540749 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3474e667-d15b-4d48-a55f-cc83ba3cb755 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:45.541219 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3474e667-d15b-4d48-a55f-cc83ba3cb755 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:45.603935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3474e667-d15b-4d48-a55f-cc83ba3cb755 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:45.611422 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3474e667-d15b-4d48-a55f-cc83ba3cb755 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082385 Jul 27 20:29:45.612062 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 947/1905] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:45 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:46.244508 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ad0327c1-3e62-4ac8-b2cb-b7ebb0df68c4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:46.246745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ad0327c1-3e62-4ac8-b2cb-b7ebb0df68c4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:46.254104 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ad0327c1-3e62-4ac8-b2cb-b7ebb0df68c4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:46.254771 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ad0327c1-3e62-4ac8-b2cb-b7ebb0df68c4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:46.255545 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ad0327c1-3e62-4ac8-b2cb-b7ebb0df68c4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:46.255995 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ad0327c1-3e62-4ac8-b2cb-b7ebb0df68c4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:46.285341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ad0327c1-3e62-4ac8-b2cb-b7ebb0df68c4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047117 Jul 27 20:29:46.285894 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 959/1906] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:46 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:46.296288 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-55df552b-78ae-4490-af18-a632354b09ef tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:46.298469 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-55df552b-78ae-4490-af18-a632354b09ef tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:46.304862 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55df552b-78ae-4490-af18-a632354b09ef tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:46.305338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55df552b-78ae-4490-af18-a632354b09ef tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:46.306100 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55df552b-78ae-4490-af18-a632354b09ef tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:46.306528 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55df552b-78ae-4490-af18-a632354b09ef tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:46.335331 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-55df552b-78ae-4490-af18-a632354b09ef tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043509 Jul 27 20:29:46.335809 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 948/1907] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:46 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:46.632779 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6c8aa1fd-b2fa-4d50-9019-a7246fb72a76 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:46.633348 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6c8aa1fd-b2fa-4d50-9019-a7246fb72a76 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:46.639880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6c8aa1fd-b2fa-4d50-9019-a7246fb72a76 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:46.640561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6c8aa1fd-b2fa-4d50-9019-a7246fb72a76 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:46.641357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6c8aa1fd-b2fa-4d50-9019-a7246fb72a76 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:46.641803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6c8aa1fd-b2fa-4d50-9019-a7246fb72a76 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:46.701023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6c8aa1fd-b2fa-4d50-9019-a7246fb72a76 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:46.709637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6c8aa1fd-b2fa-4d50-9019-a7246fb72a76 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080804 Jul 27 20:29:46.710189 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 960/1908] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:46 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:47.297481 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-29ef5fef-3fce-49e8-b304-123d85ea4562 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:47.299600 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-29ef5fef-3fce-49e8-b304-123d85ea4562 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:47.306891 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-29ef5fef-3fce-49e8-b304-123d85ea4562 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:47.307342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-29ef5fef-3fce-49e8-b304-123d85ea4562 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:47.308105 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-29ef5fef-3fce-49e8-b304-123d85ea4562 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:47.308538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-29ef5fef-3fce-49e8-b304-123d85ea4562 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:47.338061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-29ef5fef-3fce-49e8-b304-123d85ea4562 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044451 Jul 27 20:29:47.338537 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 949/1909] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:47 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:47.348052 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-34c98f0a-2753-4de6-9908-76e17b70011c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:47.350238 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-34c98f0a-2753-4de6-9908-76e17b70011c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:47.356780 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-34c98f0a-2753-4de6-9908-76e17b70011c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:47.357265 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-34c98f0a-2753-4de6-9908-76e17b70011c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:47.358035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-34c98f0a-2753-4de6-9908-76e17b70011c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:47.358763 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-34c98f0a-2753-4de6-9908-76e17b70011c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:47.387015 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-34c98f0a-2753-4de6-9908-76e17b70011c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042923 Jul 27 20:29:47.387579 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 961/1910] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:47 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:47.731245 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-838d25c3-44d9-433b-b857-ad31aa96e5aa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:47.731849 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-838d25c3-44d9-433b-b857-ad31aa96e5aa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:47.738516 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-838d25c3-44d9-433b-b857-ad31aa96e5aa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:47.738954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-838d25c3-44d9-433b-b857-ad31aa96e5aa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:47.739705 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-838d25c3-44d9-433b-b857-ad31aa96e5aa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:47.740132 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-838d25c3-44d9-433b-b857-ad31aa96e5aa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:47.799594 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-838d25c3-44d9-433b-b857-ad31aa96e5aa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:47.807078 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-838d25c3-44d9-433b-b857-ad31aa96e5aa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.079707 Jul 27 20:29:47.807634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 950/1911] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:47 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:48.350507 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d34905a3-3cde-473f-a566-07b6167a9044 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:48.352854 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d34905a3-3cde-473f-a566-07b6167a9044 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:48.359312 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d34905a3-3cde-473f-a566-07b6167a9044 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:48.359759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d34905a3-3cde-473f-a566-07b6167a9044 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:48.360519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d34905a3-3cde-473f-a566-07b6167a9044 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:48.360978 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d34905a3-3cde-473f-a566-07b6167a9044 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:48.388943 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d34905a3-3cde-473f-a566-07b6167a9044 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042489 Jul 27 20:29:48.390134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 962/1912] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:48 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:48.399762 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5b910b61-7634-40a4-bd5c-a8036f1a5935 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:48.402010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5b910b61-7634-40a4-bd5c-a8036f1a5935 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:48.409132 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b910b61-7634-40a4-bd5c-a8036f1a5935 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:48.409586 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b910b61-7634-40a4-bd5c-a8036f1a5935 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:48.410357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b910b61-7634-40a4-bd5c-a8036f1a5935 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:48.410795 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b910b61-7634-40a4-bd5c-a8036f1a5935 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:48.439730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5b910b61-7634-40a4-bd5c-a8036f1a5935 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043941 Jul 27 20:29:48.440279 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 951/1913] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:48 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:48.828761 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-74d3c26a-e996-4fb7-b5a1-58386bcbfdfe tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:48.829386 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-74d3c26a-e996-4fb7-b5a1-58386bcbfdfe tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:48.835307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-74d3c26a-e996-4fb7-b5a1-58386bcbfdfe tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:48.835752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-74d3c26a-e996-4fb7-b5a1-58386bcbfdfe tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:48.836504 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-74d3c26a-e996-4fb7-b5a1-58386bcbfdfe tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:48.836952 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-74d3c26a-e996-4fb7-b5a1-58386bcbfdfe tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:48.896638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-74d3c26a-e996-4fb7-b5a1-58386bcbfdfe tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:48.904097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-74d3c26a-e996-4fb7-b5a1-58386bcbfdfe tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.079981 Jul 27 20:29:48.904665 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 963/1914] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:48 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:49.401746 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5934894e-585e-4577-8963-dc3028790ec0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:49.403893 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5934894e-585e-4577-8963-dc3028790ec0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:49.410350 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5934894e-585e-4577-8963-dc3028790ec0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:49.410792 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5934894e-585e-4577-8963-dc3028790ec0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:49.411549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5934894e-585e-4577-8963-dc3028790ec0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:49.411982 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5934894e-585e-4577-8963-dc3028790ec0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:49.442382 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5934894e-585e-4577-8963-dc3028790ec0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044591 Jul 27 20:29:49.442948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 952/1915] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:49 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:49.452296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d262dca9-0a68-4471-b9ea-9305c5646793 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:49.454495 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d262dca9-0a68-4471-b9ea-9305c5646793 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:49.461325 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d262dca9-0a68-4471-b9ea-9305c5646793 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:49.461773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d262dca9-0a68-4471-b9ea-9305c5646793 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:49.462546 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d262dca9-0a68-4471-b9ea-9305c5646793 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:49.462998 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d262dca9-0a68-4471-b9ea-9305c5646793 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:49.493146 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d262dca9-0a68-4471-b9ea-9305c5646793 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045346 Jul 27 20:29:49.493705 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 964/1916] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:49 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:49.924786 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4f3aa4ff-2bf7-4584-98a4-be72a5a14035 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:49.925421 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4f3aa4ff-2bf7-4584-98a4-be72a5a14035 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:49.931310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4f3aa4ff-2bf7-4584-98a4-be72a5a14035 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:49.931750 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4f3aa4ff-2bf7-4584-98a4-be72a5a14035 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:49.932498 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4f3aa4ff-2bf7-4584-98a4-be72a5a14035 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:49.932927 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4f3aa4ff-2bf7-4584-98a4-be72a5a14035 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:49.992631 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4f3aa4ff-2bf7-4584-98a4-be72a5a14035 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:50.000166 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4f3aa4ff-2bf7-4584-98a4-be72a5a14035 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.079211 Jul 27 20:29:50.000722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 953/1917] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:49 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:50.455472 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ac0af4cc-dfc6-4b7e-9983-06c9e4ff74f9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:50.457666 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ac0af4cc-dfc6-4b7e-9983-06c9e4ff74f9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:50.464173 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ac0af4cc-dfc6-4b7e-9983-06c9e4ff74f9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:50.464629 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ac0af4cc-dfc6-4b7e-9983-06c9e4ff74f9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:50.465431 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ac0af4cc-dfc6-4b7e-9983-06c9e4ff74f9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:50.465876 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ac0af4cc-dfc6-4b7e-9983-06c9e4ff74f9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:50.495531 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ac0af4cc-dfc6-4b7e-9983-06c9e4ff74f9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044528 Jul 27 20:29:50.496082 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 965/1918] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:50 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:50.505681 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f1feee23-5e27-460c-b78f-db5c7b647e28 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:50.507832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f1feee23-5e27-460c-b78f-db5c7b647e28 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:50.514239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1feee23-5e27-460c-b78f-db5c7b647e28 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:50.514682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1feee23-5e27-460c-b78f-db5c7b647e28 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:50.515447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1feee23-5e27-460c-b78f-db5c7b647e28 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:50.515886 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1feee23-5e27-460c-b78f-db5c7b647e28 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:50.544416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f1feee23-5e27-460c-b78f-db5c7b647e28 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042997 Jul 27 20:29:50.544973 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 954/1919] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:50 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:51.021068 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2a4f2a1a-3b4e-45cf-acb3-6c7f6d0d4030 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:51.021677 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2a4f2a1a-3b4e-45cf-acb3-6c7f6d0d4030 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:51.027637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2a4f2a1a-3b4e-45cf-acb3-6c7f6d0d4030 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:51.028082 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2a4f2a1a-3b4e-45cf-acb3-6c7f6d0d4030 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:51.028833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2a4f2a1a-3b4e-45cf-acb3-6c7f6d0d4030 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:51.029294 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2a4f2a1a-3b4e-45cf-acb3-6c7f6d0d4030 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:51.093000 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2a4f2a1a-3b4e-45cf-acb3-6c7f6d0d4030 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:51.100521 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2a4f2a1a-3b4e-45cf-acb3-6c7f6d0d4030 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083345 Jul 27 20:29:51.101096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 966/1920] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:51 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:51.507875 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2e2509f5-3133-4d6a-b808-c0b86439e685 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:51.510062 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2e2509f5-3133-4d6a-b808-c0b86439e685 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:51.516551 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e2509f5-3133-4d6a-b808-c0b86439e685 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:51.517017 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e2509f5-3133-4d6a-b808-c0b86439e685 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:51.517772 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e2509f5-3133-4d6a-b808-c0b86439e685 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:51.518200 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e2509f5-3133-4d6a-b808-c0b86439e685 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:51.546583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2e2509f5-3133-4d6a-b808-c0b86439e685 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042551 Jul 27 20:29:51.547112 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 955/1921] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:51 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:51.557637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-aa8241a6-25e3-4b89-bb3d-467fa2ecee3f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:51.559817 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-aa8241a6-25e3-4b89-bb3d-467fa2ecee3f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:51.567010 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aa8241a6-25e3-4b89-bb3d-467fa2ecee3f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:51.567462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aa8241a6-25e3-4b89-bb3d-467fa2ecee3f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:51.568226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aa8241a6-25e3-4b89-bb3d-467fa2ecee3f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:51.568664 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aa8241a6-25e3-4b89-bb3d-467fa2ecee3f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:51.597666 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-aa8241a6-25e3-4b89-bb3d-467fa2ecee3f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043921 Jul 27 20:29:51.598213 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 967/1922] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:51 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:52.120819 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fe58e084-e57b-4455-bad3-46875efec9e3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:52.121472 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fe58e084-e57b-4455-bad3-46875efec9e3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:52.127740 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe58e084-e57b-4455-bad3-46875efec9e3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:52.128192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe58e084-e57b-4455-bad3-46875efec9e3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:52.128954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe58e084-e57b-4455-bad3-46875efec9e3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:52.129419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe58e084-e57b-4455-bad3-46875efec9e3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:52.189037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fe58e084-e57b-4455-bad3-46875efec9e3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:52.196373 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fe58e084-e57b-4455-bad3-46875efec9e3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.079354 Jul 27 20:29:52.196982 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 956/1923] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:52 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:52.558524 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-10c93045-8b00-49f4-ae23-58f7e060caba tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:52.560759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-10c93045-8b00-49f4-ae23-58f7e060caba tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:52.567920 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-10c93045-8b00-49f4-ae23-58f7e060caba tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:52.568362 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-10c93045-8b00-49f4-ae23-58f7e060caba tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:52.569153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-10c93045-8b00-49f4-ae23-58f7e060caba tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:52.569590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-10c93045-8b00-49f4-ae23-58f7e060caba tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:52.598958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-10c93045-8b00-49f4-ae23-58f7e060caba tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044343 Jul 27 20:29:52.599509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 968/1924] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:52 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:52.610633 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8d49c27d-d45d-496b-99f2-c080a2189315 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:52.612811 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8d49c27d-d45d-496b-99f2-c080a2189315 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:52.620035 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d49c27d-d45d-496b-99f2-c080a2189315 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:52.620489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d49c27d-d45d-496b-99f2-c080a2189315 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:52.621278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d49c27d-d45d-496b-99f2-c080a2189315 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:52.621714 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d49c27d-d45d-496b-99f2-c080a2189315 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:52.650243 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8d49c27d-d45d-496b-99f2-c080a2189315 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044298 Jul 27 20:29:52.650795 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 957/1925] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:52 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:53.218005 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-96e741f1-ce4d-4187-8771-df808cc0ad94 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:53.218765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-96e741f1-ce4d-4187-8771-df808cc0ad94 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:53.224812 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-96e741f1-ce4d-4187-8771-df808cc0ad94 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:53.225368 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-96e741f1-ce4d-4187-8771-df808cc0ad94 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:53.227137 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-96e741f1-ce4d-4187-8771-df808cc0ad94 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:53.227580 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-96e741f1-ce4d-4187-8771-df808cc0ad94 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:53.287896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-96e741f1-ce4d-4187-8771-df808cc0ad94 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:53.295451 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-96e741f1-ce4d-4187-8771-df808cc0ad94 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081778 Jul 27 20:29:53.296606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 969/1926] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:53 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:53.611108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-92e6622c-5cbf-4794-856a-df7df2df4672 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:53.613347 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-92e6622c-5cbf-4794-856a-df7df2df4672 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:53.619555 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-92e6622c-5cbf-4794-856a-df7df2df4672 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:53.620008 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-92e6622c-5cbf-4794-856a-df7df2df4672 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:53.620812 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-92e6622c-5cbf-4794-856a-df7df2df4672 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:53.621287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-92e6622c-5cbf-4794-856a-df7df2df4672 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:53.656943 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-92e6622c-5cbf-4794-856a-df7df2df4672 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050262 Jul 27 20:29:53.657518 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 958/1927] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:53 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:53.663710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-00216618-3c05-43b8-b1ed-f1d90e7cb889 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:53.666483 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-00216618-3c05-43b8-b1ed-f1d90e7cb889 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:53.673184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00216618-3c05-43b8-b1ed-f1d90e7cb889 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:53.673568 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00216618-3c05-43b8-b1ed-f1d90e7cb889 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:53.674329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00216618-3c05-43b8-b1ed-f1d90e7cb889 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:53.674762 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00216618-3c05-43b8-b1ed-f1d90e7cb889 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:53.704330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-00216618-3c05-43b8-b1ed-f1d90e7cb889 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044984 Jul 27 20:29:53.704899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 970/1928] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:53 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:54.316930 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-323d4607-40fb-49a1-b5c7-44ab870db3da tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:54.317653 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-323d4607-40fb-49a1-b5c7-44ab870db3da tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:54.324115 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-323d4607-40fb-49a1-b5c7-44ab870db3da tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:54.324567 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-323d4607-40fb-49a1-b5c7-44ab870db3da tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:54.325369 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-323d4607-40fb-49a1-b5c7-44ab870db3da tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:54.325874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-323d4607-40fb-49a1-b5c7-44ab870db3da tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:54.395700 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-323d4607-40fb-49a1-b5c7-44ab870db3da tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:54.404431 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-323d4607-40fb-49a1-b5c7-44ab870db3da tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.091987 Jul 27 20:29:54.405066 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 959/1929] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:54 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:54.669933 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-911b7b5b-16bf-4fdb-a8dc-f37a5a1f4fc3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:54.672815 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-911b7b5b-16bf-4fdb-a8dc-f37a5a1f4fc3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:54.675165 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=86 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:29:54.680531 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-911b7b5b-16bf-4fdb-a8dc-f37a5a1f4fc3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:54.681002 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-911b7b5b-16bf-4fdb-a8dc-f37a5a1f4fc3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:54.681790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-911b7b5b-16bf-4fdb-a8dc-f37a5a1f4fc3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:54.682250 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-911b7b5b-16bf-4fdb-a8dc-f37a5a1f4fc3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:54.711808 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-911b7b5b-16bf-4fdb-a8dc-f37a5a1f4fc3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045782 Jul 27 20:29:54.712360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 971/1930] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:54 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:54.716557 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f103e749-426a-4b5f-9a0b-45b062dbefd0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:54.719497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f103e749-426a-4b5f-9a0b-45b062dbefd0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:54.726525 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f103e749-426a-4b5f-9a0b-45b062dbefd0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:54.727300 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f103e749-426a-4b5f-9a0b-45b062dbefd0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:54.728078 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f103e749-426a-4b5f-9a0b-45b062dbefd0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:54.728523 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f103e749-426a-4b5f-9a0b-45b062dbefd0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:54.759170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f103e749-426a-4b5f-9a0b-45b062dbefd0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046592 Jul 27 20:29:54.759717 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 960/1931] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:54 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:29:55.427885 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-317c80f2-272b-415d-abcd-32e2dd934019 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:55.428426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-317c80f2-272b-415d-abcd-32e2dd934019 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:55.434465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-317c80f2-272b-415d-abcd-32e2dd934019 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:55.434922 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-317c80f2-272b-415d-abcd-32e2dd934019 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:55.435689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-317c80f2-272b-415d-abcd-32e2dd934019 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:55.436263 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-317c80f2-272b-415d-abcd-32e2dd934019 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:55.498230 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-317c80f2-272b-415d-abcd-32e2dd934019 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:55.506363 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-317c80f2-272b-415d-abcd-32e2dd934019 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082512 Jul 27 20:29:55.506929 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 972/1932] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:55 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:55.724004 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0dca192c-8ee0-4e34-be20-47900d3c30b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:55.726092 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0dca192c-8ee0-4e34-be20-47900d3c30b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:55.728380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=86 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:29:55.733789 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0dca192c-8ee0-4e34-be20-47900d3c30b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:55.734237 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0dca192c-8ee0-4e34-be20-47900d3c30b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:55.735004 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0dca192c-8ee0-4e34-be20-47900d3c30b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:55.735443 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0dca192c-8ee0-4e34-be20-47900d3c30b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:55.752305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:29:55.765825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0dca192c-8ee0-4e34-be20-47900d3c30b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045849 Jul 27 20:29:55.766668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 961/1933] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:55 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:55.771796 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1dacf666-19bb-4efd-af8d-b6b007eff127 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:55.774257 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1dacf666-19bb-4efd-af8d-b6b007eff127 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:55.781090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1dacf666-19bb-4efd-af8d-b6b007eff127 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:55.781541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1dacf666-19bb-4efd-af8d-b6b007eff127 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:55.782305 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1dacf666-19bb-4efd-af8d-b6b007eff127 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:55.782743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1dacf666-19bb-4efd-af8d-b6b007eff127 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:55.811678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1dacf666-19bb-4efd-af8d-b6b007eff127 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043317 Jul 27 20:29:55.812304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 973/1934] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:55 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:29:56.526692 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-28be2772-a6de-40ae-abc6-a3e3ef7ed074 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:56.527320 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-28be2772-a6de-40ae-abc6-a3e3ef7ed074 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:56.536058 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28be2772-a6de-40ae-abc6-a3e3ef7ed074 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:56.536505 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28be2772-a6de-40ae-abc6-a3e3ef7ed074 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:56.537285 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28be2772-a6de-40ae-abc6-a3e3ef7ed074 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:56.537720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28be2772-a6de-40ae-abc6-a3e3ef7ed074 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:56.778184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6e317db9-7656-4c1f-a490-9994fc95a055 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:56.780272 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6e317db9-7656-4c1f-a490-9994fc95a055 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:56.786906 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6e317db9-7656-4c1f-a490-9994fc95a055 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:56.787360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6e317db9-7656-4c1f-a490-9994fc95a055 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:56.788133 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6e317db9-7656-4c1f-a490-9994fc95a055 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:56.788572 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6e317db9-7656-4c1f-a490-9994fc95a055 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:56.820370 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6e317db9-7656-4c1f-a490-9994fc95a055 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046158 Jul 27 20:29:56.821291 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 974/1935] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:56 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:29:56.823296 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-28be2772-a6de-40ae-abc6-a3e3ef7ed074 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:56.825697 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-79d11be4-4be6-47a0-88c9-da00d8f42133 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:56.828342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-79d11be4-4be6-47a0-88c9-da00d8f42133 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:56.831618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-28be2772-a6de-40ae-abc6-a3e3ef7ed074 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.308681 Jul 27 20:29:56.832183 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 962/1936] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:56 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:29:56.834550 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-79d11be4-4be6-47a0-88c9-da00d8f42133 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:56.835005 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-79d11be4-4be6-47a0-88c9-da00d8f42133 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:56.835781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-79d11be4-4be6-47a0-88c9-da00d8f42133 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:56.836223 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-79d11be4-4be6-47a0-88c9-da00d8f42133 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:56.839827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:29:56.865747 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-79d11be4-4be6-47a0-88c9-da00d8f42133 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043797 Jul 27 20:29:56.866300 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 975/1937] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:56 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:57.833065 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ee57ce6e-eea8-4387-aa5f-932004c470e7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:57.835146 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ee57ce6e-eea8-4387-aa5f-932004c470e7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:57.841372 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee57ce6e-eea8-4387-aa5f-932004c470e7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:57.841811 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee57ce6e-eea8-4387-aa5f-932004c470e7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:57.843066 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee57ce6e-eea8-4387-aa5f-932004c470e7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:57.843778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee57ce6e-eea8-4387-aa5f-932004c470e7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:57.851132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-506d4d0b-0a4d-4f50-a9b9-66558dfb8c2e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:57.851864 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-506d4d0b-0a4d-4f50-a9b9-66558dfb8c2e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:57.859055 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-506d4d0b-0a4d-4f50-a9b9-66558dfb8c2e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:57.859511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-506d4d0b-0a4d-4f50-a9b9-66558dfb8c2e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:57.860277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-506d4d0b-0a4d-4f50-a9b9-66558dfb8c2e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:57.860716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-506d4d0b-0a4d-4f50-a9b9-66558dfb8c2e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:57.876758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ee57ce6e-eea8-4387-aa5f-932004c470e7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047916 Jul 27 20:29:57.877349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 963/1938] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:57 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:57.881901 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4073cba2-ffb0-4bce-b079-e2963b96e40a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:57.884004 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4073cba2-ffb0-4bce-b079-e2963b96e40a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:57.890155 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4073cba2-ffb0-4bce-b079-e2963b96e40a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:57.890600 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4073cba2-ffb0-4bce-b079-e2963b96e40a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:57.891357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4073cba2-ffb0-4bce-b079-e2963b96e40a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:57.891784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4073cba2-ffb0-4bce-b079-e2963b96e40a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:57.921474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4073cba2-ffb0-4bce-b079-e2963b96e40a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042571 Jul 27 20:29:57.921638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-506d4d0b-0a4d-4f50-a9b9-66558dfb8c2e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:57.922040 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 964/1939] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:57 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:29:57.929192 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-506d4d0b-0a4d-4f50-a9b9-66558dfb8c2e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081881 Jul 27 20:29:57.929768 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 976/1940] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:57 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:29:58.889359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4da95c56-9ed6-49a4-af1d-92204fb3362e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:58.891577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4da95c56-9ed6-49a4-af1d-92204fb3362e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:58.898447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4da95c56-9ed6-49a4-af1d-92204fb3362e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:58.898895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4da95c56-9ed6-49a4-af1d-92204fb3362e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:58.899665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4da95c56-9ed6-49a4-af1d-92204fb3362e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:58.900102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4da95c56-9ed6-49a4-af1d-92204fb3362e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:58.928734 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4da95c56-9ed6-49a4-af1d-92204fb3362e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043510 Jul 27 20:29:58.929680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 965/1941] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:58 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:29:58.934183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8eb662d4-657b-4682-996e-be0f58c9caa9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:58.937081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8eb662d4-657b-4682-996e-be0f58c9caa9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:58.943527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8eb662d4-657b-4682-996e-be0f58c9caa9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:58.943981 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8eb662d4-657b-4682-996e-be0f58c9caa9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:58.944792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8eb662d4-657b-4682-996e-be0f58c9caa9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:58.945212 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8eb662d4-657b-4682-996e-be0f58c9caa9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:58.949929 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-310bbb8f-8197-4ab2-9639-a50d7d2164a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:58.950541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-310bbb8f-8197-4ab2-9639-a50d7d2164a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:58.957013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-310bbb8f-8197-4ab2-9639-a50d7d2164a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:58.957465 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-310bbb8f-8197-4ab2-9639-a50d7d2164a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:58.958238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-310bbb8f-8197-4ab2-9639-a50d7d2164a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:58.958681 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-310bbb8f-8197-4ab2-9639-a50d7d2164a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:58.974611 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8eb662d4-657b-4682-996e-be0f58c9caa9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044330 Jul 27 20:29:58.975172 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 977/1942] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:58 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:29:59.019998 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-310bbb8f-8197-4ab2-9639-a50d7d2164a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:29:59.027525 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-310bbb8f-8197-4ab2-9639-a50d7d2164a2 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081338 Jul 27 20:29:59.028083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 966/1943] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:29:58 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:29:59.941939 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-47029896-ffe5-413b-ad1f-7a81a40cfb60 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:59.944097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-47029896-ffe5-413b-ad1f-7a81a40cfb60 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:59.950551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-47029896-ffe5-413b-ad1f-7a81a40cfb60 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:59.951008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-47029896-ffe5-413b-ad1f-7a81a40cfb60 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:59.952040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-47029896-ffe5-413b-ad1f-7a81a40cfb60 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:59.952480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-47029896-ffe5-413b-ad1f-7a81a40cfb60 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:59.981381 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-47029896-ffe5-413b-ad1f-7a81a40cfb60 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043342 Jul 27 20:29:59.982130 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 978/1944] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:29:59 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:29:59.987751 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0674002a-5f48-494e-9632-94805aa6df49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:29:59.989999 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0674002a-5f48-494e-9632-94805aa6df49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:29:59.996285 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0674002a-5f48-494e-9632-94805aa6df49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:59.996723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0674002a-5f48-494e-9632-94805aa6df49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:29:59.997509 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0674002a-5f48-494e-9632-94805aa6df49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:29:59.997932 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0674002a-5f48-494e-9632-94805aa6df49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:00.026068 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0674002a-5f48-494e-9632-94805aa6df49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042207 Jul 27 20:30:00.026609 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 967/1945] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:29:59 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:00.048049 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0129987f-a51b-49d2-b4e5-9605da5ebfa9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:00.048670 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0129987f-a51b-49d2-b4e5-9605da5ebfa9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:00.054661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0129987f-a51b-49d2-b4e5-9605da5ebfa9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:00.055117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0129987f-a51b-49d2-b4e5-9605da5ebfa9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:00.055885 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0129987f-a51b-49d2-b4e5-9605da5ebfa9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:00.056331 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0129987f-a51b-49d2-b4e5-9605da5ebfa9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:00.119067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0129987f-a51b-49d2-b4e5-9605da5ebfa9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:00.126936 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0129987f-a51b-49d2-b4e5-9605da5ebfa9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083288 Jul 27 20:30:00.127504 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 979/1946] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:00 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:00.735524 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:30:00.735776 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:30:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:30:01.086532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5c479d32-ec77-42dc-aaa9-baad203a7a86 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:01.088688 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5c479d32-ec77-42dc-aaa9-baad203a7a86 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:01.095093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c479d32-ec77-42dc-aaa9-baad203a7a86 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:01.095568 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c479d32-ec77-42dc-aaa9-baad203a7a86 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:01.096344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c479d32-ec77-42dc-aaa9-baad203a7a86 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:01.096784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c479d32-ec77-42dc-aaa9-baad203a7a86 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:01.111869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7fef24b7-0b5b-47f2-996f-6b9d215f8dc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:01.114247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7fef24b7-0b5b-47f2-996f-6b9d215f8dc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:01.120216 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7fef24b7-0b5b-47f2-996f-6b9d215f8dc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:01.120739 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7fef24b7-0b5b-47f2-996f-6b9d215f8dc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:01.121611 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7fef24b7-0b5b-47f2-996f-6b9d215f8dc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:01.122049 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7fef24b7-0b5b-47f2-996f-6b9d215f8dc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:01.127880 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5c479d32-ec77-42dc-aaa9-baad203a7a86 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137392 Jul 27 20:30:01.128444 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 968/1947] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:00 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:01.147189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-99a8ba18-f7c2-4734-a201-99238fe0ce3f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:01.147797 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-99a8ba18-f7c2-4734-a201-99238fe0ce3f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:01.152372 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7fef24b7-0b5b-47f2-996f-6b9d215f8dc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.117286 Jul 27 20:30:01.152924 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 980/1948] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:01 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:01.154091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99a8ba18-f7c2-4734-a201-99238fe0ce3f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:01.154547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99a8ba18-f7c2-4734-a201-99238fe0ce3f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:01.155370 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99a8ba18-f7c2-4734-a201-99238fe0ce3f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:01.155808 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99a8ba18-f7c2-4734-a201-99238fe0ce3f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:01.265699 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-99a8ba18-f7c2-4734-a201-99238fe0ce3f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:01.273138 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-99a8ba18-f7c2-4734-a201-99238fe0ce3f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.129591 Jul 27 20:30:01.273687 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 969/1949] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:01 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:30:02.140381 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4ee9ae5a-9fa9-4f7e-b10c-35647e7e655b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:02.142576 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4ee9ae5a-9fa9-4f7e-b10c-35647e7e655b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:02.149103 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4ee9ae5a-9fa9-4f7e-b10c-35647e7e655b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:02.149562 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4ee9ae5a-9fa9-4f7e-b10c-35647e7e655b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:02.150329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4ee9ae5a-9fa9-4f7e-b10c-35647e7e655b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:02.150770 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4ee9ae5a-9fa9-4f7e-b10c-35647e7e655b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:02.164733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a77c391e-ce37-4b53-8fd3-aa5c3fefe4a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:02.166941 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a77c391e-ce37-4b53-8fd3-aa5c3fefe4a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:02.173927 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a77c391e-ce37-4b53-8fd3-aa5c3fefe4a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:02.174365 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a77c391e-ce37-4b53-8fd3-aa5c3fefe4a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:02.175122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a77c391e-ce37-4b53-8fd3-aa5c3fefe4a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:02.175572 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a77c391e-ce37-4b53-8fd3-aa5c3fefe4a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:02.180146 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4ee9ae5a-9fa9-4f7e-b10c-35647e7e655b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043866 Jul 27 20:30:02.180700 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 981/1950] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:02 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:02.204946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a77c391e-ce37-4b53-8fd3-aa5c3fefe4a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044143 Jul 27 20:30:02.205496 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 970/1951] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:02 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:02.293740 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9177780e-9f7f-45e1-8725-096cde7abccc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:02.294424 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9177780e-9f7f-45e1-8725-096cde7abccc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:02.301129 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9177780e-9f7f-45e1-8725-096cde7abccc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:02.301587 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9177780e-9f7f-45e1-8725-096cde7abccc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:02.302357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9177780e-9f7f-45e1-8725-096cde7abccc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:02.302806 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9177780e-9f7f-45e1-8725-096cde7abccc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:02.425210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9177780e-9f7f-45e1-8725-096cde7abccc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:02.432728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9177780e-9f7f-45e1-8725-096cde7abccc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.142817 Jul 27 20:30:02.433320 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 982/1952] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:02 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:30:03.192377 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bade9045-bcaa-4551-bb13-e09d76ef4807 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:03.194625 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bade9045-bcaa-4551-bb13-e09d76ef4807 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:03.201056 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bade9045-bcaa-4551-bb13-e09d76ef4807 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:03.201637 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bade9045-bcaa-4551-bb13-e09d76ef4807 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:03.202652 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bade9045-bcaa-4551-bb13-e09d76ef4807 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:03.203088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bade9045-bcaa-4551-bb13-e09d76ef4807 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:03.217910 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0e3a15ff-e27c-461a-b3a0-ddda817d2329 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:03.220087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0e3a15ff-e27c-461a-b3a0-ddda817d2329 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:03.226161 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e3a15ff-e27c-461a-b3a0-ddda817d2329 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:03.226616 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e3a15ff-e27c-461a-b3a0-ddda817d2329 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:03.227392 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e3a15ff-e27c-461a-b3a0-ddda817d2329 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:03.228162 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e3a15ff-e27c-461a-b3a0-ddda817d2329 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:03.232305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bade9045-bcaa-4551-bb13-e09d76ef4807 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043871 Jul 27 20:30:03.233582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 971/1953] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:03 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:03.256791 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0e3a15ff-e27c-461a-b3a0-ddda817d2329 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043601 Jul 27 20:30:03.257365 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 983/1954] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:03 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:03.453533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e1f0c329-7bec-4505-a90c-658e5b6ce875 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:03.454147 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e1f0c329-7bec-4505-a90c-658e5b6ce875 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:03.460102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1f0c329-7bec-4505-a90c-658e5b6ce875 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:03.460555 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1f0c329-7bec-4505-a90c-658e5b6ce875 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:03.461352 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1f0c329-7bec-4505-a90c-658e5b6ce875 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:03.461792 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1f0c329-7bec-4505-a90c-658e5b6ce875 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:03.522872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e1f0c329-7bec-4505-a90c-658e5b6ce875 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:03.530901 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e1f0c329-7bec-4505-a90c-658e5b6ce875 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082134 Jul 27 20:30:03.531450 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 972/1955] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:03 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:04.244619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d06c835e-9006-4da3-8185-04858132cc26 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:04.246792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d06c835e-9006-4da3-8185-04858132cc26 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:04.254016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d06c835e-9006-4da3-8185-04858132cc26 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:04.254472 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d06c835e-9006-4da3-8185-04858132cc26 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:04.255237 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d06c835e-9006-4da3-8185-04858132cc26 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:04.255678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d06c835e-9006-4da3-8185-04858132cc26 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:04.268727 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cf27bc11-e898-454e-a692-49d1518d40d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:04.270895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cf27bc11-e898-454e-a692-49d1518d40d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:04.277278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cf27bc11-e898-454e-a692-49d1518d40d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:04.277730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cf27bc11-e898-454e-a692-49d1518d40d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:04.278494 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cf27bc11-e898-454e-a692-49d1518d40d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:04.278930 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cf27bc11-e898-454e-a692-49d1518d40d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:04.284366 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d06c835e-9006-4da3-8185-04858132cc26 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043683 Jul 27 20:30:04.284927 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 984/1956] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:04 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:04.308422 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cf27bc11-e898-454e-a692-49d1518d40d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043720 Jul 27 20:30:04.308973 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 973/1957] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:04 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:04.552134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bae08b79-2401-4e11-a179-8ea1d658e42a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:04.552910 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bae08b79-2401-4e11-a179-8ea1d658e42a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:04.559261 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bae08b79-2401-4e11-a179-8ea1d658e42a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:04.559747 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bae08b79-2401-4e11-a179-8ea1d658e42a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:04.560523 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bae08b79-2401-4e11-a179-8ea1d658e42a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:04.561099 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bae08b79-2401-4e11-a179-8ea1d658e42a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:04.624493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bae08b79-2401-4e11-a179-8ea1d658e42a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:04.632202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bae08b79-2401-4e11-a179-8ea1d658e42a tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083964 Jul 27 20:30:04.632759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 985/1958] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:04 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:05.296681 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-05b1dab9-8292-4c3a-83a5-8b4377a7be47 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:05.298778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-05b1dab9-8292-4c3a-83a5-8b4377a7be47 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:05.305225 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05b1dab9-8292-4c3a-83a5-8b4377a7be47 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:05.305672 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05b1dab9-8292-4c3a-83a5-8b4377a7be47 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:05.306432 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05b1dab9-8292-4c3a-83a5-8b4377a7be47 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:05.306866 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05b1dab9-8292-4c3a-83a5-8b4377a7be47 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:05.321470 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-444f794c-e31b-46cf-be14-82b95bab8b94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:05.323660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-444f794c-e31b-46cf-be14-82b95bab8b94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:05.331146 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-444f794c-e31b-46cf-be14-82b95bab8b94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:05.331635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-444f794c-e31b-46cf-be14-82b95bab8b94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:05.332413 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-444f794c-e31b-46cf-be14-82b95bab8b94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:05.332846 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-444f794c-e31b-46cf-be14-82b95bab8b94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:05.337606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-05b1dab9-8292-4c3a-83a5-8b4377a7be47 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044924 Jul 27 20:30:05.338388 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 974/1959] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:05 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:05.362035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-444f794c-e31b-46cf-be14-82b95bab8b94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044567 Jul 27 20:30:05.362578 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 986/1960] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:05 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:05.652469 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-363c56f6-33e9-464c-9a94-d0e7c79eff5c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:05.653106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-363c56f6-33e9-464c-9a94-d0e7c79eff5c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:05.659399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-363c56f6-33e9-464c-9a94-d0e7c79eff5c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:05.659848 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-363c56f6-33e9-464c-9a94-d0e7c79eff5c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:05.660607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-363c56f6-33e9-464c-9a94-d0e7c79eff5c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:05.661071 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-363c56f6-33e9-464c-9a94-d0e7c79eff5c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:05.724511 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-363c56f6-33e9-464c-9a94-d0e7c79eff5c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:05.731966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-363c56f6-33e9-464c-9a94-d0e7c79eff5c tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083330 Jul 27 20:30:05.732521 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 975/1961] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:05 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:06.349913 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-94cb3323-9727-4735-8be4-7dd6d2c60d21 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:06.352015 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-94cb3323-9727-4735-8be4-7dd6d2c60d21 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:06.359021 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-94cb3323-9727-4735-8be4-7dd6d2c60d21 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:06.359493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-94cb3323-9727-4735-8be4-7dd6d2c60d21 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:06.360247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-94cb3323-9727-4735-8be4-7dd6d2c60d21 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:06.360680 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-94cb3323-9727-4735-8be4-7dd6d2c60d21 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:06.374411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0ba14f60-30f7-47d0-8524-04e9a6e5f1e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:06.377295 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0ba14f60-30f7-47d0-8524-04e9a6e5f1e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:06.386603 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ba14f60-30f7-47d0-8524-04e9a6e5f1e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:06.387055 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ba14f60-30f7-47d0-8524-04e9a6e5f1e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:06.387859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ba14f60-30f7-47d0-8524-04e9a6e5f1e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:06.388419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ba14f60-30f7-47d0-8524-04e9a6e5f1e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:06.392317 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-94cb3323-9727-4735-8be4-7dd6d2c60d21 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046359 Jul 27 20:30:06.393021 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 987/1962] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:06 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:06.417280 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0ba14f60-30f7-47d0-8524-04e9a6e5f1e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047654 Jul 27 20:30:06.417824 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 976/1963] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:06 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:06.754369 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c6c8f653-9b31-46d1-b0ae-b0b2fd50a292 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:06.754990 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c6c8f653-9b31-46d1-b0ae-b0b2fd50a292 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:06.761023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c6c8f653-9b31-46d1-b0ae-b0b2fd50a292 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:06.761481 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c6c8f653-9b31-46d1-b0ae-b0b2fd50a292 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:06.762244 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c6c8f653-9b31-46d1-b0ae-b0b2fd50a292 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:06.762689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c6c8f653-9b31-46d1-b0ae-b0b2fd50a292 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:06.824205 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c6c8f653-9b31-46d1-b0ae-b0b2fd50a292 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:06.832728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c6c8f653-9b31-46d1-b0ae-b0b2fd50a292 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082240 Jul 27 20:30:06.833316 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 988/1964] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:06 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:06.933109 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:30:06.933308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:30:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:30:07.404779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5cff656a-f7a9-4107-ac81-646db271d5a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:07.407054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5cff656a-f7a9-4107-ac81-646db271d5a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:07.413511 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5cff656a-f7a9-4107-ac81-646db271d5a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:07.413991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5cff656a-f7a9-4107-ac81-646db271d5a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:07.414756 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5cff656a-f7a9-4107-ac81-646db271d5a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:07.415189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5cff656a-f7a9-4107-ac81-646db271d5a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:07.430392 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b70c1600-b4a6-4fbb-aed1-f98c14b26474 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:07.432584 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b70c1600-b4a6-4fbb-aed1-f98c14b26474 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:07.440236 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b70c1600-b4a6-4fbb-aed1-f98c14b26474 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:07.440687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b70c1600-b4a6-4fbb-aed1-f98c14b26474 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:07.441494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b70c1600-b4a6-4fbb-aed1-f98c14b26474 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:07.441927 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b70c1600-b4a6-4fbb-aed1-f98c14b26474 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:07.445643 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5cff656a-f7a9-4107-ac81-646db271d5a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044921 Jul 27 20:30:07.446203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 977/1965] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:07 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:07.472275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b70c1600-b4a6-4fbb-aed1-f98c14b26474 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045810 Jul 27 20:30:07.472820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 989/1966] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:07 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:07.853745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f5cfa100-0000-437a-9ad3-8002de525b04 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:07.854280 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f5cfa100-0000-437a-9ad3-8002de525b04 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:07.860808 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f5cfa100-0000-437a-9ad3-8002de525b04 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:07.861293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f5cfa100-0000-437a-9ad3-8002de525b04 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:07.862053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f5cfa100-0000-437a-9ad3-8002de525b04 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:07.862489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f5cfa100-0000-437a-9ad3-8002de525b04 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:07.866344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:07.923642 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f5cfa100-0000-437a-9ad3-8002de525b04 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:07.931028 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f5cfa100-0000-437a-9ad3-8002de525b04 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081178 Jul 27 20:30:07.931586 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 978/1967] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:07 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:08.459713 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9d4e857b-5631-4b4e-b1f8-0d8939defceb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:08.462144 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9d4e857b-5631-4b4e-b1f8-0d8939defceb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:08.469191 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d4e857b-5631-4b4e-b1f8-0d8939defceb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:08.469644 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d4e857b-5631-4b4e-b1f8-0d8939defceb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:08.470415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d4e857b-5631-4b4e-b1f8-0d8939defceb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:08.470857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d4e857b-5631-4b4e-b1f8-0d8939defceb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:08.484367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dc669be0-be51-4c9e-b465-9b22d2635638 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:08.486818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dc669be0-be51-4c9e-b465-9b22d2635638 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:08.493464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc669be0-be51-4c9e-b465-9b22d2635638 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:08.494029 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc669be0-be51-4c9e-b465-9b22d2635638 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:08.494805 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc669be0-be51-4c9e-b465-9b22d2635638 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:08.495235 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc669be0-be51-4c9e-b465-9b22d2635638 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:08.500587 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9d4e857b-5631-4b4e-b1f8-0d8939defceb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045469 Jul 27 20:30:08.501182 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 990/1968] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:08 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:08.526026 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dc669be0-be51-4c9e-b465-9b22d2635638 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046105 Jul 27 20:30:08.526576 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 979/1969] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:08 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:08.951512 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-447d984c-d195-42c0-aad8-32268909293e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:08.952385 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-447d984c-d195-42c0-aad8-32268909293e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:08.958438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-447d984c-d195-42c0-aad8-32268909293e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:08.958893 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-447d984c-d195-42c0-aad8-32268909293e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:08.959660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-447d984c-d195-42c0-aad8-32268909293e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:08.960111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-447d984c-d195-42c0-aad8-32268909293e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:09.024572 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-447d984c-d195-42c0-aad8-32268909293e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:09.028075 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:09.033899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-447d984c-d195-42c0-aad8-32268909293e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.086278 Jul 27 20:30:09.034460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 991/1970] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:08 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:09.513136 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b515c5d9-28d4-4cf9-bd11-0ce94adf8417 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:09.515917 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b515c5d9-28d4-4cf9-bd11-0ce94adf8417 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:09.522460 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b515c5d9-28d4-4cf9-bd11-0ce94adf8417 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:09.522913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b515c5d9-28d4-4cf9-bd11-0ce94adf8417 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:09.523673 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b515c5d9-28d4-4cf9-bd11-0ce94adf8417 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:09.524110 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b515c5d9-28d4-4cf9-bd11-0ce94adf8417 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:09.538803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-61bfec78-ba83-49d5-8906-92614022fb52 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:09.540915 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-61bfec78-ba83-49d5-8906-92614022fb52 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:09.547313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-61bfec78-ba83-49d5-8906-92614022fb52 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:09.547760 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-61bfec78-ba83-49d5-8906-92614022fb52 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:09.548527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-61bfec78-ba83-49d5-8906-92614022fb52 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:09.548981 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-61bfec78-ba83-49d5-8906-92614022fb52 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:09.553799 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b515c5d9-28d4-4cf9-bd11-0ce94adf8417 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044603 Jul 27 20:30:09.554362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 980/1971] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:09 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:09.578175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-61bfec78-ba83-49d5-8906-92614022fb52 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043545 Jul 27 20:30:09.578710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 992/1972] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:09 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:10.056327 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-40391d4c-a598-4dc4-a3c1-168286cd2b2f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:10.057108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-40391d4c-a598-4dc4-a3c1-168286cd2b2f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:10.065621 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-40391d4c-a598-4dc4-a3c1-168286cd2b2f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:10.066074 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-40391d4c-a598-4dc4-a3c1-168286cd2b2f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:10.066998 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-40391d4c-a598-4dc4-a3c1-168286cd2b2f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:10.067440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-40391d4c-a598-4dc4-a3c1-168286cd2b2f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:10.130977 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-40391d4c-a598-4dc4-a3c1-168286cd2b2f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:10.140071 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-40391d4c-a598-4dc4-a3c1-168286cd2b2f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.086415 Jul 27 20:30:10.141248 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 981/1973] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:10 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:10.566237 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c5be1ddb-3c18-44d2-9c9e-fa578d42a60c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:10.568323 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c5be1ddb-3c18-44d2-9c9e-fa578d42a60c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:10.574858 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c5be1ddb-3c18-44d2-9c9e-fa578d42a60c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:10.575306 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c5be1ddb-3c18-44d2-9c9e-fa578d42a60c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:10.576070 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c5be1ddb-3c18-44d2-9c9e-fa578d42a60c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:10.576508 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c5be1ddb-3c18-44d2-9c9e-fa578d42a60c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:10.590459 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5c47ed7c-8477-4ed3-9e58-5e314b8fe80b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:10.592662 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5c47ed7c-8477-4ed3-9e58-5e314b8fe80b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:10.599597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c47ed7c-8477-4ed3-9e58-5e314b8fe80b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:10.600052 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c47ed7c-8477-4ed3-9e58-5e314b8fe80b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:10.600826 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c47ed7c-8477-4ed3-9e58-5e314b8fe80b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:10.601294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c47ed7c-8477-4ed3-9e58-5e314b8fe80b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:10.606803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c5be1ddb-3c18-44d2-9c9e-fa578d42a60c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044607 Jul 27 20:30:10.607368 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 993/1974] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:10 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:10.632059 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5c47ed7c-8477-4ed3-9e58-5e314b8fe80b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045589 Jul 27 20:30:10.632625 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 982/1975] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:10 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:11.162689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-64dd588c-a913-4749-b75b-d9794ba3a6e4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:11.163309 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-64dd588c-a913-4749-b75b-d9794ba3a6e4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:11.169385 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-64dd588c-a913-4749-b75b-d9794ba3a6e4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:11.169843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-64dd588c-a913-4749-b75b-d9794ba3a6e4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:11.170613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-64dd588c-a913-4749-b75b-d9794ba3a6e4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:11.171056 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-64dd588c-a913-4749-b75b-d9794ba3a6e4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:11.233773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-64dd588c-a913-4749-b75b-d9794ba3a6e4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:11.241389 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-64dd588c-a913-4749-b75b-d9794ba3a6e4 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082621 Jul 27 20:30:11.241942 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 994/1976] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:11 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:11.619983 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-05aaf49b-52d3-4933-a348-0cd32e6d9577 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:11.623426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-05aaf49b-52d3-4933-a348-0cd32e6d9577 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:11.631569 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05aaf49b-52d3-4933-a348-0cd32e6d9577 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:11.632019 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05aaf49b-52d3-4933-a348-0cd32e6d9577 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:11.632794 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05aaf49b-52d3-4933-a348-0cd32e6d9577 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:11.633275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05aaf49b-52d3-4933-a348-0cd32e6d9577 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:11.643776 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-50ab8f6d-b3fa-4df5-b4f9-3f3ac631b0da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:11.645935 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-50ab8f6d-b3fa-4df5-b4f9-3f3ac631b0da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:11.652208 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-50ab8f6d-b3fa-4df5-b4f9-3f3ac631b0da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:11.652657 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-50ab8f6d-b3fa-4df5-b4f9-3f3ac631b0da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:11.653447 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-50ab8f6d-b3fa-4df5-b4f9-3f3ac631b0da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:11.653881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-50ab8f6d-b3fa-4df5-b4f9-3f3ac631b0da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:11.662983 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-05aaf49b-52d3-4933-a348-0cd32e6d9577 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046993 Jul 27 20:30:11.663546 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 983/1977] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:11 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:11.683485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-50ab8f6d-b3fa-4df5-b4f9-3f3ac631b0da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043577 Jul 27 20:30:11.684033 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 995/1978] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:11 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:12.262495 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-05459630-5224-4b1e-b4a3-a846cb35bdd9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:12.263106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-05459630-5224-4b1e-b4a3-a846cb35bdd9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:12.269475 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05459630-5224-4b1e-b4a3-a846cb35bdd9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:12.269919 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05459630-5224-4b1e-b4a3-a846cb35bdd9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:12.270673 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05459630-5224-4b1e-b4a3-a846cb35bdd9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:12.271102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05459630-5224-4b1e-b4a3-a846cb35bdd9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:12.336054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-05459630-5224-4b1e-b4a3-a846cb35bdd9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:12.344905 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-05459630-5224-4b1e-b4a3-a846cb35bdd9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.086183 Jul 27 20:30:12.345488 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 984/1979] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:12 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:12.675382 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-523aa4f9-234d-427d-ac9e-1eb4e0e3b76d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:12.677620 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-523aa4f9-234d-427d-ac9e-1eb4e0e3b76d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:12.684146 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-523aa4f9-234d-427d-ac9e-1eb4e0e3b76d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:12.684601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-523aa4f9-234d-427d-ac9e-1eb4e0e3b76d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:12.685401 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-523aa4f9-234d-427d-ac9e-1eb4e0e3b76d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:12.685901 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-523aa4f9-234d-427d-ac9e-1eb4e0e3b76d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:12.696437 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3829030f-e20a-495f-a098-6af2a88305cd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:12.698722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3829030f-e20a-495f-a098-6af2a88305cd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:12.705936 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3829030f-e20a-495f-a098-6af2a88305cd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:12.706389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3829030f-e20a-495f-a098-6af2a88305cd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:12.707190 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3829030f-e20a-495f-a098-6af2a88305cd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:12.707626 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3829030f-e20a-495f-a098-6af2a88305cd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:12.716376 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-523aa4f9-234d-427d-ac9e-1eb4e0e3b76d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044997 Jul 27 20:30:12.716940 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 996/1980] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:12 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:12.736634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3829030f-e20a-495f-a098-6af2a88305cd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044184 Jul 27 20:30:12.737233 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 985/1981] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:12 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:13.365876 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-20a81ca7-9235-48a1-9a57-cb6611d9f6a0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:13.366408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-20a81ca7-9235-48a1-9a57-cb6611d9f6a0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:13.372708 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-20a81ca7-9235-48a1-9a57-cb6611d9f6a0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:13.374004 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-20a81ca7-9235-48a1-9a57-cb6611d9f6a0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:13.375454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-20a81ca7-9235-48a1-9a57-cb6611d9f6a0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:13.375903 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-20a81ca7-9235-48a1-9a57-cb6611d9f6a0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:13.437160 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-20a81ca7-9235-48a1-9a57-cb6611d9f6a0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:13.445512 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-20a81ca7-9235-48a1-9a57-cb6611d9f6a0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083599 Jul 27 20:30:13.446066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 997/1982] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:13 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:13.728481 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-83dbd8d0-0d0e-4505-a45c-e08294706b54 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:13.730642 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-83dbd8d0-0d0e-4505-a45c-e08294706b54 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:13.738120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83dbd8d0-0d0e-4505-a45c-e08294706b54 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:13.738558 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83dbd8d0-0d0e-4505-a45c-e08294706b54 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:13.739308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83dbd8d0-0d0e-4505-a45c-e08294706b54 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:13.739736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83dbd8d0-0d0e-4505-a45c-e08294706b54 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:13.748518 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-139d446e-48ba-42db-80c6-9a75812da90a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:13.750714 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-139d446e-48ba-42db-80c6-9a75812da90a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:13.757091 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-139d446e-48ba-42db-80c6-9a75812da90a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:13.757551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-139d446e-48ba-42db-80c6-9a75812da90a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:13.758329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-139d446e-48ba-42db-80c6-9a75812da90a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:13.758774 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-139d446e-48ba-42db-80c6-9a75812da90a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:13.768894 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-83dbd8d0-0d0e-4505-a45c-e08294706b54 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044487 Jul 27 20:30:13.769477 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 986/1983] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:13 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:13.788098 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-139d446e-48ba-42db-80c6-9a75812da90a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043517 Jul 27 20:30:13.788650 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 998/1984] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:13 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:14.465432 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-60f1304b-7d41-40fa-9c48-39f94958696f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:14.466050 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-60f1304b-7d41-40fa-9c48-39f94958696f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:14.472764 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60f1304b-7d41-40fa-9c48-39f94958696f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:14.473253 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60f1304b-7d41-40fa-9c48-39f94958696f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:14.474022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60f1304b-7d41-40fa-9c48-39f94958696f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:14.474461 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60f1304b-7d41-40fa-9c48-39f94958696f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:14.537409 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-60f1304b-7d41-40fa-9c48-39f94958696f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:14.544929 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-60f1304b-7d41-40fa-9c48-39f94958696f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083345 Jul 27 20:30:14.545514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 987/1985] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:14 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:14.782026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-46a9b626-430d-4912-96f8-79ce2570d223 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:14.784312 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-46a9b626-430d-4912-96f8-79ce2570d223 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:14.790863 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46a9b626-430d-4912-96f8-79ce2570d223 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:14.791320 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46a9b626-430d-4912-96f8-79ce2570d223 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:14.792098 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46a9b626-430d-4912-96f8-79ce2570d223 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:14.792544 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46a9b626-430d-4912-96f8-79ce2570d223 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:14.800190 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4519a664-dbe6-46d0-81bd-e74d21e2e25a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:14.802428 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4519a664-dbe6-46d0-81bd-e74d21e2e25a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:14.808879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4519a664-dbe6-46d0-81bd-e74d21e2e25a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:14.809356 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4519a664-dbe6-46d0-81bd-e74d21e2e25a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:14.810118 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4519a664-dbe6-46d0-81bd-e74d21e2e25a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:14.810549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4519a664-dbe6-46d0-81bd-e74d21e2e25a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:14.822463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-46a9b626-430d-4912-96f8-79ce2570d223 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045185 Jul 27 20:30:14.823034 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 999/1986] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:14 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:14.841038 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4519a664-dbe6-46d0-81bd-e74d21e2e25a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045106 Jul 27 20:30:14.841598 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 988/1987] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:14 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:15.566723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-41582236-48cf-4585-8d0c-31624101dfbe tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:15.567340 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-41582236-48cf-4585-8d0c-31624101dfbe tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:15.573337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41582236-48cf-4585-8d0c-31624101dfbe tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:15.573794 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41582236-48cf-4585-8d0c-31624101dfbe tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:15.574555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41582236-48cf-4585-8d0c-31624101dfbe tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:15.574995 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41582236-48cf-4585-8d0c-31624101dfbe tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:15.639169 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-41582236-48cf-4585-8d0c-31624101dfbe tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:15.646882 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-41582236-48cf-4585-8d0c-31624101dfbe tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084674 Jul 27 20:30:15.647695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1000/1988] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:15 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:30:15.835451 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b7409305-7022-41ce-bb60-21954e748737 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:15.837638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b7409305-7022-41ce-bb60-21954e748737 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:15.844607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7409305-7022-41ce-bb60-21954e748737 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:15.845119 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7409305-7022-41ce-bb60-21954e748737 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:15.846151 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7409305-7022-41ce-bb60-21954e748737 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:15.846397 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7409305-7022-41ce-bb60-21954e748737 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:15.854458 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8471a29d-5e00-4966-ae0e-58d673da26d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:15.856632 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8471a29d-5e00-4966-ae0e-58d673da26d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:15.864035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8471a29d-5e00-4966-ae0e-58d673da26d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:15.864615 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8471a29d-5e00-4966-ae0e-58d673da26d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:15.865439 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8471a29d-5e00-4966-ae0e-58d673da26d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:15.865880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8471a29d-5e00-4966-ae0e-58d673da26d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:15.876205 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b7409305-7022-41ce-bb60-21954e748737 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044761 Jul 27 20:30:15.876811 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 989/1989] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:15 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:15.895721 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8471a29d-5e00-4966-ae0e-58d673da26d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045292 Jul 27 20:30:15.896277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1001/1990] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:15 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:16.667356 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9d2228c7-6db1-4bd8-a3de-c265adb59ea0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:16.667966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9d2228c7-6db1-4bd8-a3de-c265adb59ea0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:16.674204 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9d2228c7-6db1-4bd8-a3de-c265adb59ea0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:16.674651 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9d2228c7-6db1-4bd8-a3de-c265adb59ea0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:16.675414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9d2228c7-6db1-4bd8-a3de-c265adb59ea0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:16.675851 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9d2228c7-6db1-4bd8-a3de-c265adb59ea0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:16.739449 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9d2228c7-6db1-4bd8-a3de-c265adb59ea0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:16.747059 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9d2228c7-6db1-4bd8-a3de-c265adb59ea0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083575 Jul 27 20:30:16.747617 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 990/1991] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:16 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:16.887857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e72b751c-b888-4231-b75b-9b1b1b5b8233 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:16.890555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e72b751c-b888-4231-b75b-9b1b1b5b8233 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:16.897180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e72b751c-b888-4231-b75b-9b1b1b5b8233 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:16.897641 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e72b751c-b888-4231-b75b-9b1b1b5b8233 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:16.898412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e72b751c-b888-4231-b75b-9b1b1b5b8233 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:16.898857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e72b751c-b888-4231-b75b-9b1b1b5b8233 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:16.907856 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-50d990d6-3a15-4f25-a1ac-c5afc77a3fd5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:16.910055 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-50d990d6-3a15-4f25-a1ac-c5afc77a3fd5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:16.916538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-50d990d6-3a15-4f25-a1ac-c5afc77a3fd5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:16.917018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-50d990d6-3a15-4f25-a1ac-c5afc77a3fd5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:16.917840 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-50d990d6-3a15-4f25-a1ac-c5afc77a3fd5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:16.918233 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-50d990d6-3a15-4f25-a1ac-c5afc77a3fd5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:16.931331 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e72b751c-b888-4231-b75b-9b1b1b5b8233 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047455 Jul 27 20:30:16.936179 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1002/1992] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:16 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:16.949321 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-50d990d6-3a15-4f25-a1ac-c5afc77a3fd5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045498 Jul 27 20:30:16.949874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 991/1993] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:16 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:17.768369 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b88a661b-340f-464a-b2ea-cc21ce5f7a60 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:17.769092 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b88a661b-340f-464a-b2ea-cc21ce5f7a60 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:17.775843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b88a661b-340f-464a-b2ea-cc21ce5f7a60 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:17.776299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b88a661b-340f-464a-b2ea-cc21ce5f7a60 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:17.777246 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b88a661b-340f-464a-b2ea-cc21ce5f7a60 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:17.777740 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b88a661b-340f-464a-b2ea-cc21ce5f7a60 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:17.842925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b88a661b-340f-464a-b2ea-cc21ce5f7a60 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:17.851131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b88a661b-340f-464a-b2ea-cc21ce5f7a60 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.087420 Jul 27 20:30:17.851691 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1003/1994] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:17 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:17.944399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f0d76dba-1b6b-4686-a955-738a84da4efb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:17.946521 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f0d76dba-1b6b-4686-a955-738a84da4efb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:17.953048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f0d76dba-1b6b-4686-a955-738a84da4efb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:17.953499 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f0d76dba-1b6b-4686-a955-738a84da4efb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:17.954900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f0d76dba-1b6b-4686-a955-738a84da4efb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:17.955455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f0d76dba-1b6b-4686-a955-738a84da4efb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:17.962147 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a7eb6db6-379b-4c84-a508-3363743637b7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:17.964282 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a7eb6db6-379b-4c84-a508-3363743637b7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:17.971110 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a7eb6db6-379b-4c84-a508-3363743637b7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:17.971565 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a7eb6db6-379b-4c84-a508-3363743637b7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:17.972340 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a7eb6db6-379b-4c84-a508-3363743637b7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:17.972777 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a7eb6db6-379b-4c84-a508-3363743637b7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:17.984899 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f0d76dba-1b6b-4686-a955-738a84da4efb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044515 Jul 27 20:30:17.985559 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 992/1995] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:17 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:18.008108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a7eb6db6-379b-4c84-a508-3363743637b7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049877 Jul 27 20:30:18.008690 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1004/1996] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:17 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:18.871886 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-985f55fb-9b43-4def-8744-8f9f482f63fb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:18.872527 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-985f55fb-9b43-4def-8744-8f9f482f63fb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:18.879149 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-985f55fb-9b43-4def-8744-8f9f482f63fb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:18.879664 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-985f55fb-9b43-4def-8744-8f9f482f63fb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:18.880430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-985f55fb-9b43-4def-8744-8f9f482f63fb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:18.880869 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-985f55fb-9b43-4def-8744-8f9f482f63fb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:18.941774 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-985f55fb-9b43-4def-8744-8f9f482f63fb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:18.949187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-985f55fb-9b43-4def-8744-8f9f482f63fb tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081167 Jul 27 20:30:18.949754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 993/1997] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:18 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:19.000122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-88b8862d-a077-4caa-9af7-cbe62c13640f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:19.003428 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-88b8862d-a077-4caa-9af7-cbe62c13640f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:19.010473 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88b8862d-a077-4caa-9af7-cbe62c13640f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:19.010995 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88b8862d-a077-4caa-9af7-cbe62c13640f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:19.011807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88b8862d-a077-4caa-9af7-cbe62c13640f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:19.012279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88b8862d-a077-4caa-9af7-cbe62c13640f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:19.020425 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-202b5908-064a-40a0-85e0-70ce7541ebba tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:19.022710 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-202b5908-064a-40a0-85e0-70ce7541ebba tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:19.029321 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-202b5908-064a-40a0-85e0-70ce7541ebba tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:19.029771 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-202b5908-064a-40a0-85e0-70ce7541ebba tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:19.030545 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-202b5908-064a-40a0-85e0-70ce7541ebba tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:19.030977 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-202b5908-064a-40a0-85e0-70ce7541ebba tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:19.043669 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-88b8862d-a077-4caa-9af7-cbe62c13640f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049466 Jul 27 20:30:19.044425 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1005/1998] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:18 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:19.056254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:19.061393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-202b5908-064a-40a0-85e0-70ce7541ebba tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045630 Jul 27 20:30:19.061951 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 994/1999] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:19 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:19.970956 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a2da373c-6657-4151-84ee-a1e48d121a5e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:19.971576 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a2da373c-6657-4151-84ee-a1e48d121a5e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:19.978372 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a2da373c-6657-4151-84ee-a1e48d121a5e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:19.978929 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a2da373c-6657-4151-84ee-a1e48d121a5e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:19.979964 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a2da373c-6657-4151-84ee-a1e48d121a5e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:19.980559 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a2da373c-6657-4151-84ee-a1e48d121a5e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:20.044052 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a2da373c-6657-4151-84ee-a1e48d121a5e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:20.052150 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a2da373c-6657-4151-84ee-a1e48d121a5e tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.085471 Jul 27 20:30:20.052705 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1006/2000] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:19 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:20.056019 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c1405b4c-946d-48a8-9621-8887db0c90fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:20.058262 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c1405b4c-946d-48a8-9621-8887db0c90fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:20.066783 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1405b4c-946d-48a8-9621-8887db0c90fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:20.068773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1405b4c-946d-48a8-9621-8887db0c90fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:20.068773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1405b4c-946d-48a8-9621-8887db0c90fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:20.068773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1405b4c-946d-48a8-9621-8887db0c90fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:20.074565 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e1d65a76-57c1-4355-b573-8a31e62e59a9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:20.077225 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e1d65a76-57c1-4355-b573-8a31e62e59a9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:20.083651 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1d65a76-57c1-4355-b573-8a31e62e59a9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:20.084183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1d65a76-57c1-4355-b573-8a31e62e59a9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:20.085080 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1d65a76-57c1-4355-b573-8a31e62e59a9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:20.085592 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1d65a76-57c1-4355-b573-8a31e62e59a9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:20.100204 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c1405b4c-946d-48a8-9621-8887db0c90fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048326 Jul 27 20:30:20.100771 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 995/2001] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:20 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:30:20.115579 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e1d65a76-57c1-4355-b573-8a31e62e59a9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044964 Jul 27 20:30:20.116132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1007/2002] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:20 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:21.073817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b703746a-3a55-4d5d-9b19-e0bf5d4d56a1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:21.074467 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b703746a-3a55-4d5d-9b19-e0bf5d4d56a1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:21.081391 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b703746a-3a55-4d5d-9b19-e0bf5d4d56a1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:21.081853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b703746a-3a55-4d5d-9b19-e0bf5d4d56a1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:21.082609 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b703746a-3a55-4d5d-9b19-e0bf5d4d56a1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:21.083048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b703746a-3a55-4d5d-9b19-e0bf5d4d56a1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:21.113991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3b864642-2317-4d56-8965-9d32effaec4a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:21.116455 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3b864642-2317-4d56-8965-9d32effaec4a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:21.123640 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3b864642-2317-4d56-8965-9d32effaec4a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:21.124104 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3b864642-2317-4d56-8965-9d32effaec4a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:21.124990 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3b864642-2317-4d56-8965-9d32effaec4a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:21.127487 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3b864642-2317-4d56-8965-9d32effaec4a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:21.145351 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:21.146497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b703746a-3a55-4d5d-9b19-e0bf5d4d56a1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:21.154009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b703746a-3a55-4d5d-9b19-e0bf5d4d56a1 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084069 Jul 27 20:30:21.154570 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 996/2003] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:21 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:21.159747 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-54e9e957-0a37-4ef7-b908-8fe31be5b910 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:21.161961 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-54e9e957-0a37-4ef7-b908-8fe31be5b910 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:21.162694 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3b864642-2317-4d56-8965-9d32effaec4a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054221 Jul 27 20:30:21.163493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1008/2004] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:21 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:30:21.167782 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-54e9e957-0a37-4ef7-b908-8fe31be5b910 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:21.168221 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-54e9e957-0a37-4ef7-b908-8fe31be5b910 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:21.169000 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-54e9e957-0a37-4ef7-b908-8fe31be5b910 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:21.169430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-54e9e957-0a37-4ef7-b908-8fe31be5b910 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:21.198181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-54e9e957-0a37-4ef7-b908-8fe31be5b910 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042632 Jul 27 20:30:21.198720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 997/2005] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:21 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:22.174945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-332d1309-faf2-4f3a-8606-5da5c937ecba tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:22.175598 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-84cbac69-cac5-4fe6-ad0b-423e5f5b5a2e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:22.176463 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-332d1309-faf2-4f3a-8606-5da5c937ecba tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:22.177888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-84cbac69-cac5-4fe6-ad0b-423e5f5b5a2e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:22.182598 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-332d1309-faf2-4f3a-8606-5da5c937ecba tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:22.183144 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-332d1309-faf2-4f3a-8606-5da5c937ecba tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:22.183796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-332d1309-faf2-4f3a-8606-5da5c937ecba tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:22.184230 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-332d1309-faf2-4f3a-8606-5da5c937ecba tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:22.184396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84cbac69-cac5-4fe6-ad0b-423e5f5b5a2e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:22.184854 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84cbac69-cac5-4fe6-ad0b-423e5f5b5a2e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:22.185707 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84cbac69-cac5-4fe6-ad0b-423e5f5b5a2e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:22.186151 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84cbac69-cac5-4fe6-ad0b-423e5f5b5a2e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:22.216449 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-84cbac69-cac5-4fe6-ad0b-423e5f5b5a2e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045229 Jul 27 20:30:22.217061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1009/2006] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:22 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:22.221613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cb73e28b-399c-4b1c-9d62-e3fdbcb7fbea tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:22.223737 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cb73e28b-399c-4b1c-9d62-e3fdbcb7fbea tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:22.230319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb73e28b-399c-4b1c-9d62-e3fdbcb7fbea tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:22.230837 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb73e28b-399c-4b1c-9d62-e3fdbcb7fbea tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:22.231698 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb73e28b-399c-4b1c-9d62-e3fdbcb7fbea tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:22.232143 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb73e28b-399c-4b1c-9d62-e3fdbcb7fbea tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:22.250070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-332d1309-faf2-4f3a-8606-5da5c937ecba tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:22.258323 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-332d1309-faf2-4f3a-8606-5da5c937ecba tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.087193 Jul 27 20:30:22.258887 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 998/2007] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:22 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:22.265517 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cb73e28b-399c-4b1c-9d62-e3fdbcb7fbea tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047453 Jul 27 20:30:22.266108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1010/2008] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:22 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:23.228354 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3ff9f643-6b4a-4b0f-a50a-4876a85468e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:23.230575 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3ff9f643-6b4a-4b0f-a50a-4876a85468e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:23.237101 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ff9f643-6b4a-4b0f-a50a-4876a85468e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:23.237546 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ff9f643-6b4a-4b0f-a50a-4876a85468e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:23.238294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ff9f643-6b4a-4b0f-a50a-4876a85468e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:23.239363 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ff9f643-6b4a-4b0f-a50a-4876a85468e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:23.268429 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3ff9f643-6b4a-4b0f-a50a-4876a85468e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043909 Jul 27 20:30:23.268986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 999/2009] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:23 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:23.278198 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-19e40c7f-70d0-413f-affd-4e773f2235da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:23.278730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d8e04790-a606-4396-a4b5-01b108047002 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:23.279082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d8e04790-a606-4396-a4b5-01b108047002 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:23.280394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-19e40c7f-70d0-413f-affd-4e773f2235da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:23.285162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8e04790-a606-4396-a4b5-01b108047002 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:23.286144 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8e04790-a606-4396-a4b5-01b108047002 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:23.287008 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8e04790-a606-4396-a4b5-01b108047002 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:23.287446 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8e04790-a606-4396-a4b5-01b108047002 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:23.287727 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19e40c7f-70d0-413f-affd-4e773f2235da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:23.288184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19e40c7f-70d0-413f-affd-4e773f2235da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:23.288958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19e40c7f-70d0-413f-affd-4e773f2235da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:23.289430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19e40c7f-70d0-413f-affd-4e773f2235da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:23.318867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-19e40c7f-70d0-413f-affd-4e773f2235da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044705 Jul 27 20:30:23.319432 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1011/2010] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:23 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:23.348865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d8e04790-a606-4396-a4b5-01b108047002 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:23.356733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d8e04790-a606-4396-a4b5-01b108047002 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081701 Jul 27 20:30:23.357326 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1000/2011] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:23 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:30:24.280851 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7215a8ef-ffb4-4e9a-9152-4f08dbdd05c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:24.283011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7215a8ef-ffb4-4e9a-9152-4f08dbdd05c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:24.290343 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7215a8ef-ffb4-4e9a-9152-4f08dbdd05c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:24.290798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7215a8ef-ffb4-4e9a-9152-4f08dbdd05c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:24.291543 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7215a8ef-ffb4-4e9a-9152-4f08dbdd05c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:24.291973 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7215a8ef-ffb4-4e9a-9152-4f08dbdd05c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:24.320184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7215a8ef-ffb4-4e9a-9152-4f08dbdd05c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043287 Jul 27 20:30:24.320724 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1012/2012] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:24 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:24.331409 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4b42785d-20a1-48f3-8c2d-105008be66a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:24.334136 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4b42785d-20a1-48f3-8c2d-105008be66a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:24.340570 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b42785d-20a1-48f3-8c2d-105008be66a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:24.341051 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b42785d-20a1-48f3-8c2d-105008be66a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:24.341813 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b42785d-20a1-48f3-8c2d-105008be66a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:24.342247 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b42785d-20a1-48f3-8c2d-105008be66a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:24.371203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4b42785d-20a1-48f3-8c2d-105008be66a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044069 Jul 27 20:30:24.371756 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1001/2013] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:24 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:24.377257 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e3f66fbc-e6ec-4ebe-982a-25ca632cd422 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:24.377871 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e3f66fbc-e6ec-4ebe-982a-25ca632cd422 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:24.383948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e3f66fbc-e6ec-4ebe-982a-25ca632cd422 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:24.384394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e3f66fbc-e6ec-4ebe-982a-25ca632cd422 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:24.385183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e3f66fbc-e6ec-4ebe-982a-25ca632cd422 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:24.385616 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e3f66fbc-e6ec-4ebe-982a-25ca632cd422 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:24.447344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e3f66fbc-e6ec-4ebe-982a-25ca632cd422 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:24.455072 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e3f66fbc-e6ec-4ebe-982a-25ca632cd422 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081691 Jul 27 20:30:24.455618 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1013/2014] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:24 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:25.332244 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2e141b0c-cbae-4f92-ba89-31800be67739 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:25.334559 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2e141b0c-cbae-4f92-ba89-31800be67739 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:25.340736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e141b0c-cbae-4f92-ba89-31800be67739 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:25.341217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e141b0c-cbae-4f92-ba89-31800be67739 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:25.341995 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e141b0c-cbae-4f92-ba89-31800be67739 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:25.342436 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e141b0c-cbae-4f92-ba89-31800be67739 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:25.373466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2e141b0c-cbae-4f92-ba89-31800be67739 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045201 Jul 27 20:30:25.374031 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1002/2015] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:25 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:25.383954 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4ac467ca-4a95-4552-b92d-0eb0e9afaafc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:25.386161 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4ac467ca-4a95-4552-b92d-0eb0e9afaafc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:25.388446 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=86 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:25.394095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4ac467ca-4a95-4552-b92d-0eb0e9afaafc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:25.394541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4ac467ca-4a95-4552-b92d-0eb0e9afaafc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:25.395352 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4ac467ca-4a95-4552-b92d-0eb0e9afaafc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:25.395786 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4ac467ca-4a95-4552-b92d-0eb0e9afaafc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:25.430577 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4ac467ca-4a95-4552-b92d-0eb0e9afaafc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050799 Jul 27 20:30:25.431129 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1014/2016] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:25 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:25.477785 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-925e690c-d610-403d-a77f-18ad4e796ab8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:25.478524 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-925e690c-d610-403d-a77f-18ad4e796ab8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:25.486338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-925e690c-d610-403d-a77f-18ad4e796ab8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:25.486785 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-925e690c-d610-403d-a77f-18ad4e796ab8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:25.487558 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-925e690c-d610-403d-a77f-18ad4e796ab8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:25.488002 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-925e690c-d610-403d-a77f-18ad4e796ab8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:25.549240 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-925e690c-d610-403d-a77f-18ad4e796ab8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:25.557327 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-925e690c-d610-403d-a77f-18ad4e796ab8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083516 Jul 27 20:30:25.557888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1003/2017] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:25 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:26.133913 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:30:26.134131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:30:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:30:26.386664 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-69c22300-d722-4ea8-a7f2-731673ca6322 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:26.389733 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-69c22300-d722-4ea8-a7f2-731673ca6322 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:26.396772 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69c22300-d722-4ea8-a7f2-731673ca6322 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:26.397242 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69c22300-d722-4ea8-a7f2-731673ca6322 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:26.398002 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69c22300-d722-4ea8-a7f2-731673ca6322 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:26.398436 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69c22300-d722-4ea8-a7f2-731673ca6322 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:26.430836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-69c22300-d722-4ea8-a7f2-731673ca6322 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048365 Jul 27 20:30:26.431411 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1015/2018] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:26 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:26.443596 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b66b36c7-bd35-48dc-af20-1341ad8d3cec tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:26.445892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b66b36c7-bd35-48dc-af20-1341ad8d3cec tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:26.448400 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=86 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:26.453980 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b66b36c7-bd35-48dc-af20-1341ad8d3cec tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:26.454429 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b66b36c7-bd35-48dc-af20-1341ad8d3cec tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:26.455199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b66b36c7-bd35-48dc-af20-1341ad8d3cec tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:26.455635 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b66b36c7-bd35-48dc-af20-1341ad8d3cec tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:26.485107 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b66b36c7-bd35-48dc-af20-1341ad8d3cec tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046495 Jul 27 20:30:26.485695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1004/2019] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:26 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:26.578128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0b5cc65c-a519-490d-b3af-2bc14aff8f36 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:26.578750 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0b5cc65c-a519-490d-b3af-2bc14aff8f36 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:26.584955 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b5cc65c-a519-490d-b3af-2bc14aff8f36 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:26.585438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b5cc65c-a519-490d-b3af-2bc14aff8f36 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:26.586206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b5cc65c-a519-490d-b3af-2bc14aff8f36 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:26.586646 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b5cc65c-a519-490d-b3af-2bc14aff8f36 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:26.646483 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0b5cc65c-a519-490d-b3af-2bc14aff8f36 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:26.650607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:30:26.650749 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:30:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:30:26.654095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0b5cc65c-a519-490d-b3af-2bc14aff8f36 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080071 Jul 27 20:30:26.654664 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1016/2020] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:26 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:27.443473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7d2dc541-d870-412c-b628-7f80867276f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:27.445588 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7d2dc541-d870-412c-b628-7f80867276f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:27.452700 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d2dc541-d870-412c-b628-7f80867276f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:27.453182 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d2dc541-d870-412c-b628-7f80867276f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:27.453955 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d2dc541-d870-412c-b628-7f80867276f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:27.454389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d2dc541-d870-412c-b628-7f80867276f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:27.485511 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7d2dc541-d870-412c-b628-7f80867276f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046299 Jul 27 20:30:27.486057 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1005/2021] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:27 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:27.498023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-299f1e0f-63d5-41cf-ab95-3b3c496bffc6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:27.500175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-299f1e0f-63d5-41cf-ab95-3b3c496bffc6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:27.506721 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-299f1e0f-63d5-41cf-ab95-3b3c496bffc6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:27.507172 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-299f1e0f-63d5-41cf-ab95-3b3c496bffc6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:27.507935 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-299f1e0f-63d5-41cf-ab95-3b3c496bffc6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:27.508371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-299f1e0f-63d5-41cf-ab95-3b3c496bffc6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:27.536430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-299f1e0f-63d5-41cf-ab95-3b3c496bffc6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042349 Jul 27 20:30:27.537580 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1017/2022] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:27 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:27.674805 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7bd9bc92-466a-402e-8005-b04ee50ce692 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:27.675405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7bd9bc92-466a-402e-8005-b04ee50ce692 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:27.681554 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7bd9bc92-466a-402e-8005-b04ee50ce692 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:27.682025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7bd9bc92-466a-402e-8005-b04ee50ce692 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:27.682752 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7bd9bc92-466a-402e-8005-b04ee50ce692 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:27.683185 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7bd9bc92-466a-402e-8005-b04ee50ce692 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:27.750178 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7bd9bc92-466a-402e-8005-b04ee50ce692 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:27.758060 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7bd9bc92-466a-402e-8005-b04ee50ce692 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.087080 Jul 27 20:30:27.758615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1006/2023] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:27 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:28.498931 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1f865f62-eafd-4152-935f-a05bfb083c79 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:28.501182 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1f865f62-eafd-4152-935f-a05bfb083c79 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:28.508428 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f865f62-eafd-4152-935f-a05bfb083c79 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:28.508888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f865f62-eafd-4152-935f-a05bfb083c79 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:28.509680 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f865f62-eafd-4152-935f-a05bfb083c79 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:28.510123 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f865f62-eafd-4152-935f-a05bfb083c79 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:28.539093 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1f865f62-eafd-4152-935f-a05bfb083c79 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044134 Jul 27 20:30:28.539647 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1018/2024] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:28 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:30:28.549299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-61e94b1f-583b-4156-87df-a039d017486d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:28.551457 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-61e94b1f-583b-4156-87df-a039d017486d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:28.558593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-61e94b1f-583b-4156-87df-a039d017486d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:28.559045 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-61e94b1f-583b-4156-87df-a039d017486d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:28.559816 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-61e94b1f-583b-4156-87df-a039d017486d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:28.560254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-61e94b1f-583b-4156-87df-a039d017486d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:28.590221 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-61e94b1f-583b-4156-87df-a039d017486d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044901 Jul 27 20:30:28.590768 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1007/2025] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:28 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:28.778822 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-592707f7-23e5-430d-a1d8-3c8a248c5792 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:28.779367 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-592707f7-23e5-430d-a1d8-3c8a248c5792 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:28.785433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-592707f7-23e5-430d-a1d8-3c8a248c5792 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:28.785892 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-592707f7-23e5-430d-a1d8-3c8a248c5792 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:28.786658 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-592707f7-23e5-430d-a1d8-3c8a248c5792 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:28.787637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-592707f7-23e5-430d-a1d8-3c8a248c5792 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:28.852136 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-592707f7-23e5-430d-a1d8-3c8a248c5792 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:28.859640 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-592707f7-23e5-430d-a1d8-3c8a248c5792 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084954 Jul 27 20:30:28.860200 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1019/2026] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:28 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:30:29.551541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bfa54737-8802-4941-a34f-ce179385027b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:29.553886 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bfa54737-8802-4941-a34f-ce179385027b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:29.560206 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfa54737-8802-4941-a34f-ce179385027b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:29.560657 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfa54737-8802-4941-a34f-ce179385027b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:29.561441 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfa54737-8802-4941-a34f-ce179385027b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:29.561903 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfa54737-8802-4941-a34f-ce179385027b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:29.591270 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bfa54737-8802-4941-a34f-ce179385027b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043703 Jul 27 20:30:29.591802 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1008/2027] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:29 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:29.603179 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c7d76a66-9c10-4dab-a9fb-693282a75ebe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:29.605357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c7d76a66-9c10-4dab-a9fb-693282a75ebe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:29.611773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c7d76a66-9c10-4dab-a9fb-693282a75ebe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:29.612211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c7d76a66-9c10-4dab-a9fb-693282a75ebe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:29.612994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c7d76a66-9c10-4dab-a9fb-693282a75ebe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:29.613419 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c7d76a66-9c10-4dab-a9fb-693282a75ebe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:29.643562 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c7d76a66-9c10-4dab-a9fb-693282a75ebe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044850 Jul 27 20:30:29.644119 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1020/2028] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:29 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:29.880861 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e71d3c60-0b71-4dfa-9da6-ec6e8cb91628 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:29.882106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e71d3c60-0b71-4dfa-9da6-ec6e8cb91628 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:29.888095 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e71d3c60-0b71-4dfa-9da6-ec6e8cb91628 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:29.888543 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e71d3c60-0b71-4dfa-9da6-ec6e8cb91628 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:29.889341 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e71d3c60-0b71-4dfa-9da6-ec6e8cb91628 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:29.889780 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e71d3c60-0b71-4dfa-9da6-ec6e8cb91628 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:29.954788 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e71d3c60-0b71-4dfa-9da6-ec6e8cb91628 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:29.962739 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e71d3c60-0b71-4dfa-9da6-ec6e8cb91628 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.085888 Jul 27 20:30:29.963299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1009/2029] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:29 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:30.603597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cd2d9f9e-73c3-4d13-b99e-6fe8493e6365 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:30.606506 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cd2d9f9e-73c3-4d13-b99e-6fe8493e6365 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:30.613059 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cd2d9f9e-73c3-4d13-b99e-6fe8493e6365 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:30.613514 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cd2d9f9e-73c3-4d13-b99e-6fe8493e6365 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:30.614310 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cd2d9f9e-73c3-4d13-b99e-6fe8493e6365 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:30.614745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cd2d9f9e-73c3-4d13-b99e-6fe8493e6365 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:30.645351 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cd2d9f9e-73c3-4d13-b99e-6fe8493e6365 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045742 Jul 27 20:30:30.645900 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1021/2030] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:30 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:30.655603 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-996a1aed-3611-49e5-848d-7ce9f1b75648 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:30.657774 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-996a1aed-3611-49e5-848d-7ce9f1b75648 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:30.664188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-996a1aed-3611-49e5-848d-7ce9f1b75648 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:30.664638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-996a1aed-3611-49e5-848d-7ce9f1b75648 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:30.665430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-996a1aed-3611-49e5-848d-7ce9f1b75648 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:30.665862 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-996a1aed-3611-49e5-848d-7ce9f1b75648 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:30.695607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-996a1aed-3611-49e5-848d-7ce9f1b75648 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043677 Jul 27 20:30:30.696154 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1010/2031] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:30 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:30.983181 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-800a0eed-93d3-408e-98e6-ccdbf4a319aa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:30.983802 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-800a0eed-93d3-408e-98e6-ccdbf4a319aa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:30.990005 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-800a0eed-93d3-408e-98e6-ccdbf4a319aa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:30.990523 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-800a0eed-93d3-408e-98e6-ccdbf4a319aa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:30.991947 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-800a0eed-93d3-408e-98e6-ccdbf4a319aa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:30.992409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-800a0eed-93d3-408e-98e6-ccdbf4a319aa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:31.053863 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-800a0eed-93d3-408e-98e6-ccdbf4a319aa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:31.061687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-800a0eed-93d3-408e-98e6-ccdbf4a319aa tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082406 Jul 27 20:30:31.062241 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1022/2032] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:30 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:31.658086 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5a48e4b8-6d52-4eb9-ba37-9642d66081d2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:31.660263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5a48e4b8-6d52-4eb9-ba37-9642d66081d2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:31.667254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a48e4b8-6d52-4eb9-ba37-9642d66081d2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:31.667708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a48e4b8-6d52-4eb9-ba37-9642d66081d2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:31.668489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a48e4b8-6d52-4eb9-ba37-9642d66081d2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:31.668930 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a48e4b8-6d52-4eb9-ba37-9642d66081d2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:31.685979 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:31.700001 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5a48e4b8-6d52-4eb9-ba37-9642d66081d2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045975 Jul 27 20:30:31.700501 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1011/2033] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:31 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:31.712258 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5d246cfd-3999-455f-b483-8011d69163f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:31.714462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5d246cfd-3999-455f-b483-8011d69163f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:31.721777 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5d246cfd-3999-455f-b483-8011d69163f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:31.722262 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5d246cfd-3999-455f-b483-8011d69163f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:31.723050 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5d246cfd-3999-455f-b483-8011d69163f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:31.723495 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5d246cfd-3999-455f-b483-8011d69163f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:31.761308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5d246cfd-3999-455f-b483-8011d69163f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054809 Jul 27 20:30:31.761875 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1023/2034] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:31 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:32.082497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-57cef17c-0960-4adb-bf5e-dc0f9feedb6f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:32.083109 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-57cef17c-0960-4adb-bf5e-dc0f9feedb6f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:32.091150 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57cef17c-0960-4adb-bf5e-dc0f9feedb6f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:32.092034 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57cef17c-0960-4adb-bf5e-dc0f9feedb6f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:32.093481 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57cef17c-0960-4adb-bf5e-dc0f9feedb6f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:32.093996 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57cef17c-0960-4adb-bf5e-dc0f9feedb6f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:32.160669 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-57cef17c-0960-4adb-bf5e-dc0f9feedb6f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:32.168591 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-57cef17c-0960-4adb-bf5e-dc0f9feedb6f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.089941 Jul 27 20:30:32.169184 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1012/2035] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:32 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:32.712060 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f15699c2-85c5-4034-9615-3a07dcc8b56f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:32.714405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f15699c2-85c5-4034-9615-3a07dcc8b56f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:32.720644 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f15699c2-85c5-4034-9615-3a07dcc8b56f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:32.721147 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f15699c2-85c5-4034-9615-3a07dcc8b56f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:32.721915 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f15699c2-85c5-4034-9615-3a07dcc8b56f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:32.722345 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f15699c2-85c5-4034-9615-3a07dcc8b56f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:32.753527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f15699c2-85c5-4034-9615-3a07dcc8b56f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045595 Jul 27 20:30:32.754081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1024/2036] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:32 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:32.774725 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-05c7c85a-3998-46c8-8829-85bb989509da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:32.776882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-05c7c85a-3998-46c8-8829-85bb989509da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:32.783930 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05c7c85a-3998-46c8-8829-85bb989509da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:32.784385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05c7c85a-3998-46c8-8829-85bb989509da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:32.785230 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05c7c85a-3998-46c8-8829-85bb989509da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:32.785640 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05c7c85a-3998-46c8-8829-85bb989509da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:32.816132 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-05c7c85a-3998-46c8-8829-85bb989509da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045961 Jul 27 20:30:32.816693 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1013/2037] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:32 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:33.190388 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1e734ca1-85bb-4db0-af6b-37e6bcfe251b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:33.191010 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1e734ca1-85bb-4db0-af6b-37e6bcfe251b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:33.197755 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1e734ca1-85bb-4db0-af6b-37e6bcfe251b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:33.198208 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1e734ca1-85bb-4db0-af6b-37e6bcfe251b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:33.198982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1e734ca1-85bb-4db0-af6b-37e6bcfe251b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:33.199427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1e734ca1-85bb-4db0-af6b-37e6bcfe251b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:33.203625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:33.263085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1e734ca1-85bb-4db0-af6b-37e6bcfe251b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:33.270731 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1e734ca1-85bb-4db0-af6b-37e6bcfe251b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084310 Jul 27 20:30:33.271318 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1025/2038] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:33 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:30:33.766482 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-68685605-1686-4687-b84c-4c6c50e3c153 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:33.768720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-68685605-1686-4687-b84c-4c6c50e3c153 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:33.776119 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68685605-1686-4687-b84c-4c6c50e3c153 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:33.776720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68685605-1686-4687-b84c-4c6c50e3c153 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:33.777406 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68685605-1686-4687-b84c-4c6c50e3c153 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:33.777833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68685605-1686-4687-b84c-4c6c50e3c153 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:33.809498 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-68685605-1686-4687-b84c-4c6c50e3c153 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047015 Jul 27 20:30:33.810064 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1014/2039] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:33 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:33.828116 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-19533ef9-b66d-4d3a-8756-f41c194fbf66 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:33.831356 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-19533ef9-b66d-4d3a-8756-f41c194fbf66 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:33.838649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19533ef9-b66d-4d3a-8756-f41c194fbf66 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:33.839105 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19533ef9-b66d-4d3a-8756-f41c194fbf66 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:33.839880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19533ef9-b66d-4d3a-8756-f41c194fbf66 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:33.840324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19533ef9-b66d-4d3a-8756-f41c194fbf66 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:33.871163 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-19533ef9-b66d-4d3a-8756-f41c194fbf66 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047261 Jul 27 20:30:33.871716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1026/2040] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:33 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:34.291413 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3c9a1304-d0f9-4700-a255-26a182f05130 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:34.292028 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3c9a1304-d0f9-4700-a255-26a182f05130 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:34.298223 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c9a1304-d0f9-4700-a255-26a182f05130 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:34.298670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c9a1304-d0f9-4700-a255-26a182f05130 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:34.299437 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c9a1304-d0f9-4700-a255-26a182f05130 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:34.299872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c9a1304-d0f9-4700-a255-26a182f05130 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:34.364411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3c9a1304-d0f9-4700-a255-26a182f05130 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:34.372268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3c9a1304-d0f9-4700-a255-26a182f05130 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084759 Jul 27 20:30:34.372835 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1015/2041] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:34 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:34.823949 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b8574d38-57b8-43d7-841f-1db491f16c73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:34.826457 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b8574d38-57b8-43d7-841f-1db491f16c73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:34.834487 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b8574d38-57b8-43d7-841f-1db491f16c73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:34.837355 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b8574d38-57b8-43d7-841f-1db491f16c73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:34.838243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b8574d38-57b8-43d7-841f-1db491f16c73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:34.838698 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b8574d38-57b8-43d7-841f-1db491f16c73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:34.881441 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b8574d38-57b8-43d7-841f-1db491f16c73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063272 Jul 27 20:30:34.883888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1027/2042] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:34 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:34.889003 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f4cc6b96-cc7e-41ff-955f-d77002e97015 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:34.890606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f4cc6b96-cc7e-41ff-955f-d77002e97015 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:34.900133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f4cc6b96-cc7e-41ff-955f-d77002e97015 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:34.900472 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f4cc6b96-cc7e-41ff-955f-d77002e97015 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:34.901242 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f4cc6b96-cc7e-41ff-955f-d77002e97015 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:34.901866 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f4cc6b96-cc7e-41ff-955f-d77002e97015 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:34.940143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f4cc6b96-cc7e-41ff-955f-d77002e97015 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060455 Jul 27 20:30:34.940931 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1016/2043] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:34 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:35.392922 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-499e8713-66f2-4a65-ac95-29adfacbc9db tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:35.393702 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-499e8713-66f2-4a65-ac95-29adfacbc9db tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:35.400283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-499e8713-66f2-4a65-ac95-29adfacbc9db tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:35.400813 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-499e8713-66f2-4a65-ac95-29adfacbc9db tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:35.401628 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-499e8713-66f2-4a65-ac95-29adfacbc9db tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:35.402124 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-499e8713-66f2-4a65-ac95-29adfacbc9db tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:35.466001 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-499e8713-66f2-4a65-ac95-29adfacbc9db tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:35.473710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-499e8713-66f2-4a65-ac95-29adfacbc9db tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084664 Jul 27 20:30:35.474281 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1028/2044] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:35 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:35.895560 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0a5dd65f-78b2-41e6-89bc-04af5ceed714 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:35.897784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0a5dd65f-78b2-41e6-89bc-04af5ceed714 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:35.905362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0a5dd65f-78b2-41e6-89bc-04af5ceed714 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:35.905814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0a5dd65f-78b2-41e6-89bc-04af5ceed714 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:35.906586 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0a5dd65f-78b2-41e6-89bc-04af5ceed714 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:35.907018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0a5dd65f-78b2-41e6-89bc-04af5ceed714 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:35.938185 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0a5dd65f-78b2-41e6-89bc-04af5ceed714 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046620 Jul 27 20:30:35.938747 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1017/2045] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:35 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:35.952116 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-97c4df19-2980-4a5b-8601-21e5b8dc604f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:35.954417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-97c4df19-2980-4a5b-8601-21e5b8dc604f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:35.961057 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-97c4df19-2980-4a5b-8601-21e5b8dc604f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:35.962065 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-97c4df19-2980-4a5b-8601-21e5b8dc604f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:35.963271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-97c4df19-2980-4a5b-8601-21e5b8dc604f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:35.963718 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-97c4df19-2980-4a5b-8601-21e5b8dc604f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:35.995719 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-97c4df19-2980-4a5b-8601-21e5b8dc604f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047806 Jul 27 20:30:35.996275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1029/2046] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:35 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:36.495843 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-171f4d6a-36aa-417c-b8e2-65abb8be2cae tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:36.496454 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-171f4d6a-36aa-417c-b8e2-65abb8be2cae tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:36.502516 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-171f4d6a-36aa-417c-b8e2-65abb8be2cae tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:36.502964 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-171f4d6a-36aa-417c-b8e2-65abb8be2cae tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:36.503714 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-171f4d6a-36aa-417c-b8e2-65abb8be2cae tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:36.504144 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-171f4d6a-36aa-417c-b8e2-65abb8be2cae tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:36.568543 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-171f4d6a-36aa-417c-b8e2-65abb8be2cae tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:36.577288 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-171f4d6a-36aa-417c-b8e2-65abb8be2cae tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.085966 Jul 27 20:30:36.577867 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1018/2047] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:36 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:36.951177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c4232beb-278a-47bc-a140-e0e5e8382cc0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:36.953726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c4232beb-278a-47bc-a140-e0e5e8382cc0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:36.960114 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c4232beb-278a-47bc-a140-e0e5e8382cc0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:36.960588 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c4232beb-278a-47bc-a140-e0e5e8382cc0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:36.961470 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c4232beb-278a-47bc-a140-e0e5e8382cc0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:36.962542 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c4232beb-278a-47bc-a140-e0e5e8382cc0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:36.992561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c4232beb-278a-47bc-a140-e0e5e8382cc0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045306 Jul 27 20:30:36.993176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1030/2048] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:36 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:37.007873 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dc536124-a2ac-4b4a-93af-90628f0bde59 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:37.010583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dc536124-a2ac-4b4a-93af-90628f0bde59 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:37.017255 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc536124-a2ac-4b4a-93af-90628f0bde59 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:37.017691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc536124-a2ac-4b4a-93af-90628f0bde59 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:37.019243 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc536124-a2ac-4b4a-93af-90628f0bde59 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:37.019685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc536124-a2ac-4b4a-93af-90628f0bde59 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:37.049971 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dc536124-a2ac-4b4a-93af-90628f0bde59 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046033 Jul 27 20:30:37.050524 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1019/2049] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:37 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:37.597465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9ace6150-01d5-4f1d-8290-d33f9c18d406 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:37.598013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9ace6150-01d5-4f1d-8290-d33f9c18d406 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:37.604892 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ace6150-01d5-4f1d-8290-d33f9c18d406 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:37.605376 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ace6150-01d5-4f1d-8290-d33f9c18d406 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:37.606145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ace6150-01d5-4f1d-8290-d33f9c18d406 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:37.606593 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ace6150-01d5-4f1d-8290-d33f9c18d406 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:37.671107 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9ace6150-01d5-4f1d-8290-d33f9c18d406 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:37.679471 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9ace6150-01d5-4f1d-8290-d33f9c18d406 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.085725 Jul 27 20:30:37.680028 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1031/2050] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:37 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:38.005184 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f65043b1-9caa-4424-ba97-cf7ee3f58102 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:38.007435 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f65043b1-9caa-4424-ba97-cf7ee3f58102 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:38.014724 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f65043b1-9caa-4424-ba97-cf7ee3f58102 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:38.015303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f65043b1-9caa-4424-ba97-cf7ee3f58102 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:38.016118 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f65043b1-9caa-4424-ba97-cf7ee3f58102 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:38.016489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f65043b1-9caa-4424-ba97-cf7ee3f58102 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:38.045234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f65043b1-9caa-4424-ba97-cf7ee3f58102 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044162 Jul 27 20:30:38.045985 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1020/2051] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:37 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:38.062239 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-00e674a5-9aa3-4d57-a22b-68cc162a6f9a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:38.064459 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-00e674a5-9aa3-4d57-a22b-68cc162a6f9a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:38.071542 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00e674a5-9aa3-4d57-a22b-68cc162a6f9a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:38.072724 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00e674a5-9aa3-4d57-a22b-68cc162a6f9a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:38.073184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00e674a5-9aa3-4d57-a22b-68cc162a6f9a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:38.073638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00e674a5-9aa3-4d57-a22b-68cc162a6f9a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:38.103846 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-00e674a5-9aa3-4d57-a22b-68cc162a6f9a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045463 Jul 27 20:30:38.104402 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1032/2052] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:38 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:38.700423 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c9c3af93-2913-45c5-b1d6-5f3dc62c6a82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:38.701195 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c9c3af93-2913-45c5-b1d6-5f3dc62c6a82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:38.707526 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9c3af93-2913-45c5-b1d6-5f3dc62c6a82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:38.707976 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9c3af93-2913-45c5-b1d6-5f3dc62c6a82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:38.708736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9c3af93-2913-45c5-b1d6-5f3dc62c6a82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:38.709199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9c3af93-2913-45c5-b1d6-5f3dc62c6a82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:38.770385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c9c3af93-2913-45c5-b1d6-5f3dc62c6a82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:38.778929 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c9c3af93-2913-45c5-b1d6-5f3dc62c6a82 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082495 Jul 27 20:30:38.779494 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1021/2053] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:38 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:39.057692 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f2e2892b-acc3-4a1c-b841-2cb4b5c8e4f7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:39.059768 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f2e2892b-acc3-4a1c-b841-2cb4b5c8e4f7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:39.065884 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2e2892b-acc3-4a1c-b841-2cb4b5c8e4f7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:39.066469 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2e2892b-acc3-4a1c-b841-2cb4b5c8e4f7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:39.067087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2e2892b-acc3-4a1c-b841-2cb4b5c8e4f7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:39.067523 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2e2892b-acc3-4a1c-b841-2cb4b5c8e4f7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:39.098215 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f2e2892b-acc3-4a1c-b841-2cb4b5c8e4f7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044748 Jul 27 20:30:39.098762 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1033/2054] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:39 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:39.115751 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dbce6366-0083-4e2f-a13b-3d366c351dc6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:39.118098 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dbce6366-0083-4e2f-a13b-3d366c351dc6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:39.124559 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dbce6366-0083-4e2f-a13b-3d366c351dc6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:39.125046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dbce6366-0083-4e2f-a13b-3d366c351dc6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:39.125814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dbce6366-0083-4e2f-a13b-3d366c351dc6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:39.126251 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dbce6366-0083-4e2f-a13b-3d366c351dc6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:39.156358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dbce6366-0083-4e2f-a13b-3d366c351dc6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044602 Jul 27 20:30:39.156898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1022/2055] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:39 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:39.800763 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f41be441-822a-40d9-969b-d0b68d919423 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:39.801414 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f41be441-822a-40d9-969b-d0b68d919423 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:39.807718 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f41be441-822a-40d9-969b-d0b68d919423 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:39.808176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f41be441-822a-40d9-969b-d0b68d919423 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:39.808946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f41be441-822a-40d9-969b-d0b68d919423 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:39.809416 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f41be441-822a-40d9-969b-d0b68d919423 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:39.871141 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f41be441-822a-40d9-969b-d0b68d919423 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:39.878584 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f41be441-822a-40d9-969b-d0b68d919423 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081711 Jul 27 20:30:39.879140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1034/2056] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:39 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:40.111211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0ea43f2b-8f99-4c45-9924-9ccd6bf72089 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:40.113449 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0ea43f2b-8f99-4c45-9924-9ccd6bf72089 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:40.119530 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ea43f2b-8f99-4c45-9924-9ccd6bf72089 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:40.120096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ea43f2b-8f99-4c45-9924-9ccd6bf72089 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:40.120729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ea43f2b-8f99-4c45-9924-9ccd6bf72089 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:40.121192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ea43f2b-8f99-4c45-9924-9ccd6bf72089 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:40.150818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0ea43f2b-8f99-4c45-9924-9ccd6bf72089 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043576 Jul 27 20:30:40.151364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1023/2057] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:40 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:40.167729 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-494dbb56-a109-4d79-96c2-5f5ca347d3c1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:40.169937 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-494dbb56-a109-4d79-96c2-5f5ca347d3c1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:40.176441 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-494dbb56-a109-4d79-96c2-5f5ca347d3c1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:40.176893 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-494dbb56-a109-4d79-96c2-5f5ca347d3c1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:40.177698 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-494dbb56-a109-4d79-96c2-5f5ca347d3c1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:40.178138 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-494dbb56-a109-4d79-96c2-5f5ca347d3c1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:40.207878 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-494dbb56-a109-4d79-96c2-5f5ca347d3c1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044147 Jul 27 20:30:40.208419 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1035/2058] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:40 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:40.900254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f624e08b-0575-468a-b28f-fc822b2a5611 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:40.900864 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f624e08b-0575-468a-b28f-fc822b2a5611 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:40.906795 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f624e08b-0575-468a-b28f-fc822b2a5611 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:40.907232 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f624e08b-0575-468a-b28f-fc822b2a5611 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:40.908022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f624e08b-0575-468a-b28f-fc822b2a5611 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:40.908453 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f624e08b-0575-468a-b28f-fc822b2a5611 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:40.968188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f624e08b-0575-468a-b28f-fc822b2a5611 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:40.975491 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f624e08b-0575-468a-b28f-fc822b2a5611 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.079903 Jul 27 20:30:40.976043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1024/2059] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:40 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:41.163207 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7ae6aa01-06f5-4e51-91c3-ae585b24e0cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:41.165595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7ae6aa01-06f5-4e51-91c3-ae585b24e0cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:41.171594 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7ae6aa01-06f5-4e51-91c3-ae585b24e0cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:41.172184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7ae6aa01-06f5-4e51-91c3-ae585b24e0cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:41.172795 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7ae6aa01-06f5-4e51-91c3-ae585b24e0cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:41.173267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7ae6aa01-06f5-4e51-91c3-ae585b24e0cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:41.204044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7ae6aa01-06f5-4e51-91c3-ae585b24e0cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044865 Jul 27 20:30:41.204588 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1036/2060] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:41 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:41.220802 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-80545141-e07a-421d-81ea-f732d20704c2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:41.223118 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-80545141-e07a-421d-81ea-f732d20704c2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:41.230195 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80545141-e07a-421d-81ea-f732d20704c2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:41.230639 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80545141-e07a-421d-81ea-f732d20704c2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:41.231438 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80545141-e07a-421d-81ea-f732d20704c2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:41.231872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80545141-e07a-421d-81ea-f732d20704c2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:41.261778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-80545141-e07a-421d-81ea-f732d20704c2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044858 Jul 27 20:30:41.262329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1025/2061] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:41 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:41.996275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4c8ba977-d06c-447d-9af8-c487272063f3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:41.996915 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4c8ba977-d06c-447d-9af8-c487272063f3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:42.002953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4c8ba977-d06c-447d-9af8-c487272063f3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:42.003401 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4c8ba977-d06c-447d-9af8-c487272063f3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:42.004155 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4c8ba977-d06c-447d-9af8-c487272063f3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:42.004588 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4c8ba977-d06c-447d-9af8-c487272063f3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:42.064158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4c8ba977-d06c-447d-9af8-c487272063f3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:42.071661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4c8ba977-d06c-447d-9af8-c487272063f3 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.079328 Jul 27 20:30:42.072206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1037/2062] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:41 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:42.216818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-14bd1bb1-3dcc-4497-a108-fbda3c70f660 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:42.219031 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-14bd1bb1-3dcc-4497-a108-fbda3c70f660 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:42.224978 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14bd1bb1-3dcc-4497-a108-fbda3c70f660 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:42.225549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14bd1bb1-3dcc-4497-a108-fbda3c70f660 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:42.226159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14bd1bb1-3dcc-4497-a108-fbda3c70f660 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:42.226585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14bd1bb1-3dcc-4497-a108-fbda3c70f660 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:42.255210 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-14bd1bb1-3dcc-4497-a108-fbda3c70f660 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042190 Jul 27 20:30:42.255679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1026/2063] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:42 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:42.274700 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1a69542a-0740-4428-89c3-d6a21bdf3d67 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:42.276936 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1a69542a-0740-4428-89c3-d6a21bdf3d67 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:42.283329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1a69542a-0740-4428-89c3-d6a21bdf3d67 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:42.283771 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1a69542a-0740-4428-89c3-d6a21bdf3d67 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:42.284526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1a69542a-0740-4428-89c3-d6a21bdf3d67 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:42.284985 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1a69542a-0740-4428-89c3-d6a21bdf3d67 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:42.313012 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1a69542a-0740-4428-89c3-d6a21bdf3d67 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042939 Jul 27 20:30:42.313594 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1038/2064] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:42 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:43.091946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5df44504-9a75-4430-9ee0-a7f2a5f492a9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:43.092563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5df44504-9a75-4430-9ee0-a7f2a5f492a9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:43.099662 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5df44504-9a75-4430-9ee0-a7f2a5f492a9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:43.100111 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5df44504-9a75-4430-9ee0-a7f2a5f492a9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:43.102691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5df44504-9a75-4430-9ee0-a7f2a5f492a9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:43.102691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5df44504-9a75-4430-9ee0-a7f2a5f492a9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:43.170432 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5df44504-9a75-4430-9ee0-a7f2a5f492a9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:43.178080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5df44504-9a75-4430-9ee0-a7f2a5f492a9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.089997 Jul 27 20:30:43.178846 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1027/2065] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:43 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:43.267696 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e67a126a-1070-4bc3-be91-f2f15ba908c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:43.269879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e67a126a-1070-4bc3-be91-f2f15ba908c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:43.276781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e67a126a-1070-4bc3-be91-f2f15ba908c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:43.277379 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e67a126a-1070-4bc3-be91-f2f15ba908c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:43.278048 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e67a126a-1070-4bc3-be91-f2f15ba908c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:43.278494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e67a126a-1070-4bc3-be91-f2f15ba908c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:43.308282 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e67a126a-1070-4bc3-be91-f2f15ba908c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044467 Jul 27 20:30:43.308836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1039/2066] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:43 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:43.325487 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a5eefae8-04a1-4039-bb3d-f975ee122e2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:43.327843 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a5eefae8-04a1-4039-bb3d-f975ee122e2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:43.334352 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a5eefae8-04a1-4039-bb3d-f975ee122e2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:43.334808 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a5eefae8-04a1-4039-bb3d-f975ee122e2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:43.335570 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a5eefae8-04a1-4039-bb3d-f975ee122e2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:43.336006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a5eefae8-04a1-4039-bb3d-f975ee122e2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:43.340149 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:43.366990 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a5eefae8-04a1-4039-bb3d-f975ee122e2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045642 Jul 27 20:30:43.367542 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1028/2067] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:43 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:44.200549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8d82fdd9-1448-4ce6-832c-bcb6f23cb579 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:44.201184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8d82fdd9-1448-4ce6-832c-bcb6f23cb579 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:44.207446 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8d82fdd9-1448-4ce6-832c-bcb6f23cb579 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:44.207893 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8d82fdd9-1448-4ce6-832c-bcb6f23cb579 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:44.208648 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8d82fdd9-1448-4ce6-832c-bcb6f23cb579 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:44.209112 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8d82fdd9-1448-4ce6-832c-bcb6f23cb579 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:44.268564 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8d82fdd9-1448-4ce6-832c-bcb6f23cb579 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:44.276335 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8d82fdd9-1448-4ce6-832c-bcb6f23cb579 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080123 Jul 27 20:30:44.276912 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1040/2068] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:44 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:44.319936 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6481db7d-aac8-4bd1-8d40-a69f68e94e4b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:44.322802 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6481db7d-aac8-4bd1-8d40-a69f68e94e4b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:44.329264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6481db7d-aac8-4bd1-8d40-a69f68e94e4b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:44.329843 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6481db7d-aac8-4bd1-8d40-a69f68e94e4b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:44.330394 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6481db7d-aac8-4bd1-8d40-a69f68e94e4b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:44.330826 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6481db7d-aac8-4bd1-8d40-a69f68e94e4b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:44.359758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6481db7d-aac8-4bd1-8d40-a69f68e94e4b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043796 Jul 27 20:30:44.360307 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1029/2069] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:44 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:44.379252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0c504747-00fd-4a84-81f5-755b2a481566 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:44.381488 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0c504747-00fd-4a84-81f5-755b2a481566 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:44.388172 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0c504747-00fd-4a84-81f5-755b2a481566 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:44.388623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0c504747-00fd-4a84-81f5-755b2a481566 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:44.389421 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0c504747-00fd-4a84-81f5-755b2a481566 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:44.389859 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0c504747-00fd-4a84-81f5-755b2a481566 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:44.414198 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:44.419983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0c504747-00fd-4a84-81f5-755b2a481566 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044703 Jul 27 20:30:44.420539 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1041/2070] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:44 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:45.297304 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3beaa54b-b0bd-4547-a381-0ce89781e74f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:45.297839 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3beaa54b-b0bd-4547-a381-0ce89781e74f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:45.303876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3beaa54b-b0bd-4547-a381-0ce89781e74f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:45.304337 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3beaa54b-b0bd-4547-a381-0ce89781e74f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:45.305782 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3beaa54b-b0bd-4547-a381-0ce89781e74f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:45.306261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3beaa54b-b0bd-4547-a381-0ce89781e74f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:45.368152 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3beaa54b-b0bd-4547-a381-0ce89781e74f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:45.372503 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-74d7f9fc-8293-45d1-be9a-a06d5a7f45c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:45.374800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-74d7f9fc-8293-45d1-be9a-a06d5a7f45c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:45.376179 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3beaa54b-b0bd-4547-a381-0ce89781e74f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082875 Jul 27 20:30:45.376760 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1030/2071] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:45 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:45.381189 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-74d7f9fc-8293-45d1-be9a-a06d5a7f45c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:45.381652 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-74d7f9fc-8293-45d1-be9a-a06d5a7f45c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:45.382428 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-74d7f9fc-8293-45d1-be9a-a06d5a7f45c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:45.382875 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-74d7f9fc-8293-45d1-be9a-a06d5a7f45c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:45.411670 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-74d7f9fc-8293-45d1-be9a-a06d5a7f45c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043710 Jul 27 20:30:45.412220 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1042/2072] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:45 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:45.432297 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ac80d206-8167-435d-b597-6a5e8fab276b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:45.434478 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ac80d206-8167-435d-b597-6a5e8fab276b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:45.440513 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ac80d206-8167-435d-b597-6a5e8fab276b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:45.440975 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ac80d206-8167-435d-b597-6a5e8fab276b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:45.441763 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ac80d206-8167-435d-b597-6a5e8fab276b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:45.442208 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ac80d206-8167-435d-b597-6a5e8fab276b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:45.472658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ac80d206-8167-435d-b597-6a5e8fab276b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044895 Jul 27 20:30:45.473250 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1031/2073] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:45 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:46.397402 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b6bffff4-1ab2-4bed-8b4e-c94ecb219455 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:46.398017 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b6bffff4-1ab2-4bed-8b4e-c94ecb219455 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:46.405042 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b6bffff4-1ab2-4bed-8b4e-c94ecb219455 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:46.405492 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b6bffff4-1ab2-4bed-8b4e-c94ecb219455 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:46.406252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b6bffff4-1ab2-4bed-8b4e-c94ecb219455 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:46.406688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b6bffff4-1ab2-4bed-8b4e-c94ecb219455 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:46.424599 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-71482505-bea4-4f5f-9b7e-0e9a327dd796 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:46.426989 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-71482505-bea4-4f5f-9b7e-0e9a327dd796 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:46.435070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71482505-bea4-4f5f-9b7e-0e9a327dd796 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:46.435555 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71482505-bea4-4f5f-9b7e-0e9a327dd796 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:46.436329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71482505-bea4-4f5f-9b7e-0e9a327dd796 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:46.436758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71482505-bea4-4f5f-9b7e-0e9a327dd796 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:46.468049 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-71482505-bea4-4f5f-9b7e-0e9a327dd796 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047283 Jul 27 20:30:46.468621 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1032/2074] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:46 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:30:46.476503 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b6bffff4-1ab2-4bed-8b4e-c94ecb219455 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:46.484891 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b6bffff4-1ab2-4bed-8b4e-c94ecb219455 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.091305 Jul 27 20:30:46.485209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a2938c1d-3326-4315-8d54-a69964a87ee1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:46.485486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1043/2075] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:46 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:30:46.487357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a2938c1d-3326-4315-8d54-a69964a87ee1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:46.493986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a2938c1d-3326-4315-8d54-a69964a87ee1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:46.494818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a2938c1d-3326-4315-8d54-a69964a87ee1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:46.495577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a2938c1d-3326-4315-8d54-a69964a87ee1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:46.496029 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a2938c1d-3326-4315-8d54-a69964a87ee1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:46.525216 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a2938c1d-3326-4315-8d54-a69964a87ee1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043692 Jul 27 20:30:46.525763 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1033/2076] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:46 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:47.480358 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8caa0ff7-70a5-4aa2-a672-eed2067f0966 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:47.482589 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8caa0ff7-70a5-4aa2-a672-eed2067f0966 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:47.489159 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8caa0ff7-70a5-4aa2-a672-eed2067f0966 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:47.489646 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8caa0ff7-70a5-4aa2-a672-eed2067f0966 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:47.490415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8caa0ff7-70a5-4aa2-a672-eed2067f0966 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:47.490856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8caa0ff7-70a5-4aa2-a672-eed2067f0966 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:47.505458 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4fa3a1d3-0902-4c5f-827c-1894404162ff tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:47.506169 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4fa3a1d3-0902-4c5f-827c-1894404162ff tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:47.512380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4fa3a1d3-0902-4c5f-827c-1894404162ff tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:47.512835 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4fa3a1d3-0902-4c5f-827c-1894404162ff tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:47.513683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4fa3a1d3-0902-4c5f-827c-1894404162ff tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:47.514126 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4fa3a1d3-0902-4c5f-827c-1894404162ff tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:47.521923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8caa0ff7-70a5-4aa2-a672-eed2067f0966 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046078 Jul 27 20:30:47.522482 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1044/2077] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:47 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:47.537849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e8719cec-8199-4f97-8639-ad432f357c05 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:47.540613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e8719cec-8199-4f97-8639-ad432f357c05 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:47.546624 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8719cec-8199-4f97-8639-ad432f357c05 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:47.547085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8719cec-8199-4f97-8639-ad432f357c05 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:47.547853 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8719cec-8199-4f97-8639-ad432f357c05 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:47.548295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8719cec-8199-4f97-8639-ad432f357c05 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:47.575992 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4fa3a1d3-0902-4c5f-827c-1894404162ff tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:47.579353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e8719cec-8199-4f97-8639-ad432f357c05 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045280 Jul 27 20:30:47.580186 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1045/2078] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:47 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:47.584747 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4fa3a1d3-0902-4c5f-827c-1894404162ff tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083232 Jul 27 20:30:47.585390 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1034/2079] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:47 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:30:48.534222 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-48f631ae-af3a-4cda-9b8a-07acda88d258 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:48.536403 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-48f631ae-af3a-4cda-9b8a-07acda88d258 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:48.543738 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48f631ae-af3a-4cda-9b8a-07acda88d258 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:48.544196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48f631ae-af3a-4cda-9b8a-07acda88d258 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:48.544984 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48f631ae-af3a-4cda-9b8a-07acda88d258 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:48.545431 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48f631ae-af3a-4cda-9b8a-07acda88d258 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:48.575223 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-48f631ae-af3a-4cda-9b8a-07acda88d258 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044944 Jul 27 20:30:48.575758 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1046/2080] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:48 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:48.590965 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-704c3b50-ec90-46be-a9d1-3cc9df658ae6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:48.593162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-704c3b50-ec90-46be-a9d1-3cc9df658ae6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:48.599677 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-704c3b50-ec90-46be-a9d1-3cc9df658ae6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:48.600158 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-704c3b50-ec90-46be-a9d1-3cc9df658ae6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:48.600935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-704c3b50-ec90-46be-a9d1-3cc9df658ae6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:48.601396 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-704c3b50-ec90-46be-a9d1-3cc9df658ae6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:48.605764 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9bec3cb6-442e-4ecf-b8f6-a77ee14b14d6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:48.606378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9bec3cb6-442e-4ecf-b8f6-a77ee14b14d6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:48.614383 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9bec3cb6-442e-4ecf-b8f6-a77ee14b14d6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:48.614957 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9bec3cb6-442e-4ecf-b8f6-a77ee14b14d6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:48.615728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9bec3cb6-442e-4ecf-b8f6-a77ee14b14d6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:48.616169 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9bec3cb6-442e-4ecf-b8f6-a77ee14b14d6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:48.634514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-704c3b50-ec90-46be-a9d1-3cc9df658ae6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046749 Jul 27 20:30:48.635519 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1035/2081] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:48 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:48.690148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9bec3cb6-442e-4ecf-b8f6-a77ee14b14d6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:48.699055 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9bec3cb6-442e-4ecf-b8f6-a77ee14b14d6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.097188 Jul 27 20:30:48.699624 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1047/2082] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:48 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:30:49.587911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c6e774e3-a116-4837-9684-da646ff9005b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:49.590101 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c6e774e3-a116-4837-9684-da646ff9005b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:49.596110 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c6e774e3-a116-4837-9684-da646ff9005b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:49.596681 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c6e774e3-a116-4837-9684-da646ff9005b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:49.597356 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c6e774e3-a116-4837-9684-da646ff9005b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:49.597798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c6e774e3-a116-4837-9684-da646ff9005b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:49.627644 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c6e774e3-a116-4837-9684-da646ff9005b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044380 Jul 27 20:30:49.628199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1036/2083] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:49 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:49.649396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-74cfd2c5-d0b7-4388-96f4-7becc7b513c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:49.651522 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-74cfd2c5-d0b7-4388-96f4-7becc7b513c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:49.658195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-74cfd2c5-d0b7-4388-96f4-7becc7b513c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:49.658645 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-74cfd2c5-d0b7-4388-96f4-7becc7b513c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:49.659400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-74cfd2c5-d0b7-4388-96f4-7becc7b513c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:49.659833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-74cfd2c5-d0b7-4388-96f4-7becc7b513c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:49.692118 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-74cfd2c5-d0b7-4388-96f4-7becc7b513c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047236 Jul 27 20:30:49.692586 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1048/2084] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:49 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:30:49.726470 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ba2756a2-b69f-45a8-8299-79b61befe6cc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:49.727183 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ba2756a2-b69f-45a8-8299-79b61befe6cc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:49.733096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba2756a2-b69f-45a8-8299-79b61befe6cc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:49.733540 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba2756a2-b69f-45a8-8299-79b61befe6cc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:49.734292 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba2756a2-b69f-45a8-8299-79b61befe6cc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:49.734725 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba2756a2-b69f-45a8-8299-79b61befe6cc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:49.795262 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ba2756a2-b69f-45a8-8299-79b61befe6cc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:49.802727 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ba2756a2-b69f-45a8-8299-79b61befe6cc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080012 Jul 27 20:30:49.803292 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1037/2085] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:49 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:50.639908 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1993441c-81cf-4973-b021-d5c68490e5db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:50.642097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1993441c-81cf-4973-b021-d5c68490e5db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:50.648113 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1993441c-81cf-4973-b021-d5c68490e5db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:50.648581 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1993441c-81cf-4973-b021-d5c68490e5db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:50.649385 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1993441c-81cf-4973-b021-d5c68490e5db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:50.649826 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1993441c-81cf-4973-b021-d5c68490e5db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:50.679000 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1993441c-81cf-4973-b021-d5c68490e5db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043056 Jul 27 20:30:50.679538 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1049/2086] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:50 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:50.705359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2f996adb-d8fb-4502-af27-2eaf77ba6dec tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:50.707557 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2f996adb-d8fb-4502-af27-2eaf77ba6dec tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:50.714486 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2f996adb-d8fb-4502-af27-2eaf77ba6dec tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:50.714938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2f996adb-d8fb-4502-af27-2eaf77ba6dec tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:50.715709 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2f996adb-d8fb-4502-af27-2eaf77ba6dec tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:50.716151 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2f996adb-d8fb-4502-af27-2eaf77ba6dec tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:50.745953 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2f996adb-d8fb-4502-af27-2eaf77ba6dec tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044936 Jul 27 20:30:50.746496 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1038/2087] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:50 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:50.823510 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-718d6c67-a72b-41ed-a781-59e50c3d4eb7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:50.824132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-718d6c67-a72b-41ed-a781-59e50c3d4eb7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:50.830547 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-718d6c67-a72b-41ed-a781-59e50c3d4eb7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:50.831004 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-718d6c67-a72b-41ed-a781-59e50c3d4eb7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:50.831766 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-718d6c67-a72b-41ed-a781-59e50c3d4eb7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:50.832208 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-718d6c67-a72b-41ed-a781-59e50c3d4eb7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:50.892392 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-718d6c67-a72b-41ed-a781-59e50c3d4eb7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:50.900401 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-718d6c67-a72b-41ed-a781-59e50c3d4eb7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080905 Jul 27 20:30:50.900988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1050/2088] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:50 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:51.692369 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e009c980-31dd-4b9a-a884-ce3dd16d501d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:51.694520 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e009c980-31dd-4b9a-a884-ce3dd16d501d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:51.701145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e009c980-31dd-4b9a-a884-ce3dd16d501d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:51.701587 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e009c980-31dd-4b9a-a884-ce3dd16d501d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:51.702593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e009c980-31dd-4b9a-a884-ce3dd16d501d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:51.703019 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e009c980-31dd-4b9a-a884-ce3dd16d501d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:51.731533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e009c980-31dd-4b9a-a884-ce3dd16d501d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043745 Jul 27 20:30:51.732089 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1039/2089] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:51 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:51.758987 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f65e2aad-2d06-4efa-acc1-186f31a15be1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:51.761164 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f65e2aad-2d06-4efa-acc1-186f31a15be1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:51.767676 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f65e2aad-2d06-4efa-acc1-186f31a15be1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:51.768134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f65e2aad-2d06-4efa-acc1-186f31a15be1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:51.768895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f65e2aad-2d06-4efa-acc1-186f31a15be1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:51.769361 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f65e2aad-2d06-4efa-acc1-186f31a15be1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:51.797362 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f65e2aad-2d06-4efa-acc1-186f31a15be1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042976 Jul 27 20:30:51.797911 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1051/2090] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:51 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:51.920039 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9fbddcf7-a558-4cbb-a631-a0c21fcb0670 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:51.920643 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9fbddcf7-a558-4cbb-a631-a0c21fcb0670 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:51.926564 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9fbddcf7-a558-4cbb-a631-a0c21fcb0670 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:51.927003 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9fbddcf7-a558-4cbb-a631-a0c21fcb0670 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:51.927745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9fbddcf7-a558-4cbb-a631-a0c21fcb0670 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:51.928175 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9fbddcf7-a558-4cbb-a631-a0c21fcb0670 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:51.992057 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9fbddcf7-a558-4cbb-a631-a0c21fcb0670 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:52.000594 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9fbddcf7-a558-4cbb-a631-a0c21fcb0670 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084363 Jul 27 20:30:52.001195 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1040/2091] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:51 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:52.743906 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-03c4ef51-94cc-4d9a-a99b-a0518c04110d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:52.746180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-03c4ef51-94cc-4d9a-a99b-a0518c04110d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:52.752175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-03c4ef51-94cc-4d9a-a99b-a0518c04110d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:52.752626 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-03c4ef51-94cc-4d9a-a99b-a0518c04110d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:52.753426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-03c4ef51-94cc-4d9a-a99b-a0518c04110d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:52.753865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-03c4ef51-94cc-4d9a-a99b-a0518c04110d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:52.783461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-03c4ef51-94cc-4d9a-a99b-a0518c04110d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043656 Jul 27 20:30:52.784064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1052/2092] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:52 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:52.810256 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b77ee8dd-8d6f-4f92-a02a-e839a3bdbfbb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:52.812529 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b77ee8dd-8d6f-4f92-a02a-e839a3bdbfbb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:52.818948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b77ee8dd-8d6f-4f92-a02a-e839a3bdbfbb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:52.819393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b77ee8dd-8d6f-4f92-a02a-e839a3bdbfbb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:52.820149 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b77ee8dd-8d6f-4f92-a02a-e839a3bdbfbb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:52.821218 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b77ee8dd-8d6f-4f92-a02a-e839a3bdbfbb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:52.850733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b77ee8dd-8d6f-4f92-a02a-e839a3bdbfbb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044467 Jul 27 20:30:52.851278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1041/2093] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:52 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:53.020417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f4e72e90-5988-4440-9914-778fbee07bf9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:53.020995 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f4e72e90-5988-4440-9914-778fbee07bf9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:53.027595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f4e72e90-5988-4440-9914-778fbee07bf9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:53.028055 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f4e72e90-5988-4440-9914-778fbee07bf9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:53.028834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f4e72e90-5988-4440-9914-778fbee07bf9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:53.029304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f4e72e90-5988-4440-9914-778fbee07bf9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:53.090958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f4e72e90-5988-4440-9914-778fbee07bf9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:53.098479 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f4e72e90-5988-4440-9914-778fbee07bf9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082010 Jul 27 20:30:53.099046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1053/2094] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:53 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:53.795832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f3e14baf-2f80-461b-ac41-2a585f2bb4b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:53.797936 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f3e14baf-2f80-461b-ac41-2a585f2bb4b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:53.803956 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3e14baf-2f80-461b-ac41-2a585f2bb4b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:53.804410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3e14baf-2f80-461b-ac41-2a585f2bb4b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:53.805703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3e14baf-2f80-461b-ac41-2a585f2bb4b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:53.806145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3e14baf-2f80-461b-ac41-2a585f2bb4b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:53.835289 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f3e14baf-2f80-461b-ac41-2a585f2bb4b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043518 Jul 27 20:30:53.835904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1042/2095] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:53 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:53.863159 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3c053de2-f095-45ab-a1bc-5a4ca7c683e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:53.865371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3c053de2-f095-45ab-a1bc-5a4ca7c683e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:53.872390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c053de2-f095-45ab-a1bc-5a4ca7c683e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:53.872846 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c053de2-f095-45ab-a1bc-5a4ca7c683e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:53.873648 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c053de2-f095-45ab-a1bc-5a4ca7c683e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:53.874094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c053de2-f095-45ab-a1bc-5a4ca7c683e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:53.903017 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3c053de2-f095-45ab-a1bc-5a4ca7c683e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044038 Jul 27 20:30:53.903725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1054/2096] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:53 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:54.119854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-74f31437-1cd1-4ae0-9680-4491b69027af tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:54.120464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-74f31437-1cd1-4ae0-9680-4491b69027af tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:54.126454 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74f31437-1cd1-4ae0-9680-4491b69027af tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:54.126896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74f31437-1cd1-4ae0-9680-4491b69027af tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:54.127676 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74f31437-1cd1-4ae0-9680-4491b69027af tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:54.128109 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74f31437-1cd1-4ae0-9680-4491b69027af tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:54.189171 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-74f31437-1cd1-4ae0-9680-4491b69027af tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:54.197531 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-74f31437-1cd1-4ae0-9680-4491b69027af tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081520 Jul 27 20:30:54.198095 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1043/2097] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:54 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:54.848157 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e6c6dec5-342b-4a05-aebe-d693228dc23f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:54.851303 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e6c6dec5-342b-4a05-aebe-d693228dc23f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:54.859062 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e6c6dec5-342b-4a05-aebe-d693228dc23f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:54.859514 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e6c6dec5-342b-4a05-aebe-d693228dc23f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:54.860313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e6c6dec5-342b-4a05-aebe-d693228dc23f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:54.860745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e6c6dec5-342b-4a05-aebe-d693228dc23f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:54.894933 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e6c6dec5-342b-4a05-aebe-d693228dc23f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051086 Jul 27 20:30:54.895579 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1055/2098] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:54 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:54.916842 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-76f5a95b-26d8-4c0d-9a70-f8af9fbef980 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:54.919090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-76f5a95b-26d8-4c0d-9a70-f8af9fbef980 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:54.927546 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76f5a95b-26d8-4c0d-9a70-f8af9fbef980 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:54.928398 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76f5a95b-26d8-4c0d-9a70-f8af9fbef980 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:54.929205 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76f5a95b-26d8-4c0d-9a70-f8af9fbef980 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:54.930491 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76f5a95b-26d8-4c0d-9a70-f8af9fbef980 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:54.958627 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:54.964388 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-76f5a95b-26d8-4c0d-9a70-f8af9fbef980 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052991 Jul 27 20:30:54.964979 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1044/2099] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:54 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:55.218671 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b9b44d1b-2bf3-4a53-acd5-13ba0a514775 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:55.219287 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b9b44d1b-2bf3-4a53-acd5-13ba0a514775 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:55.225616 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b9b44d1b-2bf3-4a53-acd5-13ba0a514775 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:55.226118 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b9b44d1b-2bf3-4a53-acd5-13ba0a514775 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:55.227394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b9b44d1b-2bf3-4a53-acd5-13ba0a514775 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:55.227827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b9b44d1b-2bf3-4a53-acd5-13ba0a514775 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:55.301789 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b9b44d1b-2bf3-4a53-acd5-13ba0a514775 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:55.313213 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b9b44d1b-2bf3-4a53-acd5-13ba0a514775 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.098481 Jul 27 20:30:55.313977 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1056/2100] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:55 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:55.909771 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e9eacff3-99c5-4e61-9890-ea2c026bc080 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:55.911898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e9eacff3-99c5-4e61-9890-ea2c026bc080 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:55.918052 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e9eacff3-99c5-4e61-9890-ea2c026bc080 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:55.918628 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e9eacff3-99c5-4e61-9890-ea2c026bc080 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:55.919230 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e9eacff3-99c5-4e61-9890-ea2c026bc080 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:55.919657 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e9eacff3-99c5-4e61-9890-ea2c026bc080 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:55.947818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e9eacff3-99c5-4e61-9890-ea2c026bc080 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042859 Jul 27 20:30:55.948358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1045/2101] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:55 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:55.978583 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fc88fdc2-2b53-4bef-8e0e-f73ca96b1e54 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:55.980746 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fc88fdc2-2b53-4bef-8e0e-f73ca96b1e54 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:55.983140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=86 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:55.988419 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fc88fdc2-2b53-4bef-8e0e-f73ca96b1e54 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:55.988863 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fc88fdc2-2b53-4bef-8e0e-f73ca96b1e54 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:55.989648 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fc88fdc2-2b53-4bef-8e0e-f73ca96b1e54 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:55.990082 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fc88fdc2-2b53-4bef-8e0e-f73ca96b1e54 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:56.019551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fc88fdc2-2b53-4bef-8e0e-f73ca96b1e54 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045038 Jul 27 20:30:56.020095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1057/2102] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:55 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:56.334704 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dc53e1da-70ad-46a7-8399-7011e35f9dc8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:56.335245 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dc53e1da-70ad-46a7-8399-7011e35f9dc8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:56.341418 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc53e1da-70ad-46a7-8399-7011e35f9dc8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:56.341868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc53e1da-70ad-46a7-8399-7011e35f9dc8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:56.342626 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc53e1da-70ad-46a7-8399-7011e35f9dc8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:56.343063 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc53e1da-70ad-46a7-8399-7011e35f9dc8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:56.403449 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dc53e1da-70ad-46a7-8399-7011e35f9dc8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:56.411097 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dc53e1da-70ad-46a7-8399-7011e35f9dc8 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080296 Jul 27 20:30:56.411656 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1046/2103] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:56 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:56.960258 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c384da80-c783-4a4d-a52d-7da7c06aacc0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:56.963425 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c384da80-c783-4a4d-a52d-7da7c06aacc0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:56.969561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c384da80-c783-4a4d-a52d-7da7c06aacc0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:56.970020 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c384da80-c783-4a4d-a52d-7da7c06aacc0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:56.970830 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c384da80-c783-4a4d-a52d-7da7c06aacc0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:56.971276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c384da80-c783-4a4d-a52d-7da7c06aacc0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:56.988525 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:57.001470 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c384da80-c783-4a4d-a52d-7da7c06aacc0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045171 Jul 27 20:30:57.002019 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1058/2104] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:56 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:30:57.032046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ed72b3f3-afe0-4ae6-a2cc-1dce8c721314 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:57.034439 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ed72b3f3-afe0-4ae6-a2cc-1dce8c721314 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:57.036700 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=86 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:30:57.042896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed72b3f3-afe0-4ae6-a2cc-1dce8c721314 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:57.043349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed72b3f3-afe0-4ae6-a2cc-1dce8c721314 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:57.044146 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed72b3f3-afe0-4ae6-a2cc-1dce8c721314 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:57.044585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed72b3f3-afe0-4ae6-a2cc-1dce8c721314 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:57.073653 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ed72b3f3-afe0-4ae6-a2cc-1dce8c721314 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045536 Jul 27 20:30:57.074219 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1047/2105] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:57 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:57.432298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-80f59322-5fa6-48fe-9287-ba6b41ba5e20 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:57.432920 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-80f59322-5fa6-48fe-9287-ba6b41ba5e20 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:57.439021 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-80f59322-5fa6-48fe-9287-ba6b41ba5e20 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:57.439473 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-80f59322-5fa6-48fe-9287-ba6b41ba5e20 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:57.440235 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-80f59322-5fa6-48fe-9287-ba6b41ba5e20 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:57.440686 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-80f59322-5fa6-48fe-9287-ba6b41ba5e20 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:57.503065 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-80f59322-5fa6-48fe-9287-ba6b41ba5e20 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:57.511226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-80f59322-5fa6-48fe-9287-ba6b41ba5e20 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.082903 Jul 27 20:30:57.511772 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1059/2106] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:57 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:58.014257 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4a282f1b-827e-4c9f-b7a2-e1a9ba780fea tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:58.016435 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4a282f1b-827e-4c9f-b7a2-e1a9ba780fea tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:58.022430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a282f1b-827e-4c9f-b7a2-e1a9ba780fea tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:58.022878 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a282f1b-827e-4c9f-b7a2-e1a9ba780fea tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:58.023813 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a282f1b-827e-4c9f-b7a2-e1a9ba780fea tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:58.024409 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a282f1b-827e-4c9f-b7a2-e1a9ba780fea tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:58.053486 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4a282f1b-827e-4c9f-b7a2-e1a9ba780fea tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043144 Jul 27 20:30:58.054293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1048/2107] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:58 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:58.085576 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ec1a0a45-f1a3-48ed-9014-cd39e6846f1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:58.088108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ec1a0a45-f1a3-48ed-9014-cd39e6846f1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:58.094688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec1a0a45-f1a3-48ed-9014-cd39e6846f1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:58.095143 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec1a0a45-f1a3-48ed-9014-cd39e6846f1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:58.095908 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec1a0a45-f1a3-48ed-9014-cd39e6846f1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:58.096343 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec1a0a45-f1a3-48ed-9014-cd39e6846f1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:58.127326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ec1a0a45-f1a3-48ed-9014-cd39e6846f1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045684 Jul 27 20:30:58.127874 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1060/2108] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:58 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:58.532122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d83129f6-a3ee-4add-8104-5548f4f602bc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:58.532728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d83129f6-a3ee-4add-8104-5548f4f602bc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:58.538662 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d83129f6-a3ee-4add-8104-5548f4f602bc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:58.539738 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d83129f6-a3ee-4add-8104-5548f4f602bc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:58.540602 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d83129f6-a3ee-4add-8104-5548f4f602bc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:58.541064 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d83129f6-a3ee-4add-8104-5548f4f602bc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:58.600984 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d83129f6-a3ee-4add-8104-5548f4f602bc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:58.609179 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d83129f6-a3ee-4add-8104-5548f4f602bc tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080891 Jul 27 20:30:58.609749 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1049/2109] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:58 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:30:59.066649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-acf75f1a-639f-4010-ac9a-b9958222886d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:59.069089 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-acf75f1a-639f-4010-ac9a-b9958222886d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:59.076939 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-acf75f1a-639f-4010-ac9a-b9958222886d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:59.076939 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-acf75f1a-639f-4010-ac9a-b9958222886d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:59.077896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-acf75f1a-639f-4010-ac9a-b9958222886d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:59.078369 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-acf75f1a-639f-4010-ac9a-b9958222886d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:59.107647 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-acf75f1a-639f-4010-ac9a-b9958222886d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045061 Jul 27 20:30:59.108279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1061/2110] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:30:59 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:30:59.140006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-61878dfa-9b66-466b-95fa-2fd8c7d0eccd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:59.142181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-61878dfa-9b66-466b-95fa-2fd8c7d0eccd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:59.148941 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-61878dfa-9b66-466b-95fa-2fd8c7d0eccd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:59.149532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-61878dfa-9b66-466b-95fa-2fd8c7d0eccd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:59.150301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-61878dfa-9b66-466b-95fa-2fd8c7d0eccd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:59.150741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-61878dfa-9b66-466b-95fa-2fd8c7d0eccd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:59.179087 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-61878dfa-9b66-466b-95fa-2fd8c7d0eccd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042996 Jul 27 20:30:59.180132 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1050/2111] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:30:59 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:30:59.629582 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-099bc897-624d-48a5-9c5c-16a365cb0074 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:30:59.630223 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-099bc897-624d-48a5-9c5c-16a365cb0074 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:30:59.636753 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-099bc897-624d-48a5-9c5c-16a365cb0074 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:59.637235 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-099bc897-624d-48a5-9c5c-16a365cb0074 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:59.637997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-099bc897-624d-48a5-9c5c-16a365cb0074 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:30:59.638436 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-099bc897-624d-48a5-9c5c-16a365cb0074 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:30:59.697780 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-099bc897-624d-48a5-9c5c-16a365cb0074 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:30:59.705497 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-099bc897-624d-48a5-9c5c-16a365cb0074 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.079759 Jul 27 20:30:59.706052 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1062/2112] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:30:59 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:00.120567 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f57c62e0-cab3-443a-890f-e1100337121b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:00.122878 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f57c62e0-cab3-443a-890f-e1100337121b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:00.129012 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f57c62e0-cab3-443a-890f-e1100337121b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:00.129455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f57c62e0-cab3-443a-890f-e1100337121b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:00.130202 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f57c62e0-cab3-443a-890f-e1100337121b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:00.130635 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f57c62e0-cab3-443a-890f-e1100337121b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:00.160154 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f57c62e0-cab3-443a-890f-e1100337121b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044233 Jul 27 20:31:00.160786 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1051/2113] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:31:00 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:31:00.191703 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5c53331b-197e-47a3-bec9-aa5bfe81f8f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:00.193857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5c53331b-197e-47a3-bec9-aa5bfe81f8f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:00.200238 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5c53331b-197e-47a3-bec9-aa5bfe81f8f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:00.200685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5c53331b-197e-47a3-bec9-aa5bfe81f8f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:00.201484 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5c53331b-197e-47a3-bec9-aa5bfe81f8f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:00.201917 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5c53331b-197e-47a3-bec9-aa5bfe81f8f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:00.230805 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5c53331b-197e-47a3-bec9-aa5bfe81f8f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043025 Jul 27 20:31:00.231341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1063/2114] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:00 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:00.770913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-400b0a0e-8717-4ebc-8672-464a5bc371a9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:00.771519 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-400b0a0e-8717-4ebc-8672-464a5bc371a9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:00.777474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-400b0a0e-8717-4ebc-8672-464a5bc371a9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:00.777921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-400b0a0e-8717-4ebc-8672-464a5bc371a9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:00.778675 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-400b0a0e-8717-4ebc-8672-464a5bc371a9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:00.779111 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-400b0a0e-8717-4ebc-8672-464a5bc371a9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:00.843074 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-400b0a0e-8717-4ebc-8672-464a5bc371a9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:00.850441 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-400b0a0e-8717-4ebc-8672-464a5bc371a9 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.127490 Jul 27 20:31:00.851000 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1052/2115] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:00 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:01.173024 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5d029ad5-bcd8-4ca5-a20b-20c5c70ffd8d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:01.175169 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5d029ad5-bcd8-4ca5-a20b-20c5c70ffd8d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:01.182299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5d029ad5-bcd8-4ca5-a20b-20c5c70ffd8d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:01.182752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5d029ad5-bcd8-4ca5-a20b-20c5c70ffd8d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:01.183521 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5d029ad5-bcd8-4ca5-a20b-20c5c70ffd8d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:01.183957 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5d029ad5-bcd8-4ca5-a20b-20c5c70ffd8d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:01.212675 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5d029ad5-bcd8-4ca5-a20b-20c5c70ffd8d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043669 Jul 27 20:31:01.213341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1064/2116] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:31:01 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:31:01.243704 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f0250303-1a04-492f-a2f8-a51c5230dfb1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:01.245896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f0250303-1a04-492f-a2f8-a51c5230dfb1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:01.252192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f0250303-1a04-492f-a2f8-a51c5230dfb1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:01.252630 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f0250303-1a04-492f-a2f8-a51c5230dfb1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:01.253466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f0250303-1a04-492f-a2f8-a51c5230dfb1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:01.253896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f0250303-1a04-492f-a2f8-a51c5230dfb1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:01.282133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f0250303-1a04-492f-a2f8-a51c5230dfb1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043085 Jul 27 20:31:01.282668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1053/2117] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:01 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:01.871716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9bafe85d-3f6d-4fd8-85cc-790d1218c4c0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:01.872247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9bafe85d-3f6d-4fd8-85cc-790d1218c4c0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:01.878268 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9bafe85d-3f6d-4fd8-85cc-790d1218c4c0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:01.878716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9bafe85d-3f6d-4fd8-85cc-790d1218c4c0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:01.879473 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9bafe85d-3f6d-4fd8-85cc-790d1218c4c0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:01.879909 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9bafe85d-3f6d-4fd8-85cc-790d1218c4c0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:01.941207 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9bafe85d-3f6d-4fd8-85cc-790d1218c4c0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:01.949109 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9bafe85d-3f6d-4fd8-85cc-790d1218c4c0 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081365 Jul 27 20:31:01.949663 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1065/2118] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:01 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:02.224462 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3ff5a004-6acd-4c99-b5ab-e4ad3a2377de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:02.227666 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3ff5a004-6acd-4c99-b5ab-e4ad3a2377de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:02.233637 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ff5a004-6acd-4c99-b5ab-e4ad3a2377de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:02.234092 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ff5a004-6acd-4c99-b5ab-e4ad3a2377de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:02.234836 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ff5a004-6acd-4c99-b5ab-e4ad3a2377de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:02.235280 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ff5a004-6acd-4c99-b5ab-e4ad3a2377de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:02.264074 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3ff5a004-6acd-4c99-b5ab-e4ad3a2377de tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043503 Jul 27 20:31:02.264703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1054/2119] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:31:02 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:31:02.295141 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bfaab87d-d17c-4a88-8afe-08920bdbeb5f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:02.297317 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bfaab87d-d17c-4a88-8afe-08920bdbeb5f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:02.303809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bfaab87d-d17c-4a88-8afe-08920bdbeb5f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:02.304256 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bfaab87d-d17c-4a88-8afe-08920bdbeb5f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:02.305150 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bfaab87d-d17c-4a88-8afe-08920bdbeb5f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:02.305592 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bfaab87d-d17c-4a88-8afe-08920bdbeb5f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:02.334009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bfaab87d-d17c-4a88-8afe-08920bdbeb5f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042835 Jul 27 20:31:02.334550 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1066/2120] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:02 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:02.970349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7c829685-5605-4cb1-a6a3-2e834553a8c7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:02.970957 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7c829685-5605-4cb1-a6a3-2e834553a8c7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:02.976876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c829685-5605-4cb1-a6a3-2e834553a8c7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:02.977346 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c829685-5605-4cb1-a6a3-2e834553a8c7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:02.978091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c829685-5605-4cb1-a6a3-2e834553a8c7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:02.978518 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c829685-5605-4cb1-a6a3-2e834553a8c7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:03.038173 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7c829685-5605-4cb1-a6a3-2e834553a8c7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:03.045429 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7c829685-5605-4cb1-a6a3-2e834553a8c7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.078851 Jul 27 20:31:03.045987 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1055/2121] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:02 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:03.276682 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0cfadd31-bcc8-4825-a93e-5bec193e59e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:03.278870 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0cfadd31-bcc8-4825-a93e-5bec193e59e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:03.284983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0cfadd31-bcc8-4825-a93e-5bec193e59e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:03.285459 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0cfadd31-bcc8-4825-a93e-5bec193e59e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:03.286275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0cfadd31-bcc8-4825-a93e-5bec193e59e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:03.286677 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0cfadd31-bcc8-4825-a93e-5bec193e59e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:03.316404 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0cfadd31-bcc8-4825-a93e-5bec193e59e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044005 Jul 27 20:31:03.317066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1067/2122] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:31:03 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:31:03.346626 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2501a884-2751-42e8-b030-f68e06d693f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:03.348750 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2501a884-2751-42e8-b030-f68e06d693f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:03.355704 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2501a884-2751-42e8-b030-f68e06d693f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:03.356141 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2501a884-2751-42e8-b030-f68e06d693f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:03.356887 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2501a884-2751-42e8-b030-f68e06d693f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:03.357337 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2501a884-2751-42e8-b030-f68e06d693f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:03.386204 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2501a884-2751-42e8-b030-f68e06d693f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043492 Jul 27 20:31:03.386740 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1056/2123] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:03 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:04.066497 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-07aacdfd-8da0-4e93-81f3-24530afc1868 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:04.067217 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-07aacdfd-8da0-4e93-81f3-24530afc1868 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:04.074498 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-07aacdfd-8da0-4e93-81f3-24530afc1868 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:04.074956 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-07aacdfd-8da0-4e93-81f3-24530afc1868 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:04.075743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-07aacdfd-8da0-4e93-81f3-24530afc1868 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:04.076187 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-07aacdfd-8da0-4e93-81f3-24530afc1868 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:04.142899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-07aacdfd-8da0-4e93-81f3-24530afc1868 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:04.150731 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-07aacdfd-8da0-4e93-81f3-24530afc1868 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.088109 Jul 27 20:31:04.151295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1068/2124] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:04 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:04.328950 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-32bcbbce-a819-407c-bfa9-014205dd7541 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:04.331050 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-32bcbbce-a819-407c-bfa9-014205dd7541 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:04.337622 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-32bcbbce-a819-407c-bfa9-014205dd7541 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:04.338069 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-32bcbbce-a819-407c-bfa9-014205dd7541 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:04.338828 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-32bcbbce-a819-407c-bfa9-014205dd7541 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:04.339263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-32bcbbce-a819-407c-bfa9-014205dd7541 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:04.368210 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-32bcbbce-a819-407c-bfa9-014205dd7541 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043512 Jul 27 20:31:04.368877 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1057/2125] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:31:04 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:31:04.399099 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-63a6a06d-f932-4e47-805c-8ac4046326df tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:04.401292 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-63a6a06d-f932-4e47-805c-8ac4046326df tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:04.407381 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63a6a06d-f932-4e47-805c-8ac4046326df tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:04.407836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63a6a06d-f932-4e47-805c-8ac4046326df tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:04.408605 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63a6a06d-f932-4e47-805c-8ac4046326df tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:04.409091 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63a6a06d-f932-4e47-805c-8ac4046326df tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:04.438598 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-63a6a06d-f932-4e47-805c-8ac4046326df tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043989 Jul 27 20:31:04.439153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1069/2126] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:04 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:05.172949 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e8dc585e-e029-4578-aae2-c7e8e292a672 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:05.173584 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e8dc585e-e029-4578-aae2-c7e8e292a672 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:05.180189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e8dc585e-e029-4578-aae2-c7e8e292a672 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:05.180631 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e8dc585e-e029-4578-aae2-c7e8e292a672 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:05.181412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e8dc585e-e029-4578-aae2-c7e8e292a672 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:05.181847 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e8dc585e-e029-4578-aae2-c7e8e292a672 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:05.243120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e8dc585e-e029-4578-aae2-c7e8e292a672 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:05.250778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e8dc585e-e029-4578-aae2-c7e8e292a672 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081690 Jul 27 20:31:05.251335 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1058/2127] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:05 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:05.380538 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b0758a69-35b7-4e8e-a99b-dc03dd2dd44b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:05.382715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b0758a69-35b7-4e8e-a99b-dc03dd2dd44b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:05.389397 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b0758a69-35b7-4e8e-a99b-dc03dd2dd44b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:05.389855 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b0758a69-35b7-4e8e-a99b-dc03dd2dd44b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:05.390621 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b0758a69-35b7-4e8e-a99b-dc03dd2dd44b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:05.391090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b0758a69-35b7-4e8e-a99b-dc03dd2dd44b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:05.419610 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b0758a69-35b7-4e8e-a99b-dc03dd2dd44b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043253 Jul 27 20:31:05.420247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1070/2128] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:31:05 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:31:05.451132 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ae0ae6a5-398c-4263-a58d-031d943ac18e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:05.453580 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ae0ae6a5-398c-4263-a58d-031d943ac18e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:05.459904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae0ae6a5-398c-4263-a58d-031d943ac18e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:05.460342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae0ae6a5-398c-4263-a58d-031d943ac18e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:05.461128 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae0ae6a5-398c-4263-a58d-031d943ac18e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:05.461978 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae0ae6a5-398c-4263-a58d-031d943ac18e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:05.490203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ae0ae6a5-398c-4263-a58d-031d943ac18e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043038 Jul 27 20:31:05.490755 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1059/2129] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:05 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:06.271490 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-01e19be4-1993-4c8f-9d80-7ed16d4189c6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:06.272132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-01e19be4-1993-4c8f-9d80-7ed16d4189c6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:06.278883 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-01e19be4-1993-4c8f-9d80-7ed16d4189c6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:06.279330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-01e19be4-1993-4c8f-9d80-7ed16d4189c6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:06.280083 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-01e19be4-1993-4c8f-9d80-7ed16d4189c6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:06.280520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-01e19be4-1993-4c8f-9d80-7ed16d4189c6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:06.340834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-01e19be4-1993-4c8f-9d80-7ed16d4189c6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:06.348276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-01e19be4-1993-4c8f-9d80-7ed16d4189c6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.080699 Jul 27 20:31:06.348826 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1071/2130] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:06 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:06.434214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-491220a4-b12e-49ea-af69-4cfe88d045df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:06.434426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-491220a4-b12e-49ea-af69-4cfe88d045df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:06.442202 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-491220a4-b12e-49ea-af69-4cfe88d045df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:06.442647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-491220a4-b12e-49ea-af69-4cfe88d045df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:06.443587 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-491220a4-b12e-49ea-af69-4cfe88d045df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:06.443843 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-491220a4-b12e-49ea-af69-4cfe88d045df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:06.474188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-491220a4-b12e-49ea-af69-4cfe88d045df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046005 Jul 27 20:31:06.474834 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1060/2131] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:31:06 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:31:06.502999 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-317e1a83-8513-46ff-9f44-a81d960a9455 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:06.505248 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-317e1a83-8513-46ff-9f44-a81d960a9455 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:06.512360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-317e1a83-8513-46ff-9f44-a81d960a9455 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:06.512807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-317e1a83-8513-46ff-9f44-a81d960a9455 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:06.513612 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-317e1a83-8513-46ff-9f44-a81d960a9455 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:06.514055 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-317e1a83-8513-46ff-9f44-a81d960a9455 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:06.543919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-317e1a83-8513-46ff-9f44-a81d960a9455 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044881 Jul 27 20:31:06.544484 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1072/2132] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:06 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:07.370016 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8d180f62-f618-40ea-8d12-5c1c0dc2b5d6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:07.370562 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8d180f62-f618-40ea-8d12-5c1c0dc2b5d6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:07.376759 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d180f62-f618-40ea-8d12-5c1c0dc2b5d6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:07.377255 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d180f62-f618-40ea-8d12-5c1c0dc2b5d6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:07.378021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d180f62-f618-40ea-8d12-5c1c0dc2b5d6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:07.378460 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d180f62-f618-40ea-8d12-5c1c0dc2b5d6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:07.397353 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:31:07.442574 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8d180f62-f618-40ea-8d12-5c1c0dc2b5d6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:07.450779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8d180f62-f618-40ea-8d12-5c1c0dc2b5d6 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.085832 Jul 27 20:31:07.451335 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1061/2133] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:07 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:07.486347 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b4a4d81a-2896-4ff0-8e0f-ac26a00e1173 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:07.488558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b4a4d81a-2896-4ff0-8e0f-ac26a00e1173 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:07.495262 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4a4d81a-2896-4ff0-8e0f-ac26a00e1173 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:07.495721 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4a4d81a-2896-4ff0-8e0f-ac26a00e1173 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:07.496493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4a4d81a-2896-4ff0-8e0f-ac26a00e1173 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:07.496937 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4a4d81a-2896-4ff0-8e0f-ac26a00e1173 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:07.525889 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b4a4d81a-2896-4ff0-8e0f-ac26a00e1173 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043511 Jul 27 20:31:07.526489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1073/2134] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:31:07 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:31:07.556126 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3edd9ad6-4472-4b98-9688-45e92b3a9ea8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:07.558380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3edd9ad6-4472-4b98-9688-45e92b3a9ea8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:07.564824 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3edd9ad6-4472-4b98-9688-45e92b3a9ea8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:07.565335 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3edd9ad6-4472-4b98-9688-45e92b3a9ea8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:07.566097 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3edd9ad6-4472-4b98-9688-45e92b3a9ea8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:07.566532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3edd9ad6-4472-4b98-9688-45e92b3a9ea8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:07.595808 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3edd9ad6-4472-4b98-9688-45e92b3a9ea8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044150 Jul 27 20:31:07.596351 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1062/2135] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:07 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:08.471438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4e335178-cf63-43ed-a0e5-97e41b4a83c7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:08.472054 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4e335178-cf63-43ed-a0e5-97e41b4a83c7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:08.478157 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4e335178-cf63-43ed-a0e5-97e41b4a83c7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:08.478571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4e335178-cf63-43ed-a0e5-97e41b4a83c7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:08.479334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4e335178-cf63-43ed-a0e5-97e41b4a83c7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:08.479775 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4e335178-cf63-43ed-a0e5-97e41b4a83c7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:08.538048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-62034a2b-5e1b-4601-92ff-8f772c4e9feb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:08.539537 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4e335178-cf63-43ed-a0e5-97e41b4a83c7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:08.541061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-62034a2b-5e1b-4601-92ff-8f772c4e9feb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:08.547293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-62034a2b-5e1b-4601-92ff-8f772c4e9feb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:08.547741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-62034a2b-5e1b-4601-92ff-8f772c4e9feb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:08.548506 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-62034a2b-5e1b-4601-92ff-8f772c4e9feb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:08.548639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4e335178-cf63-43ed-a0e5-97e41b4a83c7 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081043 Jul 27 20:31:08.548940 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-62034a2b-5e1b-4601-92ff-8f772c4e9feb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:08.549241 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1074/2136] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:08 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:08.583172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-62034a2b-5e1b-4601-92ff-8f772c4e9feb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049007 Jul 27 20:31:08.583732 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1063/2137] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:31:08 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:31:08.608149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-87208cb2-9321-4df0-99c0-fcf6662f9928 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:08.610367 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-87208cb2-9321-4df0-99c0-fcf6662f9928 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:08.616622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-87208cb2-9321-4df0-99c0-fcf6662f9928 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:08.617102 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-87208cb2-9321-4df0-99c0-fcf6662f9928 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:08.617852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-87208cb2-9321-4df0-99c0-fcf6662f9928 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:08.618910 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-87208cb2-9321-4df0-99c0-fcf6662f9928 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:08.622436 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:31:08.647813 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-87208cb2-9321-4df0-99c0-fcf6662f9928 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043558 Jul 27 20:31:08.648356 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1075/2138] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:08 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:09.569922 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-74489c37-f0bd-4a89-bab7-3677a6f4075b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:09.570534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-74489c37-f0bd-4a89-bab7-3677a6f4075b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:09.578458 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74489c37-f0bd-4a89-bab7-3677a6f4075b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:09.578911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74489c37-f0bd-4a89-bab7-3677a6f4075b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:09.579677 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74489c37-f0bd-4a89-bab7-3677a6f4075b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:09.580115 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74489c37-f0bd-4a89-bab7-3677a6f4075b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:09.595587 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3a46ee00-0d99-467c-8734-95d5542897f4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:09.597865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3a46ee00-0d99-467c-8734-95d5542897f4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:09.604242 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3a46ee00-0d99-467c-8734-95d5542897f4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:09.604709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3a46ee00-0d99-467c-8734-95d5542897f4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:09.605502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3a46ee00-0d99-467c-8734-95d5542897f4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:09.605977 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3a46ee00-0d99-467c-8734-95d5542897f4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:09.636485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3a46ee00-0d99-467c-8734-95d5542897f4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044778 Jul 27 20:31:09.637069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1076/2139] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:31:09 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:31:09.645916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-74489c37-f0bd-4a89-bab7-3677a6f4075b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:09.653420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-74489c37-f0bd-4a89-bab7-3677a6f4075b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.087305 Jul 27 20:31:09.653978 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1064/2140] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:09 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:09.659737 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-89302009-32ee-44dc-8185-0969daf9faf5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:09.661900 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-89302009-32ee-44dc-8185-0969daf9faf5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:09.668929 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-89302009-32ee-44dc-8185-0969daf9faf5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:09.669407 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-89302009-32ee-44dc-8185-0969daf9faf5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:09.670184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-89302009-32ee-44dc-8185-0969daf9faf5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:09.670622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-89302009-32ee-44dc-8185-0969daf9faf5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:09.700291 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-89302009-32ee-44dc-8185-0969daf9faf5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044534 Jul 27 20:31:09.701017 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1077/2141] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:09 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:10.648772 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8eb604a0-f5f1-4269-abf1-86493eabb929 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:10.651595 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8eb604a0-f5f1-4269-abf1-86493eabb929 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:10.658064 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8eb604a0-f5f1-4269-abf1-86493eabb929 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:10.658507 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8eb604a0-f5f1-4269-abf1-86493eabb929 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:10.659268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8eb604a0-f5f1-4269-abf1-86493eabb929 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:10.659702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8eb604a0-f5f1-4269-abf1-86493eabb929 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:10.672736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fd894d10-ff61-4723-a292-31a25d6bb85f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:10.673390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fd894d10-ff61-4723-a292-31a25d6bb85f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:10.679813 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fd894d10-ff61-4723-a292-31a25d6bb85f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:10.680273 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fd894d10-ff61-4723-a292-31a25d6bb85f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:10.681121 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fd894d10-ff61-4723-a292-31a25d6bb85f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:10.681604 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fd894d10-ff61-4723-a292-31a25d6bb85f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:10.689574 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8eb604a0-f5f1-4269-abf1-86493eabb929 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044699 Jul 27 20:31:10.690150 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1065/2142] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:31:10 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:31:10.713804 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6ac6a51f-5b75-4004-8e05-fc8a9ef66194 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:10.715944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6ac6a51f-5b75-4004-8e05-fc8a9ef66194 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:10.721934 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ac6a51f-5b75-4004-8e05-fc8a9ef66194 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:10.722381 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ac6a51f-5b75-4004-8e05-fc8a9ef66194 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:10.723143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ac6a51f-5b75-4004-8e05-fc8a9ef66194 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:10.723577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ac6a51f-5b75-4004-8e05-fc8a9ef66194 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:10.744712 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fd894d10-ff61-4723-a292-31a25d6bb85f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:10.752298 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6ac6a51f-5b75-4004-8e05-fc8a9ef66194 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043081 Jul 27 20:31:10.752582 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fd894d10-ff61-4723-a292-31a25d6bb85f tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.083449 Jul 27 20:31:10.753117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1078/2143] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:10 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:10.753249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1066/2144] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:10 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:31:11.701315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7041bec2-fb1a-4396-9fcb-17ba1c12bda8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:11.703733 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7041bec2-fb1a-4396-9fcb-17ba1c12bda8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:11.710146 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7041bec2-fb1a-4396-9fcb-17ba1c12bda8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:11.710592 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7041bec2-fb1a-4396-9fcb-17ba1c12bda8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:11.711343 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7041bec2-fb1a-4396-9fcb-17ba1c12bda8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:11.711773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7041bec2-fb1a-4396-9fcb-17ba1c12bda8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:11.740547 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7041bec2-fb1a-4396-9fcb-17ba1c12bda8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043290 Jul 27 20:31:11.741040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1079/2145] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:31:11 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:31:11.763793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a567a0f9-f819-4f96-a811-062fec560d2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:11.765975 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a567a0f9-f819-4f96-a811-062fec560d2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:11.772580 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a567a0f9-f819-4f96-a811-062fec560d2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:11.772851 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fcb95c99-f3b7-4266-bf7f-0e79e2f81a2d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:11.773063 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a567a0f9-f819-4f96-a811-062fec560d2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:11.773526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fcb95c99-f3b7-4266-bf7f-0e79e2f81a2d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:11.773830 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a567a0f9-f819-4f96-a811-062fec560d2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:11.774268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a567a0f9-f819-4f96-a811-062fec560d2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:11.781151 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fcb95c99-f3b7-4266-bf7f-0e79e2f81a2d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:11.781602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fcb95c99-f3b7-4266-bf7f-0e79e2f81a2d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:11.782362 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fcb95c99-f3b7-4266-bf7f-0e79e2f81a2d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:11.782801 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fcb95c99-f3b7-4266-bf7f-0e79e2f81a2d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:11.804464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a567a0f9-f819-4f96-a811-062fec560d2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044584 Jul 27 20:31:11.805043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1067/2146] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:11 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:11.847095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fcb95c99-f3b7-4266-bf7f-0e79e2f81a2d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:11.856281 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fcb95c99-f3b7-4266-bf7f-0e79e2f81a2d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.087116 Jul 27 20:31:11.856849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1080/2147] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:11 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:12.753103 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8f2adcb6-e7e2-4e10-ad9f-27f9d18c1f53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:12.755174 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8f2adcb6-e7e2-4e10-ad9f-27f9d18c1f53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:12.761877 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8f2adcb6-e7e2-4e10-ad9f-27f9d18c1f53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:12.762328 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8f2adcb6-e7e2-4e10-ad9f-27f9d18c1f53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:12.763094 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8f2adcb6-e7e2-4e10-ad9f-27f9d18c1f53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:12.763589 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8f2adcb6-e7e2-4e10-ad9f-27f9d18c1f53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:12.792252 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8f2adcb6-e7e2-4e10-ad9f-27f9d18c1f53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043285 Jul 27 20:31:12.792807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1068/2148] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:31:12 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:31:12.816805 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bba6f676-31cf-4ed1-8702-b698ca8d5e25 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:12.819016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bba6f676-31cf-4ed1-8702-b698ca8d5e25 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:12.826341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bba6f676-31cf-4ed1-8702-b698ca8d5e25 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:12.826793 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bba6f676-31cf-4ed1-8702-b698ca8d5e25 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:12.827814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bba6f676-31cf-4ed1-8702-b698ca8d5e25 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:12.828263 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bba6f676-31cf-4ed1-8702-b698ca8d5e25 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:12.857545 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bba6f676-31cf-4ed1-8702-b698ca8d5e25 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044656 Jul 27 20:31:12.858088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1081/2149] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:12 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:12.879560 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7d1084a5-72ae-426a-8a16-e4923374b96d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:12.880392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7d1084a5-72ae-426a-8a16-e4923374b96d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:12.886632 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d1084a5-72ae-426a-8a16-e4923374b96d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:12.887081 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d1084a5-72ae-426a-8a16-e4923374b96d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:12.887846 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d1084a5-72ae-426a-8a16-e4923374b96d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:12.888289 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d1084a5-72ae-426a-8a16-e4923374b96d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:12.949376 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7d1084a5-72ae-426a-8a16-e4923374b96d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:12.957161 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7d1084a5-72ae-426a-8a16-e4923374b96d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.081525 Jul 27 20:31:12.957723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1069/2150] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:12 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:13.804569 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d84b5f20-0b73-4ffa-a584-e75bcb729099 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:13.806838 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d84b5f20-0b73-4ffa-a584-e75bcb729099 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:13.812797 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d84b5f20-0b73-4ffa-a584-e75bcb729099 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:13.813278 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d84b5f20-0b73-4ffa-a584-e75bcb729099 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:13.814027 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d84b5f20-0b73-4ffa-a584-e75bcb729099 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:13.814459 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d84b5f20-0b73-4ffa-a584-e75bcb729099 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:13.843906 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d84b5f20-0b73-4ffa-a584-e75bcb729099 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043444 Jul 27 20:31:13.844504 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1082/2151] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:31:13 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:31:13.869314 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b77571d0-9759-4402-b11c-45cdb14abbf1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:13.871459 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b77571d0-9759-4402-b11c-45cdb14abbf1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:13.878232 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b77571d0-9759-4402-b11c-45cdb14abbf1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:13.878676 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b77571d0-9759-4402-b11c-45cdb14abbf1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:13.879426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b77571d0-9759-4402-b11c-45cdb14abbf1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:13.879850 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b77571d0-9759-4402-b11c-45cdb14abbf1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:13.909997 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b77571d0-9759-4402-b11c-45cdb14abbf1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044931 Jul 27 20:31:13.910554 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1070/2152] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:31:13 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:13.977420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b624d536-b561-4d28-842d-58042eb350ed tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:13.978071 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b624d536-b561-4d28-842d-58042eb350ed tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:13.984029 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b624d536-b561-4d28-842d-58042eb350ed tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:13.984476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b624d536-b561-4d28-842d-58042eb350ed tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:13.985263 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b624d536-b561-4d28-842d-58042eb350ed tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:13.985704 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b624d536-b561-4d28-842d-58042eb350ed tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:14.046099 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b624d536-b561-4d28-842d-58042eb350ed tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:14.053548 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b624d536-b561-4d28-842d-58042eb350ed tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.079934 Jul 27 20:31:14.054108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1083/2153] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:13 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:14.856719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-50fb168a-596a-4055-8d2e-800c565d9af6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:31:14.858993 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-50fb168a-596a-4055-8d2e-800c565d9af6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:14.864939 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-50fb168a-596a-4055-8d2e-800c565d9af6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:14.865408 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-50fb168a-596a-4055-8d2e-800c565d9af6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:14.866155 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-50fb168a-596a-4055-8d2e-800c565d9af6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:14.866616 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-50fb168a-596a-4055-8d2e-800c565d9af6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:14.922864 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-aacc2b53-ff50-411c-abea-adb583cadd88 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:31:14.925040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-aacc2b53-ff50-411c-abea-adb583cadd88 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:14.932131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aacc2b53-ff50-411c-abea-adb583cadd88 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:14.932583 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aacc2b53-ff50-411c-abea-adb583cadd88 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:14.933365 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aacc2b53-ff50-411c-abea-adb583cadd88 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:14.933825 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aacc2b53-ff50-411c-abea-adb583cadd88 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:14.965162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-50fb168a-596a-4055-8d2e-800c565d9af6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "POST /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/action" status: 200 len: 76101 microversion: 2.1 time: 0.112721 Jul 27 20:31:14.965822 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1071/2154] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Jul 27 20:31:14 2022] POST /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3/action => generated 76101 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:31:15.023551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-aacc2b53-ff50-411c-abea-adb583cadd88 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "POST /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/action" status: 200 len: 37448 microversion: 2.20 time: 0.104366 Jul 27 20:31:15.024756 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1084/2155] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Jul 27 20:31:14 2022] POST /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff/action => generated 37448 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 27 20:31:15.075266 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c198871f-e778-4b59-8f19-c755d4c2639d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:15.075985 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c198871f-e778-4b59-8f19-c755d4c2639d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:15.082888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c198871f-e778-4b59-8f19-c755d4c2639d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:15.083334 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c198871f-e778-4b59-8f19-c755d4c2639d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:15.084095 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c198871f-e778-4b59-8f19-c755d4c2639d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:15.084530 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c198871f-e778-4b59-8f19-c755d4c2639d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:15.146278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c198871f-e778-4b59-8f19-c755d4c2639d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:15.154789 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c198871f-e778-4b59-8f19-c755d4c2639d tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084879 Jul 27 20:31:15.155342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1072/2156] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:15 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:16.176205 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8a7e1bf0-177a-4a35-95d5-89f1fba2ea89 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:16.176909 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8a7e1bf0-177a-4a35-95d5-89f1fba2ea89 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] [instance: c560ad96-cd64-4d84-86c8-c315f0fa0ab7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:16.184782 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8a7e1bf0-177a-4a35-95d5-89f1fba2ea89 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:16.185269 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8a7e1bf0-177a-4a35-95d5-89f1fba2ea89 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:16.186035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8a7e1bf0-177a-4a35-95d5-89f1fba2ea89 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:16.186474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8a7e1bf0-177a-4a35-95d5-89f1fba2ea89 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:16.248875 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8a7e1bf0-177a-4a35-95d5-89f1fba2ea89 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f8ecfcb241d468685b22c3f883b6623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5b073df6b48908d97ae613731adc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:16.256743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8a7e1bf0-177a-4a35-95d5-89f1fba2ea89 tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7" status: 200 len: 1218 microversion: 2.1 time: 0.084777 Jul 27 20:31:16.257338 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1085/2157] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:16 2022] GET /compute/v2.1/servers/c560ad96-cd64-4d84-86c8-c315f0fa0ab7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:16.430579 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2e1b081e-5388-4b98-879a-3188d7669c4b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] Calling method '.version_select at 0x7fc7eaea2040>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:16.458277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2e1b081e-5388-4b98-879a-3188d7669c4b tempest-TestShelveInstance-1450548017 tempest-TestShelveInstance-1450548017-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-684913906" status: 202 len: 0 microversion: 2.1 time: 0.031593 Jul 27 20:31:16.459056 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1073/2158] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Jul 27 20:31:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-684913906 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:31:17.477781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ec49e1d4-8d7d-4278-b3a6-d102deb2f68d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:17.479133 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ec49e1d4-8d7d-4278-b3a6-d102deb2f68d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:17.487675 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec49e1d4-8d7d-4278-b3a6-d102deb2f68d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:17.488660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec49e1d4-8d7d-4278-b3a6-d102deb2f68d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:17.489960 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec49e1d4-8d7d-4278-b3a6-d102deb2f68d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:17.490988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec49e1d4-8d7d-4278-b3a6-d102deb2f68d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:17.517920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ae7341a5-46ab-4a83-9c0f-e08ae3a245e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:17.518484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ae7341a5-46ab-4a83-9c0f-e08ae3a245e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:17.521537 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ec49e1d4-8d7d-4278-b3a6-d102deb2f68d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Going to try to terminate instance {{(pid=117876) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:31:17.526534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae7341a5-46ab-4a83-9c0f-e08ae3a245e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:17.527096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae7341a5-46ab-4a83-9c0f-e08ae3a245e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:17.527948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae7341a5-46ab-4a83-9c0f-e08ae3a245e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:17.528466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae7341a5-46ab-4a83-9c0f-e08ae3a245e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:17.566260 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ae7341a5-46ab-4a83-9c0f-e08ae3a245e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:31:17.646582 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ec49e1d4-8d7d-4278-b3a6-d102deb2f68d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 204 len: 0 microversion: 2.1 time: 0.173604 Jul 27 20:31:17.647332 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1086/2159] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 20:31:17 2022] DELETE /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:31:17.657012 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3c81eded-417b-4595-af33-1e6f694ad3ac tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:17.657879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3c81eded-417b-4595-af33-1e6f694ad3ac tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:17.664825 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c81eded-417b-4595-af33-1e6f694ad3ac tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:17.665534 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c81eded-417b-4595-af33-1e6f694ad3ac tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:17.666914 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c81eded-417b-4595-af33-1e6f694ad3ac tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:17.667660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c81eded-417b-4595-af33-1e6f694ad3ac tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:17.674791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ae7341a5-46ab-4a83-9c0f-e08ae3a245e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 204 len: 0 microversion: 2.1 time: 0.160041 Jul 27 20:31:17.680090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1074/2160] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 20:31:17 2022] DELETE /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 20:31:17.687788 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-90c21f0a-2b9f-4abc-a93a-3da8a8b684e1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:17.688709 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-90c21f0a-2b9f-4abc-a93a-3da8a8b684e1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:17.698160 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-90c21f0a-2b9f-4abc-a93a-3da8a8b684e1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:17.698846 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-90c21f0a-2b9f-4abc-a93a-3da8a8b684e1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:17.699824 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-90c21f0a-2b9f-4abc-a93a-3da8a8b684e1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:17.700642 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-90c21f0a-2b9f-4abc-a93a-3da8a8b684e1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:17.871333 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-90c21f0a-2b9f-4abc-a93a-3da8a8b684e1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:17.888173 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-90c21f0a-2b9f-4abc-a93a-3da8a8b684e1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.205661 Jul 27 20:31:17.888907 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1075/2161] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:17 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:17.957295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3c81eded-417b-4595-af33-1e6f694ad3ac tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:17.966039 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3c81eded-417b-4595-af33-1e6f694ad3ac tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.313508 Jul 27 20:31:17.966618 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1087/2162] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:17 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:18.910386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f543ffbe-5488-48da-84fc-b44addbae3d3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:18.910986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f543ffbe-5488-48da-84fc-b44addbae3d3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:18.917979 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f543ffbe-5488-48da-84fc-b44addbae3d3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:18.918455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f543ffbe-5488-48da-84fc-b44addbae3d3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:18.919282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f543ffbe-5488-48da-84fc-b44addbae3d3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:18.919755 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f543ffbe-5488-48da-84fc-b44addbae3d3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:18.989480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-da8bc9a4-3e71-467d-868e-956ebb60479b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:18.991473 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-da8bc9a4-3e71-467d-868e-956ebb60479b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:19.002712 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-da8bc9a4-3e71-467d-868e-956ebb60479b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:19.003629 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-da8bc9a4-3e71-467d-868e-956ebb60479b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:19.004986 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-da8bc9a4-3e71-467d-868e-956ebb60479b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:19.007740 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-da8bc9a4-3e71-467d-868e-956ebb60479b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:19.087520 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f543ffbe-5488-48da-84fc-b44addbae3d3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:19.097558 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f543ffbe-5488-48da-84fc-b44addbae3d3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.190973 Jul 27 20:31:19.098258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1076/2163] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:18 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:19.296751 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-da8bc9a4-3e71-467d-868e-956ebb60479b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:19.304798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-da8bc9a4-3e71-467d-868e-956ebb60479b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.320980 Jul 27 20:31:19.305406 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1088/2164] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:18 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:20.120058 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-73211c82-7c48-4ee8-be03-5afd4cc1674c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:20.120683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-73211c82-7c48-4ee8-be03-5afd4cc1674c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:20.127180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73211c82-7c48-4ee8-be03-5afd4cc1674c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:20.127633 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73211c82-7c48-4ee8-be03-5afd4cc1674c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:20.128405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73211c82-7c48-4ee8-be03-5afd4cc1674c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:20.128842 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73211c82-7c48-4ee8-be03-5afd4cc1674c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:20.271217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-73211c82-7c48-4ee8-be03-5afd4cc1674c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:20.274364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:31:20.284902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-73211c82-7c48-4ee8-be03-5afd4cc1674c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.168823 Jul 27 20:31:20.286035 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1077/2165] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:20 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:20.326648 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-325ef690-035a-4325-a37f-a227734daa37 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:20.327535 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-325ef690-035a-4325-a37f-a227734daa37 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:20.334624 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-325ef690-035a-4325-a37f-a227734daa37 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:20.335084 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-325ef690-035a-4325-a37f-a227734daa37 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:20.335871 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-325ef690-035a-4325-a37f-a227734daa37 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:20.336316 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-325ef690-035a-4325-a37f-a227734daa37 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:20.470523 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-325ef690-035a-4325-a37f-a227734daa37 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:20.479633 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-325ef690-035a-4325-a37f-a227734daa37 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.157455 Jul 27 20:31:20.480198 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1089/2166] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:20 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:21.308249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-46bd1090-cc27-4368-a481-fc5a4fc72794 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:21.308947 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-46bd1090-cc27-4368-a481-fc5a4fc72794 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:21.315901 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-46bd1090-cc27-4368-a481-fc5a4fc72794 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:21.316348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-46bd1090-cc27-4368-a481-fc5a4fc72794 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:21.317146 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-46bd1090-cc27-4368-a481-fc5a4fc72794 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:21.317565 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-46bd1090-cc27-4368-a481-fc5a4fc72794 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:21.501418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-35189213-6b64-4384-9ef6-aa7761320e5b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:21.502770 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-35189213-6b64-4384-9ef6-aa7761320e5b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:21.510326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-35189213-6b64-4384-9ef6-aa7761320e5b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:21.511002 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-35189213-6b64-4384-9ef6-aa7761320e5b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:21.511924 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-35189213-6b64-4384-9ef6-aa7761320e5b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:21.512671 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-35189213-6b64-4384-9ef6-aa7761320e5b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:21.535325 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:31:21.567811 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-46bd1090-cc27-4368-a481-fc5a4fc72794 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:21.576745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-46bd1090-cc27-4368-a481-fc5a4fc72794 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.272950 Jul 27 20:31:21.591492 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1078/2167] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:21 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:21.671573 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-35189213-6b64-4384-9ef6-aa7761320e5b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:21.680663 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-35189213-6b64-4384-9ef6-aa7761320e5b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.184112 Jul 27 20:31:21.681945 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1090/2168] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:21 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:22.598664 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-41386f16-3a5e-47da-a358-e487960b3d8f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:22.599416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-41386f16-3a5e-47da-a358-e487960b3d8f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:22.605962 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-41386f16-3a5e-47da-a358-e487960b3d8f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:22.606471 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-41386f16-3a5e-47da-a358-e487960b3d8f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:22.607298 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-41386f16-3a5e-47da-a358-e487960b3d8f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:22.607734 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-41386f16-3a5e-47da-a358-e487960b3d8f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:22.702585 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d5e47746-5e97-449b-a431-c6b9642bd018 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:22.703228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d5e47746-5e97-449b-a431-c6b9642bd018 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:22.709749 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d5e47746-5e97-449b-a431-c6b9642bd018 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:22.710205 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d5e47746-5e97-449b-a431-c6b9642bd018 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:22.710976 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d5e47746-5e97-449b-a431-c6b9642bd018 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:22.711417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d5e47746-5e97-449b-a431-c6b9642bd018 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:22.866622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d5e47746-5e97-449b-a431-c6b9642bd018 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:22.872111 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-41386f16-3a5e-47da-a358-e487960b3d8f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:22.882748 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-41386f16-3a5e-47da-a358-e487960b3d8f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.287875 Jul 27 20:31:22.883752 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1079/2169] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:22 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:22.885184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d5e47746-5e97-449b-a431-c6b9642bd018 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.186246 Jul 27 20:31:22.897359 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1091/2170] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:22 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:23.904641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f5b7f16e-ddc1-41f2-b055-0dbec13560db tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:23.905469 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f5b7f16e-ddc1-41f2-b055-0dbec13560db tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:23.906301 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-136095d1-242d-4dee-b5f6-9d757eb6e973 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:23.907428 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-136095d1-242d-4dee-b5f6-9d757eb6e973 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:23.912788 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f5b7f16e-ddc1-41f2-b055-0dbec13560db tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:23.913289 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f5b7f16e-ddc1-41f2-b055-0dbec13560db tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:23.913784 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-136095d1-242d-4dee-b5f6-9d757eb6e973 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:23.914233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-136095d1-242d-4dee-b5f6-9d757eb6e973 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:23.914392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f5b7f16e-ddc1-41f2-b055-0dbec13560db tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:23.914779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f5b7f16e-ddc1-41f2-b055-0dbec13560db tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:23.915375 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-136095d1-242d-4dee-b5f6-9d757eb6e973 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:23.915975 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-136095d1-242d-4dee-b5f6-9d757eb6e973 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:24.065246 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f5b7f16e-ddc1-41f2-b055-0dbec13560db tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:24.081596 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f5b7f16e-ddc1-41f2-b055-0dbec13560db tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.180966 Jul 27 20:31:24.082172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1080/2171] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:23 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:24.082736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-136095d1-242d-4dee-b5f6-9d757eb6e973 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:24.095985 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-136095d1-242d-4dee-b5f6-9d757eb6e973 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.193302 Jul 27 20:31:24.096701 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1092/2172] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:23 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:25.103814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2fb9b432-878c-4c15-9e54-bfc8d0320036 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:25.104390 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2fb9b432-878c-4c15-9e54-bfc8d0320036 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:25.111893 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fb9b432-878c-4c15-9e54-bfc8d0320036 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:25.112343 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fb9b432-878c-4c15-9e54-bfc8d0320036 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:25.113136 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fb9b432-878c-4c15-9e54-bfc8d0320036 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:25.113572 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fb9b432-878c-4c15-9e54-bfc8d0320036 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:25.117678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-530b81aa-26df-4e84-a70c-1ea9e6e1e89c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:25.118297 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-530b81aa-26df-4e84-a70c-1ea9e6e1e89c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:25.125549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-530b81aa-26df-4e84-a70c-1ea9e6e1e89c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:25.126004 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-530b81aa-26df-4e84-a70c-1ea9e6e1e89c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:25.126775 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-530b81aa-26df-4e84-a70c-1ea9e6e1e89c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:25.127215 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-530b81aa-26df-4e84-a70c-1ea9e6e1e89c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:25.247756 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2fb9b432-878c-4c15-9e54-bfc8d0320036 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:25.255898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2fb9b432-878c-4c15-9e54-bfc8d0320036 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.156090 Jul 27 20:31:25.256459 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1081/2173] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:25 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:25.263529 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-530b81aa-26df-4e84-a70c-1ea9e6e1e89c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:25.271367 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-530b81aa-26df-4e84-a70c-1ea9e6e1e89c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.157554 Jul 27 20:31:25.271917 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1093/2174] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:25 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:26.277963 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dbca5431-b2bd-4120-b9a2-9fe89835a63a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:26.278575 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dbca5431-b2bd-4120-b9a2-9fe89835a63a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:26.284986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dbca5431-b2bd-4120-b9a2-9fe89835a63a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:26.285470 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dbca5431-b2bd-4120-b9a2-9fe89835a63a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:26.286225 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dbca5431-b2bd-4120-b9a2-9fe89835a63a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:26.286661 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dbca5431-b2bd-4120-b9a2-9fe89835a63a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:26.291685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-345a99c7-e4e1-459e-81da-6c4f3147a0f6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:26.292950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-345a99c7-e4e1-459e-81da-6c4f3147a0f6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:26.295357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:31:26.300519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-345a99c7-e4e1-459e-81da-6c4f3147a0f6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:26.300991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-345a99c7-e4e1-459e-81da-6c4f3147a0f6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:26.301759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-345a99c7-e4e1-459e-81da-6c4f3147a0f6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:26.302205 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-345a99c7-e4e1-459e-81da-6c4f3147a0f6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:26.415587 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dbca5431-b2bd-4120-b9a2-9fe89835a63a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:26.424204 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dbca5431-b2bd-4120-b9a2-9fe89835a63a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.150212 Jul 27 20:31:26.424767 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1082/2175] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:26 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:26.431421 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-345a99c7-e4e1-459e-81da-6c4f3147a0f6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:26.440057 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-345a99c7-e4e1-459e-81da-6c4f3147a0f6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152181 Jul 27 20:31:26.440603 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1094/2176] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:26 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:27.446452 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-603402d8-741e-4f0d-8433-71d2a17e2410 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:27.447096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-603402d8-741e-4f0d-8433-71d2a17e2410 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:27.450481 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:31:27.456308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-603402d8-741e-4f0d-8433-71d2a17e2410 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:27.456755 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-603402d8-741e-4f0d-8433-71d2a17e2410 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:27.457552 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-603402d8-741e-4f0d-8433-71d2a17e2410 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:27.457994 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-603402d8-741e-4f0d-8433-71d2a17e2410 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:27.464159 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8979f55e-fc5c-4261-bc06-2bd374fae3a3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:27.464159 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8979f55e-fc5c-4261-bc06-2bd374fae3a3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:27.470243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8979f55e-fc5c-4261-bc06-2bd374fae3a3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:27.470873 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8979f55e-fc5c-4261-bc06-2bd374fae3a3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:27.471972 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8979f55e-fc5c-4261-bc06-2bd374fae3a3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:27.472419 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8979f55e-fc5c-4261-bc06-2bd374fae3a3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:27.594657 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-603402d8-741e-4f0d-8433-71d2a17e2410 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:27.602832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-603402d8-741e-4f0d-8433-71d2a17e2410 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.160134 Jul 27 20:31:27.603412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1083/2177] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:27 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:27.623597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8979f55e-fc5c-4261-bc06-2bd374fae3a3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:27.631715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8979f55e-fc5c-4261-bc06-2bd374fae3a3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.172859 Jul 27 20:31:27.632278 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1095/2178] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:27 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:28.623864 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-06b13054-7fe1-4d7b-a41e-a80326afde0d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:28.624506 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-06b13054-7fe1-4d7b-a41e-a80326afde0d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:28.631061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-06b13054-7fe1-4d7b-a41e-a80326afde0d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:28.631509 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-06b13054-7fe1-4d7b-a41e-a80326afde0d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:28.632301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-06b13054-7fe1-4d7b-a41e-a80326afde0d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:28.632741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-06b13054-7fe1-4d7b-a41e-a80326afde0d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:28.653801 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-46a9e133-5244-47ff-8764-ff79184d2db5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:28.654453 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-46a9e133-5244-47ff-8764-ff79184d2db5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:28.661215 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46a9e133-5244-47ff-8764-ff79184d2db5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:28.661674 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46a9e133-5244-47ff-8764-ff79184d2db5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:28.662444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46a9e133-5244-47ff-8764-ff79184d2db5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:28.662885 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46a9e133-5244-47ff-8764-ff79184d2db5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:28.774633 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-06b13054-7fe1-4d7b-a41e-a80326afde0d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:28.783082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-06b13054-7fe1-4d7b-a41e-a80326afde0d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.163291 Jul 27 20:31:28.783644 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1084/2179] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:28 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:28.798425 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-46a9e133-5244-47ff-8764-ff79184d2db5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:28.806279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-46a9e133-5244-47ff-8764-ff79184d2db5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.157045 Jul 27 20:31:28.806840 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1096/2180] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:28 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:29.804258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ae861d9d-81de-43fb-a50c-572fdbac2b22 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:29.804791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ae861d9d-81de-43fb-a50c-572fdbac2b22 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:29.812195 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae861d9d-81de-43fb-a50c-572fdbac2b22 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:29.812648 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae861d9d-81de-43fb-a50c-572fdbac2b22 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:29.813474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae861d9d-81de-43fb-a50c-572fdbac2b22 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:29.813915 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae861d9d-81de-43fb-a50c-572fdbac2b22 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:29.828390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7353d490-e70c-40bd-9039-3447078341f0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:29.829022 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7353d490-e70c-40bd-9039-3447078341f0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:29.835362 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7353d490-e70c-40bd-9039-3447078341f0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:29.835804 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7353d490-e70c-40bd-9039-3447078341f0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:29.836558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7353d490-e70c-40bd-9039-3447078341f0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:29.837013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7353d490-e70c-40bd-9039-3447078341f0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:29.948779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ae861d9d-81de-43fb-a50c-572fdbac2b22 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:29.957172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ae861d9d-81de-43fb-a50c-572fdbac2b22 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.156768 Jul 27 20:31:29.957830 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1085/2181] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:29 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:29.971614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7353d490-e70c-40bd-9039-3447078341f0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:29.980270 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7353d490-e70c-40bd-9039-3447078341f0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.155324 Jul 27 20:31:29.981064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1097/2182] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:29 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:30.979544 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-eb208800-dfa0-48cb-95f3-d72806ace902 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:30.980351 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-eb208800-dfa0-48cb-95f3-d72806ace902 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:30.987213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eb208800-dfa0-48cb-95f3-d72806ace902 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:30.987663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eb208800-dfa0-48cb-95f3-d72806ace902 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:30.988429 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eb208800-dfa0-48cb-95f3-d72806ace902 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:30.988872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eb208800-dfa0-48cb-95f3-d72806ace902 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:31.001627 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4ef35515-dbdb-42e0-8a05-c59c3bd624b8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:31.002252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4ef35515-dbdb-42e0-8a05-c59c3bd624b8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:31.008726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4ef35515-dbdb-42e0-8a05-c59c3bd624b8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:31.009228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4ef35515-dbdb-42e0-8a05-c59c3bd624b8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:31.010000 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4ef35515-dbdb-42e0-8a05-c59c3bd624b8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:31.010445 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4ef35515-dbdb-42e0-8a05-c59c3bd624b8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:31.124745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eb208800-dfa0-48cb-95f3-d72806ace902 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:31.132680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-eb208800-dfa0-48cb-95f3-d72806ace902 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.157197 Jul 27 20:31:31.133274 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1086/2183] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:30 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:31.146976 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4ef35515-dbdb-42e0-8a05-c59c3bd624b8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:31.154779 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4ef35515-dbdb-42e0-8a05-c59c3bd624b8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.157058 Jul 27 20:31:31.155344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1098/2184] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:30 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:32.154786 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9ee99e2d-430b-4026-88ab-c778956fc62a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:32.155448 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9ee99e2d-430b-4026-88ab-c778956fc62a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:32.161849 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9ee99e2d-430b-4026-88ab-c778956fc62a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:32.162289 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9ee99e2d-430b-4026-88ab-c778956fc62a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:32.163091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9ee99e2d-430b-4026-88ab-c778956fc62a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:32.163523 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9ee99e2d-430b-4026-88ab-c778956fc62a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:32.175515 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-804c0ba0-e786-498d-86ec-a6d7989c7bb1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:32.176127 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-804c0ba0-e786-498d-86ec-a6d7989c7bb1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:32.182582 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-804c0ba0-e786-498d-86ec-a6d7989c7bb1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:32.183041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-804c0ba0-e786-498d-86ec-a6d7989c7bb1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:32.183813 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-804c0ba0-e786-498d-86ec-a6d7989c7bb1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:32.184801 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-804c0ba0-e786-498d-86ec-a6d7989c7bb1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:32.296496 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9ee99e2d-430b-4026-88ab-c778956fc62a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:32.304419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9ee99e2d-430b-4026-88ab-c778956fc62a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.153502 Jul 27 20:31:32.305006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1087/2185] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:32 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:32.318124 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-804c0ba0-e786-498d-86ec-a6d7989c7bb1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:32.326541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-804c0ba0-e786-498d-86ec-a6d7989c7bb1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.154902 Jul 27 20:31:32.327096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1099/2186] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:32 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:33.326668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e26e61f6-c7e4-4bbd-8061-15d5e97b18c6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:33.327440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e26e61f6-c7e4-4bbd-8061-15d5e97b18c6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:33.333993 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e26e61f6-c7e4-4bbd-8061-15d5e97b18c6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:33.334442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e26e61f6-c7e4-4bbd-8061-15d5e97b18c6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:33.335209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e26e61f6-c7e4-4bbd-8061-15d5e97b18c6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:33.335645 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e26e61f6-c7e4-4bbd-8061-15d5e97b18c6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:33.347442 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9edbd14a-f443-45dc-9784-cc40a9f352b1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:33.348088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9edbd14a-f443-45dc-9784-cc40a9f352b1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:33.354430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9edbd14a-f443-45dc-9784-cc40a9f352b1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:33.354883 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9edbd14a-f443-45dc-9784-cc40a9f352b1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:33.355635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9edbd14a-f443-45dc-9784-cc40a9f352b1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:33.356137 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9edbd14a-f443-45dc-9784-cc40a9f352b1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:33.471718 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e26e61f6-c7e4-4bbd-8061-15d5e97b18c6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:33.479548 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e26e61f6-c7e4-4bbd-8061-15d5e97b18c6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.157219 Jul 27 20:31:33.488414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1088/2187] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:33 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:33.489154 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9edbd14a-f443-45dc-9784-cc40a9f352b1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:33.498007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9edbd14a-f443-45dc-9784-cc40a9f352b1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.154193 Jul 27 20:31:33.498571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1100/2188] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:33 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:34.501887 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-616e7417-a407-4082-b095-a887dd214174 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:34.502494 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-616e7417-a407-4082-b095-a887dd214174 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:34.509037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-616e7417-a407-4082-b095-a887dd214174 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:34.509486 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-616e7417-a407-4082-b095-a887dd214174 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:34.510238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-616e7417-a407-4082-b095-a887dd214174 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:34.510673 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-616e7417-a407-4082-b095-a887dd214174 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:34.519566 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4868dd5b-f24d-4033-8157-c9ab0ff763b0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:34.520216 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4868dd5b-f24d-4033-8157-c9ab0ff763b0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:34.526336 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4868dd5b-f24d-4033-8157-c9ab0ff763b0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:34.526782 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4868dd5b-f24d-4033-8157-c9ab0ff763b0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:34.527538 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4868dd5b-f24d-4033-8157-c9ab0ff763b0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:34.527977 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4868dd5b-f24d-4033-8157-c9ab0ff763b0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:34.643020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-616e7417-a407-4082-b095-a887dd214174 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:34.651684 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-616e7417-a407-4082-b095-a887dd214174 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.153737 Jul 27 20:31:34.652465 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1089/2189] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:34 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:34.662415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4868dd5b-f24d-4033-8157-c9ab0ff763b0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:34.671681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4868dd5b-f24d-4033-8157-c9ab0ff763b0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.156880 Jul 27 20:31:34.672259 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1101/2190] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:34 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:35.672842 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7a0e0116-8799-48e2-a98d-ad60659589cf tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:35.673468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7a0e0116-8799-48e2-a98d-ad60659589cf tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:35.679975 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a0e0116-8799-48e2-a98d-ad60659589cf tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:35.680419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a0e0116-8799-48e2-a98d-ad60659589cf tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:35.681204 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a0e0116-8799-48e2-a98d-ad60659589cf tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:35.681634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a0e0116-8799-48e2-a98d-ad60659589cf tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:35.692525 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ad85a267-2b83-4d52-b16e-d765904710f7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:35.693170 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ad85a267-2b83-4d52-b16e-d765904710f7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:35.699258 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ad85a267-2b83-4d52-b16e-d765904710f7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:35.700453 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ad85a267-2b83-4d52-b16e-d765904710f7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:35.701306 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ad85a267-2b83-4d52-b16e-d765904710f7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:35.701743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ad85a267-2b83-4d52-b16e-d765904710f7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:35.813417 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7a0e0116-8799-48e2-a98d-ad60659589cf tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:35.821301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7a0e0116-8799-48e2-a98d-ad60659589cf tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.152400 Jul 27 20:31:35.821869 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1090/2191] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:35 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:35.831090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ad85a267-2b83-4d52-b16e-d765904710f7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:35.839030 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ad85a267-2b83-4d52-b16e-d765904710f7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150163 Jul 27 20:31:35.839589 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1102/2192] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:35 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:36.844313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6ac8c012-1b5c-485d-8b5f-42263698d596 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:36.844947 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6ac8c012-1b5c-485d-8b5f-42263698d596 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:36.851452 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ac8c012-1b5c-485d-8b5f-42263698d596 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:36.851902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ac8c012-1b5c-485d-8b5f-42263698d596 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:36.852656 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ac8c012-1b5c-485d-8b5f-42263698d596 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:36.853127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ac8c012-1b5c-485d-8b5f-42263698d596 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:36.859517 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-999bdef0-7570-41e7-aff5-1997a5198ddf tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:36.860128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-999bdef0-7570-41e7-aff5-1997a5198ddf tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:36.866523 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-999bdef0-7570-41e7-aff5-1997a5198ddf tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:36.866976 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-999bdef0-7570-41e7-aff5-1997a5198ddf tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:36.867739 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-999bdef0-7570-41e7-aff5-1997a5198ddf tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:36.868177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-999bdef0-7570-41e7-aff5-1997a5198ddf tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:36.993214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6ac8c012-1b5c-485d-8b5f-42263698d596 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:37.001663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6ac8c012-1b5c-485d-8b5f-42263698d596 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.161713 Jul 27 20:31:37.002237 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1091/2193] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:36 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:37.007550 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-999bdef0-7570-41e7-aff5-1997a5198ddf tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:37.016285 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-999bdef0-7570-41e7-aff5-1997a5198ddf tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.160618 Jul 27 20:31:37.016839 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1103/2194] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:36 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:38.023643 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-97bbc4e4-3646-40ab-bd81-5f0c8830de75 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:38.024294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-97bbc4e4-3646-40ab-bd81-5f0c8830de75 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:38.030990 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97bbc4e4-3646-40ab-bd81-5f0c8830de75 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:38.031444 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97bbc4e4-3646-40ab-bd81-5f0c8830de75 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:38.032208 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97bbc4e4-3646-40ab-bd81-5f0c8830de75 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:38.032651 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97bbc4e4-3646-40ab-bd81-5f0c8830de75 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:38.037417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6a414cda-16fa-46f3-9744-022c816d7164 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:38.038069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6a414cda-16fa-46f3-9744-022c816d7164 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:38.044590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6a414cda-16fa-46f3-9744-022c816d7164 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:38.044991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6a414cda-16fa-46f3-9744-022c816d7164 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:38.045747 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6a414cda-16fa-46f3-9744-022c816d7164 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:38.046186 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6a414cda-16fa-46f3-9744-022c816d7164 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:38.164171 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-97bbc4e4-3646-40ab-bd81-5f0c8830de75 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:38.172668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-97bbc4e4-3646-40ab-bd81-5f0c8830de75 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.152829 Jul 27 20:31:38.173279 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1092/2195] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:38 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:38.177338 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6a414cda-16fa-46f3-9744-022c816d7164 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:38.185713 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6a414cda-16fa-46f3-9744-022c816d7164 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152116 Jul 27 20:31:38.186417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1104/2196] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:38 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:39.194436 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-03ce785c-2a90-410e-a7f0-98e21a2dbfae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:39.195050 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-03ce785c-2a90-410e-a7f0-98e21a2dbfae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:39.201801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03ce785c-2a90-410e-a7f0-98e21a2dbfae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:39.202526 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03ce785c-2a90-410e-a7f0-98e21a2dbfae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:39.203287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03ce785c-2a90-410e-a7f0-98e21a2dbfae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:39.203723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03ce785c-2a90-410e-a7f0-98e21a2dbfae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:39.206808 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a6553761-3cc6-43e4-bdc6-6e2808527f90 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:39.207419 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a6553761-3cc6-43e4-bdc6-6e2808527f90 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:39.213929 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6553761-3cc6-43e4-bdc6-6e2808527f90 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:39.214378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6553761-3cc6-43e4-bdc6-6e2808527f90 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:39.215130 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6553761-3cc6-43e4-bdc6-6e2808527f90 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:39.215573 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6553761-3cc6-43e4-bdc6-6e2808527f90 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:39.336327 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-03ce785c-2a90-410e-a7f0-98e21a2dbfae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:39.345059 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-03ce785c-2a90-410e-a7f0-98e21a2dbfae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.154410 Jul 27 20:31:39.345817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1093/2197] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:39 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:39.348690 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a6553761-3cc6-43e4-bdc6-6e2808527f90 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:39.356742 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a6553761-3cc6-43e4-bdc6-6e2808527f90 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153629 Jul 27 20:31:39.357450 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1105/2198] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:39 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:40.366454 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f8df8267-71d3-42a9-b16f-46ca0262076d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:40.366999 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f8df8267-71d3-42a9-b16f-46ca0262076d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:40.374161 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8df8267-71d3-42a9-b16f-46ca0262076d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:40.374609 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8df8267-71d3-42a9-b16f-46ca0262076d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:40.375374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8df8267-71d3-42a9-b16f-46ca0262076d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:40.375813 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8df8267-71d3-42a9-b16f-46ca0262076d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:40.378799 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b74b0e8f-8212-43fd-8bde-6f7e9579f672 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:40.379418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b74b0e8f-8212-43fd-8bde-6f7e9579f672 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:40.385833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b74b0e8f-8212-43fd-8bde-6f7e9579f672 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:40.386288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b74b0e8f-8212-43fd-8bde-6f7e9579f672 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:40.387060 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b74b0e8f-8212-43fd-8bde-6f7e9579f672 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:40.387503 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b74b0e8f-8212-43fd-8bde-6f7e9579f672 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:40.396615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:31:40.508148 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f8df8267-71d3-42a9-b16f-46ca0262076d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:40.516396 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f8df8267-71d3-42a9-b16f-46ca0262076d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.153869 Jul 27 20:31:40.517010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1094/2199] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:40 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:40.526640 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b74b0e8f-8212-43fd-8bde-6f7e9579f672 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:40.534817 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b74b0e8f-8212-43fd-8bde-6f7e9579f672 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.159928 Jul 27 20:31:40.535374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1106/2200] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:40 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:41.537925 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2e37dd22-54ad-4d8f-8582-2c74c811baad tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:41.538543 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2e37dd22-54ad-4d8f-8582-2c74c811baad tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:41.545768 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e37dd22-54ad-4d8f-8582-2c74c811baad tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:41.546217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e37dd22-54ad-4d8f-8582-2c74c811baad tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:41.546973 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e37dd22-54ad-4d8f-8582-2c74c811baad tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:41.547407 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e37dd22-54ad-4d8f-8582-2c74c811baad tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:41.555969 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c536cecc-ea99-424c-800a-e22760b3d5a2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:41.556623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c536cecc-ea99-424c-800a-e22760b3d5a2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:41.563828 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c536cecc-ea99-424c-800a-e22760b3d5a2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:41.564283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c536cecc-ea99-424c-800a-e22760b3d5a2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:41.565081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c536cecc-ea99-424c-800a-e22760b3d5a2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:41.565529 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c536cecc-ea99-424c-800a-e22760b3d5a2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:41.569506 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:31:41.682180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2e37dd22-54ad-4d8f-8582-2c74c811baad tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:41.690316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2e37dd22-54ad-4d8f-8582-2c74c811baad tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.156188 Jul 27 20:31:41.690898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1095/2201] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:41 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:41.698018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c536cecc-ea99-424c-800a-e22760b3d5a2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:41.706558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c536cecc-ea99-424c-800a-e22760b3d5a2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.154596 Jul 27 20:31:41.707115 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1107/2202] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:41 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:42.711658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-320e25e8-cdf2-466a-b091-65ee5283b34c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:42.712262 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-320e25e8-cdf2-466a-b091-65ee5283b34c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:42.718725 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-320e25e8-cdf2-466a-b091-65ee5283b34c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:42.719165 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-320e25e8-cdf2-466a-b091-65ee5283b34c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:42.719911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-320e25e8-cdf2-466a-b091-65ee5283b34c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:42.720337 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-320e25e8-cdf2-466a-b091-65ee5283b34c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:42.727461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ae72941d-d386-4ac8-a12a-2e1211ec7713 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:42.728081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ae72941d-d386-4ac8-a12a-2e1211ec7713 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:42.735552 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ae72941d-d386-4ac8-a12a-2e1211ec7713 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:42.736001 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ae72941d-d386-4ac8-a12a-2e1211ec7713 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:42.736774 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ae72941d-d386-4ac8-a12a-2e1211ec7713 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:42.737250 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ae72941d-d386-4ac8-a12a-2e1211ec7713 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:42.853398 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-320e25e8-cdf2-466a-b091-65ee5283b34c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:42.861426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-320e25e8-cdf2-466a-b091-65ee5283b34c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.153548 Jul 27 20:31:42.862003 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1096/2203] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:42 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:42.866280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ae72941d-d386-4ac8-a12a-2e1211ec7713 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:42.874330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ae72941d-d386-4ac8-a12a-2e1211ec7713 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150713 Jul 27 20:31:42.874890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1108/2204] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:42 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:43.883190 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8c7960fa-eaf1-4406-9769-95144daec217 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:43.883736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8c7960fa-eaf1-4406-9769-95144daec217 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:43.891288 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c7960fa-eaf1-4406-9769-95144daec217 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:43.891739 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c7960fa-eaf1-4406-9769-95144daec217 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:43.892505 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c7960fa-eaf1-4406-9769-95144daec217 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:43.892944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c7960fa-eaf1-4406-9769-95144daec217 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:43.895365 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b59406b1-0946-4da8-85eb-7aa22565fc65 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:43.895979 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b59406b1-0946-4da8-85eb-7aa22565fc65 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:43.902052 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b59406b1-0946-4da8-85eb-7aa22565fc65 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:43.902497 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b59406b1-0946-4da8-85eb-7aa22565fc65 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:43.903251 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b59406b1-0946-4da8-85eb-7aa22565fc65 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:43.903687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b59406b1-0946-4da8-85eb-7aa22565fc65 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:44.024630 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8c7960fa-eaf1-4406-9769-95144daec217 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:44.032055 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b59406b1-0946-4da8-85eb-7aa22565fc65 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:44.033129 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8c7960fa-eaf1-4406-9769-95144daec217 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.153829 Jul 27 20:31:44.033707 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1097/2205] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:43 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:44.040032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b59406b1-0946-4da8-85eb-7aa22565fc65 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148329 Jul 27 20:31:44.040584 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1109/2206] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:43 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:45.055135 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9c062a98-0f8f-4c18-a63b-6c7200172703 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:45.055779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9c062a98-0f8f-4c18-a63b-6c7200172703 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:45.061908 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5b43b750-b578-4d79-a7e3-232dff27020e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:45.062550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c062a98-0f8f-4c18-a63b-6c7200172703 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:45.062716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5b43b750-b578-4d79-a7e3-232dff27020e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:45.063000 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c062a98-0f8f-4c18-a63b-6c7200172703 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:45.063762 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c062a98-0f8f-4c18-a63b-6c7200172703 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:45.064196 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c062a98-0f8f-4c18-a63b-6c7200172703 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:45.069065 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5b43b750-b578-4d79-a7e3-232dff27020e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:45.069527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5b43b750-b578-4d79-a7e3-232dff27020e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:45.070306 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5b43b750-b578-4d79-a7e3-232dff27020e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:45.070757 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5b43b750-b578-4d79-a7e3-232dff27020e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:45.200035 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9c062a98-0f8f-4c18-a63b-6c7200172703 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:45.205405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5b43b750-b578-4d79-a7e3-232dff27020e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:45.208224 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9c062a98-0f8f-4c18-a63b-6c7200172703 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.156975 Jul 27 20:31:45.208789 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1098/2207] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:45 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:45.214526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5b43b750-b578-4d79-a7e3-232dff27020e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.157191 Jul 27 20:31:45.215088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1110/2208] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:45 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:46.229536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2ab977e3-f716-4041-b7df-034c0cdcd0dc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:46.230269 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2ab977e3-f716-4041-b7df-034c0cdcd0dc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:46.235416 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6f87d940-75ad-4707-925e-58a397d26c78 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:46.236151 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6f87d940-75ad-4707-925e-58a397d26c78 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:46.237694 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ab977e3-f716-4041-b7df-034c0cdcd0dc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:46.238140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ab977e3-f716-4041-b7df-034c0cdcd0dc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:46.238906 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ab977e3-f716-4041-b7df-034c0cdcd0dc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:46.239339 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ab977e3-f716-4041-b7df-034c0cdcd0dc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:46.242507 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6f87d940-75ad-4707-925e-58a397d26c78 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:46.242953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6f87d940-75ad-4707-925e-58a397d26c78 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:46.244418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6f87d940-75ad-4707-925e-58a397d26c78 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:46.244418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6f87d940-75ad-4707-925e-58a397d26c78 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:46.370286 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2ab977e3-f716-4041-b7df-034c0cdcd0dc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:46.370704 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6f87d940-75ad-4707-925e-58a397d26c78 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:46.378990 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2ab977e3-f716-4041-b7df-034c0cdcd0dc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.153273 Jul 27 20:31:46.379318 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6f87d940-75ad-4707-925e-58a397d26c78 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.147758 Jul 27 20:31:46.379540 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1099/2209] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:46 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:46.379872 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1111/2210] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:46 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:47.283895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:31:47.284427 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:31:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:31:47.400281 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4cb76733-3e36-4688-83d8-c853e2e46736 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:47.400860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9af30ac9-64d8-4597-8bab-2ab38b3794aa tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:47.401333 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4cb76733-3e36-4688-83d8-c853e2e46736 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:47.401514 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9af30ac9-64d8-4597-8bab-2ab38b3794aa tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:47.407907 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4cb76733-3e36-4688-83d8-c853e2e46736 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:47.408350 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4cb76733-3e36-4688-83d8-c853e2e46736 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:47.408811 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9af30ac9-64d8-4597-8bab-2ab38b3794aa tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:47.409137 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4cb76733-3e36-4688-83d8-c853e2e46736 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:47.409302 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9af30ac9-64d8-4597-8bab-2ab38b3794aa tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:47.409570 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4cb76733-3e36-4688-83d8-c853e2e46736 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:47.410081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9af30ac9-64d8-4597-8bab-2ab38b3794aa tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:47.410520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9af30ac9-64d8-4597-8bab-2ab38b3794aa tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:47.544608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4cb76733-3e36-4688-83d8-c853e2e46736 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:47.545354 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9af30ac9-64d8-4597-8bab-2ab38b3794aa tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:47.552701 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4cb76733-3e36-4688-83d8-c853e2e46736 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.156211 Jul 27 20:31:47.553121 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9af30ac9-64d8-4597-8bab-2ab38b3794aa tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.156014 Jul 27 20:31:47.553894 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1100/2211] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:47 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:47.554061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1112/2212] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:47 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:48.572689 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4214c5a5-31ac-4aac-b136-75f4d068b792 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:48.573336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4214c5a5-31ac-4aac-b136-75f4d068b792 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:48.574200 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-12b1727a-6241-47c9-8150-1ce5cbee426b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:48.574820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-12b1727a-6241-47c9-8150-1ce5cbee426b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:48.580320 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4214c5a5-31ac-4aac-b136-75f4d068b792 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:48.581014 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4214c5a5-31ac-4aac-b136-75f4d068b792 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:48.581789 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4214c5a5-31ac-4aac-b136-75f4d068b792 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:48.581909 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-12b1727a-6241-47c9-8150-1ce5cbee426b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:48.582232 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4214c5a5-31ac-4aac-b136-75f4d068b792 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:48.582360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-12b1727a-6241-47c9-8150-1ce5cbee426b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:48.583111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-12b1727a-6241-47c9-8150-1ce5cbee426b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:48.583554 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-12b1727a-6241-47c9-8150-1ce5cbee426b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:48.713113 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4214c5a5-31ac-4aac-b136-75f4d068b792 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:48.720014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-12b1727a-6241-47c9-8150-1ce5cbee426b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:48.722209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4214c5a5-31ac-4aac-b136-75f4d068b792 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153296 Jul 27 20:31:48.722943 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1101/2213] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:48 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:48.728308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-12b1727a-6241-47c9-8150-1ce5cbee426b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.157848 Jul 27 20:31:48.728862 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1113/2214] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:48 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:49.743491 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e5a17cac-8ef5-4111-bf94-8808826112c4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:49.744123 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e5a17cac-8ef5-4111-bf94-8808826112c4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:49.749995 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-228ede85-211a-46ae-a67f-d04f5bce1136 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:49.750616 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-228ede85-211a-46ae-a67f-d04f5bce1136 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:49.751239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e5a17cac-8ef5-4111-bf94-8808826112c4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:49.751691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e5a17cac-8ef5-4111-bf94-8808826112c4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:49.752463 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e5a17cac-8ef5-4111-bf94-8808826112c4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:49.752903 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e5a17cac-8ef5-4111-bf94-8808826112c4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:49.757054 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-228ede85-211a-46ae-a67f-d04f5bce1136 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:49.757511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-228ede85-211a-46ae-a67f-d04f5bce1136 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:49.758280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-228ede85-211a-46ae-a67f-d04f5bce1136 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:49.758718 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-228ede85-211a-46ae-a67f-d04f5bce1136 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:49.885730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e5a17cac-8ef5-4111-bf94-8808826112c4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:49.888542 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-228ede85-211a-46ae-a67f-d04f5bce1136 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:49.894192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e5a17cac-8ef5-4111-bf94-8808826112c4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.154631 Jul 27 20:31:49.894769 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1102/2215] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:49 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:49.897210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-228ede85-211a-46ae-a67f-d04f5bce1136 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.151773 Jul 27 20:31:49.897761 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1114/2216] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:49 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:50.915670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7b4069f6-1056-41fb-9002-82829e083bfd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:50.916287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7b4069f6-1056-41fb-9002-82829e083bfd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:50.918582 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-db946bb0-f17d-4acd-9ef7-c079f04d0956 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:50.919208 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-db946bb0-f17d-4acd-9ef7-c079f04d0956 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:50.923589 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b4069f6-1056-41fb-9002-82829e083bfd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:50.924043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b4069f6-1056-41fb-9002-82829e083bfd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:50.924813 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b4069f6-1056-41fb-9002-82829e083bfd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:50.925286 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b4069f6-1056-41fb-9002-82829e083bfd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:50.926827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-db946bb0-f17d-4acd-9ef7-c079f04d0956 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:50.927286 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-db946bb0-f17d-4acd-9ef7-c079f04d0956 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:50.928055 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-db946bb0-f17d-4acd-9ef7-c079f04d0956 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:50.928500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-db946bb0-f17d-4acd-9ef7-c079f04d0956 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:51.060018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7b4069f6-1056-41fb-9002-82829e083bfd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:51.060466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-db946bb0-f17d-4acd-9ef7-c079f04d0956 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:51.068612 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7b4069f6-1056-41fb-9002-82829e083bfd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.156789 Jul 27 20:31:51.068806 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-db946bb0-f17d-4acd-9ef7-c079f04d0956 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.154103 Jul 27 20:31:51.069419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1103/2217] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:50 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:51.073743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1115/2218] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:50 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:52.090695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-24fd375e-ae76-4caa-b3df-065a2e8a4e9e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:52.091340 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-24fd375e-ae76-4caa-b3df-065a2e8a4e9e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:52.092081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f5aa4ffe-a6f6-4a3c-be2a-b710aa9d54dd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:52.092705 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f5aa4ffe-a6f6-4a3c-be2a-b710aa9d54dd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:52.098456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-24fd375e-ae76-4caa-b3df-065a2e8a4e9e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:52.098905 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-24fd375e-ae76-4caa-b3df-065a2e8a4e9e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:52.099674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-24fd375e-ae76-4caa-b3df-065a2e8a4e9e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:52.099942 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f5aa4ffe-a6f6-4a3c-be2a-b710aa9d54dd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:52.100093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-24fd375e-ae76-4caa-b3df-065a2e8a4e9e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:52.100405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f5aa4ffe-a6f6-4a3c-be2a-b710aa9d54dd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:52.101209 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f5aa4ffe-a6f6-4a3c-be2a-b710aa9d54dd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:52.101658 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f5aa4ffe-a6f6-4a3c-be2a-b710aa9d54dd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:52.230329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f5aa4ffe-a6f6-4a3c-be2a-b710aa9d54dd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:52.232316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-24fd375e-ae76-4caa-b3df-065a2e8a4e9e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:52.239289 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f5aa4ffe-a6f6-4a3c-be2a-b710aa9d54dd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.151249 Jul 27 20:31:52.239870 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1116/2219] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:52 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:52.241093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-24fd375e-ae76-4caa-b3df-065a2e8a4e9e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.154290 Jul 27 20:31:52.241659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1104/2220] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:52 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:53.260818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d1b36271-c283-44ae-b87f-a885d539c2d4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:53.261454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d1b36271-c283-44ae-b87f-a885d539c2d4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:53.262241 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-271a1439-b128-45ee-8559-1743de13ee16 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:53.262883 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-271a1439-b128-45ee-8559-1743de13ee16 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:53.268271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d1b36271-c283-44ae-b87f-a885d539c2d4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:53.268716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d1b36271-c283-44ae-b87f-a885d539c2d4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:53.269272 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-271a1439-b128-45ee-8559-1743de13ee16 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:53.269499 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d1b36271-c283-44ae-b87f-a885d539c2d4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:53.269725 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-271a1439-b128-45ee-8559-1743de13ee16 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:53.269933 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d1b36271-c283-44ae-b87f-a885d539c2d4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:53.270483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-271a1439-b128-45ee-8559-1743de13ee16 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:53.270920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-271a1439-b128-45ee-8559-1743de13ee16 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:53.403638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d1b36271-c283-44ae-b87f-a885d539c2d4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:53.403814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-271a1439-b128-45ee-8559-1743de13ee16 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:53.411826 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d1b36271-c283-44ae-b87f-a885d539c2d4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.154905 Jul 27 20:31:53.412018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-271a1439-b128-45ee-8559-1743de13ee16 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153454 Jul 27 20:31:53.412599 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1117/2222] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:53 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:53.412718 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1105/2222] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:53 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:54.433407 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-01ad8ad9-f453-4fe4-8192-83620fd228d9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:54.434095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3573e510-923d-4e2d-a1f4-a7b304e93bd5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:54.434469 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-01ad8ad9-f453-4fe4-8192-83620fd228d9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:54.434577 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3573e510-923d-4e2d-a1f4-a7b304e93bd5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:54.441281 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3573e510-923d-4e2d-a1f4-a7b304e93bd5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:54.441474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-01ad8ad9-f453-4fe4-8192-83620fd228d9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:54.441735 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3573e510-923d-4e2d-a1f4-a7b304e93bd5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:54.441872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-01ad8ad9-f453-4fe4-8192-83620fd228d9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:54.442505 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3573e510-923d-4e2d-a1f4-a7b304e93bd5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:54.442616 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-01ad8ad9-f453-4fe4-8192-83620fd228d9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:54.442948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3573e510-923d-4e2d-a1f4-a7b304e93bd5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:54.443071 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-01ad8ad9-f453-4fe4-8192-83620fd228d9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:54.574438 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-01ad8ad9-f453-4fe4-8192-83620fd228d9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:54.574628 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3573e510-923d-4e2d-a1f4-a7b304e93bd5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:54.583412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-01ad8ad9-f453-4fe4-8192-83620fd228d9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153879 Jul 27 20:31:54.583614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3573e510-923d-4e2d-a1f4-a7b304e93bd5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.153716 Jul 27 20:31:54.583988 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1106/2223] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:54 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:54.584166 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1118/2224] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:54 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:55.604385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-07a74009-1458-48df-896b-e298cc51981f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:55.604978 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-731a90ac-7d69-4000-ab47-205c524313ac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:55.605357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-07a74009-1458-48df-896b-e298cc51981f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:55.605460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-731a90ac-7d69-4000-ab47-205c524313ac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:55.611909 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-731a90ac-7d69-4000-ab47-205c524313ac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:55.612092 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-07a74009-1458-48df-896b-e298cc51981f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:55.612355 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-731a90ac-7d69-4000-ab47-205c524313ac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:55.612512 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-07a74009-1458-48df-896b-e298cc51981f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:55.613134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-731a90ac-7d69-4000-ab47-205c524313ac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:55.613425 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-07a74009-1458-48df-896b-e298cc51981f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:55.613569 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-731a90ac-7d69-4000-ab47-205c524313ac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:55.613868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-07a74009-1458-48df-896b-e298cc51981f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:55.747460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-731a90ac-7d69-4000-ab47-205c524313ac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:55.750289 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-07a74009-1458-48df-896b-e298cc51981f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:55.756367 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-731a90ac-7d69-4000-ab47-205c524313ac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.155355 Jul 27 20:31:55.756951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1119/2225] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:55 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:55.758487 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-07a74009-1458-48df-896b-e298cc51981f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.157859 Jul 27 20:31:55.759050 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1107/2226] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:55 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:56.779919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-604d720f-9e5e-4872-b9a8-ea97213f68e3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:56.780534 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-604d720f-9e5e-4872-b9a8-ea97213f68e3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:56.785203 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=52 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:31:56.790231 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-074ff82d-a40e-4c9a-949e-2ceb09582f1b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:56.790837 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-074ff82d-a40e-4c9a-949e-2ceb09582f1b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:56.790958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-604d720f-9e5e-4872-b9a8-ea97213f68e3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:56.791414 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-604d720f-9e5e-4872-b9a8-ea97213f68e3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:56.792197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-604d720f-9e5e-4872-b9a8-ea97213f68e3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:56.792648 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-604d720f-9e5e-4872-b9a8-ea97213f68e3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:56.797601 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-074ff82d-a40e-4c9a-949e-2ceb09582f1b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:56.798107 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-074ff82d-a40e-4c9a-949e-2ceb09582f1b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:56.798878 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-074ff82d-a40e-4c9a-949e-2ceb09582f1b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:56.799312 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-074ff82d-a40e-4c9a-949e-2ceb09582f1b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:56.923886 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-604d720f-9e5e-4872-b9a8-ea97213f68e3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:56.925526 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-074ff82d-a40e-4c9a-949e-2ceb09582f1b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:56.931905 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-604d720f-9e5e-4872-b9a8-ea97213f68e3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.155864 Jul 27 20:31:56.932483 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1120/2227] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:56 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:56.933231 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-074ff82d-a40e-4c9a-949e-2ceb09582f1b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.147473 Jul 27 20:31:56.933786 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1108/2228] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:56 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:57.953277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-34d552e5-9512-47b3-83e5-c65d9225a7c3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:57.953838 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ef0fcbe8-40e5-44ab-be4f-f51edc1a01fe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:57.954199 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-34d552e5-9512-47b3-83e5-c65d9225a7c3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:57.954286 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ef0fcbe8-40e5-44ab-be4f-f51edc1a01fe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:57.956496 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=52 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:31:57.960640 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-34d552e5-9512-47b3-83e5-c65d9225a7c3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:57.961143 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-34d552e5-9512-47b3-83e5-c65d9225a7c3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:57.961922 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-34d552e5-9512-47b3-83e5-c65d9225a7c3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:57.962118 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef0fcbe8-40e5-44ab-be4f-f51edc1a01fe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:57.962365 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-34d552e5-9512-47b3-83e5-c65d9225a7c3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:57.962573 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef0fcbe8-40e5-44ab-be4f-f51edc1a01fe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:57.963366 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef0fcbe8-40e5-44ab-be4f-f51edc1a01fe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:57.963809 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef0fcbe8-40e5-44ab-be4f-f51edc1a01fe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:58.099862 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-34d552e5-9512-47b3-83e5-c65d9225a7c3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:58.100786 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ef0fcbe8-40e5-44ab-be4f-f51edc1a01fe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:58.108069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-34d552e5-9512-47b3-83e5-c65d9225a7c3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.158925 Jul 27 20:31:58.108759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1121/2229] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:57 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:31:58.108870 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ef0fcbe8-40e5-44ab-be4f-f51edc1a01fe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.159365 Jul 27 20:31:58.109995 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1109/2230] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:57 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:59.130517 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a0e84801-9b0d-4c8b-961c-8c535f64a473 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:59.131039 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ff060d42-8abc-4c0a-87bd-72c5bf0b501f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:31:59.131432 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a0e84801-9b0d-4c8b-961c-8c535f64a473 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:59.131555 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ff060d42-8abc-4c0a-87bd-72c5bf0b501f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:31:59.138001 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a0e84801-9b0d-4c8b-961c-8c535f64a473 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:59.138138 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff060d42-8abc-4c0a-87bd-72c5bf0b501f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:59.138453 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff060d42-8abc-4c0a-87bd-72c5bf0b501f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:59.138577 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a0e84801-9b0d-4c8b-961c-8c535f64a473 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:59.139219 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a0e84801-9b0d-4c8b-961c-8c535f64a473 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:59.139321 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff060d42-8abc-4c0a-87bd-72c5bf0b501f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:31:59.139656 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff060d42-8abc-4c0a-87bd-72c5bf0b501f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:59.139755 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a0e84801-9b0d-4c8b-961c-8c535f64a473 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:31:59.272034 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ff060d42-8abc-4c0a-87bd-72c5bf0b501f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:59.272305 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a0e84801-9b0d-4c8b-961c-8c535f64a473 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:31:59.280238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ff060d42-8abc-4c0a-87bd-72c5bf0b501f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.153058 Jul 27 20:31:59.280453 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a0e84801-9b0d-4c8b-961c-8c535f64a473 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153638 Jul 27 20:31:59.281118 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1110/2231] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:59 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:31:59.281262 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1122/2232] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:31:59 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:00.301231 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6940f758-4c9a-491c-b932-61aa43326698 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:00.301890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-955a5076-c71b-4302-b63f-ca246192d486 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:00.302280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6940f758-4c9a-491c-b932-61aa43326698 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:00.302391 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-955a5076-c71b-4302-b63f-ca246192d486 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:00.308387 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-955a5076-c71b-4302-b63f-ca246192d486 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:00.308536 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6940f758-4c9a-491c-b932-61aa43326698 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:00.308836 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-955a5076-c71b-4302-b63f-ca246192d486 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:00.308956 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6940f758-4c9a-491c-b932-61aa43326698 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:00.309635 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-955a5076-c71b-4302-b63f-ca246192d486 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:00.309740 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6940f758-4c9a-491c-b932-61aa43326698 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:00.310081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6940f758-4c9a-491c-b932-61aa43326698 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:00.310230 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-955a5076-c71b-4302-b63f-ca246192d486 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:00.314597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:32:00.440395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6940f758-4c9a-491c-b932-61aa43326698 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:00.441542 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-955a5076-c71b-4302-b63f-ca246192d486 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:00.443857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:32:00.449637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6940f758-4c9a-491c-b932-61aa43326698 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.152272 Jul 27 20:32:00.449802 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-955a5076-c71b-4302-b63f-ca246192d486 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151885 Jul 27 20:32:00.450405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1111/2234] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:00 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:32:00.450533 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1123/2234] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:00 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:01.471961 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e36b13d4-f842-408d-8ebb-6c48dd296b97 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:01.472635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e36b13d4-f842-408d-8ebb-6c48dd296b97 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:01.479268 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e36b13d4-f842-408d-8ebb-6c48dd296b97 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:01.479727 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e36b13d4-f842-408d-8ebb-6c48dd296b97 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:01.480502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e36b13d4-f842-408d-8ebb-6c48dd296b97 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:01.480945 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e36b13d4-f842-408d-8ebb-6c48dd296b97 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:01.613267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e36b13d4-f842-408d-8ebb-6c48dd296b97 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:01.621173 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e36b13d4-f842-408d-8ebb-6c48dd296b97 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153948 Jul 27 20:32:01.621743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1124/2235] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:01 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:01.711965 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-26604dbf-2071-4c29-a05e-eb23e843facd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:01.712568 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-26604dbf-2071-4c29-a05e-eb23e843facd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:01.719102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-26604dbf-2071-4c29-a05e-eb23e843facd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:01.719541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-26604dbf-2071-4c29-a05e-eb23e843facd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:01.720295 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-26604dbf-2071-4c29-a05e-eb23e843facd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:01.720721 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-26604dbf-2071-4c29-a05e-eb23e843facd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:01.847680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-26604dbf-2071-4c29-a05e-eb23e843facd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:01.855489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-26604dbf-2071-4c29-a05e-eb23e843facd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.387639 Jul 27 20:32:01.856047 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1112/2236] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:01 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:32:02.642431 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-473042d2-7bcf-4aaa-a830-6b748e73168e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:02.643045 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-473042d2-7bcf-4aaa-a830-6b748e73168e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:02.649240 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-473042d2-7bcf-4aaa-a830-6b748e73168e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:02.649693 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-473042d2-7bcf-4aaa-a830-6b748e73168e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:02.650447 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-473042d2-7bcf-4aaa-a830-6b748e73168e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:02.650880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-473042d2-7bcf-4aaa-a830-6b748e73168e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:02.779633 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-473042d2-7bcf-4aaa-a830-6b748e73168e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:02.788170 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-473042d2-7bcf-4aaa-a830-6b748e73168e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149807 Jul 27 20:32:02.788736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1125/2237] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:02 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:02.877144 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-87e922fe-6424-4ad5-9bd7-312d6c68e926 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:02.877749 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-87e922fe-6424-4ad5-9bd7-312d6c68e926 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:02.884103 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87e922fe-6424-4ad5-9bd7-312d6c68e926 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:02.884546 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87e922fe-6424-4ad5-9bd7-312d6c68e926 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:02.885327 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87e922fe-6424-4ad5-9bd7-312d6c68e926 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:02.885759 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87e922fe-6424-4ad5-9bd7-312d6c68e926 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:03.014676 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-87e922fe-6424-4ad5-9bd7-312d6c68e926 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:03.023112 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-87e922fe-6424-4ad5-9bd7-312d6c68e926 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.149980 Jul 27 20:32:03.023707 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1113/2238] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:02 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:03.811741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c8d059b2-d414-4e6c-806b-5dd0540d1446 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:03.812940 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c8d059b2-d414-4e6c-806b-5dd0540d1446 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:03.819420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c8d059b2-d414-4e6c-806b-5dd0540d1446 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:03.819870 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c8d059b2-d414-4e6c-806b-5dd0540d1446 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:03.820631 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c8d059b2-d414-4e6c-806b-5dd0540d1446 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:03.821103 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c8d059b2-d414-4e6c-806b-5dd0540d1446 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:03.945964 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c8d059b2-d414-4e6c-806b-5dd0540d1446 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:03.954138 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c8d059b2-d414-4e6c-806b-5dd0540d1446 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.146359 Jul 27 20:32:03.954716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1126/2239] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:03 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:04.044144 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7ea63b13-2f6c-40f5-acbb-287cc4820b2c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:04.044754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7ea63b13-2f6c-40f5-acbb-287cc4820b2c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:04.052145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ea63b13-2f6c-40f5-acbb-287cc4820b2c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:04.052514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ea63b13-2f6c-40f5-acbb-287cc4820b2c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:04.053311 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ea63b13-2f6c-40f5-acbb-287cc4820b2c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:04.053751 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ea63b13-2f6c-40f5-acbb-287cc4820b2c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:04.180670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7ea63b13-2f6c-40f5-acbb-287cc4820b2c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:04.188581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7ea63b13-2f6c-40f5-acbb-287cc4820b2c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.148410 Jul 27 20:32:04.189167 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1114/2240] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:04 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:04.975595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-418a62b2-9d47-465f-822c-421742e7d839 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:04.976217 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-418a62b2-9d47-465f-822c-421742e7d839 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:04.982724 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-418a62b2-9d47-465f-822c-421742e7d839 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:04.983185 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-418a62b2-9d47-465f-822c-421742e7d839 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:04.983986 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-418a62b2-9d47-465f-822c-421742e7d839 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:04.984428 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-418a62b2-9d47-465f-822c-421742e7d839 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:05.117506 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-418a62b2-9d47-465f-822c-421742e7d839 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:05.125975 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-418a62b2-9d47-465f-822c-421742e7d839 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.154293 Jul 27 20:32:05.126537 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1127/2241] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:04 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:05.209484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3df496a8-2144-4ce3-8b42-08f5525bed1c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:05.210086 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3df496a8-2144-4ce3-8b42-08f5525bed1c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:05.216438 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3df496a8-2144-4ce3-8b42-08f5525bed1c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:05.216878 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3df496a8-2144-4ce3-8b42-08f5525bed1c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:05.217659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3df496a8-2144-4ce3-8b42-08f5525bed1c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:05.218090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3df496a8-2144-4ce3-8b42-08f5525bed1c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:05.347904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3df496a8-2144-4ce3-8b42-08f5525bed1c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:05.355816 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3df496a8-2144-4ce3-8b42-08f5525bed1c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.150044 Jul 27 20:32:05.356382 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1115/2242] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:05 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:06.147278 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c2f06e03-ad87-4b1c-844b-ef778c7f5c9f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:06.147896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c2f06e03-ad87-4b1c-844b-ef778c7f5c9f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:06.154429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c2f06e03-ad87-4b1c-844b-ef778c7f5c9f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:06.154882 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c2f06e03-ad87-4b1c-844b-ef778c7f5c9f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:06.155756 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c2f06e03-ad87-4b1c-844b-ef778c7f5c9f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:06.156822 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c2f06e03-ad87-4b1c-844b-ef778c7f5c9f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:06.281551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c2f06e03-ad87-4b1c-844b-ef778c7f5c9f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:06.290265 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c2f06e03-ad87-4b1c-844b-ef778c7f5c9f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.146782 Jul 27 20:32:06.290839 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1128/2243] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:06 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:06.378393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8296add0-ec9c-499f-9ed5-c413d6c29c45 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:06.378956 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8296add0-ec9c-499f-9ed5-c413d6c29c45 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:06.385433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8296add0-ec9c-499f-9ed5-c413d6c29c45 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:06.385888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8296add0-ec9c-499f-9ed5-c413d6c29c45 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:06.386653 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8296add0-ec9c-499f-9ed5-c413d6c29c45 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:06.387094 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8296add0-ec9c-499f-9ed5-c413d6c29c45 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:06.512941 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8296add0-ec9c-499f-9ed5-c413d6c29c45 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:06.521637 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8296add0-ec9c-499f-9ed5-c413d6c29c45 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.147635 Jul 27 20:32:06.522198 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1116/2244] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:06 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:07.311623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b80912ac-87fa-4f6b-9398-3e64fb765e8d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:07.312396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b80912ac-87fa-4f6b-9398-3e64fb765e8d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:07.318805 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b80912ac-87fa-4f6b-9398-3e64fb765e8d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:07.319260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b80912ac-87fa-4f6b-9398-3e64fb765e8d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:07.320029 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b80912ac-87fa-4f6b-9398-3e64fb765e8d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:07.320472 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b80912ac-87fa-4f6b-9398-3e64fb765e8d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:07.450045 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b80912ac-87fa-4f6b-9398-3e64fb765e8d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:07.459013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b80912ac-87fa-4f6b-9398-3e64fb765e8d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151268 Jul 27 20:32:07.459575 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1129/2245] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:07 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:07.543090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8c762873-dae8-4720-aaef-024a7c56c17b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:07.543704 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8c762873-dae8-4720-aaef-024a7c56c17b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:07.550677 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c762873-dae8-4720-aaef-024a7c56c17b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:07.551120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c762873-dae8-4720-aaef-024a7c56c17b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:07.551866 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c762873-dae8-4720-aaef-024a7c56c17b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:07.552295 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c762873-dae8-4720-aaef-024a7c56c17b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:07.686479 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8c762873-dae8-4720-aaef-024a7c56c17b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:07.694952 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8c762873-dae8-4720-aaef-024a7c56c17b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.155766 Jul 27 20:32:07.695504 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1117/2246] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:07 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:08.480445 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0a6a0cb1-09b4-4ae6-ab10-1f956dc6b210 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:08.481063 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0a6a0cb1-09b4-4ae6-ab10-1f956dc6b210 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:08.488272 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a6a0cb1-09b4-4ae6-ab10-1f956dc6b210 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:08.488723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a6a0cb1-09b4-4ae6-ab10-1f956dc6b210 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:08.489506 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a6a0cb1-09b4-4ae6-ab10-1f956dc6b210 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:08.489939 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a6a0cb1-09b4-4ae6-ab10-1f956dc6b210 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:08.627489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0a6a0cb1-09b4-4ae6-ab10-1f956dc6b210 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:08.635262 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0a6a0cb1-09b4-4ae6-ab10-1f956dc6b210 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.158664 Jul 27 20:32:08.636076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1130/2247] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:08 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:08.717157 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-49613700-bc6f-437e-bf5b-c20a5ca900e9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:08.717762 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-49613700-bc6f-437e-bf5b-c20a5ca900e9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:08.724230 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49613700-bc6f-437e-bf5b-c20a5ca900e9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:08.724669 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49613700-bc6f-437e-bf5b-c20a5ca900e9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:08.725473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49613700-bc6f-437e-bf5b-c20a5ca900e9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:08.725900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49613700-bc6f-437e-bf5b-c20a5ca900e9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:08.856652 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-49613700-bc6f-437e-bf5b-c20a5ca900e9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:08.864898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-49613700-bc6f-437e-bf5b-c20a5ca900e9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.151636 Jul 27 20:32:08.865485 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1118/2248] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:08 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:09.657750 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-327475ed-c1cb-476d-bb1e-70e148805457 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:09.658396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-327475ed-c1cb-476d-bb1e-70e148805457 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:09.665021 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-327475ed-c1cb-476d-bb1e-70e148805457 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:09.665484 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-327475ed-c1cb-476d-bb1e-70e148805457 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:09.666251 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-327475ed-c1cb-476d-bb1e-70e148805457 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:09.666693 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-327475ed-c1cb-476d-bb1e-70e148805457 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:09.795621 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-327475ed-c1cb-476d-bb1e-70e148805457 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:09.803651 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-327475ed-c1cb-476d-bb1e-70e148805457 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150573 Jul 27 20:32:09.804252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1131/2249] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:09 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:09.886167 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c6252d1c-89d2-48d6-81e2-6f33a83f12cc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:09.886804 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c6252d1c-89d2-48d6-81e2-6f33a83f12cc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:09.893885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c6252d1c-89d2-48d6-81e2-6f33a83f12cc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:09.894329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c6252d1c-89d2-48d6-81e2-6f33a83f12cc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:09.895076 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c6252d1c-89d2-48d6-81e2-6f33a83f12cc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:09.895508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c6252d1c-89d2-48d6-81e2-6f33a83f12cc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:10.024555 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c6252d1c-89d2-48d6-81e2-6f33a83f12cc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:10.032445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c6252d1c-89d2-48d6-81e2-6f33a83f12cc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.150096 Jul 27 20:32:10.033016 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1119/2250] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:09 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:10.823559 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bb640288-9773-4adc-b1f2-06950edf709e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:10.824173 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bb640288-9773-4adc-b1f2-06950edf709e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:10.831069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb640288-9773-4adc-b1f2-06950edf709e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:10.831516 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb640288-9773-4adc-b1f2-06950edf709e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:10.832263 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb640288-9773-4adc-b1f2-06950edf709e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:10.832695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb640288-9773-4adc-b1f2-06950edf709e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:10.960139 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bb640288-9773-4adc-b1f2-06950edf709e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:10.968207 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bb640288-9773-4adc-b1f2-06950edf709e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148473 Jul 27 20:32:10.969411 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1132/2251] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:10 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:11.053955 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c6d76849-3f12-420c-8393-f295b6120536 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:11.054588 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c6d76849-3f12-420c-8393-f295b6120536 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:11.060933 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c6d76849-3f12-420c-8393-f295b6120536 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:11.061409 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c6d76849-3f12-420c-8393-f295b6120536 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:11.062155 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c6d76849-3f12-420c-8393-f295b6120536 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:11.062677 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c6d76849-3f12-420c-8393-f295b6120536 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:11.189332 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c6d76849-3f12-420c-8393-f295b6120536 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:11.197125 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c6d76849-3f12-420c-8393-f295b6120536 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.146981 Jul 27 20:32:11.197679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1120/2252] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:11 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:11.990483 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6f677178-b16e-4905-aaf1-c808c98dcc5c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:11.991119 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6f677178-b16e-4905-aaf1-c808c98dcc5c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:11.997579 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6f677178-b16e-4905-aaf1-c808c98dcc5c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:11.998033 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6f677178-b16e-4905-aaf1-c808c98dcc5c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:11.998797 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6f677178-b16e-4905-aaf1-c808c98dcc5c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:11.999241 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6f677178-b16e-4905-aaf1-c808c98dcc5c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:12.125810 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6f677178-b16e-4905-aaf1-c808c98dcc5c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:12.133669 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6f677178-b16e-4905-aaf1-c808c98dcc5c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.147167 Jul 27 20:32:12.134232 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1133/2253] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:11 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:12.218696 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-845ce449-2edd-4fd7-b2af-376a9d03fdc9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:12.219309 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-845ce449-2edd-4fd7-b2af-376a9d03fdc9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:12.225791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-845ce449-2edd-4fd7-b2af-376a9d03fdc9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:12.226246 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-845ce449-2edd-4fd7-b2af-376a9d03fdc9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:12.227000 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-845ce449-2edd-4fd7-b2af-376a9d03fdc9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:12.227431 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-845ce449-2edd-4fd7-b2af-376a9d03fdc9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:12.505984 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-845ce449-2edd-4fd7-b2af-376a9d03fdc9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:12.514359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-845ce449-2edd-4fd7-b2af-376a9d03fdc9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.299477 Jul 27 20:32:12.514931 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1121/2254] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:12 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:13.154066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-de766acc-f061-4df6-ae61-345db0efd847 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:13.154717 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-de766acc-f061-4df6-ae61-345db0efd847 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:13.161234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-de766acc-f061-4df6-ae61-345db0efd847 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:13.161677 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-de766acc-f061-4df6-ae61-345db0efd847 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:13.162430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-de766acc-f061-4df6-ae61-345db0efd847 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:13.162865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-de766acc-f061-4df6-ae61-345db0efd847 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:13.294723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-de766acc-f061-4df6-ae61-345db0efd847 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:13.302957 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-de766acc-f061-4df6-ae61-345db0efd847 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152704 Jul 27 20:32:13.303527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1134/2255] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:13 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:13.535641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-79662026-375d-4b79-bcf1-936c166ccaa5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:13.536249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-79662026-375d-4b79-bcf1-936c166ccaa5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:13.542672 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79662026-375d-4b79-bcf1-936c166ccaa5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:13.543121 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79662026-375d-4b79-bcf1-936c166ccaa5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:13.543874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79662026-375d-4b79-bcf1-936c166ccaa5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:13.544309 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79662026-375d-4b79-bcf1-936c166ccaa5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:13.679036 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-79662026-375d-4b79-bcf1-936c166ccaa5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:13.687007 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-79662026-375d-4b79-bcf1-936c166ccaa5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.155194 Jul 27 20:32:13.688119 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1122/2256] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:13 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:14.324577 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4a4b9912-c1f7-4779-96a0-4b6f72729382 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:14.325221 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4a4b9912-c1f7-4779-96a0-4b6f72729382 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:14.332470 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4a4b9912-c1f7-4779-96a0-4b6f72729382 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:14.332864 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4a4b9912-c1f7-4779-96a0-4b6f72729382 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:14.333653 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4a4b9912-c1f7-4779-96a0-4b6f72729382 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:14.334093 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4a4b9912-c1f7-4779-96a0-4b6f72729382 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:14.460869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4a4b9912-c1f7-4779-96a0-4b6f72729382 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:14.470312 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4a4b9912-c1f7-4779-96a0-4b6f72729382 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149595 Jul 27 20:32:14.470883 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1135/2257] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:14 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:14.709678 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7eaac231-25fe-4749-a79c-8a036258093f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:14.710298 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7eaac231-25fe-4749-a79c-8a036258093f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:14.716954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7eaac231-25fe-4749-a79c-8a036258093f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:14.717424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7eaac231-25fe-4749-a79c-8a036258093f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:14.718173 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7eaac231-25fe-4749-a79c-8a036258093f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:14.718641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7eaac231-25fe-4749-a79c-8a036258093f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:14.843982 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7eaac231-25fe-4749-a79c-8a036258093f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:14.851872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7eaac231-25fe-4749-a79c-8a036258093f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.146024 Jul 27 20:32:14.852438 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1123/2258] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:14 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:15.492446 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f625da34-2f46-4b67-8cfc-ec5d24bfdc17 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:15.493103 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f625da34-2f46-4b67-8cfc-ec5d24bfdc17 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:15.500804 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f625da34-2f46-4b67-8cfc-ec5d24bfdc17 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:15.500987 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f625da34-2f46-4b67-8cfc-ec5d24bfdc17 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:15.501837 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f625da34-2f46-4b67-8cfc-ec5d24bfdc17 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:15.502285 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f625da34-2f46-4b67-8cfc-ec5d24bfdc17 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:15.637672 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f625da34-2f46-4b67-8cfc-ec5d24bfdc17 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:15.645505 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f625da34-2f46-4b67-8cfc-ec5d24bfdc17 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.156906 Jul 27 20:32:15.646069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1136/2259] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:15 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:15.874014 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2e96f7c0-2c11-482f-947e-19501c136a18 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:15.874541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2e96f7c0-2c11-482f-947e-19501c136a18 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:15.881625 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e96f7c0-2c11-482f-947e-19501c136a18 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:15.882070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e96f7c0-2c11-482f-947e-19501c136a18 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:15.882819 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e96f7c0-2c11-482f-947e-19501c136a18 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:15.883244 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e96f7c0-2c11-482f-947e-19501c136a18 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:16.011378 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2e96f7c0-2c11-482f-947e-19501c136a18 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:16.019760 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2e96f7c0-2c11-482f-947e-19501c136a18 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.149624 Jul 27 20:32:16.020327 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1124/2260] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:15 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:32:16.666515 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c3c7197f-351e-44a1-87e4-dc7823b333c9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:16.667130 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c3c7197f-351e-44a1-87e4-dc7823b333c9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:16.673713 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c3c7197f-351e-44a1-87e4-dc7823b333c9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:16.674163 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c3c7197f-351e-44a1-87e4-dc7823b333c9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:16.674923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c3c7197f-351e-44a1-87e4-dc7823b333c9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:16.675358 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c3c7197f-351e-44a1-87e4-dc7823b333c9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:16.801157 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c3c7197f-351e-44a1-87e4-dc7823b333c9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:16.808942 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c3c7197f-351e-44a1-87e4-dc7823b333c9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.146307 Jul 27 20:32:16.809524 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1137/2261] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:16 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:17.041644 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9ca30a9c-4310-4570-a183-b020dac4181b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:17.042178 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9ca30a9c-4310-4570-a183-b020dac4181b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:17.048667 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9ca30a9c-4310-4570-a183-b020dac4181b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:17.049153 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9ca30a9c-4310-4570-a183-b020dac4181b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:17.049905 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9ca30a9c-4310-4570-a183-b020dac4181b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:17.050334 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9ca30a9c-4310-4570-a183-b020dac4181b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:17.178620 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9ca30a9c-4310-4570-a183-b020dac4181b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:17.186420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9ca30a9c-4310-4570-a183-b020dac4181b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.148698 Jul 27 20:32:17.186968 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1125/2262] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:17 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:17.830687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ceccc65f-96fc-4517-a23a-03dab83f3f82 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:17.831253 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ceccc65f-96fc-4517-a23a-03dab83f3f82 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:17.837763 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ceccc65f-96fc-4517-a23a-03dab83f3f82 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:17.838218 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ceccc65f-96fc-4517-a23a-03dab83f3f82 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:17.838971 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ceccc65f-96fc-4517-a23a-03dab83f3f82 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:17.839404 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ceccc65f-96fc-4517-a23a-03dab83f3f82 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:17.965057 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ceccc65f-96fc-4517-a23a-03dab83f3f82 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:17.973413 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ceccc65f-96fc-4517-a23a-03dab83f3f82 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.147105 Jul 27 20:32:17.973977 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1138/2263] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:17 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:18.215562 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f1d93303-bbcf-435e-a8f1-181b1eec8107 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:18.216180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f1d93303-bbcf-435e-a8f1-181b1eec8107 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:18.223453 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1d93303-bbcf-435e-a8f1-181b1eec8107 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:18.223930 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1d93303-bbcf-435e-a8f1-181b1eec8107 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:18.224689 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1d93303-bbcf-435e-a8f1-181b1eec8107 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:18.225159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1d93303-bbcf-435e-a8f1-181b1eec8107 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:18.354760 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f1d93303-bbcf-435e-a8f1-181b1eec8107 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:18.362872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f1d93303-bbcf-435e-a8f1-181b1eec8107 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.151190 Jul 27 20:32:18.363431 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1126/2264] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:18 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:18.993967 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-61db3f0b-c33e-4c16-be11-e7c51c6eb6d6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:18.994587 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-61db3f0b-c33e-4c16-be11-e7c51c6eb6d6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:19.002172 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-61db3f0b-c33e-4c16-be11-e7c51c6eb6d6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:19.002848 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-61db3f0b-c33e-4c16-be11-e7c51c6eb6d6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:19.003792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-61db3f0b-c33e-4c16-be11-e7c51c6eb6d6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:19.004065 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-61db3f0b-c33e-4c16-be11-e7c51c6eb6d6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:19.138844 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-61db3f0b-c33e-4c16-be11-e7c51c6eb6d6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:19.146921 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-61db3f0b-c33e-4c16-be11-e7c51c6eb6d6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.156807 Jul 27 20:32:19.147479 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1139/2265] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:18 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:32:19.383588 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9c4c34b4-b7ca-42fe-af42-ca7c0b522c8b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:19.384159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9c4c34b4-b7ca-42fe-af42-ca7c0b522c8b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:19.391147 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c4c34b4-b7ca-42fe-af42-ca7c0b522c8b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:19.391601 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c4c34b4-b7ca-42fe-af42-ca7c0b522c8b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:19.392392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c4c34b4-b7ca-42fe-af42-ca7c0b522c8b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:19.392831 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c4c34b4-b7ca-42fe-af42-ca7c0b522c8b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:19.527624 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9c4c34b4-b7ca-42fe-af42-ca7c0b522c8b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:19.531565 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:32:19.537134 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9c4c34b4-b7ca-42fe-af42-ca7c0b522c8b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.157498 Jul 27 20:32:19.537691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1127/2266] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:19 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:20.168133 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-543965c9-56ef-41f8-9997-a24c06458aaa tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:20.168741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-543965c9-56ef-41f8-9997-a24c06458aaa tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:20.175888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-543965c9-56ef-41f8-9997-a24c06458aaa tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:20.176334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-543965c9-56ef-41f8-9997-a24c06458aaa tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:20.177113 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-543965c9-56ef-41f8-9997-a24c06458aaa tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:20.177549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-543965c9-56ef-41f8-9997-a24c06458aaa tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:20.195600 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:32:20.306888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-543965c9-56ef-41f8-9997-a24c06458aaa tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:20.315381 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-543965c9-56ef-41f8-9997-a24c06458aaa tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151108 Jul 27 20:32:20.315942 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1140/2267] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:20 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:20.558745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bfb1723a-e14f-4fe5-9d67-5522cdee16b2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:20.559285 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bfb1723a-e14f-4fe5-9d67-5522cdee16b2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:20.565736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfb1723a-e14f-4fe5-9d67-5522cdee16b2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:20.566176 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfb1723a-e14f-4fe5-9d67-5522cdee16b2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:20.566919 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfb1723a-e14f-4fe5-9d67-5522cdee16b2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:20.567348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfb1723a-e14f-4fe5-9d67-5522cdee16b2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:20.693511 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bfb1723a-e14f-4fe5-9d67-5522cdee16b2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:20.701401 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bfb1723a-e14f-4fe5-9d67-5522cdee16b2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.146699 Jul 27 20:32:20.701966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1128/2268] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:20 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:21.336653 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d5784bd7-b3fe-448d-86d4-4ccc0c69b70b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:21.337228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d5784bd7-b3fe-448d-86d4-4ccc0c69b70b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:21.343749 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d5784bd7-b3fe-448d-86d4-4ccc0c69b70b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:21.344204 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d5784bd7-b3fe-448d-86d4-4ccc0c69b70b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:21.345183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d5784bd7-b3fe-448d-86d4-4ccc0c69b70b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:21.345628 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d5784bd7-b3fe-448d-86d4-4ccc0c69b70b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:21.474589 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d5784bd7-b3fe-448d-86d4-4ccc0c69b70b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:21.482448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d5784bd7-b3fe-448d-86d4-4ccc0c69b70b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149815 Jul 27 20:32:21.482999 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1141/2269] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:21 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:21.723226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d4004cee-0bb5-447c-b201-912ae6b2f97b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:21.723825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d4004cee-0bb5-447c-b201-912ae6b2f97b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:21.730374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4004cee-0bb5-447c-b201-912ae6b2f97b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:21.730829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4004cee-0bb5-447c-b201-912ae6b2f97b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:21.731593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4004cee-0bb5-447c-b201-912ae6b2f97b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:21.732034 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4004cee-0bb5-447c-b201-912ae6b2f97b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:21.861087 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d4004cee-0bb5-447c-b201-912ae6b2f97b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:21.868902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d4004cee-0bb5-447c-b201-912ae6b2f97b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.149789 Jul 27 20:32:21.869487 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1129/2270] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:21 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:22.503297 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fe904ff6-58cb-4c18-b207-dfb30ba2dfda tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:22.503917 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fe904ff6-58cb-4c18-b207-dfb30ba2dfda tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:22.510397 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fe904ff6-58cb-4c18-b207-dfb30ba2dfda tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:22.510844 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fe904ff6-58cb-4c18-b207-dfb30ba2dfda tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:22.511604 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fe904ff6-58cb-4c18-b207-dfb30ba2dfda tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:22.512040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fe904ff6-58cb-4c18-b207-dfb30ba2dfda tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:22.637109 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fe904ff6-58cb-4c18-b207-dfb30ba2dfda tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:22.644917 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fe904ff6-58cb-4c18-b207-dfb30ba2dfda tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.146297 Jul 27 20:32:22.645500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1142/2271] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:22 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:22.890608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ec3ef3ea-cc33-47cf-94b8-21c783115be0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:22.891235 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ec3ef3ea-cc33-47cf-94b8-21c783115be0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:22.897659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec3ef3ea-cc33-47cf-94b8-21c783115be0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:22.898104 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec3ef3ea-cc33-47cf-94b8-21c783115be0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:22.898852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec3ef3ea-cc33-47cf-94b8-21c783115be0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:22.899281 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec3ef3ea-cc33-47cf-94b8-21c783115be0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:23.027816 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ec3ef3ea-cc33-47cf-94b8-21c783115be0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:23.036086 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ec3ef3ea-cc33-47cf-94b8-21c783115be0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.149512 Jul 27 20:32:23.036648 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1130/2272] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:22 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:23.665835 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5459fd8c-a0af-404c-9494-b4795dec1f25 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:23.666446 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5459fd8c-a0af-404c-9494-b4795dec1f25 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:23.673053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5459fd8c-a0af-404c-9494-b4795dec1f25 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:23.673505 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5459fd8c-a0af-404c-9494-b4795dec1f25 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:23.674266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5459fd8c-a0af-404c-9494-b4795dec1f25 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:23.674700 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5459fd8c-a0af-404c-9494-b4795dec1f25 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:23.803643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5459fd8c-a0af-404c-9494-b4795dec1f25 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:23.811511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5459fd8c-a0af-404c-9494-b4795dec1f25 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149549 Jul 27 20:32:23.812073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1143/2273] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:23 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:24.058269 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3d1845d8-6e92-4747-a371-978843a611bc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:24.058811 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3d1845d8-6e92-4747-a371-978843a611bc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:24.065955 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d1845d8-6e92-4747-a371-978843a611bc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:24.066404 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d1845d8-6e92-4747-a371-978843a611bc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:24.067169 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d1845d8-6e92-4747-a371-978843a611bc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:24.067609 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d1845d8-6e92-4747-a371-978843a611bc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:24.197395 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3d1845d8-6e92-4747-a371-978843a611bc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:24.205756 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3d1845d8-6e92-4747-a371-978843a611bc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.151456 Jul 27 20:32:24.206310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1131/2274] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:24 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:24.834672 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-384b2873-0895-4327-aa20-8db3ab8871b3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:24.835292 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-384b2873-0895-4327-aa20-8db3ab8871b3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:24.841853 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-384b2873-0895-4327-aa20-8db3ab8871b3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:24.842303 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-384b2873-0895-4327-aa20-8db3ab8871b3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:24.843070 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-384b2873-0895-4327-aa20-8db3ab8871b3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:24.843508 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-384b2873-0895-4327-aa20-8db3ab8871b3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:24.975405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-384b2873-0895-4327-aa20-8db3ab8871b3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:24.983528 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-384b2873-0895-4327-aa20-8db3ab8871b3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152792 Jul 27 20:32:24.984089 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1144/2275] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:24 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:25.228159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d13b8861-017e-43fd-ac25-5a8252c2c29e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:25.228777 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d13b8861-017e-43fd-ac25-5a8252c2c29e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:25.235542 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d13b8861-017e-43fd-ac25-5a8252c2c29e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:25.235993 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d13b8861-017e-43fd-ac25-5a8252c2c29e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:25.236758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d13b8861-017e-43fd-ac25-5a8252c2c29e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:25.237224 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d13b8861-017e-43fd-ac25-5a8252c2c29e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:25.364546 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d13b8861-017e-43fd-ac25-5a8252c2c29e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:25.372457 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d13b8861-017e-43fd-ac25-5a8252c2c29e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.148113 Jul 27 20:32:25.373040 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1132/2276] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:25 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:26.004596 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ad132eab-ed43-40a1-89e0-e8c82b365816 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:26.005248 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ad132eab-ed43-40a1-89e0-e8c82b365816 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:26.011811 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ad132eab-ed43-40a1-89e0-e8c82b365816 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:26.012271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ad132eab-ed43-40a1-89e0-e8c82b365816 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:26.013090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ad132eab-ed43-40a1-89e0-e8c82b365816 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:26.013547 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ad132eab-ed43-40a1-89e0-e8c82b365816 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:26.141606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ad132eab-ed43-40a1-89e0-e8c82b365816 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:26.149409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ad132eab-ed43-40a1-89e0-e8c82b365816 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148700 Jul 27 20:32:26.149966 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1145/2277] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:25 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:26.394702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-be30c4aa-3914-489b-a4b6-0a42ad102ef0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:26.395312 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-be30c4aa-3914-489b-a4b6-0a42ad102ef0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:26.401784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-be30c4aa-3914-489b-a4b6-0a42ad102ef0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:26.402232 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-be30c4aa-3914-489b-a4b6-0a42ad102ef0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:26.403013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-be30c4aa-3914-489b-a4b6-0a42ad102ef0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:26.403452 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-be30c4aa-3914-489b-a4b6-0a42ad102ef0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:26.531801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-be30c4aa-3914-489b-a4b6-0a42ad102ef0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:26.539643 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-be30c4aa-3914-489b-a4b6-0a42ad102ef0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.149329 Jul 27 20:32:26.540202 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1133/2278] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:26 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:27.170985 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-25d2d382-0cf2-4eb3-bc82-9bbfb9a7ca57 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:27.172233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-25d2d382-0cf2-4eb3-bc82-9bbfb9a7ca57 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:27.174659 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=52 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:32:27.180339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-25d2d382-0cf2-4eb3-bc82-9bbfb9a7ca57 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:27.180818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-25d2d382-0cf2-4eb3-bc82-9bbfb9a7ca57 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:27.181621 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-25d2d382-0cf2-4eb3-bc82-9bbfb9a7ca57 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:27.182067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-25d2d382-0cf2-4eb3-bc82-9bbfb9a7ca57 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:27.312292 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-25d2d382-0cf2-4eb3-bc82-9bbfb9a7ca57 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:27.320208 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-25d2d382-0cf2-4eb3-bc82-9bbfb9a7ca57 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153174 Jul 27 20:32:27.320780 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1146/2279] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:27 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:27.560794 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d2dd5a3b-1998-45d8-b3b7-a345cdda9852 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:27.561376 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d2dd5a3b-1998-45d8-b3b7-a345cdda9852 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:27.567933 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2dd5a3b-1998-45d8-b3b7-a345cdda9852 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:27.568386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2dd5a3b-1998-45d8-b3b7-a345cdda9852 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:27.569175 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2dd5a3b-1998-45d8-b3b7-a345cdda9852 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:27.569617 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2dd5a3b-1998-45d8-b3b7-a345cdda9852 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:27.697982 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d2dd5a3b-1998-45d8-b3b7-a345cdda9852 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:27.706692 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d2dd5a3b-1998-45d8-b3b7-a345cdda9852 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.149827 Jul 27 20:32:27.707468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1134/2280] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:27 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:28.341451 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ddb7faa3-95d9-4a6a-8154-43d0ce472f56 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:28.342034 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ddb7faa3-95d9-4a6a-8154-43d0ce472f56 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:28.348768 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddb7faa3-95d9-4a6a-8154-43d0ce472f56 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:28.349256 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddb7faa3-95d9-4a6a-8154-43d0ce472f56 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:28.350023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddb7faa3-95d9-4a6a-8154-43d0ce472f56 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:28.350468 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddb7faa3-95d9-4a6a-8154-43d0ce472f56 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:28.479616 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ddb7faa3-95d9-4a6a-8154-43d0ce472f56 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:28.488326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ddb7faa3-95d9-4a6a-8154-43d0ce472f56 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150769 Jul 27 20:32:28.488905 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1147/2281] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:28 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:28.729378 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8e654389-753e-4985-8030-4e9e43bff4c6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:28.729992 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8e654389-753e-4985-8030-4e9e43bff4c6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:28.732263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=52 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:32:28.738277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e654389-753e-4985-8030-4e9e43bff4c6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:28.738731 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e654389-753e-4985-8030-4e9e43bff4c6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:28.739496 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e654389-753e-4985-8030-4e9e43bff4c6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:28.739936 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e654389-753e-4985-8030-4e9e43bff4c6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:28.867849 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8e654389-753e-4985-8030-4e9e43bff4c6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:28.875708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8e654389-753e-4985-8030-4e9e43bff4c6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.150237 Jul 27 20:32:28.876278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1135/2282] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:28 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:29.510544 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-23d9c17a-66fc-4c4a-b8b7-47f5e4f8f3a9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:29.511207 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-23d9c17a-66fc-4c4a-b8b7-47f5e4f8f3a9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:29.518562 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-23d9c17a-66fc-4c4a-b8b7-47f5e4f8f3a9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:29.519020 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-23d9c17a-66fc-4c4a-b8b7-47f5e4f8f3a9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:29.519792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-23d9c17a-66fc-4c4a-b8b7-47f5e4f8f3a9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:29.520235 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-23d9c17a-66fc-4c4a-b8b7-47f5e4f8f3a9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:29.651517 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-23d9c17a-66fc-4c4a-b8b7-47f5e4f8f3a9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:29.659469 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-23d9c17a-66fc-4c4a-b8b7-47f5e4f8f3a9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153630 Jul 27 20:32:29.660030 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1148/2283] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:29 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:29.896878 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8f0ed04a-21c7-4b81-9977-327249c664b9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:29.897543 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8f0ed04a-21c7-4b81-9977-327249c664b9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:29.904022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8f0ed04a-21c7-4b81-9977-327249c664b9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:29.904474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8f0ed04a-21c7-4b81-9977-327249c664b9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:29.905260 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8f0ed04a-21c7-4b81-9977-327249c664b9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:29.905704 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8f0ed04a-21c7-4b81-9977-327249c664b9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:30.264772 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8f0ed04a-21c7-4b81-9977-327249c664b9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:30.273265 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8f0ed04a-21c7-4b81-9977-327249c664b9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.380218 Jul 27 20:32:30.273836 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1136/2284] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:29 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:30.680208 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a7116f6d-ba99-4e20-b359-f4cb03b49558 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:30.681086 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a7116f6d-ba99-4e20-b359-f4cb03b49558 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:30.688700 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a7116f6d-ba99-4e20-b359-f4cb03b49558 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:30.689692 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a7116f6d-ba99-4e20-b359-f4cb03b49558 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:30.690517 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a7116f6d-ba99-4e20-b359-f4cb03b49558 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:30.690971 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a7116f6d-ba99-4e20-b359-f4cb03b49558 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:30.817506 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a7116f6d-ba99-4e20-b359-f4cb03b49558 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:30.825304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a7116f6d-ba99-4e20-b359-f4cb03b49558 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148970 Jul 27 20:32:30.825868 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1149/2285] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:30 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:31.293944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-32639ed5-154a-4564-94e3-7621c179437f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:31.294550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-32639ed5-154a-4564-94e3-7621c179437f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:31.301849 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-32639ed5-154a-4564-94e3-7621c179437f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:31.302293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-32639ed5-154a-4564-94e3-7621c179437f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:31.303046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-32639ed5-154a-4564-94e3-7621c179437f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:31.303478 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-32639ed5-154a-4564-94e3-7621c179437f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:31.430087 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-32639ed5-154a-4564-94e3-7621c179437f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:31.438135 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-32639ed5-154a-4564-94e3-7621c179437f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.148066 Jul 27 20:32:31.438716 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1137/2286] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:31 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:31.846571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1242d1f6-e5fd-492f-8540-69fbddfdf1bc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:31.847189 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1242d1f6-e5fd-492f-8540-69fbddfdf1bc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:31.853807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1242d1f6-e5fd-492f-8540-69fbddfdf1bc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:31.854259 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1242d1f6-e5fd-492f-8540-69fbddfdf1bc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:31.855016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1242d1f6-e5fd-492f-8540-69fbddfdf1bc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:31.855455 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1242d1f6-e5fd-492f-8540-69fbddfdf1bc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:31.982342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1242d1f6-e5fd-492f-8540-69fbddfdf1bc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:31.991984 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1242d1f6-e5fd-492f-8540-69fbddfdf1bc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148958 Jul 27 20:32:31.992771 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1150/2287] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:31 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:32.459480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8bde3309-9d4e-437e-92f0-0a8c721c225a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:32.460089 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8bde3309-9d4e-437e-92f0-0a8c721c225a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:32.466515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8bde3309-9d4e-437e-92f0-0a8c721c225a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:32.466959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8bde3309-9d4e-437e-92f0-0a8c721c225a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:32.467716 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8bde3309-9d4e-437e-92f0-0a8c721c225a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:32.468151 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8bde3309-9d4e-437e-92f0-0a8c721c225a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:32.600094 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8bde3309-9d4e-437e-92f0-0a8c721c225a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:32.608001 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8bde3309-9d4e-437e-92f0-0a8c721c225a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.152342 Jul 27 20:32:32.608562 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1138/2288] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:32 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:33.014528 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1a8e904a-2083-4b3b-9920-3bfb0da5663a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:33.015152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1a8e904a-2083-4b3b-9920-3bfb0da5663a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:33.021706 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1a8e904a-2083-4b3b-9920-3bfb0da5663a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:33.022161 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1a8e904a-2083-4b3b-9920-3bfb0da5663a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:33.022919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1a8e904a-2083-4b3b-9920-3bfb0da5663a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:33.023355 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1a8e904a-2083-4b3b-9920-3bfb0da5663a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:33.153317 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1a8e904a-2083-4b3b-9920-3bfb0da5663a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:33.161426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1a8e904a-2083-4b3b-9920-3bfb0da5663a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150875 Jul 27 20:32:33.161987 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1151/2289] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:33 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:33.629994 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-687801a2-2219-4d16-809f-e03c1bdbda0b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:33.630604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-687801a2-2219-4d16-809f-e03c1bdbda0b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:33.637096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-687801a2-2219-4d16-809f-e03c1bdbda0b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:33.637548 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-687801a2-2219-4d16-809f-e03c1bdbda0b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:33.638306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-687801a2-2219-4d16-809f-e03c1bdbda0b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:33.638742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-687801a2-2219-4d16-809f-e03c1bdbda0b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:33.771255 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-687801a2-2219-4d16-809f-e03c1bdbda0b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:33.779131 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-687801a2-2219-4d16-809f-e03c1bdbda0b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.153004 Jul 27 20:32:33.779691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1139/2290] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:33 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:34.182603 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9d5eda1b-d503-4ee5-9e8e-bc4416a365a2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:34.183212 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9d5eda1b-d503-4ee5-9e8e-bc4416a365a2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:34.189877 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d5eda1b-d503-4ee5-9e8e-bc4416a365a2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:34.190320 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d5eda1b-d503-4ee5-9e8e-bc4416a365a2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:34.191073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d5eda1b-d503-4ee5-9e8e-bc4416a365a2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:34.191513 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d5eda1b-d503-4ee5-9e8e-bc4416a365a2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:34.317431 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9d5eda1b-d503-4ee5-9e8e-bc4416a365a2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:34.325320 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9d5eda1b-d503-4ee5-9e8e-bc4416a365a2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.146573 Jul 27 20:32:34.325951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1152/2291] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:34 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:34.801522 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f85fde55-b6be-46a7-86ad-720d4373602c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:34.802127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f85fde55-b6be-46a7-86ad-720d4373602c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:34.808719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f85fde55-b6be-46a7-86ad-720d4373602c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:34.809192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f85fde55-b6be-46a7-86ad-720d4373602c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:34.809960 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f85fde55-b6be-46a7-86ad-720d4373602c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:34.810389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f85fde55-b6be-46a7-86ad-720d4373602c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:35.023510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f85fde55-b6be-46a7-86ad-720d4373602c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:35.033380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f85fde55-b6be-46a7-86ad-720d4373602c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.235421 Jul 27 20:32:35.034564 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1140/2292] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:34 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:35.346849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-69e62b30-42b0-4e15-9306-80f874be6ffd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:35.347385 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-69e62b30-42b0-4e15-9306-80f874be6ffd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:35.353842 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69e62b30-42b0-4e15-9306-80f874be6ffd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:35.354303 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69e62b30-42b0-4e15-9306-80f874be6ffd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:35.355075 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69e62b30-42b0-4e15-9306-80f874be6ffd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:35.355519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69e62b30-42b0-4e15-9306-80f874be6ffd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:35.491463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-69e62b30-42b0-4e15-9306-80f874be6ffd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:35.500058 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-69e62b30-42b0-4e15-9306-80f874be6ffd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.157362 Jul 27 20:32:35.500628 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1153/2293] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:35 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:36.057621 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-78c78616-4c24-42e4-a9e6-2bb3d5f3b05a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:36.058240 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-78c78616-4c24-42e4-a9e6-2bb3d5f3b05a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:36.065679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-78c78616-4c24-42e4-a9e6-2bb3d5f3b05a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:36.066134 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-78c78616-4c24-42e4-a9e6-2bb3d5f3b05a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:36.066905 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-78c78616-4c24-42e4-a9e6-2bb3d5f3b05a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:36.067344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-78c78616-4c24-42e4-a9e6-2bb3d5f3b05a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:36.197699 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-78c78616-4c24-42e4-a9e6-2bb3d5f3b05a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:36.206239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-78c78616-4c24-42e4-a9e6-2bb3d5f3b05a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.152522 Jul 27 20:32:36.206799 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1141/2294] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:36 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:36.520578 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d2dc7d57-a886-46d8-947c-ac6ee6b3e02c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:36.521218 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d2dc7d57-a886-46d8-947c-ac6ee6b3e02c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:36.527752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d2dc7d57-a886-46d8-947c-ac6ee6b3e02c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:36.528201 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d2dc7d57-a886-46d8-947c-ac6ee6b3e02c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:36.529010 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d2dc7d57-a886-46d8-947c-ac6ee6b3e02c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:36.529454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d2dc7d57-a886-46d8-947c-ac6ee6b3e02c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:36.657948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d2dc7d57-a886-46d8-947c-ac6ee6b3e02c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:36.665781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d2dc7d57-a886-46d8-947c-ac6ee6b3e02c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149036 Jul 27 20:32:36.666346 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1154/2295] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:36 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:32:37.227867 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6c11f09c-86a1-42e5-a120-d162791911a7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:37.228484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6c11f09c-86a1-42e5-a120-d162791911a7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:37.235059 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c11f09c-86a1-42e5-a120-d162791911a7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:37.235509 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c11f09c-86a1-42e5-a120-d162791911a7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:37.236270 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c11f09c-86a1-42e5-a120-d162791911a7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:37.236710 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c11f09c-86a1-42e5-a120-d162791911a7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:37.366651 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6c11f09c-86a1-42e5-a120-d162791911a7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:37.375130 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6c11f09c-86a1-42e5-a120-d162791911a7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.150564 Jul 27 20:32:37.375703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1142/2296] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:37 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:37.693059 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b976a5a8-13c7-4eea-b7df-5acd59e05bdb tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:37.693682 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b976a5a8-13c7-4eea-b7df-5acd59e05bdb tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:37.700256 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b976a5a8-13c7-4eea-b7df-5acd59e05bdb tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:37.700712 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b976a5a8-13c7-4eea-b7df-5acd59e05bdb tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:37.701505 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b976a5a8-13c7-4eea-b7df-5acd59e05bdb tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:37.701951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b976a5a8-13c7-4eea-b7df-5acd59e05bdb tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:37.833678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b976a5a8-13c7-4eea-b7df-5acd59e05bdb tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:37.841440 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b976a5a8-13c7-4eea-b7df-5acd59e05bdb tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152392 Jul 27 20:32:37.842007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1155/2297] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:37 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:38.397279 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-79d5b6a7-1dbb-489b-a9da-647914a8a771 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:38.397893 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-79d5b6a7-1dbb-489b-a9da-647914a8a771 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:38.404294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79d5b6a7-1dbb-489b-a9da-647914a8a771 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:38.404744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79d5b6a7-1dbb-489b-a9da-647914a8a771 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:38.405551 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79d5b6a7-1dbb-489b-a9da-647914a8a771 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:38.406659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79d5b6a7-1dbb-489b-a9da-647914a8a771 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:38.538250 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-79d5b6a7-1dbb-489b-a9da-647914a8a771 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:38.546608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-79d5b6a7-1dbb-489b-a9da-647914a8a771 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.153106 Jul 27 20:32:38.547306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1143/2298] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:38 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:38.863518 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a11560ad-a7ed-42de-bf6a-94558fa388b9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:38.864040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a11560ad-a7ed-42de-bf6a-94558fa388b9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:38.870571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a11560ad-a7ed-42de-bf6a-94558fa388b9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:38.871029 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a11560ad-a7ed-42de-bf6a-94558fa388b9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:38.871794 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a11560ad-a7ed-42de-bf6a-94558fa388b9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:38.872240 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a11560ad-a7ed-42de-bf6a-94558fa388b9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:38.999060 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a11560ad-a7ed-42de-bf6a-94558fa388b9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:39.008438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a11560ad-a7ed-42de-bf6a-94558fa388b9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149395 Jul 27 20:32:39.009045 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1156/2299] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:38 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:39.567844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5238a71b-4926-49b8-8c58-a2d98da44246 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:39.568493 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5238a71b-4926-49b8-8c58-a2d98da44246 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:39.575055 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5238a71b-4926-49b8-8c58-a2d98da44246 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:39.575508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5238a71b-4926-49b8-8c58-a2d98da44246 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:39.576269 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5238a71b-4926-49b8-8c58-a2d98da44246 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:39.576711 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5238a71b-4926-49b8-8c58-a2d98da44246 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:39.595512 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:32:39.708421 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5238a71b-4926-49b8-8c58-a2d98da44246 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:39.716395 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5238a71b-4926-49b8-8c58-a2d98da44246 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.152391 Jul 27 20:32:39.716986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1144/2300] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:39 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:40.030185 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9a67b65a-9902-4449-b44d-f5608f7326b6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:40.031336 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9a67b65a-9902-4449-b44d-f5608f7326b6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:40.037958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9a67b65a-9902-4449-b44d-f5608f7326b6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:40.038415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9a67b65a-9902-4449-b44d-f5608f7326b6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:40.039175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9a67b65a-9902-4449-b44d-f5608f7326b6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:40.039617 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9a67b65a-9902-4449-b44d-f5608f7326b6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:40.043555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:32:40.169705 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9a67b65a-9902-4449-b44d-f5608f7326b6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:40.178349 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9a67b65a-9902-4449-b44d-f5608f7326b6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152043 Jul 27 20:32:40.178913 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1157/2301] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:40 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:40.738313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e7db3401-c020-41b9-8df4-cfc937feeb89 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:40.738951 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e7db3401-c020-41b9-8df4-cfc937feeb89 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:40.745416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7db3401-c020-41b9-8df4-cfc937feeb89 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:40.745868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7db3401-c020-41b9-8df4-cfc937feeb89 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:40.746625 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7db3401-c020-41b9-8df4-cfc937feeb89 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:40.747070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7db3401-c020-41b9-8df4-cfc937feeb89 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:40.880547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e7db3401-c020-41b9-8df4-cfc937feeb89 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:40.888488 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e7db3401-c020-41b9-8df4-cfc937feeb89 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.154496 Jul 27 20:32:40.889064 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1145/2302] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:40 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:41.199247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b0171af4-981c-4577-99fd-e437578c17e4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:41.199872 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b0171af4-981c-4577-99fd-e437578c17e4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:41.207856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b0171af4-981c-4577-99fd-e437578c17e4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:41.208360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b0171af4-981c-4577-99fd-e437578c17e4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:41.209209 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b0171af4-981c-4577-99fd-e437578c17e4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:41.209734 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b0171af4-981c-4577-99fd-e437578c17e4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:41.343273 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b0171af4-981c-4577-99fd-e437578c17e4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:41.351657 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b0171af4-981c-4577-99fd-e437578c17e4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.156801 Jul 27 20:32:41.352283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1158/2303] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:41 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:41.909759 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-db650e43-9a61-4087-bdc8-63c51dd52b7e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:41.910370 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-db650e43-9a61-4087-bdc8-63c51dd52b7e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:41.917677 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db650e43-9a61-4087-bdc8-63c51dd52b7e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:41.918130 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db650e43-9a61-4087-bdc8-63c51dd52b7e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:41.918899 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db650e43-9a61-4087-bdc8-63c51dd52b7e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:41.919342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db650e43-9a61-4087-bdc8-63c51dd52b7e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:42.047122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-db650e43-9a61-4087-bdc8-63c51dd52b7e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:42.055232 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-db650e43-9a61-4087-bdc8-63c51dd52b7e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.149433 Jul 27 20:32:42.055905 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1146/2304] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:41 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:42.373782 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f9733a4f-1d1c-4699-9faa-4a9e661dae08 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:42.374402 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f9733a4f-1d1c-4699-9faa-4a9e661dae08 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:42.381495 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f9733a4f-1d1c-4699-9faa-4a9e661dae08 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:42.381947 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f9733a4f-1d1c-4699-9faa-4a9e661dae08 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:42.382709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f9733a4f-1d1c-4699-9faa-4a9e661dae08 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:42.383152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f9733a4f-1d1c-4699-9faa-4a9e661dae08 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:42.508555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f9733a4f-1d1c-4699-9faa-4a9e661dae08 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:42.517445 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f9733a4f-1d1c-4699-9faa-4a9e661dae08 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.147455 Jul 27 20:32:42.518016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1159/2305] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:42 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:43.077240 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4f555749-319e-43ee-afe5-04d052bda9a8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:43.078141 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4f555749-319e-43ee-afe5-04d052bda9a8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:43.084605 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4f555749-319e-43ee-afe5-04d052bda9a8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:43.085083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4f555749-319e-43ee-afe5-04d052bda9a8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:43.085873 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4f555749-319e-43ee-afe5-04d052bda9a8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:43.086310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4f555749-319e-43ee-afe5-04d052bda9a8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:43.219434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4f555749-319e-43ee-afe5-04d052bda9a8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:43.227343 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4f555749-319e-43ee-afe5-04d052bda9a8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.154252 Jul 27 20:32:43.227909 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1147/2306] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:43 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:43.538433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-42083308-dca5-4d39-bdf8-9a04546aecba tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:43.539054 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-42083308-dca5-4d39-bdf8-9a04546aecba tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:43.545531 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-42083308-dca5-4d39-bdf8-9a04546aecba tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:43.545986 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-42083308-dca5-4d39-bdf8-9a04546aecba tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:43.546794 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-42083308-dca5-4d39-bdf8-9a04546aecba tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:43.547397 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-42083308-dca5-4d39-bdf8-9a04546aecba tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:43.678265 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-42083308-dca5-4d39-bdf8-9a04546aecba tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:43.686122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-42083308-dca5-4d39-bdf8-9a04546aecba tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151594 Jul 27 20:32:43.686687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1160/2307] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:43 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:44.249358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c5ef288f-add0-4633-8292-e60081234b02 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:44.249978 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c5ef288f-add0-4633-8292-e60081234b02 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:44.257151 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5ef288f-add0-4633-8292-e60081234b02 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:44.257606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5ef288f-add0-4633-8292-e60081234b02 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:44.258370 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5ef288f-add0-4633-8292-e60081234b02 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:44.258812 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5ef288f-add0-4633-8292-e60081234b02 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:44.386469 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c5ef288f-add0-4633-8292-e60081234b02 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:44.394709 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c5ef288f-add0-4633-8292-e60081234b02 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.149203 Jul 27 20:32:44.395280 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1148/2308] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:44 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:44.707111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d2b6b55d-cbf0-4014-a97b-057fe71896a1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:44.707726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d2b6b55d-cbf0-4014-a97b-057fe71896a1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:44.714155 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d2b6b55d-cbf0-4014-a97b-057fe71896a1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:44.714602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d2b6b55d-cbf0-4014-a97b-057fe71896a1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:44.715353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d2b6b55d-cbf0-4014-a97b-057fe71896a1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:44.715820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d2b6b55d-cbf0-4014-a97b-057fe71896a1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:44.841547 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d2b6b55d-cbf0-4014-a97b-057fe71896a1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:44.849994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d2b6b55d-cbf0-4014-a97b-057fe71896a1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.147365 Jul 27 20:32:44.850596 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1161/2309] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:44 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:45.418300 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b27a83b4-175e-4bac-b6a2-63dc22cf430d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:45.418935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b27a83b4-175e-4bac-b6a2-63dc22cf430d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:45.425541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b27a83b4-175e-4bac-b6a2-63dc22cf430d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:45.426019 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b27a83b4-175e-4bac-b6a2-63dc22cf430d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:45.426778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b27a83b4-175e-4bac-b6a2-63dc22cf430d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:45.427221 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b27a83b4-175e-4bac-b6a2-63dc22cf430d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:45.557857 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b27a83b4-175e-4bac-b6a2-63dc22cf430d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:45.566456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b27a83b4-175e-4bac-b6a2-63dc22cf430d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.152115 Jul 27 20:32:45.567021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1149/2310] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:45 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:45.870987 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b9b2b7ca-176e-40f3-a8d8-d438d96ac789 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:45.871526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b9b2b7ca-176e-40f3-a8d8-d438d96ac789 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:45.878208 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b9b2b7ca-176e-40f3-a8d8-d438d96ac789 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:45.878665 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b9b2b7ca-176e-40f3-a8d8-d438d96ac789 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:45.879432 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b9b2b7ca-176e-40f3-a8d8-d438d96ac789 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:45.879904 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b9b2b7ca-176e-40f3-a8d8-d438d96ac789 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:46.006492 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b9b2b7ca-176e-40f3-a8d8-d438d96ac789 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:46.014351 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b9b2b7ca-176e-40f3-a8d8-d438d96ac789 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.147384 Jul 27 20:32:46.014908 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1162/2311] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:45 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:46.587642 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c157fcef-8261-4820-a56e-3578b3a589f0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:46.588249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c157fcef-8261-4820-a56e-3578b3a589f0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:46.594666 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c157fcef-8261-4820-a56e-3578b3a589f0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:46.595107 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c157fcef-8261-4820-a56e-3578b3a589f0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:46.595857 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c157fcef-8261-4820-a56e-3578b3a589f0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:46.596285 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c157fcef-8261-4820-a56e-3578b3a589f0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:46.724687 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c157fcef-8261-4820-a56e-3578b3a589f0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:46.732546 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c157fcef-8261-4820-a56e-3578b3a589f0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.148829 Jul 27 20:32:46.733139 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1150/2312] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:46 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:47.035749 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cf9f0383-6d81-4660-9c4b-0d7ee246128d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:47.036395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cf9f0383-6d81-4660-9c4b-0d7ee246128d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:47.042876 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf9f0383-6d81-4660-9c4b-0d7ee246128d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:47.043331 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf9f0383-6d81-4660-9c4b-0d7ee246128d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:47.044093 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf9f0383-6d81-4660-9c4b-0d7ee246128d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:47.044543 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf9f0383-6d81-4660-9c4b-0d7ee246128d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:47.182147 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cf9f0383-6d81-4660-9c4b-0d7ee246128d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:47.190206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cf9f0383-6d81-4660-9c4b-0d7ee246128d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.158844 Jul 27 20:32:47.190777 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1163/2313] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:47 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:47.755616 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-daca335b-0214-4fb8-98c1-abe90f98fbd7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:47.756239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-daca335b-0214-4fb8-98c1-abe90f98fbd7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:47.762643 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-daca335b-0214-4fb8-98c1-abe90f98fbd7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:47.763086 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-daca335b-0214-4fb8-98c1-abe90f98fbd7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:47.763886 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-daca335b-0214-4fb8-98c1-abe90f98fbd7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:47.764321 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-daca335b-0214-4fb8-98c1-abe90f98fbd7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:47.891951 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-daca335b-0214-4fb8-98c1-abe90f98fbd7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:47.900110 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-daca335b-0214-4fb8-98c1-abe90f98fbd7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.149270 Jul 27 20:32:47.900679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1151/2314] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:47 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:48.213530 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c42345d1-ff4f-4613-ae33-6dbe3de01cd1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:48.214199 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c42345d1-ff4f-4613-ae33-6dbe3de01cd1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:48.221573 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c42345d1-ff4f-4613-ae33-6dbe3de01cd1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:48.222056 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c42345d1-ff4f-4613-ae33-6dbe3de01cd1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:48.222838 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c42345d1-ff4f-4613-ae33-6dbe3de01cd1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:48.223284 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c42345d1-ff4f-4613-ae33-6dbe3de01cd1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:48.349485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c42345d1-ff4f-4613-ae33-6dbe3de01cd1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:48.357511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c42345d1-ff4f-4613-ae33-6dbe3de01cd1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.147864 Jul 27 20:32:48.358101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1164/2315] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:48 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:48.921444 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-864e167e-7a48-4949-a23c-5d984b797ec4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:48.922082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-864e167e-7a48-4949-a23c-5d984b797ec4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:48.929055 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-864e167e-7a48-4949-a23c-5d984b797ec4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:48.929499 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-864e167e-7a48-4949-a23c-5d984b797ec4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:48.930247 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-864e167e-7a48-4949-a23c-5d984b797ec4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:48.930677 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-864e167e-7a48-4949-a23c-5d984b797ec4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:49.067329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-864e167e-7a48-4949-a23c-5d984b797ec4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:49.075373 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-864e167e-7a48-4949-a23c-5d984b797ec4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.157775 Jul 27 20:32:49.076080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1152/2316] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:48 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:49.379887 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4bc6fbce-a4e7-416d-b064-d74972616ef0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:49.380432 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4bc6fbce-a4e7-416d-b064-d74972616ef0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:49.386867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4bc6fbce-a4e7-416d-b064-d74972616ef0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:49.387313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4bc6fbce-a4e7-416d-b064-d74972616ef0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:49.388065 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4bc6fbce-a4e7-416d-b064-d74972616ef0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:49.388499 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4bc6fbce-a4e7-416d-b064-d74972616ef0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:49.771570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4bc6fbce-a4e7-416d-b064-d74972616ef0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:49.779613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4bc6fbce-a4e7-416d-b064-d74972616ef0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.404287 Jul 27 20:32:49.780181 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1165/2317] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:49 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:50.098554 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f137336d-04db-4c01-8512-dabe9a9ac56f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:50.099166 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f137336d-04db-4c01-8512-dabe9a9ac56f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:50.105798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f137336d-04db-4c01-8512-dabe9a9ac56f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:50.106252 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f137336d-04db-4c01-8512-dabe9a9ac56f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:50.107006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f137336d-04db-4c01-8512-dabe9a9ac56f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:50.107442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f137336d-04db-4c01-8512-dabe9a9ac56f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:50.239068 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f137336d-04db-4c01-8512-dabe9a9ac56f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:50.246970 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f137336d-04db-4c01-8512-dabe9a9ac56f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.153018 Jul 27 20:32:50.247535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1153/2318] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:50 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:50.802497 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-24b2e6b8-0dd7-41d1-bf00-1ab97e6b0f6c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:50.803117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-24b2e6b8-0dd7-41d1-bf00-1ab97e6b0f6c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:50.809629 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-24b2e6b8-0dd7-41d1-bf00-1ab97e6b0f6c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:50.810083 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-24b2e6b8-0dd7-41d1-bf00-1ab97e6b0f6c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:50.810848 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-24b2e6b8-0dd7-41d1-bf00-1ab97e6b0f6c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:50.811290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-24b2e6b8-0dd7-41d1-bf00-1ab97e6b0f6c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:50.938466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-24b2e6b8-0dd7-41d1-bf00-1ab97e6b0f6c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:50.947141 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-24b2e6b8-0dd7-41d1-bf00-1ab97e6b0f6c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149390 Jul 27 20:32:50.947714 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1166/2319] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:50 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:51.269297 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c2f01f4e-8142-4a73-8a4c-2db96e14b645 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:51.269907 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c2f01f4e-8142-4a73-8a4c-2db96e14b645 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:51.276380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2f01f4e-8142-4a73-8a4c-2db96e14b645 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:51.276892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2f01f4e-8142-4a73-8a4c-2db96e14b645 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:51.277694 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2f01f4e-8142-4a73-8a4c-2db96e14b645 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:51.278124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2f01f4e-8142-4a73-8a4c-2db96e14b645 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:51.414249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c2f01f4e-8142-4a73-8a4c-2db96e14b645 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:51.422203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c2f01f4e-8142-4a73-8a4c-2db96e14b645 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.156960 Jul 27 20:32:51.422772 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1154/2320] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:51 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:51.967720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6edd0784-46cd-4881-8613-9f080a2f4bca tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:51.968271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6edd0784-46cd-4881-8613-9f080a2f4bca tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:51.975684 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6edd0784-46cd-4881-8613-9f080a2f4bca tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:51.976139 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6edd0784-46cd-4881-8613-9f080a2f4bca tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:51.976906 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6edd0784-46cd-4881-8613-9f080a2f4bca tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:51.977412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6edd0784-46cd-4881-8613-9f080a2f4bca tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:52.109458 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6edd0784-46cd-4881-8613-9f080a2f4bca tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:52.118196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6edd0784-46cd-4881-8613-9f080a2f4bca tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.154346 Jul 27 20:32:52.118811 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1167/2321] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:51 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:52.444411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0d9f0b23-e9f8-4861-aed0-cd9a530cedbd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:52.445083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0d9f0b23-e9f8-4861-aed0-cd9a530cedbd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:52.451679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d9f0b23-e9f8-4861-aed0-cd9a530cedbd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:52.452131 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d9f0b23-e9f8-4861-aed0-cd9a530cedbd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:52.453183 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d9f0b23-e9f8-4861-aed0-cd9a530cedbd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:52.453622 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d9f0b23-e9f8-4861-aed0-cd9a530cedbd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:52.583109 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0d9f0b23-e9f8-4861-aed0-cd9a530cedbd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:52.591121 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0d9f0b23-e9f8-4861-aed0-cd9a530cedbd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.150567 Jul 27 20:32:52.591682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1155/2322] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:52 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:53.139439 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-421c3b5f-afb5-42a1-9a9d-61c0fcf787ab tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:53.140061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-421c3b5f-afb5-42a1-9a9d-61c0fcf787ab tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:53.146674 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-421c3b5f-afb5-42a1-9a9d-61c0fcf787ab tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:53.147130 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-421c3b5f-afb5-42a1-9a9d-61c0fcf787ab tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:53.147898 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-421c3b5f-afb5-42a1-9a9d-61c0fcf787ab tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:53.148340 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-421c3b5f-afb5-42a1-9a9d-61c0fcf787ab tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:53.277293 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-421c3b5f-afb5-42a1-9a9d-61c0fcf787ab tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:53.286479 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-421c3b5f-afb5-42a1-9a9d-61c0fcf787ab tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151030 Jul 27 20:32:53.287048 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1168/2323] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:53 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:53.613660 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-10437d5b-c757-4b8c-82dc-2807575234f9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:53.614274 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-10437d5b-c757-4b8c-82dc-2807575234f9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:53.620888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10437d5b-c757-4b8c-82dc-2807575234f9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:53.621372 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10437d5b-c757-4b8c-82dc-2807575234f9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:53.622129 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10437d5b-c757-4b8c-82dc-2807575234f9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:53.622568 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10437d5b-c757-4b8c-82dc-2807575234f9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:53.750392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-10437d5b-c757-4b8c-82dc-2807575234f9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:53.758335 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-10437d5b-c757-4b8c-82dc-2807575234f9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.149297 Jul 27 20:32:53.758903 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1156/2324] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:53 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:54.310294 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2ca47637-50dc-4700-a8d3-87b5c37834ed tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:54.310906 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2ca47637-50dc-4700-a8d3-87b5c37834ed tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:54.318057 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ca47637-50dc-4700-a8d3-87b5c37834ed tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:54.318503 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ca47637-50dc-4700-a8d3-87b5c37834ed tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:54.319257 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ca47637-50dc-4700-a8d3-87b5c37834ed tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:54.319693 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ca47637-50dc-4700-a8d3-87b5c37834ed tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:54.453931 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2ca47637-50dc-4700-a8d3-87b5c37834ed tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:54.461958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2ca47637-50dc-4700-a8d3-87b5c37834ed tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.155559 Jul 27 20:32:54.462526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1169/2325] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:54 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:54.781821 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-71800e43-1e6a-4028-8315-3d4334e3786a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:54.782389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-71800e43-1e6a-4028-8315-3d4334e3786a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:54.789810 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71800e43-1e6a-4028-8315-3d4334e3786a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:54.790252 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71800e43-1e6a-4028-8315-3d4334e3786a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:54.791217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71800e43-1e6a-4028-8315-3d4334e3786a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:54.791651 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71800e43-1e6a-4028-8315-3d4334e3786a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:54.925613 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-71800e43-1e6a-4028-8315-3d4334e3786a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:54.933515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-71800e43-1e6a-4028-8315-3d4334e3786a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.157048 Jul 27 20:32:54.934097 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1157/2326] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:54 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:55.483321 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ee45d131-6a58-47c5-af43-4086565a8b52 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:55.483945 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ee45d131-6a58-47c5-af43-4086565a8b52 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:55.491032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ee45d131-6a58-47c5-af43-4086565a8b52 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:55.491607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ee45d131-6a58-47c5-af43-4086565a8b52 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:55.492582 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ee45d131-6a58-47c5-af43-4086565a8b52 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:55.493218 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ee45d131-6a58-47c5-af43-4086565a8b52 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:55.619764 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ee45d131-6a58-47c5-af43-4086565a8b52 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:55.627986 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ee45d131-6a58-47c5-af43-4086565a8b52 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148520 Jul 27 20:32:55.628573 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1170/2327] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:55 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:55.957247 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0c061132-959f-45be-b57c-93a452665338 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:55.958008 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0c061132-959f-45be-b57c-93a452665338 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:55.964094 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c061132-959f-45be-b57c-93a452665338 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:55.964635 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c061132-959f-45be-b57c-93a452665338 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:55.965511 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c061132-959f-45be-b57c-93a452665338 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:55.966435 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c061132-959f-45be-b57c-93a452665338 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:56.120055 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0c061132-959f-45be-b57c-93a452665338 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:56.131363 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0c061132-959f-45be-b57c-93a452665338 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.179387 Jul 27 20:32:56.131945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1158/2328] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:55 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:56.649338 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-58144ae7-2942-48b2-972a-1f91b82d3540 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:56.649960 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-58144ae7-2942-48b2-972a-1f91b82d3540 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:56.656539 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-58144ae7-2942-48b2-972a-1f91b82d3540 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:56.657023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-58144ae7-2942-48b2-972a-1f91b82d3540 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:56.657796 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-58144ae7-2942-48b2-972a-1f91b82d3540 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:56.658798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-58144ae7-2942-48b2-972a-1f91b82d3540 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:56.790936 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-58144ae7-2942-48b2-972a-1f91b82d3540 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:56.799547 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-58144ae7-2942-48b2-972a-1f91b82d3540 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153445 Jul 27 20:32:56.800091 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1171/2329] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:56 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:57.159752 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-53108974-5725-4d4f-8448-cb73edf659a7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:57.160365 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-53108974-5725-4d4f-8448-cb73edf659a7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:57.166963 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-53108974-5725-4d4f-8448-cb73edf659a7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:57.167413 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-53108974-5725-4d4f-8448-cb73edf659a7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:57.168171 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-53108974-5725-4d4f-8448-cb73edf659a7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:57.168607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-53108974-5725-4d4f-8448-cb73edf659a7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:57.298230 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-53108974-5725-4d4f-8448-cb73edf659a7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:57.306116 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-53108974-5725-4d4f-8448-cb73edf659a7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.150936 Jul 27 20:32:57.306703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1159/2330] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:57 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:57.821215 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ca1d5ed3-13f7-4cdf-8fcc-64e4a91c3435 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:57.821780 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ca1d5ed3-13f7-4cdf-8fcc-64e4a91c3435 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:57.824038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=52 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:32:57.830307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ca1d5ed3-13f7-4cdf-8fcc-64e4a91c3435 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:57.830996 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ca1d5ed3-13f7-4cdf-8fcc-64e4a91c3435 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:57.831774 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ca1d5ed3-13f7-4cdf-8fcc-64e4a91c3435 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:57.832240 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ca1d5ed3-13f7-4cdf-8fcc-64e4a91c3435 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:57.961939 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ca1d5ed3-13f7-4cdf-8fcc-64e4a91c3435 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:57.969815 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ca1d5ed3-13f7-4cdf-8fcc-64e4a91c3435 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152566 Jul 27 20:32:57.970380 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1172/2331] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:57 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:58.328143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bbc66b62-f6d4-40ec-8c32-0904a720ef6d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:58.328682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bbc66b62-f6d4-40ec-8c32-0904a720ef6d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:58.335385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bbc66b62-f6d4-40ec-8c32-0904a720ef6d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:58.335835 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bbc66b62-f6d4-40ec-8c32-0904a720ef6d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:58.336586 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bbc66b62-f6d4-40ec-8c32-0904a720ef6d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:58.337046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bbc66b62-f6d4-40ec-8c32-0904a720ef6d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:58.465115 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bbc66b62-f6d4-40ec-8c32-0904a720ef6d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:58.473235 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bbc66b62-f6d4-40ec-8c32-0904a720ef6d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.149225 Jul 27 20:32:58.473797 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1160/2332] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:58 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:58.991225 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7d8a74a1-5405-41d0-bc0b-51da25423940 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:58.991850 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7d8a74a1-5405-41d0-bc0b-51da25423940 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:58.998360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d8a74a1-5405-41d0-bc0b-51da25423940 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:58.998817 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d8a74a1-5405-41d0-bc0b-51da25423940 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:58.999584 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d8a74a1-5405-41d0-bc0b-51da25423940 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:59.000028 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d8a74a1-5405-41d0-bc0b-51da25423940 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:59.135086 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7d8a74a1-5405-41d0-bc0b-51da25423940 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:59.138520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:32:59.144398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7d8a74a1-5405-41d0-bc0b-51da25423940 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.157030 Jul 27 20:32:59.145018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1173/2333] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:58 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:32:59.495825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7bf772a1-ee4d-43df-92a6-2547ebbe797e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:32:59.496442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7bf772a1-ee4d-43df-92a6-2547ebbe797e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:32:59.498759 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=52 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:32:59.504103 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7bf772a1-ee4d-43df-92a6-2547ebbe797e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:59.504585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7bf772a1-ee4d-43df-92a6-2547ebbe797e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:59.505516 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7bf772a1-ee4d-43df-92a6-2547ebbe797e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:32:59.505881 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7bf772a1-ee4d-43df-92a6-2547ebbe797e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:32:59.510009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:32:59.636578 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7bf772a1-ee4d-43df-92a6-2547ebbe797e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:32:59.644496 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7bf772a1-ee4d-43df-92a6-2547ebbe797e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.152655 Jul 27 20:32:59.645086 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1161/2334] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:32:59 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:00.165576 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3d6d8386-a608-48af-ace6-e632e82db43b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:00.166193 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3d6d8386-a608-48af-ace6-e632e82db43b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:00.172658 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3d6d8386-a608-48af-ace6-e632e82db43b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:00.173152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3d6d8386-a608-48af-ace6-e632e82db43b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:00.173916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3d6d8386-a608-48af-ace6-e632e82db43b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:00.174358 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3d6d8386-a608-48af-ace6-e632e82db43b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:00.304446 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3d6d8386-a608-48af-ace6-e632e82db43b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:00.312344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3d6d8386-a608-48af-ace6-e632e82db43b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150613 Jul 27 20:33:00.312899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1174/2335] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:00 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:00.666127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-362b4d54-1b2b-4ed3-9443-b20f11ecc933 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:00.666716 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-362b4d54-1b2b-4ed3-9443-b20f11ecc933 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:00.673367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-362b4d54-1b2b-4ed3-9443-b20f11ecc933 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:00.673812 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-362b4d54-1b2b-4ed3-9443-b20f11ecc933 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:00.674559 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-362b4d54-1b2b-4ed3-9443-b20f11ecc933 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:00.674987 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-362b4d54-1b2b-4ed3-9443-b20f11ecc933 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:00.804023 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-362b4d54-1b2b-4ed3-9443-b20f11ecc933 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:00.811881 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-362b4d54-1b2b-4ed3-9443-b20f11ecc933 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.149915 Jul 27 20:33:00.812442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1162/2336] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:00 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:01.334954 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-30ce5e08-7942-4d8b-8a4e-559e58e775f9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:01.335499 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-30ce5e08-7942-4d8b-8a4e-559e58e775f9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:01.341974 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-30ce5e08-7942-4d8b-8a4e-559e58e775f9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:01.342424 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-30ce5e08-7942-4d8b-8a4e-559e58e775f9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:01.343186 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-30ce5e08-7942-4d8b-8a4e-559e58e775f9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:01.343631 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-30ce5e08-7942-4d8b-8a4e-559e58e775f9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:01.470292 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-30ce5e08-7942-4d8b-8a4e-559e58e775f9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:01.479027 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-30ce5e08-7942-4d8b-8a4e-559e58e775f9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148610 Jul 27 20:33:01.479587 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1175/2337] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:01 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:01.835084 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-716cdb79-0c7c-4045-889e-d8a769e74aa6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:01.835694 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-716cdb79-0c7c-4045-889e-d8a769e74aa6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:01.844031 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-716cdb79-0c7c-4045-889e-d8a769e74aa6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:01.846071 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-716cdb79-0c7c-4045-889e-d8a769e74aa6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:01.846071 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-716cdb79-0c7c-4045-889e-d8a769e74aa6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:01.846071 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-716cdb79-0c7c-4045-889e-d8a769e74aa6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:01.978167 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-716cdb79-0c7c-4045-889e-d8a769e74aa6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:01.986078 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-716cdb79-0c7c-4045-889e-d8a769e74aa6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.155804 Jul 27 20:33:01.986645 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1163/2338] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:01 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:02.499688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ec9df17f-c6a6-43e4-a455-c3fdc81eb22c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:02.500305 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ec9df17f-c6a6-43e4-a455-c3fdc81eb22c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:02.506862 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec9df17f-c6a6-43e4-a455-c3fdc81eb22c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:02.507309 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec9df17f-c6a6-43e4-a455-c3fdc81eb22c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:02.508071 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec9df17f-c6a6-43e4-a455-c3fdc81eb22c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:02.508508 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec9df17f-c6a6-43e4-a455-c3fdc81eb22c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:02.635015 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ec9df17f-c6a6-43e4-a455-c3fdc81eb22c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:02.642811 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ec9df17f-c6a6-43e4-a455-c3fdc81eb22c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.147022 Jul 27 20:33:02.643368 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1176/2339] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:02 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:03.007610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3eb43a76-6997-46b6-92b1-b129f55e8cf0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:03.008220 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3eb43a76-6997-46b6-92b1-b129f55e8cf0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:03.014720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3eb43a76-6997-46b6-92b1-b129f55e8cf0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:03.015170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3eb43a76-6997-46b6-92b1-b129f55e8cf0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:03.015925 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3eb43a76-6997-46b6-92b1-b129f55e8cf0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:03.016357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3eb43a76-6997-46b6-92b1-b129f55e8cf0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:03.150777 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3eb43a76-6997-46b6-92b1-b129f55e8cf0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:03.158728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3eb43a76-6997-46b6-92b1-b129f55e8cf0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.155038 Jul 27 20:33:03.159296 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1164/2340] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:03 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:03.664372 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-16e3cdcc-650c-428d-9260-d6492c81f903 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:03.665018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-16e3cdcc-650c-428d-9260-d6492c81f903 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:03.671497 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-16e3cdcc-650c-428d-9260-d6492c81f903 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:03.671955 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-16e3cdcc-650c-428d-9260-d6492c81f903 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:03.672719 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-16e3cdcc-650c-428d-9260-d6492c81f903 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:03.673192 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-16e3cdcc-650c-428d-9260-d6492c81f903 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:03.804351 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-16e3cdcc-650c-428d-9260-d6492c81f903 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:03.812229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-16e3cdcc-650c-428d-9260-d6492c81f903 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152465 Jul 27 20:33:03.812789 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1177/2341] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:03 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:04.180128 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-98bd9036-855f-4345-84f8-ed79051fc338 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:04.180754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-98bd9036-855f-4345-84f8-ed79051fc338 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:04.187273 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-98bd9036-855f-4345-84f8-ed79051fc338 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:04.187721 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-98bd9036-855f-4345-84f8-ed79051fc338 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:04.188488 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-98bd9036-855f-4345-84f8-ed79051fc338 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:04.188947 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-98bd9036-855f-4345-84f8-ed79051fc338 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:04.315271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-98bd9036-855f-4345-84f8-ed79051fc338 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:04.323142 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-98bd9036-855f-4345-84f8-ed79051fc338 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.147672 Jul 27 20:33:04.323714 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1165/2342] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:04 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:04.836536 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2ca47b7f-e949-4096-9799-b4dcf739b1a2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:04.837463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2ca47b7f-e949-4096-9799-b4dcf739b1a2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:04.846318 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ca47b7f-e949-4096-9799-b4dcf739b1a2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:04.846773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ca47b7f-e949-4096-9799-b4dcf739b1a2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:04.847569 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ca47b7f-e949-4096-9799-b4dcf739b1a2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:04.847989 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2ca47b7f-e949-4096-9799-b4dcf739b1a2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:04.974818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2ca47b7f-e949-4096-9799-b4dcf739b1a2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:04.982786 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2ca47b7f-e949-4096-9799-b4dcf739b1a2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152620 Jul 27 20:33:04.983355 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1178/2343] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:04 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:05.345267 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-72016e33-ed5b-4e65-9fe8-9a78eb506336 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:05.345873 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-72016e33-ed5b-4e65-9fe8-9a78eb506336 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:05.352867 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-72016e33-ed5b-4e65-9fe8-9a78eb506336 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:05.353337 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-72016e33-ed5b-4e65-9fe8-9a78eb506336 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:05.354089 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-72016e33-ed5b-4e65-9fe8-9a78eb506336 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:05.354517 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-72016e33-ed5b-4e65-9fe8-9a78eb506336 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:05.490213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-72016e33-ed5b-4e65-9fe8-9a78eb506336 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:05.498041 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-72016e33-ed5b-4e65-9fe8-9a78eb506336 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.156666 Jul 27 20:33:05.498613 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1166/2344] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:05 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:06.004288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2c083759-a084-48ae-8e7d-c1b5122c4e3a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:06.005085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2c083759-a084-48ae-8e7d-c1b5122c4e3a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:06.011645 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2c083759-a084-48ae-8e7d-c1b5122c4e3a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:06.012100 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2c083759-a084-48ae-8e7d-c1b5122c4e3a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:06.012865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2c083759-a084-48ae-8e7d-c1b5122c4e3a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:06.013339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2c083759-a084-48ae-8e7d-c1b5122c4e3a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:06.146311 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2c083759-a084-48ae-8e7d-c1b5122c4e3a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:06.154378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2c083759-a084-48ae-8e7d-c1b5122c4e3a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153929 Jul 27 20:33:06.154942 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1179/2345] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:05 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:06.520604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ec91bbdd-9fd1-4375-88e0-9dada8d8409b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:06.521239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ec91bbdd-9fd1-4375-88e0-9dada8d8409b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:06.527655 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec91bbdd-9fd1-4375-88e0-9dada8d8409b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:06.528110 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec91bbdd-9fd1-4375-88e0-9dada8d8409b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:06.528861 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec91bbdd-9fd1-4375-88e0-9dada8d8409b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:06.529319 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec91bbdd-9fd1-4375-88e0-9dada8d8409b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:06.656549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ec91bbdd-9fd1-4375-88e0-9dada8d8409b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:06.664477 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ec91bbdd-9fd1-4375-88e0-9dada8d8409b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.147791 Jul 27 20:33:06.665055 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1167/2346] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:06 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:07.175441 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-abc86f8c-56cc-4363-8faa-f837b600cee0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:07.176061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-abc86f8c-56cc-4363-8faa-f837b600cee0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:07.183305 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-abc86f8c-56cc-4363-8faa-f837b600cee0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:07.183763 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-abc86f8c-56cc-4363-8faa-f837b600cee0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:07.184527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-abc86f8c-56cc-4363-8faa-f837b600cee0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:07.185001 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-abc86f8c-56cc-4363-8faa-f837b600cee0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:07.311894 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-abc86f8c-56cc-4363-8faa-f837b600cee0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:07.319816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-abc86f8c-56cc-4363-8faa-f837b600cee0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148235 Jul 27 20:33:07.320391 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1180/2347] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:07 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:07.686040 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f0b0e073-9011-4c87-8c6f-4d5d60d6a388 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:07.686657 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f0b0e073-9011-4c87-8c6f-4d5d60d6a388 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:07.693859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f0b0e073-9011-4c87-8c6f-4d5d60d6a388 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:07.694310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f0b0e073-9011-4c87-8c6f-4d5d60d6a388 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:07.695072 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f0b0e073-9011-4c87-8c6f-4d5d60d6a388 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:07.695513 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f0b0e073-9011-4c87-8c6f-4d5d60d6a388 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:07.822588 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f0b0e073-9011-4c87-8c6f-4d5d60d6a388 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:07.830716 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f0b0e073-9011-4c87-8c6f-4d5d60d6a388 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.148597 Jul 27 20:33:07.831280 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1168/2348] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:07 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:08.341468 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1157b39e-a870-4b8e-ac96-0b5475004d58 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:08.342010 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1157b39e-a870-4b8e-ac96-0b5475004d58 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:08.349261 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1157b39e-a870-4b8e-ac96-0b5475004d58 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:08.349828 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1157b39e-a870-4b8e-ac96-0b5475004d58 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:08.350584 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1157b39e-a870-4b8e-ac96-0b5475004d58 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:08.351022 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1157b39e-a870-4b8e-ac96-0b5475004d58 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:08.479854 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1157b39e-a870-4b8e-ac96-0b5475004d58 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:08.487895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1157b39e-a870-4b8e-ac96-0b5475004d58 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150305 Jul 27 20:33:08.488464 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1181/2349] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:08 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:08.853132 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5dd550a2-7008-46ed-9b33-8f335dcce96c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:08.853744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5dd550a2-7008-46ed-9b33-8f335dcce96c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:08.860391 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5dd550a2-7008-46ed-9b33-8f335dcce96c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:08.860840 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5dd550a2-7008-46ed-9b33-8f335dcce96c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:08.861632 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5dd550a2-7008-46ed-9b33-8f335dcce96c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:08.862066 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5dd550a2-7008-46ed-9b33-8f335dcce96c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:08.991128 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5dd550a2-7008-46ed-9b33-8f335dcce96c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:08.998942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5dd550a2-7008-46ed-9b33-8f335dcce96c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.149700 Jul 27 20:33:08.999506 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1169/2350] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:08 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:09.510271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a4258768-87ec-4812-950e-bed3efddef7f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:09.510895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a4258768-87ec-4812-950e-bed3efddef7f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:09.517436 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a4258768-87ec-4812-950e-bed3efddef7f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:09.517899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a4258768-87ec-4812-950e-bed3efddef7f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:09.518665 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a4258768-87ec-4812-950e-bed3efddef7f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:09.519110 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a4258768-87ec-4812-950e-bed3efddef7f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:09.647563 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a4258768-87ec-4812-950e-bed3efddef7f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:09.655462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a4258768-87ec-4812-950e-bed3efddef7f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149062 Jul 27 20:33:09.656033 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1182/2351] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:09 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:33:10.020204 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5e0e6d46-b7e2-4612-9284-982a85bbb0d3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:10.020866 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5e0e6d46-b7e2-4612-9284-982a85bbb0d3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:10.027339 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e0e6d46-b7e2-4612-9284-982a85bbb0d3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:10.027785 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e0e6d46-b7e2-4612-9284-982a85bbb0d3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:10.028535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e0e6d46-b7e2-4612-9284-982a85bbb0d3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:10.028980 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e0e6d46-b7e2-4612-9284-982a85bbb0d3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:10.157840 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5e0e6d46-b7e2-4612-9284-982a85bbb0d3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:10.166452 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5e0e6d46-b7e2-4612-9284-982a85bbb0d3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.150212 Jul 27 20:33:10.167013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1170/2352] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:10 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:10.676227 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1dd2b815-0aa2-4eeb-bf84-cf52bf9db723 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:10.676975 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1dd2b815-0aa2-4eeb-bf84-cf52bf9db723 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:10.683297 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1dd2b815-0aa2-4eeb-bf84-cf52bf9db723 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:10.683743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1dd2b815-0aa2-4eeb-bf84-cf52bf9db723 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:10.684497 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1dd2b815-0aa2-4eeb-bf84-cf52bf9db723 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:10.684934 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1dd2b815-0aa2-4eeb-bf84-cf52bf9db723 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:10.810643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1dd2b815-0aa2-4eeb-bf84-cf52bf9db723 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:10.819079 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1dd2b815-0aa2-4eeb-bf84-cf52bf9db723 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.146680 Jul 27 20:33:10.819719 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1183/2353] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:10 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:11.187758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f738ec52-53d7-4230-990e-3bee0d81ac7b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:11.188367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f738ec52-53d7-4230-990e-3bee0d81ac7b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:11.194840 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f738ec52-53d7-4230-990e-3bee0d81ac7b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:11.195284 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f738ec52-53d7-4230-990e-3bee0d81ac7b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:11.196029 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f738ec52-53d7-4230-990e-3bee0d81ac7b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:11.196457 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f738ec52-53d7-4230-990e-3bee0d81ac7b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:11.330553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f738ec52-53d7-4230-990e-3bee0d81ac7b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:11.338691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f738ec52-53d7-4230-990e-3bee0d81ac7b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.154823 Jul 27 20:33:11.339251 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1171/2354] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:11 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:11.840048 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4c99f408-6821-411f-9c67-b70f5623cd9c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:11.840669 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4c99f408-6821-411f-9c67-b70f5623cd9c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:11.847175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4c99f408-6821-411f-9c67-b70f5623cd9c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:11.847626 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4c99f408-6821-411f-9c67-b70f5623cd9c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:11.849270 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4c99f408-6821-411f-9c67-b70f5623cd9c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:11.849821 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4c99f408-6821-411f-9c67-b70f5623cd9c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:11.978983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4c99f408-6821-411f-9c67-b70f5623cd9c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:11.986866 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4c99f408-6821-411f-9c67-b70f5623cd9c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150650 Jul 27 20:33:11.987432 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1184/2355] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:11 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:12.360031 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d841d95f-eb5b-472e-860e-08db86ec33c2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:12.360646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d841d95f-eb5b-472e-860e-08db86ec33c2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:12.367340 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d841d95f-eb5b-472e-860e-08db86ec33c2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:12.367793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d841d95f-eb5b-472e-860e-08db86ec33c2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:12.368553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d841d95f-eb5b-472e-860e-08db86ec33c2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:12.369015 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d841d95f-eb5b-472e-860e-08db86ec33c2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:12.496863 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d841d95f-eb5b-472e-860e-08db86ec33c2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:12.505355 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d841d95f-eb5b-472e-860e-08db86ec33c2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.148557 Jul 27 20:33:12.505920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1172/2356] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:12 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:13.008266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7857de7b-1d00-4a05-b003-193db1e80159 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:13.008873 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7857de7b-1d00-4a05-b003-193db1e80159 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:13.015422 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7857de7b-1d00-4a05-b003-193db1e80159 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:13.015868 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7857de7b-1d00-4a05-b003-193db1e80159 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:13.016619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7857de7b-1d00-4a05-b003-193db1e80159 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:13.017081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7857de7b-1d00-4a05-b003-193db1e80159 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:13.146079 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7857de7b-1d00-4a05-b003-193db1e80159 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:13.155680 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7857de7b-1d00-4a05-b003-193db1e80159 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151890 Jul 27 20:33:13.156244 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1185/2357] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:13 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:13.526466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-74b5f85d-6b14-4747-98f4-dc6be762904b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:13.527084 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-74b5f85d-6b14-4747-98f4-dc6be762904b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:13.533843 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74b5f85d-6b14-4747-98f4-dc6be762904b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:13.534298 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74b5f85d-6b14-4747-98f4-dc6be762904b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:13.535064 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74b5f85d-6b14-4747-98f4-dc6be762904b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:13.535504 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74b5f85d-6b14-4747-98f4-dc6be762904b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:13.672336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-74b5f85d-6b14-4747-98f4-dc6be762904b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:13.680828 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-74b5f85d-6b14-4747-98f4-dc6be762904b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.158195 Jul 27 20:33:13.681424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1173/2358] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:13 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:14.176174 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1cb16414-f55a-465a-b2f5-0e9c9683aa71 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:14.176798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1cb16414-f55a-465a-b2f5-0e9c9683aa71 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:14.183278 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1cb16414-f55a-465a-b2f5-0e9c9683aa71 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:14.183738 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1cb16414-f55a-465a-b2f5-0e9c9683aa71 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:14.184514 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1cb16414-f55a-465a-b2f5-0e9c9683aa71 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:14.184957 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1cb16414-f55a-465a-b2f5-0e9c9683aa71 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:14.316095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1cb16414-f55a-465a-b2f5-0e9c9683aa71 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:14.324029 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1cb16414-f55a-465a-b2f5-0e9c9683aa71 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151807 Jul 27 20:33:14.324588 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1186/2359] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:14 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:14.701937 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-aa006481-088b-4799-9d8a-254c448d40dc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:14.702811 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-aa006481-088b-4799-9d8a-254c448d40dc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:14.710017 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa006481-088b-4799-9d8a-254c448d40dc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:14.710480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa006481-088b-4799-9d8a-254c448d40dc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:14.711230 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa006481-088b-4799-9d8a-254c448d40dc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:14.711657 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa006481-088b-4799-9d8a-254c448d40dc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:14.839411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aa006481-088b-4799-9d8a-254c448d40dc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:14.847336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-aa006481-088b-4799-9d8a-254c448d40dc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.149369 Jul 27 20:33:14.847902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1174/2360] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:14 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:15.345889 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f8522f33-1acf-4460-a49d-98c615f40471 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:15.346633 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f8522f33-1acf-4460-a49d-98c615f40471 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:15.354154 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f8522f33-1acf-4460-a49d-98c615f40471 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:15.354607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f8522f33-1acf-4460-a49d-98c615f40471 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:15.355380 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f8522f33-1acf-4460-a49d-98c615f40471 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:15.355822 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f8522f33-1acf-4460-a49d-98c615f40471 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:15.486483 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f8522f33-1acf-4460-a49d-98c615f40471 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:15.494436 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f8522f33-1acf-4460-a49d-98c615f40471 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152530 Jul 27 20:33:15.494999 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1187/2361] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:15 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:15.868679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7d2d365b-9695-4e06-880f-66d461818534 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:15.869329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7d2d365b-9695-4e06-880f-66d461818534 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:15.875804 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d2d365b-9695-4e06-880f-66d461818534 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:15.876253 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d2d365b-9695-4e06-880f-66d461818534 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:15.877051 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d2d365b-9695-4e06-880f-66d461818534 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:15.877492 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d2d365b-9695-4e06-880f-66d461818534 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:16.003755 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7d2d365b-9695-4e06-880f-66d461818534 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:16.012160 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7d2d365b-9695-4e06-880f-66d461818534 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.147410 Jul 27 20:33:16.012719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1175/2362] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:15 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:33:16.515208 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2c2950b6-2371-4550-bfed-c342754df194 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:16.515821 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2c2950b6-2371-4550-bfed-c342754df194 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:16.522831 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2c2950b6-2371-4550-bfed-c342754df194 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:16.523277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2c2950b6-2371-4550-bfed-c342754df194 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:16.524028 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2c2950b6-2371-4550-bfed-c342754df194 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:16.524466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2c2950b6-2371-4550-bfed-c342754df194 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:16.652276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2c2950b6-2371-4550-bfed-c342754df194 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:16.660233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2c2950b6-2371-4550-bfed-c342754df194 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148937 Jul 27 20:33:16.660813 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1188/2363] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:16 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:17.034533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-72577600-a92a-4751-987f-b92e602ff953 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:17.035146 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-72577600-a92a-4751-987f-b92e602ff953 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:17.041719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-72577600-a92a-4751-987f-b92e602ff953 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:17.042165 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-72577600-a92a-4751-987f-b92e602ff953 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:17.042921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-72577600-a92a-4751-987f-b92e602ff953 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:17.043358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-72577600-a92a-4751-987f-b92e602ff953 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:17.174173 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-72577600-a92a-4751-987f-b92e602ff953 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:17.184771 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-72577600-a92a-4751-987f-b92e602ff953 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.154155 Jul 27 20:33:17.185371 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1176/2364] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:17 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:17.681166 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-71b93d3a-a45f-48a3-94cf-a70d159daf0d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:17.681819 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-71b93d3a-a45f-48a3-94cf-a70d159daf0d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:17.688578 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-71b93d3a-a45f-48a3-94cf-a70d159daf0d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:17.689061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-71b93d3a-a45f-48a3-94cf-a70d159daf0d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:17.689836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-71b93d3a-a45f-48a3-94cf-a70d159daf0d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:17.690282 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-71b93d3a-a45f-48a3-94cf-a70d159daf0d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:17.805544 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fc796927-7be1-4630-8a2e-5da3f9bda987 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:17.806191 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fc796927-7be1-4630-8a2e-5da3f9bda987 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:17.812744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc796927-7be1-4630-8a2e-5da3f9bda987 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:17.813404 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc796927-7be1-4630-8a2e-5da3f9bda987 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:17.814498 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc796927-7be1-4630-8a2e-5da3f9bda987 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:17.815009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc796927-7be1-4630-8a2e-5da3f9bda987 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:17.829621 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-71b93d3a-a45f-48a3-94cf-a70d159daf0d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:17.843266 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fc796927-7be1-4630-8a2e-5da3f9bda987 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:33:17.846309 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:33:17.852935 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-71b93d3a-a45f-48a3-94cf-a70d159daf0d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.175565 Jul 27 20:33:17.853882 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1189/2365] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:17 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:17.930463 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fc796927-7be1-4630-8a2e-5da3f9bda987 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 204 len: 0 microversion: 2.1 time: 0.128616 Jul 27 20:33:17.931054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1177/2366] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 20:33:17 2022] DELETE /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 20:33:17.940394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-48c792d6-c7e1-45ce-a790-2d665365417d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:17.941045 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-48c792d6-c7e1-45ce-a790-2d665365417d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:17.947579 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48c792d6-c7e1-45ce-a790-2d665365417d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:17.948036 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48c792d6-c7e1-45ce-a790-2d665365417d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:17.948805 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48c792d6-c7e1-45ce-a790-2d665365417d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:17.949281 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48c792d6-c7e1-45ce-a790-2d665365417d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:17.967821 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:33:18.078240 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-48c792d6-c7e1-45ce-a790-2d665365417d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:18.087051 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-48c792d6-c7e1-45ce-a790-2d665365417d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1720 microversion: 2.1 time: 0.151470 Jul 27 20:33:18.087660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1190/2367] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:17 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:33:18.208378 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-63f576f5-6a54-49c5-aeef-9d45f58709fc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:18.209113 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-63f576f5-6a54-49c5-aeef-9d45f58709fc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:18.215089 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63f576f5-6a54-49c5-aeef-9d45f58709fc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:18.215541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63f576f5-6a54-49c5-aeef-9d45f58709fc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:18.216312 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63f576f5-6a54-49c5-aeef-9d45f58709fc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:18.216751 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63f576f5-6a54-49c5-aeef-9d45f58709fc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:18.343221 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-63f576f5-6a54-49c5-aeef-9d45f58709fc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:18.351076 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-63f576f5-6a54-49c5-aeef-9d45f58709fc tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.147628 Jul 27 20:33:18.351640 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1178/2368] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:18 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:18.874105 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5bad5602-2c74-47d1-8a43-347b67ce28a8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:18.874722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5bad5602-2c74-47d1-8a43-347b67ce28a8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:18.881768 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5bad5602-2c74-47d1-8a43-347b67ce28a8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:18.882221 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5bad5602-2c74-47d1-8a43-347b67ce28a8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:18.882979 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5bad5602-2c74-47d1-8a43-347b67ce28a8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:18.883418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5bad5602-2c74-47d1-8a43-347b67ce28a8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:19.016866 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5bad5602-2c74-47d1-8a43-347b67ce28a8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:19.024908 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5bad5602-2c74-47d1-8a43-347b67ce28a8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.154679 Jul 27 20:33:19.025495 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1191/2369] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:18 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:19.109463 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0938ebe6-9aad-458b-8287-4f4819b1007e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:19.110077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0938ebe6-9aad-458b-8287-4f4819b1007e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:19.117518 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0938ebe6-9aad-458b-8287-4f4819b1007e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:19.117964 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0938ebe6-9aad-458b-8287-4f4819b1007e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:19.118737 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0938ebe6-9aad-458b-8287-4f4819b1007e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:19.119183 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0938ebe6-9aad-458b-8287-4f4819b1007e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:19.347541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0938ebe6-9aad-458b-8287-4f4819b1007e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:19.356320 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0938ebe6-9aad-458b-8287-4f4819b1007e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1720 microversion: 2.1 time: 0.250795 Jul 27 20:33:19.356888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1179/2370] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:19 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1720 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:19.371814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b77ddd74-175c-46dc-af47-2bd411567f42 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:19.372429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b77ddd74-175c-46dc-af47-2bd411567f42 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:19.378338 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b77ddd74-175c-46dc-af47-2bd411567f42 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:19.378787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b77ddd74-175c-46dc-af47-2bd411567f42 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:19.379743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b77ddd74-175c-46dc-af47-2bd411567f42 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:19.380181 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b77ddd74-175c-46dc-af47-2bd411567f42 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:19.516177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b77ddd74-175c-46dc-af47-2bd411567f42 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:19.524743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b77ddd74-175c-46dc-af47-2bd411567f42 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.156841 Jul 27 20:33:19.525339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1192/2371] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:19 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:20.047836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c92f3041-c27e-47f6-938e-70c7a7079afd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:20.049212 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c92f3041-c27e-47f6-938e-70c7a7079afd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:20.063034 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c92f3041-c27e-47f6-938e-70c7a7079afd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:20.063736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c92f3041-c27e-47f6-938e-70c7a7079afd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:20.064874 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c92f3041-c27e-47f6-938e-70c7a7079afd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:20.065799 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c92f3041-c27e-47f6-938e-70c7a7079afd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:20.119757 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-2f118494-cf5a-4e44-8322-a903d315e0b3 req-4afb949f-8adf-492c-9313-1ec8b150c0c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8779e897-ecd4-43b8-9f87-a8e0c524c94a", "name": "network-vif-deleted", "tag": "17b5101e-1922-439a-82ad-033657522bc9"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:33:20.130385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-2f118494-cf5a-4e44-8322-a903d315e0b3 req-4afb949f-8adf-492c-9313-1ec8b150c0c4 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:20.131369 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-2f118494-cf5a-4e44-8322-a903d315e0b3 req-4afb949f-8adf-492c-9313-1ec8b150c0c4 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:20.142999 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-2f118494-cf5a-4e44-8322-a903d315e0b3 req-4afb949f-8adf-492c-9313-1ec8b150c0c4 service nova] Creating event network-vif-deleted:17b5101e-1922-439a-82ad-033657522bc9 for instance 8779e897-ecd4-43b8-9f87-a8e0c524c94a on hv-cinder-79987 Jul 27 20:33:20.149320 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-2f118494-cf5a-4e44-8322-a903d315e0b3 req-4afb949f-8adf-492c-9313-1ec8b150c0c4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116345 Jul 27 20:33:20.150359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1180/2372] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:33:20.219929 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c92f3041-c27e-47f6-938e-70c7a7079afd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:20.228251 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c92f3041-c27e-47f6-938e-70c7a7079afd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.186035 Jul 27 20:33:20.228922 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1193/2373] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:20 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:20.378067 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bb7d6a61-50a9-4e25-bcd7-e6b4d8a5a530 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:20.378931 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bb7d6a61-50a9-4e25-bcd7-e6b4d8a5a530 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:20.385565 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb7d6a61-50a9-4e25-bcd7-e6b4d8a5a530 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:20.386091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb7d6a61-50a9-4e25-bcd7-e6b4d8a5a530 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:20.386938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb7d6a61-50a9-4e25-bcd7-e6b4d8a5a530 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:20.387431 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb7d6a61-50a9-4e25-bcd7-e6b4d8a5a530 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:20.454251 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bb7d6a61-50a9-4e25-bcd7-e6b4d8a5a530 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:20.462883 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bb7d6a61-50a9-4e25-bcd7-e6b4d8a5a530 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.088922 Jul 27 20:33:20.463479 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1181/2374] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:20 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:20.546716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-93ae3edc-6205-41bb-93fb-a0e8c5b27b80 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:20.547326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-93ae3edc-6205-41bb-93fb-a0e8c5b27b80 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:20.554295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-93ae3edc-6205-41bb-93fb-a0e8c5b27b80 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:20.554742 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-93ae3edc-6205-41bb-93fb-a0e8c5b27b80 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:20.555512 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-93ae3edc-6205-41bb-93fb-a0e8c5b27b80 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:20.556067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-93ae3edc-6205-41bb-93fb-a0e8c5b27b80 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:20.689390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-93ae3edc-6205-41bb-93fb-a0e8c5b27b80 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:20.698073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-93ae3edc-6205-41bb-93fb-a0e8c5b27b80 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.155131 Jul 27 20:33:20.698649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1194/2375] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:20 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:20.743930 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:33:20.744165 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:33:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:33:21.250574 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-76fcdded-9b9a-498d-81c3-34b63f259bcd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:21.251180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-76fcdded-9b9a-498d-81c3-34b63f259bcd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:21.257914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76fcdded-9b9a-498d-81c3-34b63f259bcd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:21.258358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76fcdded-9b9a-498d-81c3-34b63f259bcd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:21.259103 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76fcdded-9b9a-498d-81c3-34b63f259bcd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:21.259545 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76fcdded-9b9a-498d-81c3-34b63f259bcd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:21.389016 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-76fcdded-9b9a-498d-81c3-34b63f259bcd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:21.397106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-76fcdded-9b9a-498d-81c3-34b63f259bcd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150491 Jul 27 20:33:21.397597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1182/2376] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:21 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:33:21.483765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ffadd648-68a3-47ec-aa85-23375dfc88c1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:21.484384 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ffadd648-68a3-47ec-aa85-23375dfc88c1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:21.491028 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ffadd648-68a3-47ec-aa85-23375dfc88c1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:21.491482 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ffadd648-68a3-47ec-aa85-23375dfc88c1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:21.492249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ffadd648-68a3-47ec-aa85-23375dfc88c1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:21.492690 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ffadd648-68a3-47ec-aa85-23375dfc88c1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:21.555194 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ffadd648-68a3-47ec-aa85-23375dfc88c1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:21.563223 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ffadd648-68a3-47ec-aa85-23375dfc88c1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083380 Jul 27 20:33:21.563787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1195/2377] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:21 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:21.719954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-762344cf-cc90-483e-808e-c1aa41b4ca2f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:21.720475 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-762344cf-cc90-483e-808e-c1aa41b4ca2f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:21.727543 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-762344cf-cc90-483e-808e-c1aa41b4ca2f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:21.727994 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-762344cf-cc90-483e-808e-c1aa41b4ca2f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:21.728755 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-762344cf-cc90-483e-808e-c1aa41b4ca2f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:21.729210 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-762344cf-cc90-483e-808e-c1aa41b4ca2f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:21.867935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-762344cf-cc90-483e-808e-c1aa41b4ca2f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:21.875859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-762344cf-cc90-483e-808e-c1aa41b4ca2f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.159924 Jul 27 20:33:21.876434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1183/2378] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:21 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:22.417681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-402e4042-8a6b-4f84-9f10-ab3e044a7056 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:22.418468 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-402e4042-8a6b-4f84-9f10-ab3e044a7056 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:22.424886 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-402e4042-8a6b-4f84-9f10-ab3e044a7056 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:22.425496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-402e4042-8a6b-4f84-9f10-ab3e044a7056 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:22.426372 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-402e4042-8a6b-4f84-9f10-ab3e044a7056 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:22.426895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-402e4042-8a6b-4f84-9f10-ab3e044a7056 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:22.558023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-402e4042-8a6b-4f84-9f10-ab3e044a7056 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:22.565893 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-402e4042-8a6b-4f84-9f10-ab3e044a7056 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152090 Jul 27 20:33:22.566465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1196/2379] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:22 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:22.584474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-066d08aa-fa12-4da2-9937-9ef5e2bcb39a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:22.585114 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-066d08aa-fa12-4da2-9937-9ef5e2bcb39a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:22.591556 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-066d08aa-fa12-4da2-9937-9ef5e2bcb39a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:22.592009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-066d08aa-fa12-4da2-9937-9ef5e2bcb39a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:22.592768 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-066d08aa-fa12-4da2-9937-9ef5e2bcb39a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:22.593229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-066d08aa-fa12-4da2-9937-9ef5e2bcb39a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:22.656629 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-066d08aa-fa12-4da2-9937-9ef5e2bcb39a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:22.664513 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-066d08aa-fa12-4da2-9937-9ef5e2bcb39a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084412 Jul 27 20:33:22.665104 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1184/2380] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:22 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:22.898473 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-862c1ee4-f54a-4716-8fce-dcd670682da2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:22.899093 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-862c1ee4-f54a-4716-8fce-dcd670682da2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:22.905183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-862c1ee4-f54a-4716-8fce-dcd670682da2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:22.905638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-862c1ee4-f54a-4716-8fce-dcd670682da2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:22.906402 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-862c1ee4-f54a-4716-8fce-dcd670682da2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:22.906841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-862c1ee4-f54a-4716-8fce-dcd670682da2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:23.034277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-862c1ee4-f54a-4716-8fce-dcd670682da2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:23.042932 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-862c1ee4-f54a-4716-8fce-dcd670682da2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.148901 Jul 27 20:33:23.043489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1197/2381] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:22 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:23.062618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:33:23.062839 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:33:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:33:23.586983 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-992c6729-c1c2-4f26-af96-e68d414d4a0c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:23.587586 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-992c6729-c1c2-4f26-af96-e68d414d4a0c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:23.594544 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-992c6729-c1c2-4f26-af96-e68d414d4a0c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:23.595068 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-992c6729-c1c2-4f26-af96-e68d414d4a0c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:23.595871 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-992c6729-c1c2-4f26-af96-e68d414d4a0c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:23.596296 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-992c6729-c1c2-4f26-af96-e68d414d4a0c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:23.685272 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6f615d44-ad51-41ce-9972-a2973df461ba tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:23.686018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6f615d44-ad51-41ce-9972-a2973df461ba tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:23.693221 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6f615d44-ad51-41ce-9972-a2973df461ba tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:23.693599 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6f615d44-ad51-41ce-9972-a2973df461ba tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:23.694376 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6f615d44-ad51-41ce-9972-a2973df461ba tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:23.694821 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6f615d44-ad51-41ce-9972-a2973df461ba tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:23.728440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-992c6729-c1c2-4f26-af96-e68d414d4a0c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:23.736394 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-992c6729-c1c2-4f26-af96-e68d414d4a0c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153734 Jul 27 20:33:23.736945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1185/2382] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:23 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:23.758560 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6f615d44-ad51-41ce-9972-a2973df461ba tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:23.766625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6f615d44-ad51-41ce-9972-a2973df461ba tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085258 Jul 27 20:33:23.767189 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1198/2383] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:23 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:33:24.064538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-96bcdef1-1dbb-4e2b-8c6d-2a7c6230dbd4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:24.065103 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-96bcdef1-1dbb-4e2b-8c6d-2a7c6230dbd4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:24.071160 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96bcdef1-1dbb-4e2b-8c6d-2a7c6230dbd4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:24.071614 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96bcdef1-1dbb-4e2b-8c6d-2a7c6230dbd4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:24.072382 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96bcdef1-1dbb-4e2b-8c6d-2a7c6230dbd4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:24.072823 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96bcdef1-1dbb-4e2b-8c6d-2a7c6230dbd4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:24.198739 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-96bcdef1-1dbb-4e2b-8c6d-2a7c6230dbd4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:24.206893 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-96bcdef1-1dbb-4e2b-8c6d-2a7c6230dbd4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.146332 Jul 27 20:33:24.208163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1186/2384] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:24 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:24.758807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-62cc9f90-afd8-401f-95ae-6f2df136b038 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:24.759438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-62cc9f90-afd8-401f-95ae-6f2df136b038 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:24.766004 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-62cc9f90-afd8-401f-95ae-6f2df136b038 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:24.766463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-62cc9f90-afd8-401f-95ae-6f2df136b038 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:24.767230 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-62cc9f90-afd8-401f-95ae-6f2df136b038 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:24.767681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-62cc9f90-afd8-401f-95ae-6f2df136b038 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:24.787275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bd6ba7a1-36e7-4126-bf6e-55ef2c949831 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:24.787889 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bd6ba7a1-36e7-4126-bf6e-55ef2c949831 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:24.794292 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bd6ba7a1-36e7-4126-bf6e-55ef2c949831 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:24.794745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bd6ba7a1-36e7-4126-bf6e-55ef2c949831 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:24.795516 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bd6ba7a1-36e7-4126-bf6e-55ef2c949831 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:24.795956 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bd6ba7a1-36e7-4126-bf6e-55ef2c949831 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:24.860811 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bd6ba7a1-36e7-4126-bf6e-55ef2c949831 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:24.869985 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bd6ba7a1-36e7-4126-bf6e-55ef2c949831 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.086567 Jul 27 20:33:24.871009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1187/2385] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:24 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:33:24.904371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-62cc9f90-afd8-401f-95ae-6f2df136b038 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:24.912869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-62cc9f90-afd8-401f-95ae-6f2df136b038 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.159120 Jul 27 20:33:24.913514 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1199/2386] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:24 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:25.229675 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1c165358-e73c-47e1-8148-b67c7a1f3c05 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:25.230288 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1c165358-e73c-47e1-8148-b67c7a1f3c05 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:25.236221 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c165358-e73c-47e1-8148-b67c7a1f3c05 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:25.236674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c165358-e73c-47e1-8148-b67c7a1f3c05 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:25.237461 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c165358-e73c-47e1-8148-b67c7a1f3c05 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:25.237904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c165358-e73c-47e1-8148-b67c7a1f3c05 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:25.372859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1c165358-e73c-47e1-8148-b67c7a1f3c05 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:25.380914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1c165358-e73c-47e1-8148-b67c7a1f3c05 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.155174 Jul 27 20:33:25.381499 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1188/2387] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:25 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:25.892042 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-60650fcf-f782-4bbb-ada3-f916b991fa67 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:25.892654 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-60650fcf-f782-4bbb-ada3-f916b991fa67 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:25.900016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-60650fcf-f782-4bbb-ada3-f916b991fa67 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:25.900474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-60650fcf-f782-4bbb-ada3-f916b991fa67 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:25.901307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-60650fcf-f782-4bbb-ada3-f916b991fa67 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:25.901787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-60650fcf-f782-4bbb-ada3-f916b991fa67 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:25.933018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-519c8eef-3fde-4b53-ac49-8a8815522da7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:25.933637 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-519c8eef-3fde-4b53-ac49-8a8815522da7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:25.940142 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-519c8eef-3fde-4b53-ac49-8a8815522da7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:25.940706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-519c8eef-3fde-4b53-ac49-8a8815522da7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:25.942028 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-519c8eef-3fde-4b53-ac49-8a8815522da7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:25.942464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-519c8eef-3fde-4b53-ac49-8a8815522da7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:25.964839 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-60650fcf-f782-4bbb-ada3-f916b991fa67 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:25.973196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-60650fcf-f782-4bbb-ada3-f916b991fa67 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084881 Jul 27 20:33:25.973769 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1200/2388] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:25 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:26.070173 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-519c8eef-3fde-4b53-ac49-8a8815522da7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:26.078598 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-519c8eef-3fde-4b53-ac49-8a8815522da7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149364 Jul 27 20:33:26.079161 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1189/2389] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:25 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:33:26.401985 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-93ba3c73-2e3b-496f-860d-f09c6055c339 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:26.402607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-93ba3c73-2e3b-496f-860d-f09c6055c339 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:26.408643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-93ba3c73-2e3b-496f-860d-f09c6055c339 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:26.409166 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-93ba3c73-2e3b-496f-860d-f09c6055c339 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:26.409936 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-93ba3c73-2e3b-496f-860d-f09c6055c339 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:26.410536 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-93ba3c73-2e3b-496f-860d-f09c6055c339 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:26.534518 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-93ba3c73-2e3b-496f-860d-f09c6055c339 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:26.542472 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-93ba3c73-2e3b-496f-860d-f09c6055c339 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.144423 Jul 27 20:33:26.543275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1201/2390] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:26 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:26.943166 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:33:26.943789 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:33:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:33:26.994090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-05769a76-07db-4fd7-834e-a90f13815b56 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:26.994703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-05769a76-07db-4fd7-834e-a90f13815b56 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:27.001459 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05769a76-07db-4fd7-834e-a90f13815b56 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:27.002048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05769a76-07db-4fd7-834e-a90f13815b56 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:27.002925 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05769a76-07db-4fd7-834e-a90f13815b56 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:27.003372 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05769a76-07db-4fd7-834e-a90f13815b56 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:27.064917 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-05769a76-07db-4fd7-834e-a90f13815b56 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:27.073379 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-05769a76-07db-4fd7-834e-a90f13815b56 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083092 Jul 27 20:33:27.073956 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1190/2391] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:26 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:27.100286 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-da97162b-927b-476b-b0fe-cabf2b3c3f4f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:27.100980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-da97162b-927b-476b-b0fe-cabf2b3c3f4f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:27.107672 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-da97162b-927b-476b-b0fe-cabf2b3c3f4f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:27.108132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-da97162b-927b-476b-b0fe-cabf2b3c3f4f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:27.108896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-da97162b-927b-476b-b0fe-cabf2b3c3f4f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:27.109364 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-da97162b-927b-476b-b0fe-cabf2b3c3f4f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:27.241769 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-da97162b-927b-476b-b0fe-cabf2b3c3f4f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:27.249748 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-da97162b-927b-476b-b0fe-cabf2b3c3f4f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.154008 Jul 27 20:33:27.250317 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1202/2392] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:27 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:27.564033 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-84d861cd-2ce0-44a1-a8f7-0ce37963310b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:27.564651 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-84d861cd-2ce0-44a1-a8f7-0ce37963310b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:27.571487 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-84d861cd-2ce0-44a1-a8f7-0ce37963310b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:27.571938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-84d861cd-2ce0-44a1-a8f7-0ce37963310b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:27.572700 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-84d861cd-2ce0-44a1-a8f7-0ce37963310b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:27.573178 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-84d861cd-2ce0-44a1-a8f7-0ce37963310b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:27.704625 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-84d861cd-2ce0-44a1-a8f7-0ce37963310b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:27.713099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-84d861cd-2ce0-44a1-a8f7-0ce37963310b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.152886 Jul 27 20:33:27.713896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1191/2393] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:27 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:28.095086 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a0113504-c35c-418d-aacb-271ba5e14432 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:28.095736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a0113504-c35c-418d-aacb-271ba5e14432 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:28.098141 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=62 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:33:28.103657 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a0113504-c35c-418d-aacb-271ba5e14432 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:28.104120 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a0113504-c35c-418d-aacb-271ba5e14432 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:28.104893 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a0113504-c35c-418d-aacb-271ba5e14432 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:28.105364 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a0113504-c35c-418d-aacb-271ba5e14432 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:28.167202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a0113504-c35c-418d-aacb-271ba5e14432 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:28.175012 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a0113504-c35c-418d-aacb-271ba5e14432 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083804 Jul 27 20:33:28.175568 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1203/2394] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:28 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:28.272455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3350095f-da80-4b81-9f52-ab81cdf81f6d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:28.273090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3350095f-da80-4b81-9f52-ab81cdf81f6d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:28.279615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3350095f-da80-4b81-9f52-ab81cdf81f6d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:28.280065 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3350095f-da80-4b81-9f52-ab81cdf81f6d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:28.280819 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3350095f-da80-4b81-9f52-ab81cdf81f6d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:28.281290 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3350095f-da80-4b81-9f52-ab81cdf81f6d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:28.407722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3350095f-da80-4b81-9f52-ab81cdf81f6d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:28.416523 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3350095f-da80-4b81-9f52-ab81cdf81f6d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148455 Jul 27 20:33:28.417034 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1192/2395] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:28 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:28.734688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8658867d-9c4b-4d99-a260-ccaaf3d65688 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:28.735230 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8658867d-9c4b-4d99-a260-ccaaf3d65688 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:28.741475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8658867d-9c4b-4d99-a260-ccaaf3d65688 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:28.741933 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8658867d-9c4b-4d99-a260-ccaaf3d65688 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:28.742699 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8658867d-9c4b-4d99-a260-ccaaf3d65688 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:28.743148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8658867d-9c4b-4d99-a260-ccaaf3d65688 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:28.870349 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8658867d-9c4b-4d99-a260-ccaaf3d65688 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:28.878177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8658867d-9c4b-4d99-a260-ccaaf3d65688 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.147580 Jul 27 20:33:28.878764 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1204/2396] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:28 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:29.196709 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-932bcc44-0b57-45da-874f-a47ea82157c1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:29.197351 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-932bcc44-0b57-45da-874f-a47ea82157c1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:29.203584 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-932bcc44-0b57-45da-874f-a47ea82157c1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:29.204028 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-932bcc44-0b57-45da-874f-a47ea82157c1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:29.204783 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-932bcc44-0b57-45da-874f-a47ea82157c1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:29.205248 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-932bcc44-0b57-45da-874f-a47ea82157c1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:29.224307 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:33:29.267938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-932bcc44-0b57-45da-874f-a47ea82157c1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:29.278606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-932bcc44-0b57-45da-874f-a47ea82157c1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085767 Jul 27 20:33:29.279230 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1193/2397] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:29 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:29.437438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7baccd12-4600-466b-ae53-1adf3c75354a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:29.438060 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7baccd12-4600-466b-ae53-1adf3c75354a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:29.445217 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7baccd12-4600-466b-ae53-1adf3c75354a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:29.445676 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7baccd12-4600-466b-ae53-1adf3c75354a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:29.446435 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7baccd12-4600-466b-ae53-1adf3c75354a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:29.446877 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7baccd12-4600-466b-ae53-1adf3c75354a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:29.581853 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7baccd12-4600-466b-ae53-1adf3c75354a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:29.592930 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7baccd12-4600-466b-ae53-1adf3c75354a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.159278 Jul 27 20:33:29.593526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1205/2398] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:29 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:29.899939 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fd5c71d2-95eb-4865-9019-edd50b38bcd5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:29.900544 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fd5c71d2-95eb-4865-9019-edd50b38bcd5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:29.902369 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:33:29.907739 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fd5c71d2-95eb-4865-9019-edd50b38bcd5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:29.908213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fd5c71d2-95eb-4865-9019-edd50b38bcd5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:29.908983 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fd5c71d2-95eb-4865-9019-edd50b38bcd5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:29.909414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fd5c71d2-95eb-4865-9019-edd50b38bcd5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:30.041516 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fd5c71d2-95eb-4865-9019-edd50b38bcd5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:30.049646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fd5c71d2-95eb-4865-9019-edd50b38bcd5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.153556 Jul 27 20:33:30.050211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1194/2399] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:29 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:30.300634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bd8f40c1-a4a4-4cb2-9e15-c83258e96eef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:30.301983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bd8f40c1-a4a4-4cb2-9e15-c83258e96eef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:30.307952 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bd8f40c1-a4a4-4cb2-9e15-c83258e96eef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:30.308402 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bd8f40c1-a4a4-4cb2-9e15-c83258e96eef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:30.309186 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bd8f40c1-a4a4-4cb2-9e15-c83258e96eef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:30.309653 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bd8f40c1-a4a4-4cb2-9e15-c83258e96eef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:30.370721 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bd8f40c1-a4a4-4cb2-9e15-c83258e96eef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:30.378535 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bd8f40c1-a4a4-4cb2-9e15-c83258e96eef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081944 Jul 27 20:33:30.379136 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1206/2400] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:30 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:30.613515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-87747146-5751-4936-afff-6ef60025eac7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:30.614097 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-87747146-5751-4936-afff-6ef60025eac7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:30.620573 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87747146-5751-4936-afff-6ef60025eac7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:30.621048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87747146-5751-4936-afff-6ef60025eac7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:30.621801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87747146-5751-4936-afff-6ef60025eac7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:30.622230 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87747146-5751-4936-afff-6ef60025eac7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:30.752125 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-87747146-5751-4936-afff-6ef60025eac7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:30.760286 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-87747146-5751-4936-afff-6ef60025eac7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150692 Jul 27 20:33:30.760847 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1195/2401] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:30 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:31.072492 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9dce370e-e95e-464b-996e-b8ac22f301d5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:31.073158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9dce370e-e95e-464b-996e-b8ac22f301d5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:31.080003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9dce370e-e95e-464b-996e-b8ac22f301d5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:31.080488 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9dce370e-e95e-464b-996e-b8ac22f301d5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:31.081290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9dce370e-e95e-464b-996e-b8ac22f301d5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:31.081738 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9dce370e-e95e-464b-996e-b8ac22f301d5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:31.086450 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:33:31.214330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9dce370e-e95e-464b-996e-b8ac22f301d5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:31.222227 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9dce370e-e95e-464b-996e-b8ac22f301d5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.153736 Jul 27 20:33:31.223524 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1207/2402] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:31 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:31.400217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a09b1b50-6e28-432b-87b0-e4bda879b7e5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:31.400823 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a09b1b50-6e28-432b-87b0-e4bda879b7e5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:31.406874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a09b1b50-6e28-432b-87b0-e4bda879b7e5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:31.407315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a09b1b50-6e28-432b-87b0-e4bda879b7e5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:31.408063 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a09b1b50-6e28-432b-87b0-e4bda879b7e5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:31.408493 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a09b1b50-6e28-432b-87b0-e4bda879b7e5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:31.468718 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a09b1b50-6e28-432b-87b0-e4bda879b7e5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:31.477562 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a09b1b50-6e28-432b-87b0-e4bda879b7e5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081318 Jul 27 20:33:31.478112 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1196/2403] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:31 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:31.781963 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e92fdd68-23a5-4f7b-abe7-5cab49e91dde tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:31.782510 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e92fdd68-23a5-4f7b-abe7-5cab49e91dde tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:31.788656 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e92fdd68-23a5-4f7b-abe7-5cab49e91dde tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:31.789174 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e92fdd68-23a5-4f7b-abe7-5cab49e91dde tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:31.789938 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e92fdd68-23a5-4f7b-abe7-5cab49e91dde tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:31.790386 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e92fdd68-23a5-4f7b-abe7-5cab49e91dde tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:31.917328 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e92fdd68-23a5-4f7b-abe7-5cab49e91dde tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:31.925263 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e92fdd68-23a5-4f7b-abe7-5cab49e91dde tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.147233 Jul 27 20:33:31.925832 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1208/2404] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:31 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:32.244552 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5b3ce7bd-ca7c-42ce-90ea-0e8d2b174f21 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:32.245194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5b3ce7bd-ca7c-42ce-90ea-0e8d2b174f21 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:32.251689 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b3ce7bd-ca7c-42ce-90ea-0e8d2b174f21 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:32.252143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b3ce7bd-ca7c-42ce-90ea-0e8d2b174f21 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:32.252904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b3ce7bd-ca7c-42ce-90ea-0e8d2b174f21 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:32.253367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b3ce7bd-ca7c-42ce-90ea-0e8d2b174f21 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:32.392865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5b3ce7bd-ca7c-42ce-90ea-0e8d2b174f21 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:32.400864 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5b3ce7bd-ca7c-42ce-90ea-0e8d2b174f21 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.160129 Jul 27 20:33:32.401450 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1197/2405] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:32 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:32.497923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-129dba40-5ad9-4b32-a76d-23a661be6252 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:32.498540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-129dba40-5ad9-4b32-a76d-23a661be6252 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:32.505568 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-129dba40-5ad9-4b32-a76d-23a661be6252 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:32.506019 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-129dba40-5ad9-4b32-a76d-23a661be6252 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:32.506785 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-129dba40-5ad9-4b32-a76d-23a661be6252 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:32.507228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-129dba40-5ad9-4b32-a76d-23a661be6252 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:32.567620 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-129dba40-5ad9-4b32-a76d-23a661be6252 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:32.575462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-129dba40-5ad9-4b32-a76d-23a661be6252 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081430 Jul 27 20:33:32.576022 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1209/2406] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:32 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:32.946696 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2c9c953d-f195-453e-9c1a-cc872fb9c797 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:32.947339 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2c9c953d-f195-453e-9c1a-cc872fb9c797 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:32.953725 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c9c953d-f195-453e-9c1a-cc872fb9c797 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:32.954157 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c9c953d-f195-453e-9c1a-cc872fb9c797 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:32.954914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c9c953d-f195-453e-9c1a-cc872fb9c797 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:32.955354 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c9c953d-f195-453e-9c1a-cc872fb9c797 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:33.092162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2c9c953d-f195-453e-9c1a-cc872fb9c797 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:33.101077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2c9c953d-f195-453e-9c1a-cc872fb9c797 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.158221 Jul 27 20:33:33.101636 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1198/2407] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:32 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:33.422706 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4db51d54-806d-401c-8bd1-a49b47797b99 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:33.423333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4db51d54-806d-401c-8bd1-a49b47797b99 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:33.430264 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4db51d54-806d-401c-8bd1-a49b47797b99 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:33.430722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4db51d54-806d-401c-8bd1-a49b47797b99 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:33.431487 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4db51d54-806d-401c-8bd1-a49b47797b99 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:33.431936 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4db51d54-806d-401c-8bd1-a49b47797b99 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:33.561850 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4db51d54-806d-401c-8bd1-a49b47797b99 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:33.570296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4db51d54-806d-401c-8bd1-a49b47797b99 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.151575 Jul 27 20:33:33.570856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1210/2408] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:33 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:33.596759 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5170e653-7a88-46b7-ae9f-be9049591642 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:33.597434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5170e653-7a88-46b7-ae9f-be9049591642 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:33.604608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5170e653-7a88-46b7-ae9f-be9049591642 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:33.605091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5170e653-7a88-46b7-ae9f-be9049591642 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:33.605857 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5170e653-7a88-46b7-ae9f-be9049591642 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:33.606300 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5170e653-7a88-46b7-ae9f-be9049591642 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:33.671037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5170e653-7a88-46b7-ae9f-be9049591642 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:33.680288 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5170e653-7a88-46b7-ae9f-be9049591642 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.087249 Jul 27 20:33:33.680780 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1199/2409] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:33 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:34.122539 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0e8755ac-969f-49e1-a78a-7d9d2be8bc5f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:34.123180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0e8755ac-969f-49e1-a78a-7d9d2be8bc5f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:34.130233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e8755ac-969f-49e1-a78a-7d9d2be8bc5f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:34.130691 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e8755ac-969f-49e1-a78a-7d9d2be8bc5f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:34.131489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e8755ac-969f-49e1-a78a-7d9d2be8bc5f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:34.131934 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e8755ac-969f-49e1-a78a-7d9d2be8bc5f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:34.264059 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0e8755ac-969f-49e1-a78a-7d9d2be8bc5f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:34.272089 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0e8755ac-969f-49e1-a78a-7d9d2be8bc5f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153384 Jul 27 20:33:34.272600 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1211/2410] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:34 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:34.592800 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-56b165be-118a-493f-944a-a2eccea29012 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:34.593351 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-56b165be-118a-493f-944a-a2eccea29012 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:34.599853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-56b165be-118a-493f-944a-a2eccea29012 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:34.600426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-56b165be-118a-493f-944a-a2eccea29012 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:34.601138 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-56b165be-118a-493f-944a-a2eccea29012 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:34.601571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-56b165be-118a-493f-944a-a2eccea29012 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:34.702784 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1af42ef4-4c8c-49cf-91e6-f94c6aa2517a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:34.703525 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1af42ef4-4c8c-49cf-91e6-f94c6aa2517a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:34.710486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1af42ef4-4c8c-49cf-91e6-f94c6aa2517a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:34.711049 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1af42ef4-4c8c-49cf-91e6-f94c6aa2517a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:34.711899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1af42ef4-4c8c-49cf-91e6-f94c6aa2517a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:34.712410 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1af42ef4-4c8c-49cf-91e6-f94c6aa2517a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:34.732127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-56b165be-118a-493f-944a-a2eccea29012 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:34.740634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-56b165be-118a-493f-944a-a2eccea29012 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.151824 Jul 27 20:33:34.741227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1200/2411] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:34 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:34.777954 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1af42ef4-4c8c-49cf-91e6-f94c6aa2517a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:34.786490 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1af42ef4-4c8c-49cf-91e6-f94c6aa2517a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.088758 Jul 27 20:33:34.787042 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1212/2412] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:34 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:33:35.292144 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a7271427-a6c6-46de-a04e-3575d7470848 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:35.292682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a7271427-a6c6-46de-a04e-3575d7470848 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:35.298685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7271427-a6c6-46de-a04e-3575d7470848 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:35.299135 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7271427-a6c6-46de-a04e-3575d7470848 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:35.299899 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7271427-a6c6-46de-a04e-3575d7470848 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:35.300335 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7271427-a6c6-46de-a04e-3575d7470848 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:35.436018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a7271427-a6c6-46de-a04e-3575d7470848 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:35.444891 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a7271427-a6c6-46de-a04e-3575d7470848 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.156597 Jul 27 20:33:35.445583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1201/2413] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:35 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:35.762292 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-611015b5-261e-4688-a6fb-aac56b5b0938 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:35.763001 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-611015b5-261e-4688-a6fb-aac56b5b0938 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:35.770034 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-611015b5-261e-4688-a6fb-aac56b5b0938 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:35.770518 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-611015b5-261e-4688-a6fb-aac56b5b0938 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:35.771367 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-611015b5-261e-4688-a6fb-aac56b5b0938 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:35.771806 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-611015b5-261e-4688-a6fb-aac56b5b0938 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:35.806410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8aa93f61-900c-45c3-b2b3-1b2ea0aea25a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:35.806949 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8aa93f61-900c-45c3-b2b3-1b2ea0aea25a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:35.816633 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8aa93f61-900c-45c3-b2b3-1b2ea0aea25a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:35.816633 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8aa93f61-900c-45c3-b2b3-1b2ea0aea25a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:35.817428 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8aa93f61-900c-45c3-b2b3-1b2ea0aea25a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:35.817870 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8aa93f61-900c-45c3-b2b3-1b2ea0aea25a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:35.916706 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-611015b5-261e-4688-a6fb-aac56b5b0938 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:35.925226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-611015b5-261e-4688-a6fb-aac56b5b0938 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.166678 Jul 27 20:33:35.926104 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1213/2414] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:35 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:36.126447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8aa93f61-900c-45c3-b2b3-1b2ea0aea25a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:36.135019 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8aa93f61-900c-45c3-b2b3-1b2ea0aea25a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.332559 Jul 27 20:33:36.135587 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1202/2415] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:35 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:36.467353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d0ac3c58-738b-4368-9277-5b2c7cd0ac88 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:36.467972 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d0ac3c58-738b-4368-9277-5b2c7cd0ac88 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:36.474059 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d0ac3c58-738b-4368-9277-5b2c7cd0ac88 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:36.474510 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d0ac3c58-738b-4368-9277-5b2c7cd0ac88 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:36.475266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d0ac3c58-738b-4368-9277-5b2c7cd0ac88 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:36.475709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d0ac3c58-738b-4368-9277-5b2c7cd0ac88 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:36.601919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d0ac3c58-738b-4368-9277-5b2c7cd0ac88 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:36.609756 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d0ac3c58-738b-4368-9277-5b2c7cd0ac88 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.146258 Jul 27 20:33:36.610316 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1214/2416] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:36 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:36.947437 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e381f132-0bfd-4496-a7e9-9cfa2c7b4d20 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:36.948047 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e381f132-0bfd-4496-a7e9-9cfa2c7b4d20 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:36.954728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e381f132-0bfd-4496-a7e9-9cfa2c7b4d20 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:36.955198 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e381f132-0bfd-4496-a7e9-9cfa2c7b4d20 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:36.955958 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e381f132-0bfd-4496-a7e9-9cfa2c7b4d20 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:36.956389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e381f132-0bfd-4496-a7e9-9cfa2c7b4d20 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:37.086622 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e381f132-0bfd-4496-a7e9-9cfa2c7b4d20 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:37.094596 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e381f132-0bfd-4496-a7e9-9cfa2c7b4d20 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.150947 Jul 27 20:33:37.095157 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1203/2417] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:36 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:37.156706 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-28e1d0e7-1993-4ca1-b8eb-6e4f45f18742 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:37.157339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-28e1d0e7-1993-4ca1-b8eb-6e4f45f18742 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:37.164632 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-28e1d0e7-1993-4ca1-b8eb-6e4f45f18742 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:37.165126 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-28e1d0e7-1993-4ca1-b8eb-6e4f45f18742 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:37.165921 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-28e1d0e7-1993-4ca1-b8eb-6e4f45f18742 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:37.166367 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-28e1d0e7-1993-4ca1-b8eb-6e4f45f18742 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:37.228533 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-28e1d0e7-1993-4ca1-b8eb-6e4f45f18742 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:37.236384 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-28e1d0e7-1993-4ca1-b8eb-6e4f45f18742 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083504 Jul 27 20:33:37.236943 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1215/2418] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:37 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:37.630826 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2974f984-de1a-4a69-bf06-cf1c36a2aba0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:37.631498 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2974f984-de1a-4a69-bf06-cf1c36a2aba0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:37.637510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2974f984-de1a-4a69-bf06-cf1c36a2aba0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:37.637969 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2974f984-de1a-4a69-bf06-cf1c36a2aba0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:37.638730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2974f984-de1a-4a69-bf06-cf1c36a2aba0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:37.639164 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2974f984-de1a-4a69-bf06-cf1c36a2aba0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:37.771564 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2974f984-de1a-4a69-bf06-cf1c36a2aba0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:37.779588 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2974f984-de1a-4a69-bf06-cf1c36a2aba0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153326 Jul 27 20:33:37.780151 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1204/2419] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:37 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:38.116888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a111e6ba-64f6-4d78-bfb1-5fead07f073c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:38.117548 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a111e6ba-64f6-4d78-bfb1-5fead07f073c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:38.123590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a111e6ba-64f6-4d78-bfb1-5fead07f073c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:38.124041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a111e6ba-64f6-4d78-bfb1-5fead07f073c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:38.124803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a111e6ba-64f6-4d78-bfb1-5fead07f073c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:38.125275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a111e6ba-64f6-4d78-bfb1-5fead07f073c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:38.255971 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a111e6ba-64f6-4d78-bfb1-5fead07f073c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:38.256999 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-db5b410e-fb19-49ea-9615-ea26ea64639b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:38.257692 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-db5b410e-fb19-49ea-9615-ea26ea64639b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:38.264007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a111e6ba-64f6-4d78-bfb1-5fead07f073c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.151028 Jul 27 20:33:38.264168 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db5b410e-fb19-49ea-9615-ea26ea64639b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:38.264797 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db5b410e-fb19-49ea-9615-ea26ea64639b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:38.264940 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1216/2420] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:38 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:38.265312 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db5b410e-fb19-49ea-9615-ea26ea64639b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:38.265793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db5b410e-fb19-49ea-9615-ea26ea64639b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:38.326575 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-db5b410e-fb19-49ea-9615-ea26ea64639b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:38.335133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-db5b410e-fb19-49ea-9615-ea26ea64639b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082448 Jul 27 20:33:38.335686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1205/2421] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:38 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:33:38.801437 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-40ac561a-7381-423a-b5b0-943b49377afa tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:38.802055 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-40ac561a-7381-423a-b5b0-943b49377afa tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:38.808135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-40ac561a-7381-423a-b5b0-943b49377afa tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:38.808590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-40ac561a-7381-423a-b5b0-943b49377afa tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:38.809422 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-40ac561a-7381-423a-b5b0-943b49377afa tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:38.809869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-40ac561a-7381-423a-b5b0-943b49377afa tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:38.936508 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-40ac561a-7381-423a-b5b0-943b49377afa tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:38.945090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-40ac561a-7381-423a-b5b0-943b49377afa tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148025 Jul 27 20:33:38.945658 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1217/2422] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:38 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:39.286464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bdd417e1-ba83-438b-ab5f-1209509ae263 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:39.287247 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bdd417e1-ba83-438b-ab5f-1209509ae263 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:39.293659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bdd417e1-ba83-438b-ab5f-1209509ae263 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:39.294104 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bdd417e1-ba83-438b-ab5f-1209509ae263 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:39.294859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bdd417e1-ba83-438b-ab5f-1209509ae263 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:39.295291 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bdd417e1-ba83-438b-ab5f-1209509ae263 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:39.355889 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e91e8c39-0f3f-40b4-9b3e-731e9389602b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:39.356515 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e91e8c39-0f3f-40b4-9b3e-731e9389602b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:39.363010 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e91e8c39-0f3f-40b4-9b3e-731e9389602b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:39.363462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e91e8c39-0f3f-40b4-9b3e-731e9389602b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:39.365007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e91e8c39-0f3f-40b4-9b3e-731e9389602b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:39.365608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e91e8c39-0f3f-40b4-9b3e-731e9389602b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:39.424615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bdd417e1-ba83-438b-ab5f-1209509ae263 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:39.427364 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e91e8c39-0f3f-40b4-9b3e-731e9389602b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:39.433849 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bdd417e1-ba83-438b-ab5f-1209509ae263 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.151684 Jul 27 20:33:39.434418 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1206/2423] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:39 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:39.435119 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e91e8c39-0f3f-40b4-9b3e-731e9389602b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083238 Jul 27 20:33:39.435676 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1218/2424] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:39 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:33:39.967470 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-683d76e5-aa18-4759-bd07-05c731f4da3f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:39.968081 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-683d76e5-aa18-4759-bd07-05c731f4da3f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:39.974255 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-683d76e5-aa18-4759-bd07-05c731f4da3f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:39.974705 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-683d76e5-aa18-4759-bd07-05c731f4da3f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:39.975492 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-683d76e5-aa18-4759-bd07-05c731f4da3f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:39.975928 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-683d76e5-aa18-4759-bd07-05c731f4da3f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:40.108845 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-683d76e5-aa18-4759-bd07-05c731f4da3f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:40.116779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-683d76e5-aa18-4759-bd07-05c731f4da3f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153177 Jul 27 20:33:40.117364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1207/2425] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:39 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:40.455595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-52df8aa5-4065-4ddb-8718-b1a6ef0bd85c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:40.456181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b6bd0008-a95d-4e75-9631-a56bbbcb3043 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:40.456558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-52df8aa5-4065-4ddb-8718-b1a6ef0bd85c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:40.456668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b6bd0008-a95d-4e75-9631-a56bbbcb3043 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:40.462791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6bd0008-a95d-4e75-9631-a56bbbcb3043 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:40.462973 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-52df8aa5-4065-4ddb-8718-b1a6ef0bd85c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:40.463243 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6bd0008-a95d-4e75-9631-a56bbbcb3043 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:40.463363 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-52df8aa5-4065-4ddb-8718-b1a6ef0bd85c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:40.464011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-52df8aa5-4065-4ddb-8718-b1a6ef0bd85c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:40.464111 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6bd0008-a95d-4e75-9631-a56bbbcb3043 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:40.464449 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6bd0008-a95d-4e75-9631-a56bbbcb3043 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:40.464561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-52df8aa5-4065-4ddb-8718-b1a6ef0bd85c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:40.529165 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b6bd0008-a95d-4e75-9631-a56bbbcb3043 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:40.537941 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b6bd0008-a95d-4e75-9631-a56bbbcb3043 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.086408 Jul 27 20:33:40.538516 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1208/2426] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:40 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:40.607708 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-52df8aa5-4065-4ddb-8718-b1a6ef0bd85c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:40.615701 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-52df8aa5-4065-4ddb-8718-b1a6ef0bd85c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.164456 Jul 27 20:33:40.616266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1219/2427] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:40 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:41.137301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9ec6aa8d-1418-4056-9b09-d23f55ab4acc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:41.137938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9ec6aa8d-1418-4056-9b09-d23f55ab4acc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:41.143874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9ec6aa8d-1418-4056-9b09-d23f55ab4acc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:41.144334 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9ec6aa8d-1418-4056-9b09-d23f55ab4acc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:41.145127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9ec6aa8d-1418-4056-9b09-d23f55ab4acc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:41.145652 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9ec6aa8d-1418-4056-9b09-d23f55ab4acc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:41.270826 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9ec6aa8d-1418-4056-9b09-d23f55ab4acc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:41.278737 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9ec6aa8d-1418-4056-9b09-d23f55ab4acc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.145298 Jul 27 20:33:41.279304 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1209/2428] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:41 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:41.558945 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f477bb18-0497-46fa-87b9-9b84ea5fd649 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:41.559566 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f477bb18-0497-46fa-87b9-9b84ea5fd649 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:41.565970 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f477bb18-0497-46fa-87b9-9b84ea5fd649 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:41.566425 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f477bb18-0497-46fa-87b9-9b84ea5fd649 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:41.567239 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f477bb18-0497-46fa-87b9-9b84ea5fd649 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:41.567826 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f477bb18-0497-46fa-87b9-9b84ea5fd649 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:41.629591 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f477bb18-0497-46fa-87b9-9b84ea5fd649 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:41.636359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7ce8b129-e9b0-4bfe-80d6-b72907e5a054 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:41.636991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7ce8b129-e9b0-4bfe-80d6-b72907e5a054 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:41.637605 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f477bb18-0497-46fa-87b9-9b84ea5fd649 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082501 Jul 27 20:33:41.638178 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1220/2429] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:41 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:41.643414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ce8b129-e9b0-4bfe-80d6-b72907e5a054 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:41.643861 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ce8b129-e9b0-4bfe-80d6-b72907e5a054 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:41.644618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ce8b129-e9b0-4bfe-80d6-b72907e5a054 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:41.645077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ce8b129-e9b0-4bfe-80d6-b72907e5a054 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:41.648950 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:33:41.776054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7ce8b129-e9b0-4bfe-80d6-b72907e5a054 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:41.783892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7ce8b129-e9b0-4bfe-80d6-b72907e5a054 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.151290 Jul 27 20:33:41.784441 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1210/2430] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:41 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:33:42.299215 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-76e271f7-5886-4d82-a015-eb9ace47ba33 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:42.299832 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-76e271f7-5886-4d82-a015-eb9ace47ba33 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:42.306176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-76e271f7-5886-4d82-a015-eb9ace47ba33 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:42.306629 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-76e271f7-5886-4d82-a015-eb9ace47ba33 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:42.307391 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-76e271f7-5886-4d82-a015-eb9ace47ba33 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:42.307834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-76e271f7-5886-4d82-a015-eb9ace47ba33 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:42.437974 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-76e271f7-5886-4d82-a015-eb9ace47ba33 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:42.446858 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-76e271f7-5886-4d82-a015-eb9ace47ba33 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151443 Jul 27 20:33:42.447420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1221/2431] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:42 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:42.658986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-99ab0807-5ebb-44c7-a6f3-cf01cddc54ce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:42.659515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-99ab0807-5ebb-44c7-a6f3-cf01cddc54ce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:42.666357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99ab0807-5ebb-44c7-a6f3-cf01cddc54ce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:42.666807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99ab0807-5ebb-44c7-a6f3-cf01cddc54ce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:42.667574 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99ab0807-5ebb-44c7-a6f3-cf01cddc54ce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:42.668014 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99ab0807-5ebb-44c7-a6f3-cf01cddc54ce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:42.730377 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-99ab0807-5ebb-44c7-a6f3-cf01cddc54ce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:42.738235 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-99ab0807-5ebb-44c7-a6f3-cf01cddc54ce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083223 Jul 27 20:33:42.738800 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1211/2432] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:42 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:42.805590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-419a5788-4483-4b17-a9b4-8a9b272d626c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:42.806205 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-419a5788-4483-4b17-a9b4-8a9b272d626c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:42.812619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-419a5788-4483-4b17-a9b4-8a9b272d626c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:42.813107 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-419a5788-4483-4b17-a9b4-8a9b272d626c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:42.813857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-419a5788-4483-4b17-a9b4-8a9b272d626c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:42.814296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-419a5788-4483-4b17-a9b4-8a9b272d626c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:42.941155 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-419a5788-4483-4b17-a9b4-8a9b272d626c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:42.949749 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-419a5788-4483-4b17-a9b4-8a9b272d626c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.148069 Jul 27 20:33:42.950312 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1222/2433] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:42 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:43.473082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ba75f238-2cf0-47e6-9a41-7fc02625701d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:43.474579 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ba75f238-2cf0-47e6-9a41-7fc02625701d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:43.480634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba75f238-2cf0-47e6-9a41-7fc02625701d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:43.481120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba75f238-2cf0-47e6-9a41-7fc02625701d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:43.481887 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba75f238-2cf0-47e6-9a41-7fc02625701d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:43.482324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba75f238-2cf0-47e6-9a41-7fc02625701d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:43.610725 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ba75f238-2cf0-47e6-9a41-7fc02625701d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:43.618694 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ba75f238-2cf0-47e6-9a41-7fc02625701d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149512 Jul 27 20:33:43.619258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1212/2434] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:43 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:43.759536 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9d99daa0-578e-4ef5-907c-ef62dc8558e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:43.760165 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9d99daa0-578e-4ef5-907c-ef62dc8558e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:43.766329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d99daa0-578e-4ef5-907c-ef62dc8558e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:43.766787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d99daa0-578e-4ef5-907c-ef62dc8558e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:43.767553 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d99daa0-578e-4ef5-907c-ef62dc8558e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:43.767998 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d99daa0-578e-4ef5-907c-ef62dc8558e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:43.829379 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9d99daa0-578e-4ef5-907c-ef62dc8558e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:43.833451 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:33:43.839126 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9d99daa0-578e-4ef5-907c-ef62dc8558e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083425 Jul 27 20:33:43.839694 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1223/2435] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:43 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:43.971641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-73f6d83a-996a-4ed0-83c0-01f8d0f034d8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:43.972248 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-73f6d83a-996a-4ed0-83c0-01f8d0f034d8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:43.979261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73f6d83a-996a-4ed0-83c0-01f8d0f034d8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:43.979698 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73f6d83a-996a-4ed0-83c0-01f8d0f034d8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:43.980445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73f6d83a-996a-4ed0-83c0-01f8d0f034d8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:43.980880 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73f6d83a-996a-4ed0-83c0-01f8d0f034d8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:44.120908 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-73f6d83a-996a-4ed0-83c0-01f8d0f034d8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:44.128831 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-73f6d83a-996a-4ed0-83c0-01f8d0f034d8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.160972 Jul 27 20:33:44.129432 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1213/2436] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:43 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:44.639634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e992c476-abf1-45db-bb05-134db8f6aaa1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:44.640267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e992c476-abf1-45db-bb05-134db8f6aaa1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:44.646663 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e992c476-abf1-45db-bb05-134db8f6aaa1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:44.647119 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e992c476-abf1-45db-bb05-134db8f6aaa1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:44.647885 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e992c476-abf1-45db-bb05-134db8f6aaa1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:44.648332 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e992c476-abf1-45db-bb05-134db8f6aaa1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:44.777943 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e992c476-abf1-45db-bb05-134db8f6aaa1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:44.785837 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e992c476-abf1-45db-bb05-134db8f6aaa1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149987 Jul 27 20:33:44.787086 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1224/2437] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:44 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:44.859476 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ed00810c-214e-4584-81fb-93500fcfb1b5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:44.860093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ed00810c-214e-4584-81fb-93500fcfb1b5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:44.866295 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed00810c-214e-4584-81fb-93500fcfb1b5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:44.866715 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed00810c-214e-4584-81fb-93500fcfb1b5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:44.867465 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed00810c-214e-4584-81fb-93500fcfb1b5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:44.867899 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed00810c-214e-4584-81fb-93500fcfb1b5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:44.927902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ed00810c-214e-4584-81fb-93500fcfb1b5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:44.935638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ed00810c-214e-4584-81fb-93500fcfb1b5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.079990 Jul 27 20:33:44.936188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1214/2438] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:44 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:45.151068 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2b5fe59a-c694-4ff3-a64a-28755912adae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:45.151679 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2b5fe59a-c694-4ff3-a64a-28755912adae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:45.158143 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2b5fe59a-c694-4ff3-a64a-28755912adae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:45.158589 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2b5fe59a-c694-4ff3-a64a-28755912adae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:45.159343 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2b5fe59a-c694-4ff3-a64a-28755912adae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:45.159773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2b5fe59a-c694-4ff3-a64a-28755912adae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:45.286623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2b5fe59a-c694-4ff3-a64a-28755912adae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:45.294446 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2b5fe59a-c694-4ff3-a64a-28755912adae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.147256 Jul 27 20:33:45.295010 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1225/2439] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:45 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:45.808159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0fc94859-f653-4159-98d2-29b93897fa12 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:45.808720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0fc94859-f653-4159-98d2-29b93897fa12 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:45.815159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0fc94859-f653-4159-98d2-29b93897fa12 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:45.815618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0fc94859-f653-4159-98d2-29b93897fa12 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:45.816381 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0fc94859-f653-4159-98d2-29b93897fa12 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:45.816823 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0fc94859-f653-4159-98d2-29b93897fa12 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:45.947176 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0fc94859-f653-4159-98d2-29b93897fa12 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:45.955501 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0fc94859-f653-4159-98d2-29b93897fa12 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151241 Jul 27 20:33:45.955905 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cfd0b3bd-e4ec-4138-80b5-7a2269f4c852 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:45.956322 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1215/2440] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:45 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:45.956594 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cfd0b3bd-e4ec-4138-80b5-7a2269f4c852 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:45.962979 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cfd0b3bd-e4ec-4138-80b5-7a2269f4c852 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:45.963437 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cfd0b3bd-e4ec-4138-80b5-7a2269f4c852 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:45.964207 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cfd0b3bd-e4ec-4138-80b5-7a2269f4c852 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:45.964653 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cfd0b3bd-e4ec-4138-80b5-7a2269f4c852 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:46.024618 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cfd0b3bd-e4ec-4138-80b5-7a2269f4c852 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:46.032592 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cfd0b3bd-e4ec-4138-80b5-7a2269f4c852 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.080894 Jul 27 20:33:46.033187 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1226/2441] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:45 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:33:46.142687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:33:46.142976 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:33:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:33:46.316055 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-647473b8-eb3f-432b-82e4-2604a044e504 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:46.316661 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-647473b8-eb3f-432b-82e4-2604a044e504 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:46.322798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-647473b8-eb3f-432b-82e4-2604a044e504 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:46.323243 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-647473b8-eb3f-432b-82e4-2604a044e504 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:46.323992 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-647473b8-eb3f-432b-82e4-2604a044e504 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:46.324420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-647473b8-eb3f-432b-82e4-2604a044e504 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:46.451268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-647473b8-eb3f-432b-82e4-2604a044e504 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:46.460133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-647473b8-eb3f-432b-82e4-2604a044e504 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.147923 Jul 27 20:33:46.460702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1216/2442] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:46 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:46.976746 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-26fef4d5-7d98-43e5-bdbd-93f70597157e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:46.977398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-26fef4d5-7d98-43e5-bdbd-93f70597157e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:46.983869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-26fef4d5-7d98-43e5-bdbd-93f70597157e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:46.984320 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-26fef4d5-7d98-43e5-bdbd-93f70597157e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:46.985129 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-26fef4d5-7d98-43e5-bdbd-93f70597157e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:46.985601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-26fef4d5-7d98-43e5-bdbd-93f70597157e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:47.058529 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0701b737-b699-429a-ab28-e97a339bcaf6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:47.059141 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0701b737-b699-429a-ab28-e97a339bcaf6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:47.065538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0701b737-b699-429a-ab28-e97a339bcaf6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:47.065988 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0701b737-b699-429a-ab28-e97a339bcaf6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:47.066782 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0701b737-b699-429a-ab28-e97a339bcaf6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:47.067775 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0701b737-b699-429a-ab28-e97a339bcaf6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:47.121929 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-26fef4d5-7d98-43e5-bdbd-93f70597157e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:47.130621 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-26fef4d5-7d98-43e5-bdbd-93f70597157e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.157392 Jul 27 20:33:47.131292 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1227/2443] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:46 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:47.135323 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0701b737-b699-429a-ab28-e97a339bcaf6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:47.143267 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0701b737-b699-429a-ab28-e97a339bcaf6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.088704 Jul 27 20:33:47.143815 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1217/2444] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:47 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:33:47.482364 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-51de6461-c083-44c3-b7fb-4a84a2fc2d73 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:47.482977 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-51de6461-c083-44c3-b7fb-4a84a2fc2d73 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:47.489726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-51de6461-c083-44c3-b7fb-4a84a2fc2d73 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:47.490181 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-51de6461-c083-44c3-b7fb-4a84a2fc2d73 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:47.490931 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-51de6461-c083-44c3-b7fb-4a84a2fc2d73 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:47.491396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-51de6461-c083-44c3-b7fb-4a84a2fc2d73 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:47.619124 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-51de6461-c083-44c3-b7fb-4a84a2fc2d73 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:47.627442 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-51de6461-c083-44c3-b7fb-4a84a2fc2d73 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.149021 Jul 27 20:33:47.628026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1228/2445] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:47 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:48.152010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c08cfcc3-108d-4828-84ef-099314d28a68 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:48.152621 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c08cfcc3-108d-4828-84ef-099314d28a68 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:48.158812 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c08cfcc3-108d-4828-84ef-099314d28a68 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:48.159260 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c08cfcc3-108d-4828-84ef-099314d28a68 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:48.160021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c08cfcc3-108d-4828-84ef-099314d28a68 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:48.160460 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c08cfcc3-108d-4828-84ef-099314d28a68 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:48.163616 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c2a1eb54-18fa-4c49-b7cd-3aaf642d8890 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:48.164227 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c2a1eb54-18fa-4c49-b7cd-3aaf642d8890 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:48.170705 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c2a1eb54-18fa-4c49-b7cd-3aaf642d8890 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:48.171148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c2a1eb54-18fa-4c49-b7cd-3aaf642d8890 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:48.171905 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c2a1eb54-18fa-4c49-b7cd-3aaf642d8890 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:48.172339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c2a1eb54-18fa-4c49-b7cd-3aaf642d8890 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:48.235067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c2a1eb54-18fa-4c49-b7cd-3aaf642d8890 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:48.242969 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c2a1eb54-18fa-4c49-b7cd-3aaf642d8890 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083298 Jul 27 20:33:48.243538 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1229/2446] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:48 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:33:48.292433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c08cfcc3-108d-4828-84ef-099314d28a68 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:48.300288 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c08cfcc3-108d-4828-84ef-099314d28a68 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152159 Jul 27 20:33:48.300841 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1218/2447] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:48 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:48.649736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c357e1ab-2d98-40ee-8ea3-508ec763f2a6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:48.650366 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c357e1ab-2d98-40ee-8ea3-508ec763f2a6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:48.656339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c357e1ab-2d98-40ee-8ea3-508ec763f2a6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:48.656795 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c357e1ab-2d98-40ee-8ea3-508ec763f2a6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:48.657623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c357e1ab-2d98-40ee-8ea3-508ec763f2a6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:48.658072 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c357e1ab-2d98-40ee-8ea3-508ec763f2a6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:48.794150 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c357e1ab-2d98-40ee-8ea3-508ec763f2a6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:48.802485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c357e1ab-2d98-40ee-8ea3-508ec763f2a6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.157208 Jul 27 20:33:48.803057 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1230/2448] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:48 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:49.263600 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1d1bd71e-3219-456c-a806-7e70ccf973fa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:49.264208 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1d1bd71e-3219-456c-a806-7e70ccf973fa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:49.271501 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d1bd71e-3219-456c-a806-7e70ccf973fa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:49.271946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d1bd71e-3219-456c-a806-7e70ccf973fa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:49.272711 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d1bd71e-3219-456c-a806-7e70ccf973fa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:49.273184 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d1bd71e-3219-456c-a806-7e70ccf973fa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:49.321418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fac2914c-4707-4442-a564-36176aaca05a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:49.322036 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fac2914c-4707-4442-a564-36176aaca05a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:49.328814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fac2914c-4707-4442-a564-36176aaca05a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:49.329242 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fac2914c-4707-4442-a564-36176aaca05a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:49.330007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fac2914c-4707-4442-a564-36176aaca05a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:49.330453 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fac2914c-4707-4442-a564-36176aaca05a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:49.335258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1d1bd71e-3219-456c-a806-7e70ccf973fa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:49.343144 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1d1bd71e-3219-456c-a806-7e70ccf973fa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083408 Jul 27 20:33:49.343719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1219/2449] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:49 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:49.461965 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fac2914c-4707-4442-a564-36176aaca05a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:49.470300 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fac2914c-4707-4442-a564-36176aaca05a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152716 Jul 27 20:33:49.470896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1231/2450] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:49 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:33:49.823875 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8bff2d6f-78e2-409a-962b-c5015a2cc570 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:49.824498 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8bff2d6f-78e2-409a-962b-c5015a2cc570 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:49.830846 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8bff2d6f-78e2-409a-962b-c5015a2cc570 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:49.831298 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8bff2d6f-78e2-409a-962b-c5015a2cc570 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:49.832062 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8bff2d6f-78e2-409a-962b-c5015a2cc570 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:49.832606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8bff2d6f-78e2-409a-962b-c5015a2cc570 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:49.961392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8bff2d6f-78e2-409a-962b-c5015a2cc570 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:49.969276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8bff2d6f-78e2-409a-962b-c5015a2cc570 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.149308 Jul 27 20:33:49.969843 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1220/2451] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:49 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:50.363776 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6c95a0fd-2479-4198-b80c-eb2f172eb460 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:50.364892 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6c95a0fd-2479-4198-b80c-eb2f172eb460 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:50.371442 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6c95a0fd-2479-4198-b80c-eb2f172eb460 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:50.371896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6c95a0fd-2479-4198-b80c-eb2f172eb460 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:50.372660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6c95a0fd-2479-4198-b80c-eb2f172eb460 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:50.373145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6c95a0fd-2479-4198-b80c-eb2f172eb460 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:50.433711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6c95a0fd-2479-4198-b80c-eb2f172eb460 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:50.441735 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6c95a0fd-2479-4198-b80c-eb2f172eb460 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081904 Jul 27 20:33:50.442308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1232/2452] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:50 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:50.492845 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-316e3031-fd92-4586-904d-ea24a73aebe0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:50.493581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-316e3031-fd92-4586-904d-ea24a73aebe0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:50.500283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-316e3031-fd92-4586-904d-ea24a73aebe0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:50.500809 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-316e3031-fd92-4586-904d-ea24a73aebe0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:50.501662 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-316e3031-fd92-4586-904d-ea24a73aebe0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:50.502166 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-316e3031-fd92-4586-904d-ea24a73aebe0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:50.637063 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-316e3031-fd92-4586-904d-ea24a73aebe0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:50.644981 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-316e3031-fd92-4586-904d-ea24a73aebe0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.156532 Jul 27 20:33:50.645554 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1221/2453] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:50 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:50.990559 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-62e46408-f401-4fc3-b867-406e64e2fc7a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:50.991101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-62e46408-f401-4fc3-b867-406e64e2fc7a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:50.997206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-62e46408-f401-4fc3-b867-406e64e2fc7a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:50.997667 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-62e46408-f401-4fc3-b867-406e64e2fc7a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:50.998441 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-62e46408-f401-4fc3-b867-406e64e2fc7a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:50.998888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-62e46408-f401-4fc3-b867-406e64e2fc7a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:51.132670 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-62e46408-f401-4fc3-b867-406e64e2fc7a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:51.140601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-62e46408-f401-4fc3-b867-406e64e2fc7a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.154028 Jul 27 20:33:51.141183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1233/2454] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:50 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:51.463395 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-97fb3fcb-addd-4fe7-95a9-6fb23c3237c3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:51.464007 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-97fb3fcb-addd-4fe7-95a9-6fb23c3237c3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:51.469956 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97fb3fcb-addd-4fe7-95a9-6fb23c3237c3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:51.470396 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97fb3fcb-addd-4fe7-95a9-6fb23c3237c3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:51.471139 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97fb3fcb-addd-4fe7-95a9-6fb23c3237c3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:51.471568 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97fb3fcb-addd-4fe7-95a9-6fb23c3237c3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:51.533309 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-97fb3fcb-addd-4fe7-95a9-6fb23c3237c3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:51.541100 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-97fb3fcb-addd-4fe7-95a9-6fb23c3237c3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081503 Jul 27 20:33:51.541647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1222/2455] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:51 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:51.665800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e24c5d74-6910-4725-bece-a860a6533422 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:51.666415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e24c5d74-6910-4725-bece-a860a6533422 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:51.672914 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e24c5d74-6910-4725-bece-a860a6533422 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:51.673378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e24c5d74-6910-4725-bece-a860a6533422 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:51.674141 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e24c5d74-6910-4725-bece-a860a6533422 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:51.674582 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e24c5d74-6910-4725-bece-a860a6533422 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:51.803089 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e24c5d74-6910-4725-bece-a860a6533422 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:51.810976 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e24c5d74-6910-4725-bece-a860a6533422 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149020 Jul 27 20:33:51.811538 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1234/2456] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:51 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:52.162782 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-429cf975-9af4-41d1-abff-0f9ee7c9829e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:52.163422 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-429cf975-9af4-41d1-abff-0f9ee7c9829e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:52.169439 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-429cf975-9af4-41d1-abff-0f9ee7c9829e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:52.169887 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-429cf975-9af4-41d1-abff-0f9ee7c9829e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:52.170646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-429cf975-9af4-41d1-abff-0f9ee7c9829e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:52.171079 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-429cf975-9af4-41d1-abff-0f9ee7c9829e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:52.299317 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-429cf975-9af4-41d1-abff-0f9ee7c9829e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:52.307879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-429cf975-9af4-41d1-abff-0f9ee7c9829e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.149501 Jul 27 20:33:52.308453 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1223/2457] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:52 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:52.562454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-09f8f7dc-b65e-46c9-bf72-e5b60c02a1aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:52.563062 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-09f8f7dc-b65e-46c9-bf72-e5b60c02a1aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:52.569627 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-09f8f7dc-b65e-46c9-bf72-e5b60c02a1aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:52.570074 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-09f8f7dc-b65e-46c9-bf72-e5b60c02a1aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:52.570825 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-09f8f7dc-b65e-46c9-bf72-e5b60c02a1aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:52.571260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-09f8f7dc-b65e-46c9-bf72-e5b60c02a1aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:52.635277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-09f8f7dc-b65e-46c9-bf72-e5b60c02a1aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:52.643232 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-09f8f7dc-b65e-46c9-bf72-e5b60c02a1aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084598 Jul 27 20:33:52.643794 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1235/2458] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:52 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:52.833250 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-038dddd2-a8ed-4bda-993b-24e036617840 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:52.833876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-038dddd2-a8ed-4bda-993b-24e036617840 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:52.840346 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-038dddd2-a8ed-4bda-993b-24e036617840 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:52.840797 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-038dddd2-a8ed-4bda-993b-24e036617840 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:52.841593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-038dddd2-a8ed-4bda-993b-24e036617840 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:52.842036 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-038dddd2-a8ed-4bda-993b-24e036617840 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:52.974416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-038dddd2-a8ed-4bda-993b-24e036617840 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:52.982309 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-038dddd2-a8ed-4bda-993b-24e036617840 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153656 Jul 27 20:33:52.982878 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1224/2459] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:52 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:53.330002 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-23ee43fe-36b0-42c3-bf74-712e29ad5f57 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:53.330622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-23ee43fe-36b0-42c3-bf74-712e29ad5f57 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:53.337151 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-23ee43fe-36b0-42c3-bf74-712e29ad5f57 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:53.337608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-23ee43fe-36b0-42c3-bf74-712e29ad5f57 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:53.338372 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-23ee43fe-36b0-42c3-bf74-712e29ad5f57 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:53.338818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-23ee43fe-36b0-42c3-bf74-712e29ad5f57 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:53.476744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-23ee43fe-36b0-42c3-bf74-712e29ad5f57 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:53.484683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-23ee43fe-36b0-42c3-bf74-712e29ad5f57 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.158819 Jul 27 20:33:53.485278 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1236/2460] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:53 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:53.665041 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-00b725e9-0461-43fb-a37e-20b505f47226 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:53.665657 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-00b725e9-0461-43fb-a37e-20b505f47226 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:53.671742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00b725e9-0461-43fb-a37e-20b505f47226 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:53.672203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00b725e9-0461-43fb-a37e-20b505f47226 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:53.672999 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00b725e9-0461-43fb-a37e-20b505f47226 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:53.673508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00b725e9-0461-43fb-a37e-20b505f47226 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:53.734941 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-00b725e9-0461-43fb-a37e-20b505f47226 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:53.742784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-00b725e9-0461-43fb-a37e-20b505f47226 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082235 Jul 27 20:33:53.743369 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1225/2461] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:53 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:54.003110 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d99ccb7a-ffb6-4947-9df9-29d1d7e07569 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:54.003660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d99ccb7a-ffb6-4947-9df9-29d1d7e07569 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:54.010022 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d99ccb7a-ffb6-4947-9df9-29d1d7e07569 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:54.010478 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d99ccb7a-ffb6-4947-9df9-29d1d7e07569 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:54.011243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d99ccb7a-ffb6-4947-9df9-29d1d7e07569 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:54.011688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d99ccb7a-ffb6-4947-9df9-29d1d7e07569 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:54.138962 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d99ccb7a-ffb6-4947-9df9-29d1d7e07569 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:54.147151 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d99ccb7a-ffb6-4947-9df9-29d1d7e07569 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148048 Jul 27 20:33:54.147718 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1237/2462] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:53 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:54.506176 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6f6c89be-df6d-4825-b17b-d544e4ddfa2c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:54.506792 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6f6c89be-df6d-4825-b17b-d544e4ddfa2c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:54.513310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f6c89be-df6d-4825-b17b-d544e4ddfa2c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:54.513764 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f6c89be-df6d-4825-b17b-d544e4ddfa2c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:54.514528 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f6c89be-df6d-4825-b17b-d544e4ddfa2c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:54.514966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f6c89be-df6d-4825-b17b-d544e4ddfa2c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:54.640940 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6f6c89be-df6d-4825-b17b-d544e4ddfa2c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:54.644308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:33:54.650409 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6f6c89be-df6d-4825-b17b-d544e4ddfa2c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.148108 Jul 27 20:33:54.650975 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1226/2463] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:54 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:54.763711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3b905aca-2f7e-460b-8053-31930e7e0ac8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:54.764250 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3b905aca-2f7e-460b-8053-31930e7e0ac8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:54.771284 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3b905aca-2f7e-460b-8053-31930e7e0ac8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:54.771735 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3b905aca-2f7e-460b-8053-31930e7e0ac8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:54.772495 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3b905aca-2f7e-460b-8053-31930e7e0ac8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:54.772937 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3b905aca-2f7e-460b-8053-31930e7e0ac8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:54.839552 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3b905aca-2f7e-460b-8053-31930e7e0ac8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:54.847775 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3b905aca-2f7e-460b-8053-31930e7e0ac8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.087991 Jul 27 20:33:54.848551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1238/2464] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:54 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:55.168135 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5750129e-db93-4f04-8a97-ed41b0f90150 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:55.168749 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5750129e-db93-4f04-8a97-ed41b0f90150 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:55.174904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5750129e-db93-4f04-8a97-ed41b0f90150 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:55.175351 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5750129e-db93-4f04-8a97-ed41b0f90150 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:55.176160 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5750129e-db93-4f04-8a97-ed41b0f90150 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:55.177207 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5750129e-db93-4f04-8a97-ed41b0f90150 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:55.310370 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5750129e-db93-4f04-8a97-ed41b0f90150 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:55.318463 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5750129e-db93-4f04-8a97-ed41b0f90150 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.154226 Jul 27 20:33:55.319052 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1227/2465] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:55 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:55.671589 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-13fbceef-e35e-4788-ad66-735c716e36b2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:55.672203 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-13fbceef-e35e-4788-ad66-735c716e36b2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:55.678243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-13fbceef-e35e-4788-ad66-735c716e36b2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:55.678691 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-13fbceef-e35e-4788-ad66-735c716e36b2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:55.679444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-13fbceef-e35e-4788-ad66-735c716e36b2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:55.679881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-13fbceef-e35e-4788-ad66-735c716e36b2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:55.806528 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-13fbceef-e35e-4788-ad66-735c716e36b2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:55.814482 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-13fbceef-e35e-4788-ad66-735c716e36b2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.146718 Jul 27 20:33:55.815054 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1239/2466] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:55 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:55.868798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4c69b2ee-1990-481f-95fe-18dbf911f4c5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:55.869418 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4c69b2ee-1990-481f-95fe-18dbf911f4c5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:55.875742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c69b2ee-1990-481f-95fe-18dbf911f4c5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:55.876188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c69b2ee-1990-481f-95fe-18dbf911f4c5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:55.876945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c69b2ee-1990-481f-95fe-18dbf911f4c5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:55.877395 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c69b2ee-1990-481f-95fe-18dbf911f4c5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:55.937817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4c69b2ee-1990-481f-95fe-18dbf911f4c5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:55.946168 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4c69b2ee-1990-481f-95fe-18dbf911f4c5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081202 Jul 27 20:33:55.946726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1228/2467] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:55 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:33:56.339994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ce89451b-a7c6-4f71-b281-aa210e2b6a81 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:56.340534 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ce89451b-a7c6-4f71-b281-aa210e2b6a81 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:56.346561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ce89451b-a7c6-4f71-b281-aa210e2b6a81 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:56.347012 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ce89451b-a7c6-4f71-b281-aa210e2b6a81 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:56.347772 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ce89451b-a7c6-4f71-b281-aa210e2b6a81 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:56.348446 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ce89451b-a7c6-4f71-b281-aa210e2b6a81 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:56.367146 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:33:56.478949 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ce89451b-a7c6-4f71-b281-aa210e2b6a81 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:56.486855 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ce89451b-a7c6-4f71-b281-aa210e2b6a81 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150806 Jul 27 20:33:56.487421 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1240/2468] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:56 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:56.836524 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-19370de7-311d-4576-88a8-bea2d0ae3703 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:56.837158 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-19370de7-311d-4576-88a8-bea2d0ae3703 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:56.843172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19370de7-311d-4576-88a8-bea2d0ae3703 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:56.843618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19370de7-311d-4576-88a8-bea2d0ae3703 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:56.844366 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19370de7-311d-4576-88a8-bea2d0ae3703 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:56.844792 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19370de7-311d-4576-88a8-bea2d0ae3703 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:56.967789 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0a00c071-f426-4645-952d-83203d4cba80 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:56.968428 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0a00c071-f426-4645-952d-83203d4cba80 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:56.974664 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-19370de7-311d-4576-88a8-bea2d0ae3703 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:56.975384 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a00c071-f426-4645-952d-83203d4cba80 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:56.975964 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a00c071-f426-4645-952d-83203d4cba80 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:56.976755 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a00c071-f426-4645-952d-83203d4cba80 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:56.977226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a00c071-f426-4645-952d-83203d4cba80 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:56.982822 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-19370de7-311d-4576-88a8-bea2d0ae3703 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.150252 Jul 27 20:33:56.983389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1229/2469] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:56 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:57.042091 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0a00c071-f426-4645-952d-83203d4cba80 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:57.050115 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0a00c071-f426-4645-952d-83203d4cba80 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.086355 Jul 27 20:33:57.050682 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1241/2470] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:56 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:33:57.509204 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5518a247-cdbd-4f64-9a58-b2bf468d05f8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:57.509808 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5518a247-cdbd-4f64-9a58-b2bf468d05f8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:57.515797 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5518a247-cdbd-4f64-9a58-b2bf468d05f8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:57.516238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5518a247-cdbd-4f64-9a58-b2bf468d05f8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:57.517003 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5518a247-cdbd-4f64-9a58-b2bf468d05f8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:57.517453 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5518a247-cdbd-4f64-9a58-b2bf468d05f8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:57.648600 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5518a247-cdbd-4f64-9a58-b2bf468d05f8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:57.656601 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5518a247-cdbd-4f64-9a58-b2bf468d05f8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151232 Jul 27 20:33:57.657192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1230/2471] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:57 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:58.005076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3e0a5606-aed5-446a-9111-fed4e65f0aec tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:58.005680 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3e0a5606-aed5-446a-9111-fed4e65f0aec tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:58.014611 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3e0a5606-aed5-446a-9111-fed4e65f0aec tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:58.015073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3e0a5606-aed5-446a-9111-fed4e65f0aec tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:58.016356 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3e0a5606-aed5-446a-9111-fed4e65f0aec tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:58.016983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3e0a5606-aed5-446a-9111-fed4e65f0aec tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:58.073297 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-94ac5d49-7244-42cd-b764-a30d9888d44b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:58.074216 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-94ac5d49-7244-42cd-b764-a30d9888d44b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:58.081608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-94ac5d49-7244-42cd-b764-a30d9888d44b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:58.082140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-94ac5d49-7244-42cd-b764-a30d9888d44b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:58.083117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-94ac5d49-7244-42cd-b764-a30d9888d44b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:58.083641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-94ac5d49-7244-42cd-b764-a30d9888d44b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:58.155747 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-94ac5d49-7244-42cd-b764-a30d9888d44b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:58.167991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3e0a5606-aed5-446a-9111-fed4e65f0aec tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:58.168587 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-94ac5d49-7244-42cd-b764-a30d9888d44b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.099716 Jul 27 20:33:58.169537 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1231/2472] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:58 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:33:58.176656 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3e0a5606-aed5-446a-9111-fed4e65f0aec tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.175180 Jul 27 20:33:58.177233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1242/2473] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:57 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:58.678345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-43db7e7d-d766-4367-bd5c-c5e37a41b93d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:58.678948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-43db7e7d-d766-4367-bd5c-c5e37a41b93d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:58.684873 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43db7e7d-d766-4367-bd5c-c5e37a41b93d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:58.685353 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43db7e7d-d766-4367-bd5c-c5e37a41b93d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:58.686102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43db7e7d-d766-4367-bd5c-c5e37a41b93d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:58.686533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43db7e7d-d766-4367-bd5c-c5e37a41b93d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:58.826799 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-43db7e7d-d766-4367-bd5c-c5e37a41b93d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:58.834918 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-43db7e7d-d766-4367-bd5c-c5e37a41b93d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.161182 Jul 27 20:33:58.835473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1232/2474] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:58 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:59.196384 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-53158772-46ba-418e-8f2a-99f1515e50af tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:59.197009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-53158772-46ba-418e-8f2a-99f1515e50af tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:59.197828 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-abd4bc81-70c4-4ab3-9b68-c9f8e49551d7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:59.198371 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-abd4bc81-70c4-4ab3-9b68-c9f8e49551d7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:59.199311 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=80 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:33:59.205011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-53158772-46ba-418e-8f2a-99f1515e50af tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:59.205343 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-abd4bc81-70c4-4ab3-9b68-c9f8e49551d7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:59.205470 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-53158772-46ba-418e-8f2a-99f1515e50af tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:59.205796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-abd4bc81-70c4-4ab3-9b68-c9f8e49551d7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:59.206207 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-53158772-46ba-418e-8f2a-99f1515e50af tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:59.206563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-abd4bc81-70c4-4ab3-9b68-c9f8e49551d7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:59.206668 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-53158772-46ba-418e-8f2a-99f1515e50af tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:59.207002 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-abd4bc81-70c4-4ab3-9b68-c9f8e49551d7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:59.268439 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-53158772-46ba-418e-8f2a-99f1515e50af tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:59.276632 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-53158772-46ba-418e-8f2a-99f1515e50af tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084190 Jul 27 20:33:59.277234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1243/2475] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:59 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:33:59.337238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-abd4bc81-70c4-4ab3-9b68-c9f8e49551d7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:33:59.345154 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-abd4bc81-70c4-4ab3-9b68-c9f8e49551d7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.151122 Jul 27 20:33:59.345733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1233/2476] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:59 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:33:59.855465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-88389d9c-0b22-4e45-aff0-6b87a047d1bb tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:33:59.856002 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-88389d9c-0b22-4e45-aff0-6b87a047d1bb tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:33:59.862067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88389d9c-0b22-4e45-aff0-6b87a047d1bb tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:59.862553 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88389d9c-0b22-4e45-aff0-6b87a047d1bb tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:59.863324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88389d9c-0b22-4e45-aff0-6b87a047d1bb tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:33:59.863768 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88389d9c-0b22-4e45-aff0-6b87a047d1bb tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:33:59.995413 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-88389d9c-0b22-4e45-aff0-6b87a047d1bb tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:00.003296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-88389d9c-0b22-4e45-aff0-6b87a047d1bb tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151781 Jul 27 20:34:00.003854 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1244/2477] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:33:59 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:00.298278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2441a508-bd41-4418-b3de-bfa76fb88e68 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:00.298894 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2441a508-bd41-4418-b3de-bfa76fb88e68 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:00.301730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=80 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:00.307223 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2441a508-bd41-4418-b3de-bfa76fb88e68 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:00.307678 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2441a508-bd41-4418-b3de-bfa76fb88e68 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:00.308444 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2441a508-bd41-4418-b3de-bfa76fb88e68 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:00.309021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2441a508-bd41-4418-b3de-bfa76fb88e68 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:00.368120 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2fbc23c0-edd5-4bf2-a10d-735293d01dbd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:00.368599 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2fbc23c0-edd5-4bf2-a10d-735293d01dbd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:00.370224 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2441a508-bd41-4418-b3de-bfa76fb88e68 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:00.375162 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2fbc23c0-edd5-4bf2-a10d-735293d01dbd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:00.375618 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2fbc23c0-edd5-4bf2-a10d-735293d01dbd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:00.376388 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2fbc23c0-edd5-4bf2-a10d-735293d01dbd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:00.376838 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2fbc23c0-edd5-4bf2-a10d-735293d01dbd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:00.378136 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2441a508-bd41-4418-b3de-bfa76fb88e68 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083788 Jul 27 20:34:00.378701 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1234/2478] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:00 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:00.506191 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2fbc23c0-edd5-4bf2-a10d-735293d01dbd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:00.514240 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2fbc23c0-edd5-4bf2-a10d-735293d01dbd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.150972 Jul 27 20:34:00.514808 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1245/2479] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:00 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:34:01.025592 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f3a6f386-b583-440b-92fa-98647ee113b7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:01.026209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f3a6f386-b583-440b-92fa-98647ee113b7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:01.032252 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3a6f386-b583-440b-92fa-98647ee113b7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:01.032705 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3a6f386-b583-440b-92fa-98647ee113b7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:01.033499 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3a6f386-b583-440b-92fa-98647ee113b7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:01.033940 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3a6f386-b583-440b-92fa-98647ee113b7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:01.166348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f3a6f386-b583-440b-92fa-98647ee113b7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:01.174294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f3a6f386-b583-440b-92fa-98647ee113b7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152704 Jul 27 20:34:01.174855 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1235/2480] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:01 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:01.399725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2eac0651-4f4a-4668-885c-78fc966bbdd7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:01.400343 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2eac0651-4f4a-4668-885c-78fc966bbdd7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:01.406849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2eac0651-4f4a-4668-885c-78fc966bbdd7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:01.407304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2eac0651-4f4a-4668-885c-78fc966bbdd7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:01.408062 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2eac0651-4f4a-4668-885c-78fc966bbdd7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:01.408506 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2eac0651-4f4a-4668-885c-78fc966bbdd7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:01.476098 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2eac0651-4f4a-4668-885c-78fc966bbdd7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:01.484105 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2eac0651-4f4a-4668-885c-78fc966bbdd7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.088309 Jul 27 20:34:01.484664 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1246/2481] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:01 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:01.536667 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-838e6307-5817-43cb-9822-3581e140726c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:01.537290 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-838e6307-5817-43cb-9822-3581e140726c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:01.543702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-838e6307-5817-43cb-9822-3581e140726c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:01.544140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-838e6307-5817-43cb-9822-3581e140726c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:01.544885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-838e6307-5817-43cb-9822-3581e140726c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:01.545350 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-838e6307-5817-43cb-9822-3581e140726c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:01.672734 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-838e6307-5817-43cb-9822-3581e140726c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:01.680653 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-838e6307-5817-43cb-9822-3581e140726c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.148447 Jul 27 20:34:01.681239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1236/2482] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:01 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:02.196127 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7259ed38-e5ff-4e47-a7ad-0dc9e27e38a6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:02.196766 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7259ed38-e5ff-4e47-a7ad-0dc9e27e38a6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:02.203036 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7259ed38-e5ff-4e47-a7ad-0dc9e27e38a6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:02.203483 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7259ed38-e5ff-4e47-a7ad-0dc9e27e38a6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:02.204240 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7259ed38-e5ff-4e47-a7ad-0dc9e27e38a6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:02.204675 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7259ed38-e5ff-4e47-a7ad-0dc9e27e38a6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:02.332012 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7259ed38-e5ff-4e47-a7ad-0dc9e27e38a6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:02.340843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7259ed38-e5ff-4e47-a7ad-0dc9e27e38a6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149272 Jul 27 20:34:02.341448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1247/2483] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:02 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:02.510641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b121bc28-515f-477f-b831-85d339c781d4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:02.511259 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b121bc28-515f-477f-b831-85d339c781d4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:02.517332 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b121bc28-515f-477f-b831-85d339c781d4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:02.517785 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b121bc28-515f-477f-b831-85d339c781d4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:02.518550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b121bc28-515f-477f-b831-85d339c781d4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:02.518988 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b121bc28-515f-477f-b831-85d339c781d4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:02.580821 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b121bc28-515f-477f-b831-85d339c781d4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:02.588723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b121bc28-515f-477f-b831-85d339c781d4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082101 Jul 27 20:34:02.589343 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1237/2484] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:02 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:02.702014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1cb55149-bc45-4fd5-b8c5-d67bf76698fd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:02.702890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1cb55149-bc45-4fd5-b8c5-d67bf76698fd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:02.709318 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1cb55149-bc45-4fd5-b8c5-d67bf76698fd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:02.709785 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1cb55149-bc45-4fd5-b8c5-d67bf76698fd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:02.710585 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1cb55149-bc45-4fd5-b8c5-d67bf76698fd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:02.711030 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1cb55149-bc45-4fd5-b8c5-d67bf76698fd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:02.836502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1cb55149-bc45-4fd5-b8c5-d67bf76698fd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:02.844333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1cb55149-bc45-4fd5-b8c5-d67bf76698fd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.146186 Jul 27 20:34:02.844891 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1248/2485] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:02 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:03.361541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-33053e61-049d-49e8-9f98-f447a0899cc6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:03.362157 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-33053e61-049d-49e8-9f98-f447a0899cc6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:03.368636 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33053e61-049d-49e8-9f98-f447a0899cc6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:03.369121 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33053e61-049d-49e8-9f98-f447a0899cc6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:03.369893 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33053e61-049d-49e8-9f98-f447a0899cc6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:03.370329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33053e61-049d-49e8-9f98-f447a0899cc6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:03.502163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-33053e61-049d-49e8-9f98-f447a0899cc6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:03.510609 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-33053e61-049d-49e8-9f98-f447a0899cc6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152999 Jul 27 20:34:03.511176 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1238/2486] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:03 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:03.609623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b54475df-b66f-4f89-9056-bf299df8a10e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:03.610239 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b54475df-b66f-4f89-9056-bf299df8a10e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:03.616993 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b54475df-b66f-4f89-9056-bf299df8a10e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:03.617391 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b54475df-b66f-4f89-9056-bf299df8a10e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:03.618145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b54475df-b66f-4f89-9056-bf299df8a10e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:03.618583 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b54475df-b66f-4f89-9056-bf299df8a10e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:03.679204 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b54475df-b66f-4f89-9056-bf299df8a10e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:03.687010 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b54475df-b66f-4f89-9056-bf299df8a10e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081240 Jul 27 20:34:03.687568 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1249/2487] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:03 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:03.865906 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-471a84b5-18bc-4536-974c-f5df1f3d2cba tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:03.866518 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-471a84b5-18bc-4536-974c-f5df1f3d2cba tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:03.873154 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-471a84b5-18bc-4536-974c-f5df1f3d2cba tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:03.873546 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-471a84b5-18bc-4536-974c-f5df1f3d2cba tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:03.874300 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-471a84b5-18bc-4536-974c-f5df1f3d2cba tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:03.874734 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-471a84b5-18bc-4536-974c-f5df1f3d2cba tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:04.011782 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-471a84b5-18bc-4536-974c-f5df1f3d2cba tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:04.020177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-471a84b5-18bc-4536-974c-f5df1f3d2cba tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.158273 Jul 27 20:34:04.020853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1239/2488] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:03 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:04.533185 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-828463f8-a2c8-49f2-a50e-41941ecf053c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:04.533807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-828463f8-a2c8-49f2-a50e-41941ecf053c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:04.539988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-828463f8-a2c8-49f2-a50e-41941ecf053c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:04.540444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-828463f8-a2c8-49f2-a50e-41941ecf053c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:04.541242 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-828463f8-a2c8-49f2-a50e-41941ecf053c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:04.541682 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-828463f8-a2c8-49f2-a50e-41941ecf053c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:04.668955 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-828463f8-a2c8-49f2-a50e-41941ecf053c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:04.677468 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-828463f8-a2c8-49f2-a50e-41941ecf053c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148236 Jul 27 20:34:04.678035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1250/2489] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:04 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:04.708066 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8b4f601c-6d1c-4dde-b7b2-69ff1ca811b3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:04.708686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8b4f601c-6d1c-4dde-b7b2-69ff1ca811b3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:04.714657 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b4f601c-6d1c-4dde-b7b2-69ff1ca811b3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:04.715109 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b4f601c-6d1c-4dde-b7b2-69ff1ca811b3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:04.715871 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b4f601c-6d1c-4dde-b7b2-69ff1ca811b3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:04.716312 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b4f601c-6d1c-4dde-b7b2-69ff1ca811b3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:04.777133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8b4f601c-6d1c-4dde-b7b2-69ff1ca811b3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:04.785046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8b4f601c-6d1c-4dde-b7b2-69ff1ca811b3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081033 Jul 27 20:34:04.785756 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1240/2490] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:04 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:05.042607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d9b4f20c-c4a4-47d2-bc7a-5d129fde3df4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:05.043318 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d9b4f20c-c4a4-47d2-bc7a-5d129fde3df4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:05.049829 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d9b4f20c-c4a4-47d2-bc7a-5d129fde3df4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:05.050289 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d9b4f20c-c4a4-47d2-bc7a-5d129fde3df4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:05.051630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d9b4f20c-c4a4-47d2-bc7a-5d129fde3df4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:05.052129 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d9b4f20c-c4a4-47d2-bc7a-5d129fde3df4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:05.178785 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d9b4f20c-c4a4-47d2-bc7a-5d129fde3df4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:05.186687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d9b4f20c-c4a4-47d2-bc7a-5d129fde3df4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.148688 Jul 27 20:34:05.187258 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1251/2491] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:05 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:05.698787 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d42d8ec0-9f70-4779-b102-e34ebcf25817 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:05.699413 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d42d8ec0-9f70-4779-b102-e34ebcf25817 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:05.706212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d42d8ec0-9f70-4779-b102-e34ebcf25817 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:05.706659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d42d8ec0-9f70-4779-b102-e34ebcf25817 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:05.707506 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d42d8ec0-9f70-4779-b102-e34ebcf25817 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:05.707946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d42d8ec0-9f70-4779-b102-e34ebcf25817 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:05.805806 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a385396e-4b36-4861-ba2e-623b80c00ee1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:05.806346 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a385396e-4b36-4861-ba2e-623b80c00ee1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:05.812831 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a385396e-4b36-4861-ba2e-623b80c00ee1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:05.813356 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a385396e-4b36-4861-ba2e-623b80c00ee1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:05.814132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a385396e-4b36-4861-ba2e-623b80c00ee1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:05.814573 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a385396e-4b36-4861-ba2e-623b80c00ee1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:05.838866 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d42d8ec0-9f70-4779-b102-e34ebcf25817 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:05.846996 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d42d8ec0-9f70-4779-b102-e34ebcf25817 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152070 Jul 27 20:34:05.847576 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1241/2492] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:05 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:05.876333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a385396e-4b36-4861-ba2e-623b80c00ee1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:05.884412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a385396e-4b36-4861-ba2e-623b80c00ee1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083134 Jul 27 20:34:05.884999 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1252/2493] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:05 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:34:06.209208 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9fb45fa0-f48d-4380-8071-63c49861d044 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:06.209821 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9fb45fa0-f48d-4380-8071-63c49861d044 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:06.215832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9fb45fa0-f48d-4380-8071-63c49861d044 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:06.216279 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9fb45fa0-f48d-4380-8071-63c49861d044 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:06.217062 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9fb45fa0-f48d-4380-8071-63c49861d044 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:06.217502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9fb45fa0-f48d-4380-8071-63c49861d044 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:06.345914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9fb45fa0-f48d-4380-8071-63c49861d044 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:06.354829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9fb45fa0-f48d-4380-8071-63c49861d044 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.150066 Jul 27 20:34:06.355390 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1242/2494] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:06 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:06.868450 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-312f89da-6f3d-477c-9714-ebdc784f1b79 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:06.869093 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-312f89da-6f3d-477c-9714-ebdc784f1b79 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:06.875643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-312f89da-6f3d-477c-9714-ebdc784f1b79 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:06.876104 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-312f89da-6f3d-477c-9714-ebdc784f1b79 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:06.876867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-312f89da-6f3d-477c-9714-ebdc784f1b79 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:06.877343 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-312f89da-6f3d-477c-9714-ebdc784f1b79 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:06.905236 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-62c8e6f6-a6ed-41cd-a9bf-99a10a03081c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:06.905839 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-62c8e6f6-a6ed-41cd-a9bf-99a10a03081c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:06.912280 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-62c8e6f6-a6ed-41cd-a9bf-99a10a03081c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:06.912719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-62c8e6f6-a6ed-41cd-a9bf-99a10a03081c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:06.913529 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-62c8e6f6-a6ed-41cd-a9bf-99a10a03081c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:06.913928 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-62c8e6f6-a6ed-41cd-a9bf-99a10a03081c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:06.933895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:06.982068 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-62c8e6f6-a6ed-41cd-a9bf-99a10a03081c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:06.990456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-62c8e6f6-a6ed-41cd-a9bf-99a10a03081c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.088999 Jul 27 20:34:06.991274 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1243/2495] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:06 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:34:07.014514 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-312f89da-6f3d-477c-9714-ebdc784f1b79 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:07.023622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-312f89da-6f3d-477c-9714-ebdc784f1b79 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.159043 Jul 27 20:34:07.024197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1253/2496] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:06 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:07.375378 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-374f163c-9f65-4791-8958-90f38c6354b1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:07.375983 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-374f163c-9f65-4791-8958-90f38c6354b1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:07.382031 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-374f163c-9f65-4791-8958-90f38c6354b1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:07.382473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-374f163c-9f65-4791-8958-90f38c6354b1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:07.383219 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-374f163c-9f65-4791-8958-90f38c6354b1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:07.383650 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-374f163c-9f65-4791-8958-90f38c6354b1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:07.510588 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-374f163c-9f65-4791-8958-90f38c6354b1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:07.518473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-374f163c-9f65-4791-8958-90f38c6354b1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.146914 Jul 27 20:34:07.519038 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1244/2497] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:07 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:08.011157 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b3244896-0d38-4f9d-88b4-cc721edf09aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:08.011779 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b3244896-0d38-4f9d-88b4-cc721edf09aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:08.018329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b3244896-0d38-4f9d-88b4-cc721edf09aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:08.018791 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b3244896-0d38-4f9d-88b4-cc721edf09aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:08.019666 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b3244896-0d38-4f9d-88b4-cc721edf09aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:08.020117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b3244896-0d38-4f9d-88b4-cc721edf09aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:08.044163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8cba4080-d54d-44b8-a4ad-b20181502bff tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:08.044782 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8cba4080-d54d-44b8-a4ad-b20181502bff tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:08.051847 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8cba4080-d54d-44b8-a4ad-b20181502bff tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:08.052464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8cba4080-d54d-44b8-a4ad-b20181502bff tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:08.053264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8cba4080-d54d-44b8-a4ad-b20181502bff tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:08.053708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8cba4080-d54d-44b8-a4ad-b20181502bff tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:08.081866 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b3244896-0d38-4f9d-88b4-cc721edf09aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:08.090227 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b3244896-0d38-4f9d-88b4-cc721edf09aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082967 Jul 27 20:34:08.091020 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1254/2498] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:08 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:08.181848 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8cba4080-d54d-44b8-a4ad-b20181502bff tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:08.189689 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8cba4080-d54d-44b8-a4ad-b20181502bff tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149309 Jul 27 20:34:08.190254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1245/2499] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:08 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:34:08.542106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f48c2b1d-7aa1-403a-9a1f-4e61911fc8da tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:08.542722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f48c2b1d-7aa1-403a-9a1f-4e61911fc8da tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:08.548736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f48c2b1d-7aa1-403a-9a1f-4e61911fc8da tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:08.549230 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f48c2b1d-7aa1-403a-9a1f-4e61911fc8da tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:08.549996 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f48c2b1d-7aa1-403a-9a1f-4e61911fc8da tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:08.550439 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f48c2b1d-7aa1-403a-9a1f-4e61911fc8da tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:08.678439 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f48c2b1d-7aa1-403a-9a1f-4e61911fc8da tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:08.686379 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f48c2b1d-7aa1-403a-9a1f-4e61911fc8da tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.148208 Jul 27 20:34:08.686947 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1255/2500] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:08 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:09.111567 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-074c8568-1568-4dc9-a5d7-032adcc57c43 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:09.112174 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-074c8568-1568-4dc9-a5d7-032adcc57c43 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:09.119289 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-074c8568-1568-4dc9-a5d7-032adcc57c43 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:09.119746 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-074c8568-1568-4dc9-a5d7-032adcc57c43 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:09.120508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-074c8568-1568-4dc9-a5d7-032adcc57c43 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:09.120950 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-074c8568-1568-4dc9-a5d7-032adcc57c43 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:09.184338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-074c8568-1568-4dc9-a5d7-032adcc57c43 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:09.192913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-074c8568-1568-4dc9-a5d7-032adcc57c43 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085173 Jul 27 20:34:09.193578 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1246/2501] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:09 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:09.211114 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ca2f0f5c-e2fe-4627-a3b1-36ccda92ba20 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:09.211761 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ca2f0f5c-e2fe-4627-a3b1-36ccda92ba20 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:09.217738 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ca2f0f5c-e2fe-4627-a3b1-36ccda92ba20 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:09.218184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ca2f0f5c-e2fe-4627-a3b1-36ccda92ba20 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:09.218939 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ca2f0f5c-e2fe-4627-a3b1-36ccda92ba20 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:09.219369 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ca2f0f5c-e2fe-4627-a3b1-36ccda92ba20 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:09.345776 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ca2f0f5c-e2fe-4627-a3b1-36ccda92ba20 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:09.353704 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ca2f0f5c-e2fe-4627-a3b1-36ccda92ba20 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.146897 Jul 27 20:34:09.354254 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1256/2502] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:09 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:09.707925 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e9bedd02-15d2-4302-9463-f2dab96b111b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:09.708530 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e9bedd02-15d2-4302-9463-f2dab96b111b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:09.714698 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e9bedd02-15d2-4302-9463-f2dab96b111b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:09.715146 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e9bedd02-15d2-4302-9463-f2dab96b111b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:09.715901 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e9bedd02-15d2-4302-9463-f2dab96b111b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:09.716338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e9bedd02-15d2-4302-9463-f2dab96b111b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:09.845453 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e9bedd02-15d2-4302-9463-f2dab96b111b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:09.854163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e9bedd02-15d2-4302-9463-f2dab96b111b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.150277 Jul 27 20:34:09.854729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1247/2503] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:09 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:10.214525 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ea176057-a510-4406-a150-7dd88ec57f57 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:10.215151 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ea176057-a510-4406-a150-7dd88ec57f57 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:10.221741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ea176057-a510-4406-a150-7dd88ec57f57 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:10.222196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ea176057-a510-4406-a150-7dd88ec57f57 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:10.223538 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ea176057-a510-4406-a150-7dd88ec57f57 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:10.223983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ea176057-a510-4406-a150-7dd88ec57f57 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:10.227863 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:10.284770 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ea176057-a510-4406-a150-7dd88ec57f57 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:10.292703 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ea176057-a510-4406-a150-7dd88ec57f57 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082170 Jul 27 20:34:10.293292 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1257/2504] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:10 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:10.375079 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bc8de851-23cb-41fe-8f34-6d1f5e4eab3a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:10.375624 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bc8de851-23cb-41fe-8f34-6d1f5e4eab3a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:10.382882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc8de851-23cb-41fe-8f34-6d1f5e4eab3a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:10.383336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc8de851-23cb-41fe-8f34-6d1f5e4eab3a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:10.384102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc8de851-23cb-41fe-8f34-6d1f5e4eab3a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:10.384534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc8de851-23cb-41fe-8f34-6d1f5e4eab3a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:10.513665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bc8de851-23cb-41fe-8f34-6d1f5e4eab3a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:10.522505 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bc8de851-23cb-41fe-8f34-6d1f5e4eab3a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151321 Jul 27 20:34:10.523082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1248/2505] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:10 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:10.875549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1997cbad-a519-4d6d-85ab-125b2f7f6534 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:10.876164 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1997cbad-a519-4d6d-85ab-125b2f7f6534 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:10.883063 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1997cbad-a519-4d6d-85ab-125b2f7f6534 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:10.883522 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1997cbad-a519-4d6d-85ab-125b2f7f6534 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:10.884294 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1997cbad-a519-4d6d-85ab-125b2f7f6534 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:10.884741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1997cbad-a519-4d6d-85ab-125b2f7f6534 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:11.012230 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1997cbad-a519-4d6d-85ab-125b2f7f6534 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:11.020274 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1997cbad-a519-4d6d-85ab-125b2f7f6534 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.148635 Jul 27 20:34:11.020865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1258/2506] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:10 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:11.312782 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-290aa97c-f346-48aa-857a-12bf6ddf1209 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:11.313421 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-290aa97c-f346-48aa-857a-12bf6ddf1209 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:11.319430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-290aa97c-f346-48aa-857a-12bf6ddf1209 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:11.319884 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-290aa97c-f346-48aa-857a-12bf6ddf1209 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:11.320644 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-290aa97c-f346-48aa-857a-12bf6ddf1209 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:11.321112 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-290aa97c-f346-48aa-857a-12bf6ddf1209 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:11.386935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-290aa97c-f346-48aa-857a-12bf6ddf1209 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:11.395437 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-290aa97c-f346-48aa-857a-12bf6ddf1209 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.086564 Jul 27 20:34:11.396001 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1249/2507] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:11 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:11.543808 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f1776210-84e7-4c47-a954-1369efce5160 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:11.544409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f1776210-84e7-4c47-a954-1369efce5160 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:11.551417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f1776210-84e7-4c47-a954-1369efce5160 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:11.552038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f1776210-84e7-4c47-a954-1369efce5160 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:11.552795 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f1776210-84e7-4c47-a954-1369efce5160 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:11.553263 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f1776210-84e7-4c47-a954-1369efce5160 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:11.683545 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f1776210-84e7-4c47-a954-1369efce5160 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:11.692157 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f1776210-84e7-4c47-a954-1369efce5160 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151487 Jul 27 20:34:11.692764 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1259/2508] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:11 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:12.042252 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-245c0e9d-2cbc-48ed-8ccf-662e133841ec tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:12.043140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-245c0e9d-2cbc-48ed-8ccf-662e133841ec tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:12.049588 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-245c0e9d-2cbc-48ed-8ccf-662e133841ec tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:12.050028 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-245c0e9d-2cbc-48ed-8ccf-662e133841ec tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:12.051665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-245c0e9d-2cbc-48ed-8ccf-662e133841ec tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:12.052096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-245c0e9d-2cbc-48ed-8ccf-662e133841ec tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:12.181228 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-245c0e9d-2cbc-48ed-8ccf-662e133841ec tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:12.189168 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-245c0e9d-2cbc-48ed-8ccf-662e133841ec tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.150962 Jul 27 20:34:12.189737 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1250/2509] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:12 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:12.416601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-91ede69a-0b22-4279-b665-247deec5b879 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:12.417269 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-91ede69a-0b22-4279-b665-247deec5b879 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:12.423334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-91ede69a-0b22-4279-b665-247deec5b879 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:12.423808 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-91ede69a-0b22-4279-b665-247deec5b879 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:12.424552 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-91ede69a-0b22-4279-b665-247deec5b879 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:12.425017 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-91ede69a-0b22-4279-b665-247deec5b879 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:12.487609 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-91ede69a-0b22-4279-b665-247deec5b879 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:12.495779 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-91ede69a-0b22-4279-b665-247deec5b879 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083004 Jul 27 20:34:12.496353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1260/2510] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:12 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:12.713297 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4c36f4f3-b10d-467e-811a-383410efe350 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:12.713833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4c36f4f3-b10d-467e-811a-383410efe350 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:12.720275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c36f4f3-b10d-467e-811a-383410efe350 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:12.720727 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c36f4f3-b10d-467e-811a-383410efe350 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:12.721522 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c36f4f3-b10d-467e-811a-383410efe350 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:12.721958 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c36f4f3-b10d-467e-811a-383410efe350 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:12.852119 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4c36f4f3-b10d-467e-811a-383410efe350 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:12.859905 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4c36f4f3-b10d-467e-811a-383410efe350 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150732 Jul 27 20:34:12.860468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1251/2511] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:12 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:13.210732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7b33fece-c053-4b52-a8db-8506728111a0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:13.211367 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7b33fece-c053-4b52-a8db-8506728111a0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:13.217774 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7b33fece-c053-4b52-a8db-8506728111a0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:13.218221 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7b33fece-c053-4b52-a8db-8506728111a0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:13.218972 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7b33fece-c053-4b52-a8db-8506728111a0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:13.219408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7b33fece-c053-4b52-a8db-8506728111a0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:13.348771 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7b33fece-c053-4b52-a8db-8506728111a0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:13.356589 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7b33fece-c053-4b52-a8db-8506728111a0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.149860 Jul 27 20:34:13.357241 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1261/2512] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:13 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:13.517036 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c99284ad-b9d5-4a54-af86-c6c8cc831391 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:13.517648 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c99284ad-b9d5-4a54-af86-c6c8cc831391 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:13.524211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c99284ad-b9d5-4a54-af86-c6c8cc831391 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:13.524659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c99284ad-b9d5-4a54-af86-c6c8cc831391 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:13.525441 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c99284ad-b9d5-4a54-af86-c6c8cc831391 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:13.525875 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c99284ad-b9d5-4a54-af86-c6c8cc831391 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:13.590093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c99284ad-b9d5-4a54-af86-c6c8cc831391 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:13.598436 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c99284ad-b9d5-4a54-af86-c6c8cc831391 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085161 Jul 27 20:34:13.598922 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1252/2513] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:13 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:13.881716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e8435c62-aa36-4a3e-b403-8d8a3ebb3e6d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:13.882275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e8435c62-aa36-4a3e-b403-8d8a3ebb3e6d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:13.888289 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8435c62-aa36-4a3e-b403-8d8a3ebb3e6d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:13.888737 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8435c62-aa36-4a3e-b403-8d8a3ebb3e6d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:13.889522 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8435c62-aa36-4a3e-b403-8d8a3ebb3e6d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:13.889957 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8435c62-aa36-4a3e-b403-8d8a3ebb3e6d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:14.017501 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e8435c62-aa36-4a3e-b403-8d8a3ebb3e6d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:14.025428 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e8435c62-aa36-4a3e-b403-8d8a3ebb3e6d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148321 Jul 27 20:34:14.026024 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1262/2514] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:13 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:14.377226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8dc78626-94b7-4fea-a982-7c5069f72402 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:14.377844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8dc78626-94b7-4fea-a982-7c5069f72402 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:14.384357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8dc78626-94b7-4fea-a982-7c5069f72402 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:14.384805 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8dc78626-94b7-4fea-a982-7c5069f72402 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:14.385603 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8dc78626-94b7-4fea-a982-7c5069f72402 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:14.386074 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8dc78626-94b7-4fea-a982-7c5069f72402 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:14.513811 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8dc78626-94b7-4fea-a982-7c5069f72402 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:14.522310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8dc78626-94b7-4fea-a982-7c5069f72402 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.148904 Jul 27 20:34:14.522876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1253/2515] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:14 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:14.623770 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-19bbbcad-eb2a-4481-9c07-95c65bc02b9d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:14.624321 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-19bbbcad-eb2a-4481-9c07-95c65bc02b9d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:14.631096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19bbbcad-eb2a-4481-9c07-95c65bc02b9d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:14.631554 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19bbbcad-eb2a-4481-9c07-95c65bc02b9d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:14.632356 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19bbbcad-eb2a-4481-9c07-95c65bc02b9d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:14.632851 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19bbbcad-eb2a-4481-9c07-95c65bc02b9d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:14.693430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-19bbbcad-eb2a-4481-9c07-95c65bc02b9d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:14.701354 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-19bbbcad-eb2a-4481-9c07-95c65bc02b9d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081632 Jul 27 20:34:14.701922 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1263/2516] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:14 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:15.046837 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2fc3d23b-b85f-422f-bca3-d3e6992096c5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:15.047477 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2fc3d23b-b85f-422f-bca3-d3e6992096c5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:15.053663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fc3d23b-b85f-422f-bca3-d3e6992096c5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:15.054109 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fc3d23b-b85f-422f-bca3-d3e6992096c5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:15.054860 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fc3d23b-b85f-422f-bca3-d3e6992096c5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:15.055295 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fc3d23b-b85f-422f-bca3-d3e6992096c5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:15.182048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2fc3d23b-b85f-422f-bca3-d3e6992096c5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:15.189823 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2fc3d23b-b85f-422f-bca3-d3e6992096c5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.146888 Jul 27 20:34:15.190383 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1254/2517] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:15 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:15.544148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ad635f3f-e2d3-4b1c-a346-1fb9f89c597d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:15.544764 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ad635f3f-e2d3-4b1c-a346-1fb9f89c597d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:15.551473 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ad635f3f-e2d3-4b1c-a346-1fb9f89c597d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:15.551929 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ad635f3f-e2d3-4b1c-a346-1fb9f89c597d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:15.552687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ad635f3f-e2d3-4b1c-a346-1fb9f89c597d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:15.553156 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ad635f3f-e2d3-4b1c-a346-1fb9f89c597d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:15.684092 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ad635f3f-e2d3-4b1c-a346-1fb9f89c597d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:15.692079 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ad635f3f-e2d3-4b1c-a346-1fb9f89c597d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.151802 Jul 27 20:34:15.692647 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1264/2518] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:15 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:15.723154 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c1f3e3ee-f4b9-48bd-ad1f-5bdb0df5fcfc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:15.723761 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c1f3e3ee-f4b9-48bd-ad1f-5bdb0df5fcfc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:15.730180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1f3e3ee-f4b9-48bd-ad1f-5bdb0df5fcfc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:15.730621 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1f3e3ee-f4b9-48bd-ad1f-5bdb0df5fcfc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:15.731403 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1f3e3ee-f4b9-48bd-ad1f-5bdb0df5fcfc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:15.731837 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c1f3e3ee-f4b9-48bd-ad1f-5bdb0df5fcfc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:15.795794 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c1f3e3ee-f4b9-48bd-ad1f-5bdb0df5fcfc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:15.804220 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c1f3e3ee-f4b9-48bd-ad1f-5bdb0df5fcfc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085512 Jul 27 20:34:15.804780 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1255/2519] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:15 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:16.212075 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ded70d2c-91dc-42b4-b0a0-37cf6da9a805 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:16.212685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ded70d2c-91dc-42b4-b0a0-37cf6da9a805 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:16.218717 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ded70d2c-91dc-42b4-b0a0-37cf6da9a805 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:16.219160 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ded70d2c-91dc-42b4-b0a0-37cf6da9a805 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:16.219911 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ded70d2c-91dc-42b4-b0a0-37cf6da9a805 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:16.220352 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ded70d2c-91dc-42b4-b0a0-37cf6da9a805 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:16.346824 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ded70d2c-91dc-42b4-b0a0-37cf6da9a805 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:16.354892 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ded70d2c-91dc-42b4-b0a0-37cf6da9a805 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.146707 Jul 27 20:34:16.355458 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1265/2520] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:16 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:16.713578 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-accac489-f9de-499f-b6f0-0dd4be02c021 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:16.714211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-accac489-f9de-499f-b6f0-0dd4be02c021 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:16.720215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-accac489-f9de-499f-b6f0-0dd4be02c021 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:16.720659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-accac489-f9de-499f-b6f0-0dd4be02c021 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:16.721436 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-accac489-f9de-499f-b6f0-0dd4be02c021 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:16.721864 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-accac489-f9de-499f-b6f0-0dd4be02c021 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:16.824378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f91d21de-1e45-4d4d-b963-3203407c81a4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:16.825148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f91d21de-1e45-4d4d-b963-3203407c81a4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:16.831945 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f91d21de-1e45-4d4d-b963-3203407c81a4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:16.832465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f91d21de-1e45-4d4d-b963-3203407c81a4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:16.833342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f91d21de-1e45-4d4d-b963-3203407c81a4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:16.833853 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f91d21de-1e45-4d4d-b963-3203407c81a4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:16.856015 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-accac489-f9de-499f-b6f0-0dd4be02c021 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:16.864541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-accac489-f9de-499f-b6f0-0dd4be02c021 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.154770 Jul 27 20:34:16.865135 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1256/2521] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:16 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:16.896185 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f91d21de-1e45-4d4d-b963-3203407c81a4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:16.904231 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f91d21de-1e45-4d4d-b963-3203407c81a4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083844 Jul 27 20:34:16.904796 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1266/2522] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:16 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:34:17.375719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cdd13525-411d-4710-9a94-d421fda0b69e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:17.376293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cdd13525-411d-4710-9a94-d421fda0b69e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:17.382512 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdd13525-411d-4710-9a94-d421fda0b69e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:17.382963 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdd13525-411d-4710-9a94-d421fda0b69e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:17.383759 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdd13525-411d-4710-9a94-d421fda0b69e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:17.384196 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdd13525-411d-4710-9a94-d421fda0b69e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:17.516321 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cdd13525-411d-4710-9a94-d421fda0b69e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:17.524830 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cdd13525-411d-4710-9a94-d421fda0b69e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153081 Jul 27 20:34:17.525428 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1257/2523] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:17 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:17.886007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-be5ee329-db0d-4c9f-97b2-6009de7840f5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:17.886631 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-be5ee329-db0d-4c9f-97b2-6009de7840f5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:17.893269 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-be5ee329-db0d-4c9f-97b2-6009de7840f5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:17.893728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-be5ee329-db0d-4c9f-97b2-6009de7840f5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:17.895268 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-be5ee329-db0d-4c9f-97b2-6009de7840f5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:17.895720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-be5ee329-db0d-4c9f-97b2-6009de7840f5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:17.924844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4affc64c-f6ed-4e45-b6e4-f8b76b8679c8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:17.925559 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4affc64c-f6ed-4e45-b6e4-f8b76b8679c8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:17.931539 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4affc64c-f6ed-4e45-b6e4-f8b76b8679c8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:17.931999 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4affc64c-f6ed-4e45-b6e4-f8b76b8679c8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:17.932735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4affc64c-f6ed-4e45-b6e4-f8b76b8679c8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:17.933189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4affc64c-f6ed-4e45-b6e4-f8b76b8679c8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:18.000913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4affc64c-f6ed-4e45-b6e4-f8b76b8679c8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:18.009439 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4affc64c-f6ed-4e45-b6e4-f8b76b8679c8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.088388 Jul 27 20:34:18.010006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1258/2524] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:17 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:34:18.027583 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-be5ee329-db0d-4c9f-97b2-6009de7840f5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:18.035521 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-be5ee329-db0d-4c9f-97b2-6009de7840f5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.153395 Jul 27 20:34:18.036079 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1267/2525] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:17 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:34:18.546446 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-854dcd7a-05bf-4fb4-9934-63173fe00fa2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:18.547072 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-854dcd7a-05bf-4fb4-9934-63173fe00fa2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:18.554108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-854dcd7a-05bf-4fb4-9934-63173fe00fa2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:18.554560 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-854dcd7a-05bf-4fb4-9934-63173fe00fa2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:18.555318 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-854dcd7a-05bf-4fb4-9934-63173fe00fa2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:18.555755 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-854dcd7a-05bf-4fb4-9934-63173fe00fa2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:18.682842 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-854dcd7a-05bf-4fb4-9934-63173fe00fa2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:18.690811 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-854dcd7a-05bf-4fb4-9934-63173fe00fa2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148263 Jul 27 20:34:18.691376 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1259/2526] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:18 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:19.030797 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fbc0df71-0f44-4894-9d49-8df6450dbc22 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:19.031417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fbc0df71-0f44-4894-9d49-8df6450dbc22 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:19.038897 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fbc0df71-0f44-4894-9d49-8df6450dbc22 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:19.039355 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fbc0df71-0f44-4894-9d49-8df6450dbc22 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:19.040125 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fbc0df71-0f44-4894-9d49-8df6450dbc22 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:19.040573 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fbc0df71-0f44-4894-9d49-8df6450dbc22 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:19.056697 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b9d16155-b691-4f89-953a-6953901bad91 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:19.057342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b9d16155-b691-4f89-953a-6953901bad91 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:19.063433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b9d16155-b691-4f89-953a-6953901bad91 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:19.063882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b9d16155-b691-4f89-953a-6953901bad91 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:19.064645 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b9d16155-b691-4f89-953a-6953901bad91 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:19.065111 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b9d16155-b691-4f89-953a-6953901bad91 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:19.069558 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:19.116133 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fbc0df71-0f44-4894-9d49-8df6450dbc22 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:19.126158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fbc0df71-0f44-4894-9d49-8df6450dbc22 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.099130 Jul 27 20:34:19.127833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1268/2527] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:19 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:19.205879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b9d16155-b691-4f89-953a-6953901bad91 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:19.214700 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b9d16155-b691-4f89-953a-6953901bad91 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.161871 Jul 27 20:34:19.215279 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1260/2528] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:19 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:34:19.711383 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9305cc7c-3f2d-4423-8e82-914942a5497c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:19.711995 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9305cc7c-3f2d-4423-8e82-914942a5497c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:19.717990 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9305cc7c-3f2d-4423-8e82-914942a5497c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:19.718433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9305cc7c-3f2d-4423-8e82-914942a5497c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:19.719180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9305cc7c-3f2d-4423-8e82-914942a5497c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:19.719617 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9305cc7c-3f2d-4423-8e82-914942a5497c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:19.847171 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9305cc7c-3f2d-4423-8e82-914942a5497c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:19.855136 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9305cc7c-3f2d-4423-8e82-914942a5497c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.147831 Jul 27 20:34:19.855697 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1269/2529] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:19 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:20.147864 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b04b2a32-941d-4809-8f83-348556265378 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:20.148507 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b04b2a32-941d-4809-8f83-348556265378 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:20.155215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b04b2a32-941d-4809-8f83-348556265378 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:20.155663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b04b2a32-941d-4809-8f83-348556265378 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:20.156427 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b04b2a32-941d-4809-8f83-348556265378 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:20.156862 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b04b2a32-941d-4809-8f83-348556265378 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:20.221901 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b04b2a32-941d-4809-8f83-348556265378 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:20.230854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b04b2a32-941d-4809-8f83-348556265378 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.087070 Jul 27 20:34:20.231426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1261/2530] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:20 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:20.237012 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-57d89d88-5076-4b07-9b5d-8533ef1bbd27 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:20.237645 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-57d89d88-5076-4b07-9b5d-8533ef1bbd27 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:20.244674 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-57d89d88-5076-4b07-9b5d-8533ef1bbd27 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:20.245167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-57d89d88-5076-4b07-9b5d-8533ef1bbd27 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:20.245937 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-57d89d88-5076-4b07-9b5d-8533ef1bbd27 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:20.246379 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-57d89d88-5076-4b07-9b5d-8533ef1bbd27 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:20.371080 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-57d89d88-5076-4b07-9b5d-8533ef1bbd27 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:20.379277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-57d89d88-5076-4b07-9b5d-8533ef1bbd27 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.145857 Jul 27 20:34:20.379852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1270/2531] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:20 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:20.876351 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3e031320-1177-4033-9e02-5dd4ef0c49ce tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:20.876984 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3e031320-1177-4033-9e02-5dd4ef0c49ce tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:20.883616 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e031320-1177-4033-9e02-5dd4ef0c49ce tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:20.884054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e031320-1177-4033-9e02-5dd4ef0c49ce tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:20.884800 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e031320-1177-4033-9e02-5dd4ef0c49ce tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:20.885260 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e031320-1177-4033-9e02-5dd4ef0c49ce tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:21.012728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3e031320-1177-4033-9e02-5dd4ef0c49ce tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:21.021449 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3e031320-1177-4033-9e02-5dd4ef0c49ce tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148958 Jul 27 20:34:21.022021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1262/2532] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:20 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:21.252836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-75745bc8-9aa8-44ae-8acf-6820e701d886 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:21.253500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-75745bc8-9aa8-44ae-8acf-6820e701d886 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:21.260552 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-75745bc8-9aa8-44ae-8acf-6820e701d886 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:21.261105 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-75745bc8-9aa8-44ae-8acf-6820e701d886 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:21.261879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-75745bc8-9aa8-44ae-8acf-6820e701d886 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:21.262321 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-75745bc8-9aa8-44ae-8acf-6820e701d886 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:21.322726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-75745bc8-9aa8-44ae-8acf-6820e701d886 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:21.330928 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-75745bc8-9aa8-44ae-8acf-6820e701d886 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081957 Jul 27 20:34:21.331493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1271/2533] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:21 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:21.400526 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dea2070f-efef-4eee-9b8d-63185b8e8ff7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:21.401167 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dea2070f-efef-4eee-9b8d-63185b8e8ff7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:21.407822 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dea2070f-efef-4eee-9b8d-63185b8e8ff7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:21.408265 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dea2070f-efef-4eee-9b8d-63185b8e8ff7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:21.409043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dea2070f-efef-4eee-9b8d-63185b8e8ff7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:21.409473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dea2070f-efef-4eee-9b8d-63185b8e8ff7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:21.536655 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dea2070f-efef-4eee-9b8d-63185b8e8ff7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:21.544486 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dea2070f-efef-4eee-9b8d-63185b8e8ff7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.147788 Jul 27 20:34:21.545067 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1263/2534] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:21 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:22.042839 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9b43d29a-70df-411b-a51c-7e46156b6cf8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:22.043449 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9b43d29a-70df-411b-a51c-7e46156b6cf8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:22.049466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9b43d29a-70df-411b-a51c-7e46156b6cf8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:22.049914 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9b43d29a-70df-411b-a51c-7e46156b6cf8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:22.050727 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9b43d29a-70df-411b-a51c-7e46156b6cf8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:22.051182 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9b43d29a-70df-411b-a51c-7e46156b6cf8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:22.181744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9b43d29a-70df-411b-a51c-7e46156b6cf8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:22.189656 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9b43d29a-70df-411b-a51c-7e46156b6cf8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150649 Jul 27 20:34:22.190203 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1272/2535] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:22 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:22.351769 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c5daccc7-088f-47b2-825e-4029edcd45c3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:22.352383 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c5daccc7-088f-47b2-825e-4029edcd45c3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:22.358457 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5daccc7-088f-47b2-825e-4029edcd45c3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:22.358906 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5daccc7-088f-47b2-825e-4029edcd45c3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:22.359667 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5daccc7-088f-47b2-825e-4029edcd45c3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:22.360105 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5daccc7-088f-47b2-825e-4029edcd45c3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:22.425337 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c5daccc7-088f-47b2-825e-4029edcd45c3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:22.433293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c5daccc7-088f-47b2-825e-4029edcd45c3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085366 Jul 27 20:34:22.433857 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1264/2536] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:22 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:22.566634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-94e94e60-29f4-4c53-b108-b0f91d53cf7e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:22.567304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-94e94e60-29f4-4c53-b108-b0f91d53cf7e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:22.573777 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-94e94e60-29f4-4c53-b108-b0f91d53cf7e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:22.574223 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-94e94e60-29f4-4c53-b108-b0f91d53cf7e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:22.575023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-94e94e60-29f4-4c53-b108-b0f91d53cf7e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:22.575409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-94e94e60-29f4-4c53-b108-b0f91d53cf7e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:22.702461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-94e94e60-29f4-4c53-b108-b0f91d53cf7e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:22.706090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:22.711999 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-94e94e60-29f4-4c53-b108-b0f91d53cf7e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.149673 Jul 27 20:34:22.712552 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1273/2537] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:22 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:23.211752 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2e75f666-1a08-4312-aef7-31bf09f2f4e6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:23.212367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2e75f666-1a08-4312-aef7-31bf09f2f4e6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:23.218343 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e75f666-1a08-4312-aef7-31bf09f2f4e6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:23.218791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e75f666-1a08-4312-aef7-31bf09f2f4e6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:23.219547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e75f666-1a08-4312-aef7-31bf09f2f4e6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:23.219983 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e75f666-1a08-4312-aef7-31bf09f2f4e6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:23.351484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2e75f666-1a08-4312-aef7-31bf09f2f4e6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:23.359279 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2e75f666-1a08-4312-aef7-31bf09f2f4e6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152549 Jul 27 20:34:23.359837 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1265/2538] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:23 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:23.454979 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-46a3ec24-74a5-43c9-84c3-ddae52fde971 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:23.455602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-46a3ec24-74a5-43c9-84c3-ddae52fde971 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:23.461586 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46a3ec24-74a5-43c9-84c3-ddae52fde971 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:23.462041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46a3ec24-74a5-43c9-84c3-ddae52fde971 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:23.462809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46a3ec24-74a5-43c9-84c3-ddae52fde971 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:23.463256 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46a3ec24-74a5-43c9-84c3-ddae52fde971 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:23.523887 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-46a3ec24-74a5-43c9-84c3-ddae52fde971 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:23.531775 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-46a3ec24-74a5-43c9-84c3-ddae52fde971 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081105 Jul 27 20:34:23.532341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1274/2539] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:23 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:23.734369 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-faeb4d06-c5b5-4c78-87e2-8fa316976c23 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:23.734981 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-faeb4d06-c5b5-4c78-87e2-8fa316976c23 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:23.742254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-faeb4d06-c5b5-4c78-87e2-8fa316976c23 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:23.742699 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-faeb4d06-c5b5-4c78-87e2-8fa316976c23 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:23.743456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-faeb4d06-c5b5-4c78-87e2-8fa316976c23 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:23.743892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-faeb4d06-c5b5-4c78-87e2-8fa316976c23 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:23.872871 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-faeb4d06-c5b5-4c78-87e2-8fa316976c23 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:23.881191 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-faeb4d06-c5b5-4c78-87e2-8fa316976c23 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.150704 Jul 27 20:34:23.881762 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1266/2540] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:23 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:24.381883 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9b25c4c4-1014-4e1b-b372-674d41e5861b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:24.382456 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9b25c4c4-1014-4e1b-b372-674d41e5861b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:24.389065 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9b25c4c4-1014-4e1b-b372-674d41e5861b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:24.389522 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9b25c4c4-1014-4e1b-b372-674d41e5861b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:24.390290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9b25c4c4-1014-4e1b-b372-674d41e5861b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:24.390741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9b25c4c4-1014-4e1b-b372-674d41e5861b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:24.520520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9b25c4c4-1014-4e1b-b372-674d41e5861b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:24.528364 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9b25c4c4-1014-4e1b-b372-674d41e5861b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150614 Jul 27 20:34:24.528930 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1275/2541] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:24 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:24.551858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f07c0a30-153e-45f6-b4cf-fd21958a3c19 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:24.552475 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f07c0a30-153e-45f6-b4cf-fd21958a3c19 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:24.558540 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f07c0a30-153e-45f6-b4cf-fd21958a3c19 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:24.558995 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f07c0a30-153e-45f6-b4cf-fd21958a3c19 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:24.559759 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f07c0a30-153e-45f6-b4cf-fd21958a3c19 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:24.560203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f07c0a30-153e-45f6-b4cf-fd21958a3c19 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:24.625006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f07c0a30-153e-45f6-b4cf-fd21958a3c19 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:24.633885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f07c0a30-153e-45f6-b4cf-fd21958a3c19 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.086126 Jul 27 20:34:24.634480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1267/2542] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:24 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:24.902564 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6246fb94-bbe4-4bc9-ab1c-120783728a66 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:24.903120 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6246fb94-bbe4-4bc9-ab1c-120783728a66 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:24.909309 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6246fb94-bbe4-4bc9-ab1c-120783728a66 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:24.909912 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6246fb94-bbe4-4bc9-ab1c-120783728a66 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:24.910770 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6246fb94-bbe4-4bc9-ab1c-120783728a66 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:24.911221 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6246fb94-bbe4-4bc9-ab1c-120783728a66 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:25.039235 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6246fb94-bbe4-4bc9-ab1c-120783728a66 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:25.047170 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6246fb94-bbe4-4bc9-ab1c-120783728a66 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.148427 Jul 27 20:34:25.047928 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1276/2543] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:24 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:25.549329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-aa857cb4-8af1-425e-8f5f-0626c2e530b0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:25.549942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-aa857cb4-8af1-425e-8f5f-0626c2e530b0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:25.556375 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa857cb4-8af1-425e-8f5f-0626c2e530b0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:25.556819 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa857cb4-8af1-425e-8f5f-0626c2e530b0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:25.557604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa857cb4-8af1-425e-8f5f-0626c2e530b0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:25.558037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa857cb4-8af1-425e-8f5f-0626c2e530b0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:25.655475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b6e39f10-5478-422d-ba3e-76438841156a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:25.656106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b6e39f10-5478-422d-ba3e-76438841156a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:25.662600 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b6e39f10-5478-422d-ba3e-76438841156a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:25.663079 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b6e39f10-5478-422d-ba3e-76438841156a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:25.663839 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b6e39f10-5478-422d-ba3e-76438841156a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:25.664297 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b6e39f10-5478-422d-ba3e-76438841156a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:25.693700 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aa857cb4-8af1-425e-8f5f-0626c2e530b0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:25.701822 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-aa857cb4-8af1-425e-8f5f-0626c2e530b0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.156318 Jul 27 20:34:25.702399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1268/2544] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:25 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:25.732915 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b6e39f10-5478-422d-ba3e-76438841156a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:25.740928 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b6e39f10-5478-422d-ba3e-76438841156a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.089355 Jul 27 20:34:25.741518 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1277/2545] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:25 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:34:26.069653 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5a147c52-b965-445c-9d04-6cc0c2ff6447 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:26.070257 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5a147c52-b965-445c-9d04-6cc0c2ff6447 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:26.076250 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a147c52-b965-445c-9d04-6cc0c2ff6447 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:26.076694 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a147c52-b965-445c-9d04-6cc0c2ff6447 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:26.077483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a147c52-b965-445c-9d04-6cc0c2ff6447 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:26.078195 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a147c52-b965-445c-9d04-6cc0c2ff6447 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:26.205330 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5a147c52-b965-445c-9d04-6cc0c2ff6447 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:26.213948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5a147c52-b965-445c-9d04-6cc0c2ff6447 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.148722 Jul 27 20:34:26.214512 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1269/2546] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:26 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:26.728065 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f642b28d-317b-4a1a-96d3-a428b480fa40 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:26.728708 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f642b28d-317b-4a1a-96d3-a428b480fa40 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:26.735140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f642b28d-317b-4a1a-96d3-a428b480fa40 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:26.735586 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f642b28d-317b-4a1a-96d3-a428b480fa40 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:26.736342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f642b28d-317b-4a1a-96d3-a428b480fa40 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:26.736775 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f642b28d-317b-4a1a-96d3-a428b480fa40 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:26.761699 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6ad1f93b-38c0-4479-9ec8-4df5df1f020d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:26.762312 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6ad1f93b-38c0-4479-9ec8-4df5df1f020d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:26.768801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ad1f93b-38c0-4479-9ec8-4df5df1f020d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:26.769459 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ad1f93b-38c0-4479-9ec8-4df5df1f020d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:26.770231 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ad1f93b-38c0-4479-9ec8-4df5df1f020d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:26.770674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ad1f93b-38c0-4479-9ec8-4df5df1f020d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:26.835812 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6ad1f93b-38c0-4479-9ec8-4df5df1f020d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:26.843818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6ad1f93b-38c0-4479-9ec8-4df5df1f020d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085904 Jul 27 20:34:26.844502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1270/2547] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:26 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:34:26.869540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f642b28d-317b-4a1a-96d3-a428b480fa40 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:26.877541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f642b28d-317b-4a1a-96d3-a428b480fa40 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153307 Jul 27 20:34:26.878110 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1278/2548] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:26 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:27.235591 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-827b4378-f304-475d-8bff-202500ecffe9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:27.236215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-827b4378-f304-475d-8bff-202500ecffe9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:27.242662 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-827b4378-f304-475d-8bff-202500ecffe9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:27.243109 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-827b4378-f304-475d-8bff-202500ecffe9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:27.243873 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-827b4378-f304-475d-8bff-202500ecffe9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:27.244307 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-827b4378-f304-475d-8bff-202500ecffe9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:27.370797 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-827b4378-f304-475d-8bff-202500ecffe9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:27.378811 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-827b4378-f304-475d-8bff-202500ecffe9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.147032 Jul 27 20:34:27.379369 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1271/2549] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:27 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:27.865465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-371b2868-31be-4479-9b61-09df909f11f5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:27.866075 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-371b2868-31be-4479-9b61-09df909f11f5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:27.872545 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-371b2868-31be-4479-9b61-09df909f11f5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:27.873019 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-371b2868-31be-4479-9b61-09df909f11f5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:27.873778 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-371b2868-31be-4479-9b61-09df909f11f5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:27.874212 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-371b2868-31be-4479-9b61-09df909f11f5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:27.899381 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-55e67634-f250-46db-ac0e-fcf5155a5824 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:27.899998 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-55e67634-f250-46db-ac0e-fcf5155a5824 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:27.906482 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55e67634-f250-46db-ac0e-fcf5155a5824 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:27.906934 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55e67634-f250-46db-ac0e-fcf5155a5824 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:27.907702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55e67634-f250-46db-ac0e-fcf5155a5824 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:27.908158 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55e67634-f250-46db-ac0e-fcf5155a5824 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:27.936132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-371b2868-31be-4479-9b61-09df909f11f5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:27.945233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-371b2868-31be-4479-9b61-09df909f11f5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084152 Jul 27 20:34:27.945888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1279/2550] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:27 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:28.037126 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-55e67634-f250-46db-ac0e-fcf5155a5824 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:28.044955 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-55e67634-f250-46db-ac0e-fcf5155a5824 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150434 Jul 27 20:34:28.045536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1272/2551] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:27 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:34:28.400341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7a0d245e-625e-452e-bb93-06b4b943a718 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:28.400953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7a0d245e-625e-452e-bb93-06b4b943a718 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:28.406932 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7a0d245e-625e-452e-bb93-06b4b943a718 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:28.407381 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7a0d245e-625e-452e-bb93-06b4b943a718 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:28.408131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7a0d245e-625e-452e-bb93-06b4b943a718 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:28.408564 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7a0d245e-625e-452e-bb93-06b4b943a718 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:28.532379 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7a0d245e-625e-452e-bb93-06b4b943a718 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:28.541078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7a0d245e-625e-452e-bb93-06b4b943a718 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.144588 Jul 27 20:34:28.541644 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1280/2552] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:28 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:28.966949 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d836afbf-a7aa-4f77-810a-f35c4ac4c900 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:28.967596 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d836afbf-a7aa-4f77-810a-f35c4ac4c900 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:28.974981 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d836afbf-a7aa-4f77-810a-f35c4ac4c900 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:28.975438 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d836afbf-a7aa-4f77-810a-f35c4ac4c900 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:28.976202 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d836afbf-a7aa-4f77-810a-f35c4ac4c900 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:28.976641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d836afbf-a7aa-4f77-810a-f35c4ac4c900 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:29.042645 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d836afbf-a7aa-4f77-810a-f35c4ac4c900 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:29.051127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d836afbf-a7aa-4f77-810a-f35c4ac4c900 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.087391 Jul 27 20:34:29.051678 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1273/2553] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:28 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:29.065666 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-69d31db3-72f9-4e4a-8f9c-f5f116bb5757 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:29.066531 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-69d31db3-72f9-4e4a-8f9c-f5f116bb5757 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:29.073302 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69d31db3-72f9-4e4a-8f9c-f5f116bb5757 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:29.073761 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69d31db3-72f9-4e4a-8f9c-f5f116bb5757 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:29.074703 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69d31db3-72f9-4e4a-8f9c-f5f116bb5757 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:29.075144 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69d31db3-72f9-4e4a-8f9c-f5f116bb5757 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:29.205525 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-69d31db3-72f9-4e4a-8f9c-f5f116bb5757 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:29.213657 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-69d31db3-72f9-4e4a-8f9c-f5f116bb5757 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151735 Jul 27 20:34:29.214224 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1281/2554] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:29 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:29.562482 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-58a1cd97-8d72-4aaf-bfc0-234126e89209 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:29.563115 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-58a1cd97-8d72-4aaf-bfc0-234126e89209 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:29.569259 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-58a1cd97-8d72-4aaf-bfc0-234126e89209 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:29.569574 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-58a1cd97-8d72-4aaf-bfc0-234126e89209 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:29.570323 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-58a1cd97-8d72-4aaf-bfc0-234126e89209 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:29.570749 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-58a1cd97-8d72-4aaf-bfc0-234126e89209 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:29.699661 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-58a1cd97-8d72-4aaf-bfc0-234126e89209 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:29.708357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-58a1cd97-8d72-4aaf-bfc0-234126e89209 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.149777 Jul 27 20:34:29.708950 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1274/2555] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:29 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:30.071733 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-744ab16c-60f0-461e-b1b9-0b139edbc0ac tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:30.072360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-744ab16c-60f0-461e-b1b9-0b139edbc0ac tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:30.074707 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=78 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:30.080296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-744ab16c-60f0-461e-b1b9-0b139edbc0ac tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:30.080756 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-744ab16c-60f0-461e-b1b9-0b139edbc0ac tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:30.082088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-744ab16c-60f0-461e-b1b9-0b139edbc0ac tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:30.082536 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-744ab16c-60f0-461e-b1b9-0b139edbc0ac tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:30.145078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-744ab16c-60f0-461e-b1b9-0b139edbc0ac tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:30.153010 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-744ab16c-60f0-461e-b1b9-0b139edbc0ac tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085161 Jul 27 20:34:30.153579 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1282/2556] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:30 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:30.233883 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0e872dd3-5d5d-493e-9d74-a787545248b6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:30.234527 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0e872dd3-5d5d-493e-9d74-a787545248b6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:30.241563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e872dd3-5d5d-493e-9d74-a787545248b6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:30.242015 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e872dd3-5d5d-493e-9d74-a787545248b6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:30.242774 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e872dd3-5d5d-493e-9d74-a787545248b6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:30.243212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e872dd3-5d5d-493e-9d74-a787545248b6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:30.370778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0e872dd3-5d5d-493e-9d74-a787545248b6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:30.379186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0e872dd3-5d5d-493e-9d74-a787545248b6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149134 Jul 27 20:34:30.379753 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1275/2557] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:30 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:30.730737 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0b1a6cac-0bbd-434b-bd1c-65091691ba18 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:30.731363 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0b1a6cac-0bbd-434b-bd1c-65091691ba18 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:30.738014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b1a6cac-0bbd-434b-bd1c-65091691ba18 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:30.738463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b1a6cac-0bbd-434b-bd1c-65091691ba18 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:30.739225 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b1a6cac-0bbd-434b-bd1c-65091691ba18 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:30.739666 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b1a6cac-0bbd-434b-bd1c-65091691ba18 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:30.869979 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0b1a6cac-0bbd-434b-bd1c-65091691ba18 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:30.878055 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0b1a6cac-0bbd-434b-bd1c-65091691ba18 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.151169 Jul 27 20:34:30.878636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1283/2558] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:30 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:31.173721 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-04870511-32bf-4e41-9d0d-aa31b623e3d8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:31.174335 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-04870511-32bf-4e41-9d0d-aa31b623e3d8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:31.176809 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=84 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:31.182093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04870511-32bf-4e41-9d0d-aa31b623e3d8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:31.182543 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04870511-32bf-4e41-9d0d-aa31b623e3d8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:31.183308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04870511-32bf-4e41-9d0d-aa31b623e3d8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:31.183745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04870511-32bf-4e41-9d0d-aa31b623e3d8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:31.248271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-04870511-32bf-4e41-9d0d-aa31b623e3d8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:31.251632 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:31.256813 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-04870511-32bf-4e41-9d0d-aa31b623e3d8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.086904 Jul 27 20:34:31.257412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1276/2559] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:31 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:31.400894 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b7928b93-e35d-4596-bc20-700b30914bae tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:31.401549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b7928b93-e35d-4596-bc20-700b30914bae tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:31.408002 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b7928b93-e35d-4596-bc20-700b30914bae tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:31.408457 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b7928b93-e35d-4596-bc20-700b30914bae tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:31.409249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b7928b93-e35d-4596-bc20-700b30914bae tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:31.410404 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b7928b93-e35d-4596-bc20-700b30914bae tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:31.540091 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b7928b93-e35d-4596-bc20-700b30914bae tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:31.548024 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b7928b93-e35d-4596-bc20-700b30914bae tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151014 Jul 27 20:34:31.548584 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1284/2560] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:31 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:31.899927 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-88af249a-c118-42f7-88d3-0aaa8ca65604 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:31.900537 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-88af249a-c118-42f7-88d3-0aaa8ca65604 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:31.906481 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-88af249a-c118-42f7-88d3-0aaa8ca65604 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:31.906925 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-88af249a-c118-42f7-88d3-0aaa8ca65604 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:31.907676 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-88af249a-c118-42f7-88d3-0aaa8ca65604 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:31.908108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-88af249a-c118-42f7-88d3-0aaa8ca65604 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:32.035979 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-88af249a-c118-42f7-88d3-0aaa8ca65604 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:32.043989 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-88af249a-c118-42f7-88d3-0aaa8ca65604 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.148173 Jul 27 20:34:32.044554 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1277/2561] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:31 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:32.278619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-caeeb40c-12cc-4e54-98c0-0cfd0742bb9b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:32.279155 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-caeeb40c-12cc-4e54-98c0-0cfd0742bb9b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:32.286036 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-caeeb40c-12cc-4e54-98c0-0cfd0742bb9b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:32.286498 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-caeeb40c-12cc-4e54-98c0-0cfd0742bb9b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:32.287284 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-caeeb40c-12cc-4e54-98c0-0cfd0742bb9b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:32.287729 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-caeeb40c-12cc-4e54-98c0-0cfd0742bb9b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:32.349575 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-caeeb40c-12cc-4e54-98c0-0cfd0742bb9b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:32.357542 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-caeeb40c-12cc-4e54-98c0-0cfd0742bb9b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082914 Jul 27 20:34:32.358117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1285/2562] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:32 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:32.570187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d87dfb85-4bdc-4ab1-ba89-d49f468930cd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:32.570719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d87dfb85-4bdc-4ab1-ba89-d49f468930cd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:32.578201 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d87dfb85-4bdc-4ab1-ba89-d49f468930cd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:32.578643 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d87dfb85-4bdc-4ab1-ba89-d49f468930cd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:32.579412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d87dfb85-4bdc-4ab1-ba89-d49f468930cd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:32.579845 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d87dfb85-4bdc-4ab1-ba89-d49f468930cd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:32.723245 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d87dfb85-4bdc-4ab1-ba89-d49f468930cd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:32.731258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d87dfb85-4bdc-4ab1-ba89-d49f468930cd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.165521 Jul 27 20:34:32.731816 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1278/2563] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:32 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:33.065453 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4c74ea53-0f63-4401-9c55-4425912ae281 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:33.066744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4c74ea53-0f63-4401-9c55-4425912ae281 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:33.072873 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4c74ea53-0f63-4401-9c55-4425912ae281 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:33.073357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4c74ea53-0f63-4401-9c55-4425912ae281 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:33.074125 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4c74ea53-0f63-4401-9c55-4425912ae281 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:33.074567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4c74ea53-0f63-4401-9c55-4425912ae281 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:33.211233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4c74ea53-0f63-4401-9c55-4425912ae281 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:33.219392 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4c74ea53-0f63-4401-9c55-4425912ae281 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.157788 Jul 27 20:34:33.219952 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1286/2564] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:33 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:33.379548 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1463d3e4-c659-414f-999a-550db20ccf70 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:33.380096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1463d3e4-c659-414f-999a-550db20ccf70 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:33.386114 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1463d3e4-c659-414f-999a-550db20ccf70 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:33.386557 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1463d3e4-c659-414f-999a-550db20ccf70 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:33.387308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1463d3e4-c659-414f-999a-550db20ccf70 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:33.387734 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1463d3e4-c659-414f-999a-550db20ccf70 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:33.452330 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1463d3e4-c659-414f-999a-550db20ccf70 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:33.461325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1463d3e4-c659-414f-999a-550db20ccf70 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.086007 Jul 27 20:34:33.461886 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1279/2565] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:33 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:33.751656 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9274a13d-e7eb-4d5d-8014-2ecee7b79c34 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:33.752283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9274a13d-e7eb-4d5d-8014-2ecee7b79c34 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:33.760448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9274a13d-e7eb-4d5d-8014-2ecee7b79c34 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:33.760902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9274a13d-e7eb-4d5d-8014-2ecee7b79c34 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:33.761721 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9274a13d-e7eb-4d5d-8014-2ecee7b79c34 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:33.762164 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9274a13d-e7eb-4d5d-8014-2ecee7b79c34 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:33.896382 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9274a13d-e7eb-4d5d-8014-2ecee7b79c34 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:33.904341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9274a13d-e7eb-4d5d-8014-2ecee7b79c34 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.156533 Jul 27 20:34:33.904907 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1287/2566] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:33 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:34.244056 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2e329365-58f2-49e6-bd8c-536ba733a73d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:34.244758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2e329365-58f2-49e6-bd8c-536ba733a73d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:34.252222 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e329365-58f2-49e6-bd8c-536ba733a73d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:34.252749 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e329365-58f2-49e6-bd8c-536ba733a73d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:34.253608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e329365-58f2-49e6-bd8c-536ba733a73d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:34.254138 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e329365-58f2-49e6-bd8c-536ba733a73d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:34.382192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2e329365-58f2-49e6-bd8c-536ba733a73d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:34.390091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2e329365-58f2-49e6-bd8c-536ba733a73d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.150655 Jul 27 20:34:34.390852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1280/2567] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:34 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:34.482395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3ab78e9c-0814-4d2a-9a2f-7bd792225268 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:34.483005 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3ab78e9c-0814-4d2a-9a2f-7bd792225268 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:34.489514 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3ab78e9c-0814-4d2a-9a2f-7bd792225268 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:34.489959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3ab78e9c-0814-4d2a-9a2f-7bd792225268 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:34.490710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3ab78e9c-0814-4d2a-9a2f-7bd792225268 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:34.491161 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3ab78e9c-0814-4d2a-9a2f-7bd792225268 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:34.551614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3ab78e9c-0814-4d2a-9a2f-7bd792225268 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:34.559659 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3ab78e9c-0814-4d2a-9a2f-7bd792225268 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081477 Jul 27 20:34:34.560222 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1288/2568] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:34 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:34.926072 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c955caa5-f702-4526-8647-ef970b27beb5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:34.926713 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c955caa5-f702-4526-8647-ef970b27beb5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:34.932836 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c955caa5-f702-4526-8647-ef970b27beb5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:34.933315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c955caa5-f702-4526-8647-ef970b27beb5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:34.934074 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c955caa5-f702-4526-8647-ef970b27beb5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:34.934512 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c955caa5-f702-4526-8647-ef970b27beb5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:35.063090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c955caa5-f702-4526-8647-ef970b27beb5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:35.071152 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c955caa5-f702-4526-8647-ef970b27beb5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149518 Jul 27 20:34:35.071718 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1281/2569] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:34 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:35.411882 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-323ba522-ff0d-4c5c-b4ad-7e188825a749 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:35.412537 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-323ba522-ff0d-4c5c-b4ad-7e188825a749 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:35.419121 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-323ba522-ff0d-4c5c-b4ad-7e188825a749 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:35.419582 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-323ba522-ff0d-4c5c-b4ad-7e188825a749 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:35.420337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-323ba522-ff0d-4c5c-b4ad-7e188825a749 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:35.420783 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-323ba522-ff0d-4c5c-b4ad-7e188825a749 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:35.552460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-323ba522-ff0d-4c5c-b4ad-7e188825a749 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:35.560451 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-323ba522-ff0d-4c5c-b4ad-7e188825a749 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.152482 Jul 27 20:34:35.561115 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1289/2570] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:35 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:35.580769 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f9f84241-399d-45b6-b744-0d27215bb863 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:35.582142 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f9f84241-399d-45b6-b744-0d27215bb863 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:35.588589 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9f84241-399d-45b6-b744-0d27215bb863 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:35.589062 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9f84241-399d-45b6-b744-0d27215bb863 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:35.589812 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9f84241-399d-45b6-b744-0d27215bb863 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:35.590242 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9f84241-399d-45b6-b744-0d27215bb863 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:35.654070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f9f84241-399d-45b6-b744-0d27215bb863 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:35.662385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f9f84241-399d-45b6-b744-0d27215bb863 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085529 Jul 27 20:34:35.662885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1282/2571] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:35 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:36.092702 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-35cad6ec-f513-48dc-a191-0e959d669714 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:36.093490 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-35cad6ec-f513-48dc-a191-0e959d669714 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:36.100208 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-35cad6ec-f513-48dc-a191-0e959d669714 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:36.100664 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-35cad6ec-f513-48dc-a191-0e959d669714 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:36.101474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-35cad6ec-f513-48dc-a191-0e959d669714 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:36.101916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-35cad6ec-f513-48dc-a191-0e959d669714 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:36.120555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:36.227772 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-35cad6ec-f513-48dc-a191-0e959d669714 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:36.235645 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-35cad6ec-f513-48dc-a191-0e959d669714 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.146829 Jul 27 20:34:36.236208 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1290/2572] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:36 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:36.583104 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7ecd2974-b794-4740-b317-140eaae496be tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:36.583721 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7ecd2974-b794-4740-b317-140eaae496be tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:36.590176 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ecd2974-b794-4740-b317-140eaae496be tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:36.590628 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ecd2974-b794-4740-b317-140eaae496be tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:36.591388 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ecd2974-b794-4740-b317-140eaae496be tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:36.591828 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ecd2974-b794-4740-b317-140eaae496be tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:36.684061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5ff4fd0e-6177-494e-a7b1-2b11db41ac26 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:36.684862 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5ff4fd0e-6177-494e-a7b1-2b11db41ac26 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:36.691454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5ff4fd0e-6177-494e-a7b1-2b11db41ac26 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:36.691922 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5ff4fd0e-6177-494e-a7b1-2b11db41ac26 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:36.692680 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5ff4fd0e-6177-494e-a7b1-2b11db41ac26 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:36.693142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5ff4fd0e-6177-494e-a7b1-2b11db41ac26 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:36.723224 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7ecd2974-b794-4740-b317-140eaae496be tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:36.731335 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7ecd2974-b794-4740-b317-140eaae496be tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.152563 Jul 27 20:34:36.731904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1283/2573] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:36 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:36.754983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5ff4fd0e-6177-494e-a7b1-2b11db41ac26 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:36.763065 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5ff4fd0e-6177-494e-a7b1-2b11db41ac26 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083254 Jul 27 20:34:36.763629 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1291/2574] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:36 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:34:37.256939 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2b4bdc98-83c9-4149-bf37-dcbe9b381e70 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:37.257658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2b4bdc98-83c9-4149-bf37-dcbe9b381e70 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:37.263688 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b4bdc98-83c9-4149-bf37-dcbe9b381e70 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:37.264133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b4bdc98-83c9-4149-bf37-dcbe9b381e70 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:37.264879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b4bdc98-83c9-4149-bf37-dcbe9b381e70 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:37.265332 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b4bdc98-83c9-4149-bf37-dcbe9b381e70 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:37.392564 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2b4bdc98-83c9-4149-bf37-dcbe9b381e70 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:37.400341 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2b4bdc98-83c9-4149-bf37-dcbe9b381e70 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.147877 Jul 27 20:34:37.400896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1284/2575] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:37 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:37.751647 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f46617f3-7555-40ad-b1da-92aa925e6cc1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:37.752255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f46617f3-7555-40ad-b1da-92aa925e6cc1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:37.758869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f46617f3-7555-40ad-b1da-92aa925e6cc1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:37.759316 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f46617f3-7555-40ad-b1da-92aa925e6cc1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:37.760215 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f46617f3-7555-40ad-b1da-92aa925e6cc1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:37.760665 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f46617f3-7555-40ad-b1da-92aa925e6cc1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:37.783409 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ff2bc834-4224-4101-b649-4b2e22da7ef2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:37.784006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ff2bc834-4224-4101-b649-4b2e22da7ef2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:37.791396 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff2bc834-4224-4101-b649-4b2e22da7ef2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:37.791836 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff2bc834-4224-4101-b649-4b2e22da7ef2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:37.792597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff2bc834-4224-4101-b649-4b2e22da7ef2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:37.793049 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff2bc834-4224-4101-b649-4b2e22da7ef2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:37.865102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ff2bc834-4224-4101-b649-4b2e22da7ef2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:37.873385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ff2bc834-4224-4101-b649-4b2e22da7ef2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.093578 Jul 27 20:34:37.874025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1285/2576] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:37 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:34:37.905926 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f46617f3-7555-40ad-b1da-92aa925e6cc1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:37.914819 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f46617f3-7555-40ad-b1da-92aa925e6cc1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.166784 Jul 27 20:34:37.915687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1292/2577] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:37 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:38.421136 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fed79a93-c3c7-4cdb-adba-de03ee04f7dd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:38.421742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fed79a93-c3c7-4cdb-adba-de03ee04f7dd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:38.427719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fed79a93-c3c7-4cdb-adba-de03ee04f7dd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:38.428162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fed79a93-c3c7-4cdb-adba-de03ee04f7dd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:38.428919 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fed79a93-c3c7-4cdb-adba-de03ee04f7dd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:38.429380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fed79a93-c3c7-4cdb-adba-de03ee04f7dd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:38.557717 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fed79a93-c3c7-4cdb-adba-de03ee04f7dd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:38.566079 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fed79a93-c3c7-4cdb-adba-de03ee04f7dd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148378 Jul 27 20:34:38.566665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1286/2578] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:38 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:38.893651 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-10e9efff-aad2-4a7a-bcca-96ba72416b41 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:38.894390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-10e9efff-aad2-4a7a-bcca-96ba72416b41 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:38.900829 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-10e9efff-aad2-4a7a-bcca-96ba72416b41 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:38.901305 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-10e9efff-aad2-4a7a-bcca-96ba72416b41 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:38.902084 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-10e9efff-aad2-4a7a-bcca-96ba72416b41 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:38.902519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-10e9efff-aad2-4a7a-bcca-96ba72416b41 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:38.935964 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e7e68eb4-7f05-4e24-ab79-49e9e3c76e46 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:38.936583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e7e68eb4-7f05-4e24-ab79-49e9e3c76e46 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:38.943525 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7e68eb4-7f05-4e24-ab79-49e9e3c76e46 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:38.943980 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7e68eb4-7f05-4e24-ab79-49e9e3c76e46 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:38.945290 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7e68eb4-7f05-4e24-ab79-49e9e3c76e46 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:38.945735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7e68eb4-7f05-4e24-ab79-49e9e3c76e46 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:38.965945 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-10e9efff-aad2-4a7a-bcca-96ba72416b41 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:38.973793 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-10e9efff-aad2-4a7a-bcca-96ba72416b41 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084023 Jul 27 20:34:38.974365 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1293/2579] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:38 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:39.076631 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e7e68eb4-7f05-4e24-ab79-49e9e3c76e46 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:39.085506 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e7e68eb4-7f05-4e24-ab79-49e9e3c76e46 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.153614 Jul 27 20:34:39.086061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1287/2580] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:38 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:34:39.586469 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-da60936c-d6a1-4eb4-9f51-a5c3155860dc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:39.587077 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-da60936c-d6a1-4eb4-9f51-a5c3155860dc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:39.593225 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-da60936c-d6a1-4eb4-9f51-a5c3155860dc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:39.593679 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-da60936c-d6a1-4eb4-9f51-a5c3155860dc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:39.594431 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-da60936c-d6a1-4eb4-9f51-a5c3155860dc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:39.594867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-da60936c-d6a1-4eb4-9f51-a5c3155860dc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:39.722328 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-da60936c-d6a1-4eb4-9f51-a5c3155860dc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:39.730163 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-da60936c-d6a1-4eb4-9f51-a5c3155860dc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.147504 Jul 27 20:34:39.730732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1294/2581] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:39 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:39.994951 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8d39c4ea-3e46-4edb-958e-5c27ec93cdb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:39.995570 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8d39c4ea-3e46-4edb-958e-5c27ec93cdb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:40.001989 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d39c4ea-3e46-4edb-958e-5c27ec93cdb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:40.002443 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d39c4ea-3e46-4edb-958e-5c27ec93cdb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:40.003306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d39c4ea-3e46-4edb-958e-5c27ec93cdb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:40.003744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d39c4ea-3e46-4edb-958e-5c27ec93cdb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:40.067527 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8d39c4ea-3e46-4edb-958e-5c27ec93cdb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:40.075570 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8d39c4ea-3e46-4edb-958e-5c27ec93cdb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084441 Jul 27 20:34:40.076146 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1288/2582] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:39 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:40.107250 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5136728b-dc81-48d8-b8de-09a4c6c3680d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:40.107867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5136728b-dc81-48d8-b8de-09a4c6c3680d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:40.115055 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5136728b-dc81-48d8-b8de-09a4c6c3680d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:40.115507 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5136728b-dc81-48d8-b8de-09a4c6c3680d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:40.116275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5136728b-dc81-48d8-b8de-09a4c6c3680d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:40.116715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5136728b-dc81-48d8-b8de-09a4c6c3680d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:40.244389 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5136728b-dc81-48d8-b8de-09a4c6c3680d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:40.252297 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5136728b-dc81-48d8-b8de-09a4c6c3680d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.148985 Jul 27 20:34:40.252807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1295/2583] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:40 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:40.751675 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8f5a844e-3bab-4e2e-9ea2-d52632ca577c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:40.752289 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8f5a844e-3bab-4e2e-9ea2-d52632ca577c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:40.759193 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8f5a844e-3bab-4e2e-9ea2-d52632ca577c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:40.759653 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8f5a844e-3bab-4e2e-9ea2-d52632ca577c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:40.760458 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8f5a844e-3bab-4e2e-9ea2-d52632ca577c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:40.760900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8f5a844e-3bab-4e2e-9ea2-d52632ca577c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:40.887074 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8f5a844e-3bab-4e2e-9ea2-d52632ca577c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:40.895714 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8f5a844e-3bab-4e2e-9ea2-d52632ca577c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.147948 Jul 27 20:34:40.896270 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1289/2584] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:40 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:41.098480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-86b5a74b-2116-4970-b96f-908146fc0b4f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:41.099133 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-86b5a74b-2116-4970-b96f-908146fc0b4f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:41.106716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-86b5a74b-2116-4970-b96f-908146fc0b4f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:41.107167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-86b5a74b-2116-4970-b96f-908146fc0b4f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:41.107934 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-86b5a74b-2116-4970-b96f-908146fc0b4f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:41.108469 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-86b5a74b-2116-4970-b96f-908146fc0b4f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:41.171273 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-86b5a74b-2116-4970-b96f-908146fc0b4f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:41.179067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-86b5a74b-2116-4970-b96f-908146fc0b4f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085462 Jul 27 20:34:41.179624 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1296/2585] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:41 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:41.273641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f2b075ac-a216-46c2-9fe2-80b8089ac76e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:41.274259 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f2b075ac-a216-46c2-9fe2-80b8089ac76e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:41.280692 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f2b075ac-a216-46c2-9fe2-80b8089ac76e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:41.281182 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f2b075ac-a216-46c2-9fe2-80b8089ac76e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:41.281942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f2b075ac-a216-46c2-9fe2-80b8089ac76e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:41.282378 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f2b075ac-a216-46c2-9fe2-80b8089ac76e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:41.409970 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f2b075ac-a216-46c2-9fe2-80b8089ac76e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:41.417919 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f2b075ac-a216-46c2-9fe2-80b8089ac76e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.148110 Jul 27 20:34:41.418486 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1290/2586] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:41 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:41.916333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-63dc8e77-41e3-427b-be37-1bf3d53ff7c1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:41.916982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-63dc8e77-41e3-427b-be37-1bf3d53ff7c1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:41.923048 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63dc8e77-41e3-427b-be37-1bf3d53ff7c1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:41.923494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63dc8e77-41e3-427b-be37-1bf3d53ff7c1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:41.924243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63dc8e77-41e3-427b-be37-1bf3d53ff7c1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:41.924678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63dc8e77-41e3-427b-be37-1bf3d53ff7c1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:42.052784 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-63dc8e77-41e3-427b-be37-1bf3d53ff7c1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:42.060753 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-63dc8e77-41e3-427b-be37-1bf3d53ff7c1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148234 Jul 27 20:34:42.061366 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1297/2587] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:41 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:42.199631 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-86c44dec-076d-4863-96b7-c1ff0f8be82c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:42.200158 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-86c44dec-076d-4863-96b7-c1ff0f8be82c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:42.207437 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86c44dec-076d-4863-96b7-c1ff0f8be82c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:42.207899 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86c44dec-076d-4863-96b7-c1ff0f8be82c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:42.208661 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86c44dec-076d-4863-96b7-c1ff0f8be82c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:42.209134 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86c44dec-076d-4863-96b7-c1ff0f8be82c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:42.273301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-86c44dec-076d-4863-96b7-c1ff0f8be82c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:42.281287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-86c44dec-076d-4863-96b7-c1ff0f8be82c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085557 Jul 27 20:34:42.281853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1291/2588] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:42 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:42.438368 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a19e7e04-430f-4ce6-89d7-38418590fd97 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:42.438992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a19e7e04-430f-4ce6-89d7-38418590fd97 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:42.446253 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a19e7e04-430f-4ce6-89d7-38418590fd97 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:42.446707 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a19e7e04-430f-4ce6-89d7-38418590fd97 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:42.447473 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a19e7e04-430f-4ce6-89d7-38418590fd97 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:42.447916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a19e7e04-430f-4ce6-89d7-38418590fd97 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:42.581385 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a19e7e04-430f-4ce6-89d7-38418590fd97 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:42.589329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a19e7e04-430f-4ce6-89d7-38418590fd97 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.154780 Jul 27 20:34:42.589904 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1298/2589] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:42 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:43.082521 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-317402f8-52e6-4e0d-96fd-cc2fe5ceebd2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:43.083139 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-317402f8-52e6-4e0d-96fd-cc2fe5ceebd2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:43.089318 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-317402f8-52e6-4e0d-96fd-cc2fe5ceebd2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:43.089778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-317402f8-52e6-4e0d-96fd-cc2fe5ceebd2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:43.090545 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-317402f8-52e6-4e0d-96fd-cc2fe5ceebd2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:43.090983 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-317402f8-52e6-4e0d-96fd-cc2fe5ceebd2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:43.222581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-317402f8-52e6-4e0d-96fd-cc2fe5ceebd2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:43.230566 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-317402f8-52e6-4e0d-96fd-cc2fe5ceebd2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151938 Jul 27 20:34:43.231126 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1292/2590] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:43 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:43.302755 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1ccc5aab-061e-4039-be1f-473e5422a077 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:43.303405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1ccc5aab-061e-4039-be1f-473e5422a077 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:43.309532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1ccc5aab-061e-4039-be1f-473e5422a077 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:43.309985 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1ccc5aab-061e-4039-be1f-473e5422a077 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:43.310752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1ccc5aab-061e-4039-be1f-473e5422a077 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:43.311196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1ccc5aab-061e-4039-be1f-473e5422a077 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:43.372189 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1ccc5aab-061e-4039-be1f-473e5422a077 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:43.380230 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1ccc5aab-061e-4039-be1f-473e5422a077 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082031 Jul 27 20:34:43.380803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1299/2591] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:43 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:43.611004 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-18c0bd89-71b8-4209-b7e7-7b5a00491cd0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:43.611562 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-18c0bd89-71b8-4209-b7e7-7b5a00491cd0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:43.618844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18c0bd89-71b8-4209-b7e7-7b5a00491cd0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:43.619299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18c0bd89-71b8-4209-b7e7-7b5a00491cd0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:43.620058 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18c0bd89-71b8-4209-b7e7-7b5a00491cd0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:43.620497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18c0bd89-71b8-4209-b7e7-7b5a00491cd0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:43.638514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:43.750958 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-18c0bd89-71b8-4209-b7e7-7b5a00491cd0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:43.759038 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-18c0bd89-71b8-4209-b7e7-7b5a00491cd0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.151968 Jul 27 20:34:43.759594 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1293/2592] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:43 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:44.252009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-55ab0394-0f88-41ff-8363-3c7cab14131f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:44.252625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-55ab0394-0f88-41ff-8363-3c7cab14131f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:44.259784 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-55ab0394-0f88-41ff-8363-3c7cab14131f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:44.260241 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-55ab0394-0f88-41ff-8363-3c7cab14131f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:44.261034 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-55ab0394-0f88-41ff-8363-3c7cab14131f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:44.261481 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-55ab0394-0f88-41ff-8363-3c7cab14131f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:44.392066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-55ab0394-0f88-41ff-8363-3c7cab14131f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:44.400324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-55ab0394-0f88-41ff-8363-3c7cab14131f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152135 Jul 27 20:34:44.400877 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bfe70046-7ae1-4605-9d11-1160418c59cf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:44.401046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1300/2593] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:44 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:44.401517 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bfe70046-7ae1-4605-9d11-1160418c59cf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:44.407682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfe70046-7ae1-4605-9d11-1160418c59cf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:44.408141 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfe70046-7ae1-4605-9d11-1160418c59cf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:44.408911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfe70046-7ae1-4605-9d11-1160418c59cf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:44.409480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfe70046-7ae1-4605-9d11-1160418c59cf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:44.474567 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bfe70046-7ae1-4605-9d11-1160418c59cf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:44.482457 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bfe70046-7ae1-4605-9d11-1160418c59cf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085395 Jul 27 20:34:44.483016 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1294/2594] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:44 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:34:44.780813 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cf5fed57-709a-47dc-870f-9aaa66248867 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:44.781461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cf5fed57-709a-47dc-870f-9aaa66248867 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:44.788012 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf5fed57-709a-47dc-870f-9aaa66248867 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:44.788473 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf5fed57-709a-47dc-870f-9aaa66248867 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:44.789268 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf5fed57-709a-47dc-870f-9aaa66248867 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:44.789715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf5fed57-709a-47dc-870f-9aaa66248867 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:44.915432 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cf5fed57-709a-47dc-870f-9aaa66248867 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:44.923380 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cf5fed57-709a-47dc-870f-9aaa66248867 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.146415 Jul 27 20:34:44.923946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1301/2595] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:44 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:45.420734 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4f31832e-975f-428e-8d70-ee6d7f550e53 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:45.421376 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4f31832e-975f-428e-8d70-ee6d7f550e53 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:45.427875 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4f31832e-975f-428e-8d70-ee6d7f550e53 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:45.428326 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4f31832e-975f-428e-8d70-ee6d7f550e53 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:45.429121 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4f31832e-975f-428e-8d70-ee6d7f550e53 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:45.429560 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4f31832e-975f-428e-8d70-ee6d7f550e53 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:45.504380 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b98dc631-e71a-46de-8fba-538717079182 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:45.505047 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b98dc631-e71a-46de-8fba-538717079182 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:45.511667 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b98dc631-e71a-46de-8fba-538717079182 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:45.512127 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b98dc631-e71a-46de-8fba-538717079182 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:45.512899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b98dc631-e71a-46de-8fba-538717079182 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:45.513396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b98dc631-e71a-46de-8fba-538717079182 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:45.561682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4f31832e-975f-428e-8d70-ee6d7f550e53 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:45.570559 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4f31832e-975f-428e-8d70-ee6d7f550e53 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153659 Jul 27 20:34:45.571352 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1295/2596] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:45 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:45.577410 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b98dc631-e71a-46de-8fba-538717079182 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:45.586284 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b98dc631-e71a-46de-8fba-538717079182 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.086483 Jul 27 20:34:45.586843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1302/2597] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:45 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:34:45.946311 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3155a59c-82b2-4a9f-a0ea-7168c5417534 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:45.946924 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3155a59c-82b2-4a9f-a0ea-7168c5417534 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:45.953406 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3155a59c-82b2-4a9f-a0ea-7168c5417534 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:45.953867 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3155a59c-82b2-4a9f-a0ea-7168c5417534 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:45.954664 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3155a59c-82b2-4a9f-a0ea-7168c5417534 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:45.955104 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3155a59c-82b2-4a9f-a0ea-7168c5417534 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:46.084189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3155a59c-82b2-4a9f-a0ea-7168c5417534 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:46.092077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3155a59c-82b2-4a9f-a0ea-7168c5417534 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.149710 Jul 27 20:34:46.092643 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1296/2598] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:45 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:46.592439 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-875d03f1-92eb-4181-b557-1e31d1f2e379 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:46.593065 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-875d03f1-92eb-4181-b557-1e31d1f2e379 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:46.599611 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-875d03f1-92eb-4181-b557-1e31d1f2e379 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:46.600071 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-875d03f1-92eb-4181-b557-1e31d1f2e379 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:46.600880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-875d03f1-92eb-4181-b557-1e31d1f2e379 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:46.601431 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-875d03f1-92eb-4181-b557-1e31d1f2e379 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:46.606678 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7df62f82-df34-49b9-b154-7c43d416707a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:46.607290 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7df62f82-df34-49b9-b154-7c43d416707a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:46.614572 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7df62f82-df34-49b9-b154-7c43d416707a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:46.615025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7df62f82-df34-49b9-b154-7c43d416707a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:46.615789 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7df62f82-df34-49b9-b154-7c43d416707a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:46.616258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7df62f82-df34-49b9-b154-7c43d416707a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:46.682142 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7df62f82-df34-49b9-b154-7c43d416707a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:46.690400 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7df62f82-df34-49b9-b154-7c43d416707a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.087436 Jul 27 20:34:46.691575 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1297/2599] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:46 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:34:46.731989 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-875d03f1-92eb-4181-b557-1e31d1f2e379 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:46.740444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-875d03f1-92eb-4181-b557-1e31d1f2e379 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151893 Jul 27 20:34:46.741026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1303/2600] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:46 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:47.114276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-21768abc-1d49-4667-9495-552b8318f7c2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:47.114890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-21768abc-1d49-4667-9495-552b8318f7c2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:47.120897 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21768abc-1d49-4667-9495-552b8318f7c2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:47.121382 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21768abc-1d49-4667-9495-552b8318f7c2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:47.122140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21768abc-1d49-4667-9495-552b8318f7c2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:47.122579 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21768abc-1d49-4667-9495-552b8318f7c2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:47.248529 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-21768abc-1d49-4667-9495-552b8318f7c2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:47.256537 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-21768abc-1d49-4667-9495-552b8318f7c2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.146884 Jul 27 20:34:47.257119 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1298/2601] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:47 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:47.713204 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4c76fb7e-bb3e-43b1-879e-a2dc3e47a193 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:47.713826 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4c76fb7e-bb3e-43b1-879e-a2dc3e47a193 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:47.720606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4c76fb7e-bb3e-43b1-879e-a2dc3e47a193 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:47.721096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4c76fb7e-bb3e-43b1-879e-a2dc3e47a193 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:47.721921 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4c76fb7e-bb3e-43b1-879e-a2dc3e47a193 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:47.723068 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4c76fb7e-bb3e-43b1-879e-a2dc3e47a193 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:47.761908 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-74679c54-1a98-4cfa-abac-6e68fb7faf44 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:47.762511 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-74679c54-1a98-4cfa-abac-6e68fb7faf44 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:47.768662 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74679c54-1a98-4cfa-abac-6e68fb7faf44 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:47.769745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74679c54-1a98-4cfa-abac-6e68fb7faf44 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:47.770522 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74679c54-1a98-4cfa-abac-6e68fb7faf44 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:47.770965 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74679c54-1a98-4cfa-abac-6e68fb7faf44 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:47.785827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4c76fb7e-bb3e-43b1-879e-a2dc3e47a193 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:47.793762 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4c76fb7e-bb3e-43b1-879e-a2dc3e47a193 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084447 Jul 27 20:34:47.794331 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1304/2602] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:47 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:47.905245 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-74679c54-1a98-4cfa-abac-6e68fb7faf44 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:47.913372 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-74679c54-1a98-4cfa-abac-6e68fb7faf44 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.155288 Jul 27 20:34:47.913966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1299/2603] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:47 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:34:48.281606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d2bed774-dda4-4c23-8d76-07fee6e00d83 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:48.282228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d2bed774-dda4-4c23-8d76-07fee6e00d83 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:48.288196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d2bed774-dda4-4c23-8d76-07fee6e00d83 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:48.288649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d2bed774-dda4-4c23-8d76-07fee6e00d83 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:48.289443 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d2bed774-dda4-4c23-8d76-07fee6e00d83 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:48.289882 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d2bed774-dda4-4c23-8d76-07fee6e00d83 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:48.415258 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d2bed774-dda4-4c23-8d76-07fee6e00d83 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:48.423163 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d2bed774-dda4-4c23-8d76-07fee6e00d83 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.145465 Jul 27 20:34:48.423730 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1305/2604] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:48 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:48.815765 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-495c2c60-5ed8-4362-b008-640667a0cb92 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:48.816903 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-495c2c60-5ed8-4362-b008-640667a0cb92 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:48.823320 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-495c2c60-5ed8-4362-b008-640667a0cb92 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:48.823758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-495c2c60-5ed8-4362-b008-640667a0cb92 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:48.824504 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-495c2c60-5ed8-4362-b008-640667a0cb92 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:48.824933 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-495c2c60-5ed8-4362-b008-640667a0cb92 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:48.890393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-495c2c60-5ed8-4362-b008-640667a0cb92 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:48.898220 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-495c2c60-5ed8-4362-b008-640667a0cb92 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.086336 Jul 27 20:34:48.898776 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1300/2605] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:48 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:48.934140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-46d59cbf-3197-4326-ad72-792b8d64e1f0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:48.934865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-46d59cbf-3197-4326-ad72-792b8d64e1f0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:48.942516 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46d59cbf-3197-4326-ad72-792b8d64e1f0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:48.942995 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46d59cbf-3197-4326-ad72-792b8d64e1f0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:48.943765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46d59cbf-3197-4326-ad72-792b8d64e1f0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:48.944209 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46d59cbf-3197-4326-ad72-792b8d64e1f0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:49.076021 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-46d59cbf-3197-4326-ad72-792b8d64e1f0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:49.085004 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-46d59cbf-3197-4326-ad72-792b8d64e1f0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.154680 Jul 27 20:34:49.085572 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1306/2606] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:48 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:49.445462 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-963348bf-5296-443f-aaf2-cae6ac5a68e7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:49.446091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-963348bf-5296-443f-aaf2-cae6ac5a68e7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:49.452136 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-963348bf-5296-443f-aaf2-cae6ac5a68e7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:49.452584 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-963348bf-5296-443f-aaf2-cae6ac5a68e7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:49.453620 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-963348bf-5296-443f-aaf2-cae6ac5a68e7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:49.454059 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-963348bf-5296-443f-aaf2-cae6ac5a68e7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:49.588794 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-963348bf-5296-443f-aaf2-cae6ac5a68e7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:49.597539 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-963348bf-5296-443f-aaf2-cae6ac5a68e7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.156269 Jul 27 20:34:49.598626 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1301/2607] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:49 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:49.918880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-69377bba-ed2e-4532-9a32-b1127890a241 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:49.919507 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-69377bba-ed2e-4532-9a32-b1127890a241 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:49.926546 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69377bba-ed2e-4532-9a32-b1127890a241 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:49.927009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69377bba-ed2e-4532-9a32-b1127890a241 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:49.927778 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69377bba-ed2e-4532-9a32-b1127890a241 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:49.928224 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69377bba-ed2e-4532-9a32-b1127890a241 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:49.932106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:49.990251 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-69377bba-ed2e-4532-9a32-b1127890a241 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:49.998200 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-69377bba-ed2e-4532-9a32-b1127890a241 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083188 Jul 27 20:34:49.998761 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1307/2608] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:49 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:34:50.106738 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a0c2b8c7-6d09-42a8-adc8-d070b95db652 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:50.107377 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a0c2b8c7-6d09-42a8-adc8-d070b95db652 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:50.114589 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0c2b8c7-6d09-42a8-adc8-d070b95db652 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:50.115036 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0c2b8c7-6d09-42a8-adc8-d070b95db652 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:50.115797 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0c2b8c7-6d09-42a8-adc8-d070b95db652 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:50.116231 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0c2b8c7-6d09-42a8-adc8-d070b95db652 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:50.252208 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a0c2b8c7-6d09-42a8-adc8-d070b95db652 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:50.260163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a0c2b8c7-6d09-42a8-adc8-d070b95db652 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.157310 Jul 27 20:34:50.260720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1302/2609] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:50 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:50.618324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-21aa94c5-18b2-4e3b-9e5f-d0a8aaa5016d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:50.618932 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-21aa94c5-18b2-4e3b-9e5f-d0a8aaa5016d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:50.624884 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-21aa94c5-18b2-4e3b-9e5f-d0a8aaa5016d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:50.625366 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-21aa94c5-18b2-4e3b-9e5f-d0a8aaa5016d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:50.626119 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-21aa94c5-18b2-4e3b-9e5f-d0a8aaa5016d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:50.626551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-21aa94c5-18b2-4e3b-9e5f-d0a8aaa5016d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:50.752481 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-21aa94c5-18b2-4e3b-9e5f-d0a8aaa5016d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:50.760730 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-21aa94c5-18b2-4e3b-9e5f-d0a8aaa5016d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.146178 Jul 27 20:34:50.761338 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1308/2610] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:50 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:51.019197 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-716a8923-4c62-4119-844b-871d99c03bbd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:51.019810 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-716a8923-4c62-4119-844b-871d99c03bbd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:51.025827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-716a8923-4c62-4119-844b-871d99c03bbd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:51.026275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-716a8923-4c62-4119-844b-871d99c03bbd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:51.027034 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-716a8923-4c62-4119-844b-871d99c03bbd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:51.027472 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-716a8923-4c62-4119-844b-871d99c03bbd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:51.091976 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-716a8923-4c62-4119-844b-871d99c03bbd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:51.100695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-716a8923-4c62-4119-844b-871d99c03bbd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085406 Jul 27 20:34:51.101283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1303/2611] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:51 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:51.281176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3ca62edf-e871-4a94-8adb-40ad12132685 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:51.281696 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3ca62edf-e871-4a94-8adb-40ad12132685 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:51.288749 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3ca62edf-e871-4a94-8adb-40ad12132685 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:51.289224 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3ca62edf-e871-4a94-8adb-40ad12132685 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:51.289978 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3ca62edf-e871-4a94-8adb-40ad12132685 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:51.290411 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3ca62edf-e871-4a94-8adb-40ad12132685 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:51.424139 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3ca62edf-e871-4a94-8adb-40ad12132685 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:51.432229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3ca62edf-e871-4a94-8adb-40ad12132685 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.154973 Jul 27 20:34:51.432781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1309/2612] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:51 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:51.782708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-83e669e4-82ba-492a-9991-775b3e193e83 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:51.783328 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-83e669e4-82ba-492a-9991-775b3e193e83 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:51.790075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83e669e4-82ba-492a-9991-775b3e193e83 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:51.790526 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83e669e4-82ba-492a-9991-775b3e193e83 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:51.791287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83e669e4-82ba-492a-9991-775b3e193e83 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:51.791725 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83e669e4-82ba-492a-9991-775b3e193e83 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:51.922670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-83e669e4-82ba-492a-9991-775b3e193e83 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:51.931473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-83e669e4-82ba-492a-9991-775b3e193e83 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.152628 Jul 27 20:34:51.932037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1304/2613] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:51 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:52.121699 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-00e681c6-470d-4a9d-a72e-fb65c2766ca7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:52.122401 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-00e681c6-470d-4a9d-a72e-fb65c2766ca7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:52.129036 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00e681c6-470d-4a9d-a72e-fb65c2766ca7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:52.129518 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00e681c6-470d-4a9d-a72e-fb65c2766ca7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:52.130313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00e681c6-470d-4a9d-a72e-fb65c2766ca7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:52.130764 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00e681c6-470d-4a9d-a72e-fb65c2766ca7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:52.190601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-00e681c6-470d-4a9d-a72e-fb65c2766ca7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:52.199020 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-00e681c6-470d-4a9d-a72e-fb65c2766ca7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081206 Jul 27 20:34:52.199588 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1310/2614] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:52 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:52.453831 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a5449d69-dfee-4f82-b351-c05bb1048df3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:52.454444 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a5449d69-dfee-4f82-b351-c05bb1048df3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:52.460545 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a5449d69-dfee-4f82-b351-c05bb1048df3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:52.461022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a5449d69-dfee-4f82-b351-c05bb1048df3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:52.461785 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a5449d69-dfee-4f82-b351-c05bb1048df3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:52.462220 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a5449d69-dfee-4f82-b351-c05bb1048df3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:52.590177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a5449d69-dfee-4f82-b351-c05bb1048df3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:52.599033 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a5449d69-dfee-4f82-b351-c05bb1048df3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149248 Jul 27 20:34:52.599605 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1305/2615] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:52 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:52.953898 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d28de988-6269-41ee-a739-a949d7ee3552 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:52.954513 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d28de988-6269-41ee-a739-a949d7ee3552 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:52.961517 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d28de988-6269-41ee-a739-a949d7ee3552 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:52.961965 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d28de988-6269-41ee-a739-a949d7ee3552 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:52.962725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d28de988-6269-41ee-a739-a949d7ee3552 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:52.963165 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d28de988-6269-41ee-a739-a949d7ee3552 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:53.092213 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d28de988-6269-41ee-a739-a949d7ee3552 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:53.100887 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d28de988-6269-41ee-a739-a949d7ee3552 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.151062 Jul 27 20:34:53.101481 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1311/2616] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:52 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:53.220122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-de5120ee-ce12-4083-bf5d-200a1e06d489 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:53.220694 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-de5120ee-ce12-4083-bf5d-200a1e06d489 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:53.227620 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-de5120ee-ce12-4083-bf5d-200a1e06d489 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:53.228071 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-de5120ee-ce12-4083-bf5d-200a1e06d489 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:53.228823 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-de5120ee-ce12-4083-bf5d-200a1e06d489 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:53.229288 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-de5120ee-ce12-4083-bf5d-200a1e06d489 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:53.293785 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-de5120ee-ce12-4083-bf5d-200a1e06d489 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:53.302216 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-de5120ee-ce12-4083-bf5d-200a1e06d489 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085944 Jul 27 20:34:53.302766 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1306/2617] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:53 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:53.619928 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bb0e4224-6f08-4ff2-bbe6-64517612e310 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:53.620551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bb0e4224-6f08-4ff2-bbe6-64517612e310 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:53.626637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb0e4224-6f08-4ff2-bbe6-64517612e310 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:53.627097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb0e4224-6f08-4ff2-bbe6-64517612e310 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:53.627899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb0e4224-6f08-4ff2-bbe6-64517612e310 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:53.628413 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb0e4224-6f08-4ff2-bbe6-64517612e310 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:53.754858 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bb0e4224-6f08-4ff2-bbe6-64517612e310 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:53.762765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bb0e4224-6f08-4ff2-bbe6-64517612e310 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.146722 Jul 27 20:34:53.763341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1312/2618] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:53 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:54.123697 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-63ed74f1-0aa9-4f38-8f8c-f1b83dd94a03 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:54.124304 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-63ed74f1-0aa9-4f38-8f8c-f1b83dd94a03 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:54.131764 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63ed74f1-0aa9-4f38-8f8c-f1b83dd94a03 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:54.132205 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63ed74f1-0aa9-4f38-8f8c-f1b83dd94a03 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:54.132986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63ed74f1-0aa9-4f38-8f8c-f1b83dd94a03 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:54.133414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63ed74f1-0aa9-4f38-8f8c-f1b83dd94a03 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:54.259068 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-63ed74f1-0aa9-4f38-8f8c-f1b83dd94a03 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:54.266980 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-63ed74f1-0aa9-4f38-8f8c-f1b83dd94a03 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.147145 Jul 27 20:34:54.267541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1307/2619] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:54 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:54.322818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-84542c6e-6a01-4fc5-bda6-41d0a9096ce1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:54.323430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-84542c6e-6a01-4fc5-bda6-41d0a9096ce1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:54.330117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84542c6e-6a01-4fc5-bda6-41d0a9096ce1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:54.330508 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84542c6e-6a01-4fc5-bda6-41d0a9096ce1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:54.331265 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84542c6e-6a01-4fc5-bda6-41d0a9096ce1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:54.331784 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84542c6e-6a01-4fc5-bda6-41d0a9096ce1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:54.392602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-84542c6e-6a01-4fc5-bda6-41d0a9096ce1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:54.400451 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-84542c6e-6a01-4fc5-bda6-41d0a9096ce1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081453 Jul 27 20:34:54.401024 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1313/2620] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:54 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:54.785378 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ccfb1127-4551-4143-99e3-38d7a652e3e8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:54.786082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ccfb1127-4551-4143-99e3-38d7a652e3e8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:54.792049 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ccfb1127-4551-4143-99e3-38d7a652e3e8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:54.792487 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ccfb1127-4551-4143-99e3-38d7a652e3e8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:54.793254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ccfb1127-4551-4143-99e3-38d7a652e3e8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:54.793684 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ccfb1127-4551-4143-99e3-38d7a652e3e8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:54.923405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ccfb1127-4551-4143-99e3-38d7a652e3e8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:54.931863 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ccfb1127-4551-4143-99e3-38d7a652e3e8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151113 Jul 27 20:34:54.932429 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1308/2621] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:54 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:55.288324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-434342b2-f8ed-478d-bdc0-31f7ecb257e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:55.288932 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-434342b2-f8ed-478d-bdc0-31f7ecb257e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:55.294994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-434342b2-f8ed-478d-bdc0-31f7ecb257e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:55.295386 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-434342b2-f8ed-478d-bdc0-31f7ecb257e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:55.296137 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-434342b2-f8ed-478d-bdc0-31f7ecb257e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:55.296573 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-434342b2-f8ed-478d-bdc0-31f7ecb257e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:55.420590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1410d384-8ee0-46ab-bf2f-413a6faa9855 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:55.421208 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1410d384-8ee0-46ab-bf2f-413a6faa9855 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:55.428684 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1410d384-8ee0-46ab-bf2f-413a6faa9855 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:55.429158 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1410d384-8ee0-46ab-bf2f-413a6faa9855 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:55.429921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1410d384-8ee0-46ab-bf2f-413a6faa9855 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:55.430350 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1410d384-8ee0-46ab-bf2f-413a6faa9855 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:55.498505 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1410d384-8ee0-46ab-bf2f-413a6faa9855 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:55.506865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1410d384-8ee0-46ab-bf2f-413a6faa9855 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.090183 Jul 27 20:34:55.507452 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1309/2622] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:55 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:34:55.679659 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-434342b2-f8ed-478d-bdc0-31f7ecb257e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:55.687627 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-434342b2-f8ed-478d-bdc0-31f7ecb257e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.403858 Jul 27 20:34:55.688197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1314/2623] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:55 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:55.954267 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8b8c3405-5090-42c9-8c19-0349b3b52f06 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:55.954879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8b8c3405-5090-42c9-8c19-0349b3b52f06 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:55.960915 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b8c3405-5090-42c9-8c19-0349b3b52f06 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:55.961400 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b8c3405-5090-42c9-8c19-0349b3b52f06 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:55.962168 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b8c3405-5090-42c9-8c19-0349b3b52f06 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:55.962606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b8c3405-5090-42c9-8c19-0349b3b52f06 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:55.966547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:34:56.093631 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8b8c3405-5090-42c9-8c19-0349b3b52f06 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:56.102214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8b8c3405-5090-42c9-8c19-0349b3b52f06 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152111 Jul 27 20:34:56.102784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1310/2624] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:55 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:56.527758 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2b95438d-933d-4b89-8bb6-30782d67ab76 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:56.528368 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2b95438d-933d-4b89-8bb6-30782d67ab76 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:56.535513 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2b95438d-933d-4b89-8bb6-30782d67ab76 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:56.535956 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2b95438d-933d-4b89-8bb6-30782d67ab76 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:56.536710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2b95438d-933d-4b89-8bb6-30782d67ab76 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:56.537172 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2b95438d-933d-4b89-8bb6-30782d67ab76 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:56.596634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2b95438d-933d-4b89-8bb6-30782d67ab76 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:56.605210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2b95438d-933d-4b89-8bb6-30782d67ab76 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081342 Jul 27 20:34:56.605767 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1315/2625] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:56 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:56.710006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-292284dc-6353-45f3-83b4-c4c177328c69 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:56.710611 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-292284dc-6353-45f3-83b4-c4c177328c69 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:56.717052 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-292284dc-6353-45f3-83b4-c4c177328c69 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:56.717496 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-292284dc-6353-45f3-83b4-c4c177328c69 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:56.718239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-292284dc-6353-45f3-83b4-c4c177328c69 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:56.718665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-292284dc-6353-45f3-83b4-c4c177328c69 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:56.848829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-292284dc-6353-45f3-83b4-c4c177328c69 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:56.856739 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-292284dc-6353-45f3-83b4-c4c177328c69 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.151003 Jul 27 20:34:56.857330 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1311/2626] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:56 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:57.123349 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-74f82931-fc2f-42c8-8535-7f0dd26468d3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:57.123970 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-74f82931-fc2f-42c8-8535-7f0dd26468d3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:57.130925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-74f82931-fc2f-42c8-8535-7f0dd26468d3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:57.131381 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-74f82931-fc2f-42c8-8535-7f0dd26468d3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:57.132149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-74f82931-fc2f-42c8-8535-7f0dd26468d3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:57.132619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-74f82931-fc2f-42c8-8535-7f0dd26468d3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:57.262527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-74f82931-fc2f-42c8-8535-7f0dd26468d3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:57.270381 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-74f82931-fc2f-42c8-8535-7f0dd26468d3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150869 Jul 27 20:34:57.270954 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1316/2627] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:57 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:57.627648 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a5cf227e-8309-4dd3-b942-24b5605168eb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:57.628392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a5cf227e-8309-4dd3-b942-24b5605168eb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:57.634396 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a5cf227e-8309-4dd3-b942-24b5605168eb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:57.634834 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a5cf227e-8309-4dd3-b942-24b5605168eb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:57.635584 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a5cf227e-8309-4dd3-b942-24b5605168eb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:57.636026 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a5cf227e-8309-4dd3-b942-24b5605168eb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:57.699904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a5cf227e-8309-4dd3-b942-24b5605168eb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:57.708206 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a5cf227e-8309-4dd3-b942-24b5605168eb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084482 Jul 27 20:34:57.708761 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1312/2628] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:57 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:57.879418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2b3c943b-d31d-47b0-8505-805d4393bf5c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:57.880144 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2b3c943b-d31d-47b0-8505-805d4393bf5c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:57.887174 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2b3c943b-d31d-47b0-8505-805d4393bf5c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:57.887617 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2b3c943b-d31d-47b0-8505-805d4393bf5c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:57.888650 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2b3c943b-d31d-47b0-8505-805d4393bf5c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:57.889118 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2b3c943b-d31d-47b0-8505-805d4393bf5c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:58.017833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2b3c943b-d31d-47b0-8505-805d4393bf5c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:58.026301 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2b3c943b-d31d-47b0-8505-805d4393bf5c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.151113 Jul 27 20:34:58.026873 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1317/2629] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:57 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:58.290892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f5680dd6-e184-4c9e-b9bf-b6091b19bc11 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:58.291508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f5680dd6-e184-4c9e-b9bf-b6091b19bc11 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:58.298103 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f5680dd6-e184-4c9e-b9bf-b6091b19bc11 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:58.298555 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f5680dd6-e184-4c9e-b9bf-b6091b19bc11 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:58.299314 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f5680dd6-e184-4c9e-b9bf-b6091b19bc11 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:58.299759 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f5680dd6-e184-4c9e-b9bf-b6091b19bc11 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:58.427705 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f5680dd6-e184-4c9e-b9bf-b6091b19bc11 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:58.435708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f5680dd6-e184-4c9e-b9bf-b6091b19bc11 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148702 Jul 27 20:34:58.436273 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1313/2630] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:58 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:58.730376 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-84f7b1e6-6c4a-4c5a-addc-8d727cc8240d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:58.731028 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-84f7b1e6-6c4a-4c5a-addc-8d727cc8240d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:58.737069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84f7b1e6-6c4a-4c5a-addc-8d727cc8240d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:58.737606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84f7b1e6-6c4a-4c5a-addc-8d727cc8240d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:58.738545 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84f7b1e6-6c4a-4c5a-addc-8d727cc8240d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:58.739001 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84f7b1e6-6c4a-4c5a-addc-8d727cc8240d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:58.799289 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-84f7b1e6-6c4a-4c5a-addc-8d727cc8240d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:58.807068 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-84f7b1e6-6c4a-4c5a-addc-8d727cc8240d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081628 Jul 27 20:34:58.807623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1318/2631] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:58 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:59.048194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c2f5c084-e568-4dc1-8c0e-ff1c251cfcbe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:59.048730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c2f5c084-e568-4dc1-8c0e-ff1c251cfcbe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:59.054887 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2f5c084-e568-4dc1-8c0e-ff1c251cfcbe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:59.055340 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2f5c084-e568-4dc1-8c0e-ff1c251cfcbe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:59.056100 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2f5c084-e568-4dc1-8c0e-ff1c251cfcbe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:59.056536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2f5c084-e568-4dc1-8c0e-ff1c251cfcbe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:59.184152 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c2f5c084-e568-4dc1-8c0e-ff1c251cfcbe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:59.192113 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c2f5c084-e568-4dc1-8c0e-ff1c251cfcbe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.148393 Jul 27 20:34:59.192667 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1314/2632] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:59 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:59.457608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-83d2dcdb-12ab-48c2-b264-8a6b47292623 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:59.458229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-83d2dcdb-12ab-48c2-b264-8a6b47292623 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:59.464722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-83d2dcdb-12ab-48c2-b264-8a6b47292623 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:59.465222 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-83d2dcdb-12ab-48c2-b264-8a6b47292623 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:59.465988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-83d2dcdb-12ab-48c2-b264-8a6b47292623 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:59.466432 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-83d2dcdb-12ab-48c2-b264-8a6b47292623 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:59.595752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-83d2dcdb-12ab-48c2-b264-8a6b47292623 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:59.604745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-83d2dcdb-12ab-48c2-b264-8a6b47292623 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152026 Jul 27 20:34:59.605345 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1319/2633] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:59 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:34:59.828640 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ec699c49-a431-4176-8ad4-98ea10815679 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:34:59.829220 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ec699c49-a431-4176-8ad4-98ea10815679 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:34:59.837163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec699c49-a431-4176-8ad4-98ea10815679 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:59.837794 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec699c49-a431-4176-8ad4-98ea10815679 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:59.838756 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec699c49-a431-4176-8ad4-98ea10815679 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:34:59.839298 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec699c49-a431-4176-8ad4-98ea10815679 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:34:59.915440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ec699c49-a431-4176-8ad4-98ea10815679 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:34:59.924504 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ec699c49-a431-4176-8ad4-98ea10815679 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.100572 Jul 27 20:34:59.925218 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1315/2634] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:34:59 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:00.212874 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8d0ba296-2aea-4f08-b400-b8dcc28453ac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:00.213690 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8d0ba296-2aea-4f08-b400-b8dcc28453ac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:00.215689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=76 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:35:00.221415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8d0ba296-2aea-4f08-b400-b8dcc28453ac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:00.221918 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8d0ba296-2aea-4f08-b400-b8dcc28453ac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:00.222792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8d0ba296-2aea-4f08-b400-b8dcc28453ac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:00.223345 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8d0ba296-2aea-4f08-b400-b8dcc28453ac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:00.376366 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8d0ba296-2aea-4f08-b400-b8dcc28453ac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:00.386941 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8d0ba296-2aea-4f08-b400-b8dcc28453ac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.178002 Jul 27 20:35:00.388698 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1320/2635] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:00 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:00.626142 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-70b9a28a-6bbd-407f-8680-f2c25fd983e1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:00.626667 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-70b9a28a-6bbd-407f-8680-f2c25fd983e1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:00.632931 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70b9a28a-6bbd-407f-8680-f2c25fd983e1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:00.633404 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70b9a28a-6bbd-407f-8680-f2c25fd983e1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:00.634152 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70b9a28a-6bbd-407f-8680-f2c25fd983e1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:00.634580 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70b9a28a-6bbd-407f-8680-f2c25fd983e1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:00.873285 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-70b9a28a-6bbd-407f-8680-f2c25fd983e1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:00.881744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-70b9a28a-6bbd-407f-8680-f2c25fd983e1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.259452 Jul 27 20:35:00.882241 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1316/2636] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:00 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:00.946403 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8cb6510b-9766-4b36-9ae2-3efa7b3da2dc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:00.947053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8cb6510b-9766-4b36-9ae2-3efa7b3da2dc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:00.953877 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8cb6510b-9766-4b36-9ae2-3efa7b3da2dc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:00.954339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8cb6510b-9766-4b36-9ae2-3efa7b3da2dc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:00.955107 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8cb6510b-9766-4b36-9ae2-3efa7b3da2dc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:00.955557 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8cb6510b-9766-4b36-9ae2-3efa7b3da2dc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:01.016652 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8cb6510b-9766-4b36-9ae2-3efa7b3da2dc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:01.025255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8cb6510b-9766-4b36-9ae2-3efa7b3da2dc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082696 Jul 27 20:35:01.025820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1321/2637] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:00 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:01.412494 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2be13676-40c6-4115-925b-cd2e0e03817f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:01.413143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2be13676-40c6-4115-925b-cd2e0e03817f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:01.414983 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=82 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:35:01.420394 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2be13676-40c6-4115-925b-cd2e0e03817f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:01.420838 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2be13676-40c6-4115-925b-cd2e0e03817f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:01.421633 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2be13676-40c6-4115-925b-cd2e0e03817f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:01.422095 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2be13676-40c6-4115-925b-cd2e0e03817f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:01.549130 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2be13676-40c6-4115-925b-cd2e0e03817f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:01.557634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2be13676-40c6-4115-925b-cd2e0e03817f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.149817 Jul 27 20:35:01.558192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1317/2638] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:01 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:01.902822 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6a2f81e6-ff33-4fc0-a920-f330393f39d8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:01.903440 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6a2f81e6-ff33-4fc0-a920-f330393f39d8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:01.909458 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6a2f81e6-ff33-4fc0-a920-f330393f39d8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:01.909921 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6a2f81e6-ff33-4fc0-a920-f330393f39d8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:01.910731 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6a2f81e6-ff33-4fc0-a920-f330393f39d8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:01.911172 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6a2f81e6-ff33-4fc0-a920-f330393f39d8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:02.046624 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-05110447-865a-48a1-a9ba-82fe221cdd97 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:02.048158 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-05110447-865a-48a1-a9ba-82fe221cdd97 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:02.056607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05110447-865a-48a1-a9ba-82fe221cdd97 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:02.057163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05110447-865a-48a1-a9ba-82fe221cdd97 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:02.057938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05110447-865a-48a1-a9ba-82fe221cdd97 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:02.058379 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05110447-865a-48a1-a9ba-82fe221cdd97 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:02.105431 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6a2f81e6-ff33-4fc0-a920-f330393f39d8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:02.115129 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6a2f81e6-ff33-4fc0-a920-f330393f39d8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.216030 Jul 27 20:35:02.115719 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1322/2639] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:01 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:02.126864 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-05110447-865a-48a1-a9ba-82fe221cdd97 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:02.135085 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-05110447-865a-48a1-a9ba-82fe221cdd97 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.092386 Jul 27 20:35:02.135641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1318/2640] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:02 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:35:02.580656 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4823aed8-cea4-4c58-87d9-a0ceaff20052 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:02.581918 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4823aed8-cea4-4c58-87d9-a0ceaff20052 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:02.587996 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4823aed8-cea4-4c58-87d9-a0ceaff20052 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:02.588445 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4823aed8-cea4-4c58-87d9-a0ceaff20052 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:02.589234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4823aed8-cea4-4c58-87d9-a0ceaff20052 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:02.589675 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4823aed8-cea4-4c58-87d9-a0ceaff20052 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:02.717426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4823aed8-cea4-4c58-87d9-a0ceaff20052 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:02.720774 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:35:02.727015 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4823aed8-cea4-4c58-87d9-a0ceaff20052 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.150716 Jul 27 20:35:02.727585 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1323/2641] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:02 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:03.135621 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0e405884-a866-4740-93d1-23511a328567 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:03.136240 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0e405884-a866-4740-93d1-23511a328567 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:03.142602 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e405884-a866-4740-93d1-23511a328567 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:03.143048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e405884-a866-4740-93d1-23511a328567 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:03.143856 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e405884-a866-4740-93d1-23511a328567 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:03.144294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e405884-a866-4740-93d1-23511a328567 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:03.157109 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2d9903bf-8dd6-473e-9389-772803c03730 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:03.158471 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2d9903bf-8dd6-473e-9389-772803c03730 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:03.169065 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d9903bf-8dd6-473e-9389-772803c03730 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:03.170184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d9903bf-8dd6-473e-9389-772803c03730 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:03.171213 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d9903bf-8dd6-473e-9389-772803c03730 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:03.171730 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d9903bf-8dd6-473e-9389-772803c03730 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:03.256179 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2d9903bf-8dd6-473e-9389-772803c03730 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:03.265500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2d9903bf-8dd6-473e-9389-772803c03730 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.113297 Jul 27 20:35:03.266257 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1324/2642] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:03 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:03.289219 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0e405884-a866-4740-93d1-23511a328567 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:03.296996 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0e405884-a866-4740-93d1-23511a328567 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.165119 Jul 27 20:35:03.297666 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1319/2643] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:03 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:03.748931 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4251ad95-37e2-482c-9934-b1b4344b45d1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:03.749567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4251ad95-37e2-482c-9934-b1b4344b45d1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:03.756617 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4251ad95-37e2-482c-9934-b1b4344b45d1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:03.757097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4251ad95-37e2-482c-9934-b1b4344b45d1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:03.757863 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4251ad95-37e2-482c-9934-b1b4344b45d1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:03.758308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4251ad95-37e2-482c-9934-b1b4344b45d1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:03.897170 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4251ad95-37e2-482c-9934-b1b4344b45d1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:03.906213 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4251ad95-37e2-482c-9934-b1b4344b45d1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.161126 Jul 27 20:35:03.906782 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1325/2644] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:03 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:04.287624 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-85eb0365-dd87-4655-8f68-ba12a9601caf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:04.288229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-85eb0365-dd87-4655-8f68-ba12a9601caf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:04.294674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-85eb0365-dd87-4655-8f68-ba12a9601caf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:04.295128 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-85eb0365-dd87-4655-8f68-ba12a9601caf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:04.295890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-85eb0365-dd87-4655-8f68-ba12a9601caf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:04.296323 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-85eb0365-dd87-4655-8f68-ba12a9601caf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:04.319658 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-48c81b82-f28f-45aa-91d2-5af3b037ad73 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:04.320415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-48c81b82-f28f-45aa-91d2-5af3b037ad73 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:04.326605 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48c81b82-f28f-45aa-91d2-5af3b037ad73 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:04.327154 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48c81b82-f28f-45aa-91d2-5af3b037ad73 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:04.328302 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48c81b82-f28f-45aa-91d2-5af3b037ad73 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:04.328748 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48c81b82-f28f-45aa-91d2-5af3b037ad73 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:04.357433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-85eb0365-dd87-4655-8f68-ba12a9601caf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:04.366120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-85eb0365-dd87-4655-8f68-ba12a9601caf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083790 Jul 27 20:35:04.366686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1320/2645] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:04 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:04.456267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-48c81b82-f28f-45aa-91d2-5af3b037ad73 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:04.464388 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-48c81b82-f28f-45aa-91d2-5af3b037ad73 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148731 Jul 27 20:35:04.464985 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1326/2646] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:04 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:35:04.928041 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-09f1c68c-1e1b-4a54-900d-cd957e8d4ca1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:04.928794 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-09f1c68c-1e1b-4a54-900d-cd957e8d4ca1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:04.935698 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-09f1c68c-1e1b-4a54-900d-cd957e8d4ca1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:04.936147 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-09f1c68c-1e1b-4a54-900d-cd957e8d4ca1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:04.936913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-09f1c68c-1e1b-4a54-900d-cd957e8d4ca1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:04.937373 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-09f1c68c-1e1b-4a54-900d-cd957e8d4ca1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:05.354945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-09f1c68c-1e1b-4a54-900d-cd957e8d4ca1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:05.363562 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-09f1c68c-1e1b-4a54-900d-cd957e8d4ca1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1602 microversion: 2.1 time: 0.439475 Jul 27 20:35:05.364124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1321/2647] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:04 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1602 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:05.386822 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1c01380f-7fa7-445a-a0de-4f56905273f7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:05.387431 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1c01380f-7fa7-445a-a0de-4f56905273f7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:05.393814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1c01380f-7fa7-445a-a0de-4f56905273f7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:05.394267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1c01380f-7fa7-445a-a0de-4f56905273f7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:05.395031 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1c01380f-7fa7-445a-a0de-4f56905273f7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:05.395470 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1c01380f-7fa7-445a-a0de-4f56905273f7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:05.460540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1c01380f-7fa7-445a-a0de-4f56905273f7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:05.468561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1c01380f-7fa7-445a-a0de-4f56905273f7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085515 Jul 27 20:35:05.469258 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1327/2648] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:05 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:05.484750 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-72d3f0a5-0793-4a1a-9c24-aa25998e3090 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:05.485473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-72d3f0a5-0793-4a1a-9c24-aa25998e3090 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:05.492236 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-72d3f0a5-0793-4a1a-9c24-aa25998e3090 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:05.492731 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-72d3f0a5-0793-4a1a-9c24-aa25998e3090 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:05.493465 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-72d3f0a5-0793-4a1a-9c24-aa25998e3090 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:05.493896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-72d3f0a5-0793-4a1a-9c24-aa25998e3090 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:05.622385 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-1738bcaf-3332-48c4-80e0-e4966f74b6dd req-c6091fe3-cfd0-4747-b035-8d1fb9a6dc18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a92495d-74f4-4470-b9a4-919eb729c2a7", "name": "network-vif-deleted", "tag": "f9060715-d759-4b5a-9395-c2ef1b01d78e"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:35:05.635285 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-1738bcaf-3332-48c4-80e0-e4966f74b6dd req-c6091fe3-cfd0-4747-b035-8d1fb9a6dc18 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:05.636133 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-1738bcaf-3332-48c4-80e0-e4966f74b6dd req-c6091fe3-cfd0-4747-b035-8d1fb9a6dc18 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:05.648373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-1738bcaf-3332-48c4-80e0-e4966f74b6dd req-c6091fe3-cfd0-4747-b035-8d1fb9a6dc18 service nova] Creating event network-vif-deleted:f9060715-d759-4b5a-9395-c2ef1b01d78e for instance 8a92495d-74f4-4470-b9a4-919eb729c2a7 on hv-cinder-79987 Jul 27 20:35:05.656102 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-1738bcaf-3332-48c4-80e0-e4966f74b6dd req-c6091fe3-cfd0-4747-b035-8d1fb9a6dc18 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038138 Jul 27 20:35:05.656715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1328/2649] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:35:05.686275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-72d3f0a5-0793-4a1a-9c24-aa25998e3090 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:05.695341 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-72d3f0a5-0793-4a1a-9c24-aa25998e3090 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.214463 Jul 27 20:35:05.695919 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1322/2650] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:05 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:06.386043 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d24c0e06-b64f-489e-b1e7-4d799dfba9f0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:06.386751 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d24c0e06-b64f-489e-b1e7-4d799dfba9f0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:06.393228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d24c0e06-b64f-489e-b1e7-4d799dfba9f0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:06.393911 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d24c0e06-b64f-489e-b1e7-4d799dfba9f0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:06.394566 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d24c0e06-b64f-489e-b1e7-4d799dfba9f0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:06.395016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d24c0e06-b64f-489e-b1e7-4d799dfba9f0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:06.456431 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d24c0e06-b64f-489e-b1e7-4d799dfba9f0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:06.464208 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d24c0e06-b64f-489e-b1e7-4d799dfba9f0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.082398 Jul 27 20:35:06.464758 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1329/2651] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:06 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:06.490615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2b3fabe0-710b-46b0-8b3a-8daf0044c0b0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:06.491226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2b3fabe0-710b-46b0-8b3a-8daf0044c0b0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:06.497627 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b3fabe0-710b-46b0-8b3a-8daf0044c0b0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:06.498080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b3fabe0-710b-46b0-8b3a-8daf0044c0b0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:06.498836 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b3fabe0-710b-46b0-8b3a-8daf0044c0b0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:06.499273 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b3fabe0-710b-46b0-8b3a-8daf0044c0b0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:06.559307 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2b3fabe0-710b-46b0-8b3a-8daf0044c0b0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:06.567556 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2b3fabe0-710b-46b0-8b3a-8daf0044c0b0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081758 Jul 27 20:35:06.568118 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1323/2652] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:06 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:06.717862 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-39e216a5-a3bc-4209-aa09-df59de63a790 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:06.718406 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-39e216a5-a3bc-4209-aa09-df59de63a790 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:06.725013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-39e216a5-a3bc-4209-aa09-df59de63a790 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:06.725470 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-39e216a5-a3bc-4209-aa09-df59de63a790 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:06.726233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-39e216a5-a3bc-4209-aa09-df59de63a790 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:06.726676 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-39e216a5-a3bc-4209-aa09-df59de63a790 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:06.856115 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-39e216a5-a3bc-4209-aa09-df59de63a790 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:06.864369 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-39e216a5-a3bc-4209-aa09-df59de63a790 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150528 Jul 27 20:35:06.864937 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1330/2653] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:06 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:07.292510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:35:07.292700 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:35:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:35:07.486007 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-64d798c9-45f0-4ece-8f8d-08ec8274593e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:07.486618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-64d798c9-45f0-4ece-8f8d-08ec8274593e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:07.493312 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-64d798c9-45f0-4ece-8f8d-08ec8274593e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:07.493859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-64d798c9-45f0-4ece-8f8d-08ec8274593e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:07.494524 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-64d798c9-45f0-4ece-8f8d-08ec8274593e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:07.494934 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-64d798c9-45f0-4ece-8f8d-08ec8274593e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:07.555397 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-64d798c9-45f0-4ece-8f8d-08ec8274593e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:07.563232 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-64d798c9-45f0-4ece-8f8d-08ec8274593e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.081088 Jul 27 20:35:07.563781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1324/2654] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:07 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:35:07.588416 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-784e1440-d7bd-45ea-85aa-aa9853d5d662 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:07.589061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-784e1440-d7bd-45ea-85aa-aa9853d5d662 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:07.595574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-784e1440-d7bd-45ea-85aa-aa9853d5d662 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:07.596025 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-784e1440-d7bd-45ea-85aa-aa9853d5d662 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:07.597493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-784e1440-d7bd-45ea-85aa-aa9853d5d662 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:07.597965 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-784e1440-d7bd-45ea-85aa-aa9853d5d662 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:07.659951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-784e1440-d7bd-45ea-85aa-aa9853d5d662 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:07.667817 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-784e1440-d7bd-45ea-85aa-aa9853d5d662 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083241 Jul 27 20:35:07.668408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1331/2655] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:07 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:07.884977 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-635944e3-b6b8-47bd-afef-bc19142a6260 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:07.885605 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-635944e3-b6b8-47bd-afef-bc19142a6260 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:07.892160 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-635944e3-b6b8-47bd-afef-bc19142a6260 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:07.892610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-635944e3-b6b8-47bd-afef-bc19142a6260 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:07.893886 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-635944e3-b6b8-47bd-afef-bc19142a6260 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:07.894326 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-635944e3-b6b8-47bd-afef-bc19142a6260 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:08.026433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-635944e3-b6b8-47bd-afef-bc19142a6260 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:08.034406 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-635944e3-b6b8-47bd-afef-bc19142a6260 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153245 Jul 27 20:35:08.034959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1325/2656] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:07 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:08.584475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d2d512f6-4d68-401a-a8d7-df0b1e95889e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:08.585053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d2d512f6-4d68-401a-a8d7-df0b1e95889e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:08.591073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d2d512f6-4d68-401a-a8d7-df0b1e95889e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:08.591632 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d2d512f6-4d68-401a-a8d7-df0b1e95889e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:08.592273 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d2d512f6-4d68-401a-a8d7-df0b1e95889e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:08.592717 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d2d512f6-4d68-401a-a8d7-df0b1e95889e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:08.657131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d2d512f6-4d68-401a-a8d7-df0b1e95889e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:08.665665 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d2d512f6-4d68-401a-a8d7-df0b1e95889e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.085735 Jul 27 20:35:08.666227 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1332/2657] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:08 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:08.688562 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-709652a3-ff5e-4a00-9429-276ee915bf06 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:08.689229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-709652a3-ff5e-4a00-9429-276ee915bf06 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:08.695847 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-709652a3-ff5e-4a00-9429-276ee915bf06 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:08.696298 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-709652a3-ff5e-4a00-9429-276ee915bf06 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:08.697088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-709652a3-ff5e-4a00-9429-276ee915bf06 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:08.697525 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-709652a3-ff5e-4a00-9429-276ee915bf06 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:08.758977 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-709652a3-ff5e-4a00-9429-276ee915bf06 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:08.762273 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:35:08.767466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-709652a3-ff5e-4a00-9429-276ee915bf06 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082737 Jul 27 20:35:08.768019 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1326/2658] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:08 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:09.055267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2429892e-c0f9-44b4-85e5-31e1093e1c14 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:09.055893 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2429892e-c0f9-44b4-85e5-31e1093e1c14 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:09.061976 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2429892e-c0f9-44b4-85e5-31e1093e1c14 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:09.062433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2429892e-c0f9-44b4-85e5-31e1093e1c14 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:09.063206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2429892e-c0f9-44b4-85e5-31e1093e1c14 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:09.063649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2429892e-c0f9-44b4-85e5-31e1093e1c14 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:09.194584 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2429892e-c0f9-44b4-85e5-31e1093e1c14 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:09.202496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2429892e-c0f9-44b4-85e5-31e1093e1c14 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151259 Jul 27 20:35:09.203326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1333/2659] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:09 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:09.686470 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2fee5992-5d26-4854-bd8d-fc8eb8b4900d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:09.687078 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2fee5992-5d26-4854-bd8d-fc8eb8b4900d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:09.693913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fee5992-5d26-4854-bd8d-fc8eb8b4900d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:09.694467 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fee5992-5d26-4854-bd8d-fc8eb8b4900d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:09.695102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fee5992-5d26-4854-bd8d-fc8eb8b4900d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:09.695534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fee5992-5d26-4854-bd8d-fc8eb8b4900d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:09.758079 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2fee5992-5d26-4854-bd8d-fc8eb8b4900d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:09.765910 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2fee5992-5d26-4854-bd8d-fc8eb8b4900d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.083364 Jul 27 20:35:09.766462 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1327/2660] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:09 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:09.789190 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cb1fa1f1-138a-4a11-990b-938ab3bfbdaf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:09.789802 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cb1fa1f1-138a-4a11-990b-938ab3bfbdaf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:09.796152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb1fa1f1-138a-4a11-990b-938ab3bfbdaf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:09.796604 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb1fa1f1-138a-4a11-990b-938ab3bfbdaf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:09.797391 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb1fa1f1-138a-4a11-990b-938ab3bfbdaf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:09.797828 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb1fa1f1-138a-4a11-990b-938ab3bfbdaf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:09.860331 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cb1fa1f1-138a-4a11-990b-938ab3bfbdaf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:09.868338 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cb1fa1f1-138a-4a11-990b-938ab3bfbdaf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083070 Jul 27 20:35:09.868901 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1334/2661] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:09 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:10.224385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-187b67af-5411-4157-8f70-89b6b9533f4f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:10.225045 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-187b67af-5411-4157-8f70-89b6b9533f4f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:10.231098 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-187b67af-5411-4157-8f70-89b6b9533f4f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:10.231546 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-187b67af-5411-4157-8f70-89b6b9533f4f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:10.232301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-187b67af-5411-4157-8f70-89b6b9533f4f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:10.232734 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-187b67af-5411-4157-8f70-89b6b9533f4f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:10.360536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-187b67af-5411-4157-8f70-89b6b9533f4f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:10.369168 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-187b67af-5411-4157-8f70-89b6b9533f4f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149276 Jul 27 20:35:10.369799 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1328/2662] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:10 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:10.787591 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-471e0cae-3aab-434b-8cf3-7654e52c16b4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:10.788228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-471e0cae-3aab-434b-8cf3-7654e52c16b4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:10.794739 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-471e0cae-3aab-434b-8cf3-7654e52c16b4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:10.795303 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-471e0cae-3aab-434b-8cf3-7654e52c16b4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:10.795952 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-471e0cae-3aab-434b-8cf3-7654e52c16b4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:10.796397 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-471e0cae-3aab-434b-8cf3-7654e52c16b4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:10.856497 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-471e0cae-3aab-434b-8cf3-7654e52c16b4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:10.864745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-471e0cae-3aab-434b-8cf3-7654e52c16b4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.081637 Jul 27 20:35:10.865357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1335/2663] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:10 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:10.889720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9aba0f3e-c0ac-4936-ba1f-4b68671501d2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:10.890352 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9aba0f3e-c0ac-4936-ba1f-4b68671501d2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:10.896760 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9aba0f3e-c0ac-4936-ba1f-4b68671501d2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:10.897223 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9aba0f3e-c0ac-4936-ba1f-4b68671501d2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:10.897970 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9aba0f3e-c0ac-4936-ba1f-4b68671501d2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:10.898415 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9aba0f3e-c0ac-4936-ba1f-4b68671501d2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:10.958453 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9aba0f3e-c0ac-4936-ba1f-4b68671501d2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:10.966347 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9aba0f3e-c0ac-4936-ba1f-4b68671501d2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081008 Jul 27 20:35:10.966902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1329/2664] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:10 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:11.390824 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d4c95c58-d9f9-42db-8b07-1fdae8301d8d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:11.391432 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d4c95c58-d9f9-42db-8b07-1fdae8301d8d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:11.397739 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d4c95c58-d9f9-42db-8b07-1fdae8301d8d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:11.398196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d4c95c58-d9f9-42db-8b07-1fdae8301d8d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:11.398951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d4c95c58-d9f9-42db-8b07-1fdae8301d8d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:11.399384 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d4c95c58-d9f9-42db-8b07-1fdae8301d8d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:11.529521 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d4c95c58-d9f9-42db-8b07-1fdae8301d8d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:11.538296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d4c95c58-d9f9-42db-8b07-1fdae8301d8d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151464 Jul 27 20:35:11.538863 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1336/2665] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:11 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:11.885823 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-204853c4-e4de-49f8-92c9-b76568277350 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:11.886440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-204853c4-e4de-49f8-92c9-b76568277350 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:11.892932 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-204853c4-e4de-49f8-92c9-b76568277350 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:11.893845 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-204853c4-e4de-49f8-92c9-b76568277350 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:11.898330 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-204853c4-e4de-49f8-92c9-b76568277350 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:11.898794 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-204853c4-e4de-49f8-92c9-b76568277350 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:11.963736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-204853c4-e4de-49f8-92c9-b76568277350 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:11.972388 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-204853c4-e4de-49f8-92c9-b76568277350 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.090296 Jul 27 20:35:11.973093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1330/2666] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:11 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:11.990868 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c01333b6-7e37-4703-8827-0e080c5f9c54 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:11.991485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c01333b6-7e37-4703-8827-0e080c5f9c54 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:11.997914 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c01333b6-7e37-4703-8827-0e080c5f9c54 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:11.998365 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c01333b6-7e37-4703-8827-0e080c5f9c54 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:11.999133 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c01333b6-7e37-4703-8827-0e080c5f9c54 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:11.999575 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c01333b6-7e37-4703-8827-0e080c5f9c54 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:12.060468 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c01333b6-7e37-4703-8827-0e080c5f9c54 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:12.068408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c01333b6-7e37-4703-8827-0e080c5f9c54 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082541 Jul 27 20:35:12.068986 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1337/2667] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:11 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:35:12.559828 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3c7f4dd9-eb20-415f-86e9-0f6c0b311f69 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:12.560468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3c7f4dd9-eb20-415f-86e9-0f6c0b311f69 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:12.567150 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c7f4dd9-eb20-415f-86e9-0f6c0b311f69 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:12.567600 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c7f4dd9-eb20-415f-86e9-0f6c0b311f69 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:12.568358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c7f4dd9-eb20-415f-86e9-0f6c0b311f69 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:12.568793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c7f4dd9-eb20-415f-86e9-0f6c0b311f69 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:12.698485 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3c7f4dd9-eb20-415f-86e9-0f6c0b311f69 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:12.707301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3c7f4dd9-eb20-415f-86e9-0f6c0b311f69 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151458 Jul 27 20:35:12.707857 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1331/2668] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:12 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:12.998047 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-41885702-b991-4900-a081-c635549d56f0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:12.998672 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-41885702-b991-4900-a081-c635549d56f0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:13.005884 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41885702-b991-4900-a081-c635549d56f0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:13.006336 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41885702-b991-4900-a081-c635549d56f0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:13.007105 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41885702-b991-4900-a081-c635549d56f0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:13.007558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41885702-b991-4900-a081-c635549d56f0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:13.069017 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-41885702-b991-4900-a081-c635549d56f0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:13.077236 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-41885702-b991-4900-a081-c635549d56f0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.082961 Jul 27 20:35:13.078080 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1338/2669] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:12 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:13.089427 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7b1552f0-d563-4298-bc18-015db2c5f2f1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:13.090041 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7b1552f0-d563-4298-bc18-015db2c5f2f1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:13.096514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b1552f0-d563-4298-bc18-015db2c5f2f1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:13.097002 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b1552f0-d563-4298-bc18-015db2c5f2f1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:13.097779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b1552f0-d563-4298-bc18-015db2c5f2f1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:13.098211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b1552f0-d563-4298-bc18-015db2c5f2f1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:13.159042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7b1552f0-d563-4298-bc18-015db2c5f2f1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:13.167022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7b1552f0-d563-4298-bc18-015db2c5f2f1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081381 Jul 27 20:35:13.167576 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1332/2670] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:13 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:13.728563 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ff6a58d1-4dfa-446b-a3bf-b40dc06c7ce6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:13.729202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ff6a58d1-4dfa-446b-a3bf-b40dc06c7ce6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:13.735253 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ff6a58d1-4dfa-446b-a3bf-b40dc06c7ce6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:13.735697 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ff6a58d1-4dfa-446b-a3bf-b40dc06c7ce6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:13.736444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ff6a58d1-4dfa-446b-a3bf-b40dc06c7ce6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:13.736875 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ff6a58d1-4dfa-446b-a3bf-b40dc06c7ce6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:13.864570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ff6a58d1-4dfa-446b-a3bf-b40dc06c7ce6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:13.872656 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ff6a58d1-4dfa-446b-a3bf-b40dc06c7ce6 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.147956 Jul 27 20:35:13.873256 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1339/2671] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:13 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:14.099880 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b353c421-95cd-4aca-a9a4-9241df53170c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:14.100486 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b353c421-95cd-4aca-a9a4-9241df53170c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:14.107081 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b353c421-95cd-4aca-a9a4-9241df53170c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:14.107527 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b353c421-95cd-4aca-a9a4-9241df53170c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:14.108274 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b353c421-95cd-4aca-a9a4-9241df53170c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:14.108703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b353c421-95cd-4aca-a9a4-9241df53170c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:14.168565 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b353c421-95cd-4aca-a9a4-9241df53170c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:14.176273 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b353c421-95cd-4aca-a9a4-9241df53170c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.080502 Jul 27 20:35:14.176815 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1333/2672] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:14 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:14.187552 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7c8bf663-dc34-402b-96c3-565494b23e7a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:14.188257 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7c8bf663-dc34-402b-96c3-565494b23e7a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:14.195616 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7c8bf663-dc34-402b-96c3-565494b23e7a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:14.196071 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7c8bf663-dc34-402b-96c3-565494b23e7a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:14.196836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7c8bf663-dc34-402b-96c3-565494b23e7a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:14.197312 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7c8bf663-dc34-402b-96c3-565494b23e7a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:14.258470 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7c8bf663-dc34-402b-96c3-565494b23e7a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:14.266202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7c8bf663-dc34-402b-96c3-565494b23e7a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082573 Jul 27 20:35:14.266767 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1340/2673] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:14 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:14.894151 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3607445b-2323-4509-9fb1-816649d727ce tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:14.894855 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3607445b-2323-4509-9fb1-816649d727ce tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:14.900759 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3607445b-2323-4509-9fb1-816649d727ce tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:14.901262 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3607445b-2323-4509-9fb1-816649d727ce tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:14.902018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3607445b-2323-4509-9fb1-816649d727ce tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:14.902451 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3607445b-2323-4509-9fb1-816649d727ce tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:15.030620 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3607445b-2323-4509-9fb1-816649d727ce tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:15.039043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3607445b-2323-4509-9fb1-816649d727ce tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148928 Jul 27 20:35:15.039611 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1334/2674] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:14 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:15.197513 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fafa55ce-625c-4672-b5e5-3fd78434fdb8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:15.198065 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fafa55ce-625c-4672-b5e5-3fd78434fdb8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:15.204810 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fafa55ce-625c-4672-b5e5-3fd78434fdb8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:15.205297 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fafa55ce-625c-4672-b5e5-3fd78434fdb8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:15.206648 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fafa55ce-625c-4672-b5e5-3fd78434fdb8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:15.207086 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fafa55ce-625c-4672-b5e5-3fd78434fdb8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:15.211217 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:35:15.267018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fafa55ce-625c-4672-b5e5-3fd78434fdb8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:15.275687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fafa55ce-625c-4672-b5e5-3fd78434fdb8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.082129 Jul 27 20:35:15.276251 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1341/2675] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:15 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:15.288020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-15383158-c498-4607-ac0a-076437a1cf8a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:15.288670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-15383158-c498-4607-ac0a-076437a1cf8a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:15.294756 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-15383158-c498-4607-ac0a-076437a1cf8a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:15.295244 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-15383158-c498-4607-ac0a-076437a1cf8a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:15.296002 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-15383158-c498-4607-ac0a-076437a1cf8a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:15.296449 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-15383158-c498-4607-ac0a-076437a1cf8a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:15.361049 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-15383158-c498-4607-ac0a-076437a1cf8a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:15.369006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-15383158-c498-4607-ac0a-076437a1cf8a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085383 Jul 27 20:35:15.369579 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1335/2676] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:15 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:16.060362 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0a16a600-c1a9-439f-bda5-1e27722a38fe tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:16.061140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0a16a600-c1a9-439f-bda5-1e27722a38fe tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:16.068067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a16a600-c1a9-439f-bda5-1e27722a38fe tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:16.068524 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a16a600-c1a9-439f-bda5-1e27722a38fe tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:16.069357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a16a600-c1a9-439f-bda5-1e27722a38fe tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:16.069804 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a16a600-c1a9-439f-bda5-1e27722a38fe tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:16.199409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0a16a600-c1a9-439f-bda5-1e27722a38fe tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:16.208278 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0a16a600-c1a9-439f-bda5-1e27722a38fe tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151775 Jul 27 20:35:16.208847 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1342/2677] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:16 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:16.296262 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-73ec0648-5513-4c59-9e17-fdf21c3e9e3a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:16.296871 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-73ec0648-5513-4c59-9e17-fdf21c3e9e3a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:16.304009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73ec0648-5513-4c59-9e17-fdf21c3e9e3a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:16.304453 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73ec0648-5513-4c59-9e17-fdf21c3e9e3a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:16.305237 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73ec0648-5513-4c59-9e17-fdf21c3e9e3a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:16.305673 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73ec0648-5513-4c59-9e17-fdf21c3e9e3a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:16.366173 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-73ec0648-5513-4c59-9e17-fdf21c3e9e3a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:16.374110 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-73ec0648-5513-4c59-9e17-fdf21c3e9e3a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.081613 Jul 27 20:35:16.374671 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1336/2678] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:16 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:16.389559 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5a1d94f5-36a3-4e9f-9a04-a0099bbc99e3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:16.390183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5a1d94f5-36a3-4e9f-9a04-a0099bbc99e3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:16.396407 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5a1d94f5-36a3-4e9f-9a04-a0099bbc99e3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:16.396869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5a1d94f5-36a3-4e9f-9a04-a0099bbc99e3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:16.397659 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5a1d94f5-36a3-4e9f-9a04-a0099bbc99e3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:16.398107 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5a1d94f5-36a3-4e9f-9a04-a0099bbc99e3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:16.461807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5a1d94f5-36a3-4e9f-9a04-a0099bbc99e3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:16.469739 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5a1d94f5-36a3-4e9f-9a04-a0099bbc99e3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084023 Jul 27 20:35:16.470337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1343/2679] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:16 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:17.229523 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0f3c02b1-4421-47bb-a716-249f6c03b622 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:17.230157 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0f3c02b1-4421-47bb-a716-249f6c03b622 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:17.236154 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f3c02b1-4421-47bb-a716-249f6c03b622 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:17.236602 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f3c02b1-4421-47bb-a716-249f6c03b622 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:17.237399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f3c02b1-4421-47bb-a716-249f6c03b622 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:17.237830 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f3c02b1-4421-47bb-a716-249f6c03b622 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:17.367357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0f3c02b1-4421-47bb-a716-249f6c03b622 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:17.375098 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0f3c02b1-4421-47bb-a716-249f6c03b622 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149448 Jul 27 20:35:17.375644 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1337/2680] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:17 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:17.395298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-392c8a7e-3eff-4bc1-bac1-14f0b2662b38 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:17.395920 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-392c8a7e-3eff-4bc1-bac1-14f0b2662b38 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:17.402375 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-392c8a7e-3eff-4bc1-bac1-14f0b2662b38 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:17.402839 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-392c8a7e-3eff-4bc1-bac1-14f0b2662b38 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:17.403607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-392c8a7e-3eff-4bc1-bac1-14f0b2662b38 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:17.404050 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-392c8a7e-3eff-4bc1-bac1-14f0b2662b38 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:17.464074 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-392c8a7e-3eff-4bc1-bac1-14f0b2662b38 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:17.472098 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-392c8a7e-3eff-4bc1-bac1-14f0b2662b38 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.080773 Jul 27 20:35:17.472662 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1344/2681] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:17 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:17.491822 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4a9644f1-9d29-4538-8d7d-76bb4a45938f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:17.492428 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4a9644f1-9d29-4538-8d7d-76bb4a45938f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:17.498399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a9644f1-9d29-4538-8d7d-76bb4a45938f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:17.498840 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a9644f1-9d29-4538-8d7d-76bb4a45938f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:17.499592 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a9644f1-9d29-4538-8d7d-76bb4a45938f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:17.500020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a9644f1-9d29-4538-8d7d-76bb4a45938f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:17.563728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4a9644f1-9d29-4538-8d7d-76bb4a45938f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:17.572152 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4a9644f1-9d29-4538-8d7d-76bb4a45938f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085008 Jul 27 20:35:17.572702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1338/2682] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:17 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:18.396546 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-33a52c9f-7f2b-4266-acd5-5e90d6705967 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:18.397195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-33a52c9f-7f2b-4266-acd5-5e90d6705967 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:18.403716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-33a52c9f-7f2b-4266-acd5-5e90d6705967 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:18.404172 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-33a52c9f-7f2b-4266-acd5-5e90d6705967 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:18.404932 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-33a52c9f-7f2b-4266-acd5-5e90d6705967 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:18.405408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-33a52c9f-7f2b-4266-acd5-5e90d6705967 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:18.493929 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-691fd316-6bcf-44d3-ba39-fe489915fe39 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:18.494547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-691fd316-6bcf-44d3-ba39-fe489915fe39 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:18.500933 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-691fd316-6bcf-44d3-ba39-fe489915fe39 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:18.501415 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-691fd316-6bcf-44d3-ba39-fe489915fe39 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:18.502185 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-691fd316-6bcf-44d3-ba39-fe489915fe39 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:18.502688 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-691fd316-6bcf-44d3-ba39-fe489915fe39 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:18.534971 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-33a52c9f-7f2b-4266-acd5-5e90d6705967 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:18.543049 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-33a52c9f-7f2b-4266-acd5-5e90d6705967 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150472 Jul 27 20:35:18.543627 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1345/2683] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:18 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:18.563296 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-691fd316-6bcf-44d3-ba39-fe489915fe39 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:18.571410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-691fd316-6bcf-44d3-ba39-fe489915fe39 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.081233 Jul 27 20:35:18.572005 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1339/2684] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:18 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:35:18.593432 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b816f25a-4af7-44e5-9b09-0765293b3204 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:18.594048 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b816f25a-4af7-44e5-9b09-0765293b3204 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:18.600770 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b816f25a-4af7-44e5-9b09-0765293b3204 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:18.601252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b816f25a-4af7-44e5-9b09-0765293b3204 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:18.602010 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b816f25a-4af7-44e5-9b09-0765293b3204 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:18.602446 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b816f25a-4af7-44e5-9b09-0765293b3204 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:18.665837 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b816f25a-4af7-44e5-9b09-0765293b3204 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:18.673670 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b816f25a-4af7-44e5-9b09-0765293b3204 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084017 Jul 27 20:35:18.674220 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1346/2685] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:18 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:19.565352 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-651a6d52-e90f-4664-8c88-2f78815efdb3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:19.566012 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-651a6d52-e90f-4664-8c88-2f78815efdb3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:19.572571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-651a6d52-e90f-4664-8c88-2f78815efdb3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:19.573093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-651a6d52-e90f-4664-8c88-2f78815efdb3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:19.573883 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-651a6d52-e90f-4664-8c88-2f78815efdb3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:19.574311 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-651a6d52-e90f-4664-8c88-2f78815efdb3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:19.592635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d856f2ce-5920-4e32-b999-d9ffe5527af9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:19.593443 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d856f2ce-5920-4e32-b999-d9ffe5527af9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:19.602741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d856f2ce-5920-4e32-b999-d9ffe5527af9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:19.603201 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d856f2ce-5920-4e32-b999-d9ffe5527af9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:19.603973 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d856f2ce-5920-4e32-b999-d9ffe5527af9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:19.604406 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d856f2ce-5920-4e32-b999-d9ffe5527af9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:19.666087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d856f2ce-5920-4e32-b999-d9ffe5527af9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:19.674208 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d856f2ce-5920-4e32-b999-d9ffe5527af9 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.085295 Jul 27 20:35:19.674739 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1347/2686] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:19 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:35:19.694736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c3aad812-a29e-496e-8c04-cfde6afd44c2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:19.695342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c3aad812-a29e-496e-8c04-cfde6afd44c2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:19.701247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c3aad812-a29e-496e-8c04-cfde6afd44c2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:19.701696 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c3aad812-a29e-496e-8c04-cfde6afd44c2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:19.702453 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c3aad812-a29e-496e-8c04-cfde6afd44c2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:19.703156 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c3aad812-a29e-496e-8c04-cfde6afd44c2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:19.710777 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-651a6d52-e90f-4664-8c88-2f78815efdb3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:19.718933 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-651a6d52-e90f-4664-8c88-2f78815efdb3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.157637 Jul 27 20:35:19.719778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1340/2687] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:19 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:19.764242 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c3aad812-a29e-496e-8c04-cfde6afd44c2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:19.772562 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c3aad812-a29e-496e-8c04-cfde6afd44c2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081742 Jul 27 20:35:19.773159 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1348/2688] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:19 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:35:20.696016 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ccc4ee47-e311-48dc-ade6-0159b442529c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:20.696628 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ccc4ee47-e311-48dc-ade6-0159b442529c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:20.703346 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ccc4ee47-e311-48dc-ade6-0159b442529c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:20.703793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ccc4ee47-e311-48dc-ade6-0159b442529c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:20.704547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ccc4ee47-e311-48dc-ade6-0159b442529c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:20.705014 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ccc4ee47-e311-48dc-ade6-0159b442529c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:20.740194 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9acbbd5d-a217-4218-96f9-67eb947c2afd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:20.740807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9acbbd5d-a217-4218-96f9-67eb947c2afd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:20.747513 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9acbbd5d-a217-4218-96f9-67eb947c2afd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:20.747960 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9acbbd5d-a217-4218-96f9-67eb947c2afd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:20.748725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9acbbd5d-a217-4218-96f9-67eb947c2afd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:20.749185 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9acbbd5d-a217-4218-96f9-67eb947c2afd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:20.766243 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ccc4ee47-e311-48dc-ade6-0159b442529c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:20.774269 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ccc4ee47-e311-48dc-ade6-0159b442529c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.082891 Jul 27 20:35:20.775036 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1341/2689] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:20 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:20.793634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0925afa2-69df-4e91-b11c-e77c5fcbbf83 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:20.794251 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0925afa2-69df-4e91-b11c-e77c5fcbbf83 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:20.800147 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0925afa2-69df-4e91-b11c-e77c5fcbbf83 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:20.800598 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0925afa2-69df-4e91-b11c-e77c5fcbbf83 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:20.802046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0925afa2-69df-4e91-b11c-e77c5fcbbf83 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:20.802479 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0925afa2-69df-4e91-b11c-e77c5fcbbf83 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:20.868789 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0925afa2-69df-4e91-b11c-e77c5fcbbf83 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:20.876731 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0925afa2-69df-4e91-b11c-e77c5fcbbf83 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.086791 Jul 27 20:35:20.877335 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1342/2690] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:20 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:35:20.883414 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9acbbd5d-a217-4218-96f9-67eb947c2afd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:20.891416 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9acbbd5d-a217-4218-96f9-67eb947c2afd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.155691 Jul 27 20:35:20.891972 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1349/2691] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:20 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:35:21.795645 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5d485736-23d3-404e-b62c-70c2e0264b6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:21.796185 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5d485736-23d3-404e-b62c-70c2e0264b6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:21.803473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d485736-23d3-404e-b62c-70c2e0264b6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:21.803925 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d485736-23d3-404e-b62c-70c2e0264b6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:21.804690 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d485736-23d3-404e-b62c-70c2e0264b6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:21.805159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d485736-23d3-404e-b62c-70c2e0264b6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:21.823342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:35:21.867562 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5d485736-23d3-404e-b62c-70c2e0264b6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:21.875433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5d485736-23d3-404e-b62c-70c2e0264b6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.083734 Jul 27 20:35:21.875992 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1343/2692] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:21 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:21.898319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-56956c2b-c3c4-4c61-80df-0a500f05aa37 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:21.898938 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-56956c2b-c3c4-4c61-80df-0a500f05aa37 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:21.905401 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56956c2b-c3c4-4c61-80df-0a500f05aa37 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:21.905852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56956c2b-c3c4-4c61-80df-0a500f05aa37 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:21.906860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56956c2b-c3c4-4c61-80df-0a500f05aa37 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:21.907305 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56956c2b-c3c4-4c61-80df-0a500f05aa37 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:21.911327 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-84328468-1200-4622-89e8-88eb59c4de41 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:21.911935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-84328468-1200-4622-89e8-88eb59c4de41 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:21.917831 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-84328468-1200-4622-89e8-88eb59c4de41 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:21.918287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-84328468-1200-4622-89e8-88eb59c4de41 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:21.919054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-84328468-1200-4622-89e8-88eb59c4de41 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:21.919492 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-84328468-1200-4622-89e8-88eb59c4de41 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:21.969192 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-56956c2b-c3c4-4c61-80df-0a500f05aa37 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:21.977447 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-56956c2b-c3c4-4c61-80df-0a500f05aa37 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083503 Jul 27 20:35:21.978622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1350/2693] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:21 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:22.051487 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-84328468-1200-4622-89e8-88eb59c4de41 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:22.059347 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-84328468-1200-4622-89e8-88eb59c4de41 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151777 Jul 27 20:35:22.059915 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1344/2694] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:21 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:35:22.897340 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e1763269-9e1d-478d-a17b-f9ef560494c6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:22.897990 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e1763269-9e1d-478d-a17b-f9ef560494c6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:22.904562 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1763269-9e1d-478d-a17b-f9ef560494c6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:22.905155 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1763269-9e1d-478d-a17b-f9ef560494c6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:22.905792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1763269-9e1d-478d-a17b-f9ef560494c6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:22.906236 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1763269-9e1d-478d-a17b-f9ef560494c6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:22.968254 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e1763269-9e1d-478d-a17b-f9ef560494c6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:22.976253 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e1763269-9e1d-478d-a17b-f9ef560494c6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.083441 Jul 27 20:35:22.976820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1351/2695] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:22 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:23.001784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9243e09f-09ca-42e0-a184-d6b90670a09d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:23.002394 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9243e09f-09ca-42e0-a184-d6b90670a09d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:23.009430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9243e09f-09ca-42e0-a184-d6b90670a09d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:23.009875 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9243e09f-09ca-42e0-a184-d6b90670a09d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:23.010631 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9243e09f-09ca-42e0-a184-d6b90670a09d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:23.011065 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9243e09f-09ca-42e0-a184-d6b90670a09d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:23.079991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9243e09f-09ca-42e0-a184-d6b90670a09d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:23.081063 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f33c0965-7e96-46ee-abeb-dbf1fb3b8d67 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:23.081682 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f33c0965-7e96-46ee-abeb-dbf1fb3b8d67 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:23.088296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f33c0965-7e96-46ee-abeb-dbf1fb3b8d67 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:23.088638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9243e09f-09ca-42e0-a184-d6b90670a09d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.090599 Jul 27 20:35:23.088784 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f33c0965-7e96-46ee-abeb-dbf1fb3b8d67 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:23.089463 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1345/2696] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:22 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:23.089582 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f33c0965-7e96-46ee-abeb-dbf1fb3b8d67 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:23.090011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f33c0965-7e96-46ee-abeb-dbf1fb3b8d67 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:23.217555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f33c0965-7e96-46ee-abeb-dbf1fb3b8d67 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:23.225809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f33c0965-7e96-46ee-abeb-dbf1fb3b8d67 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148849 Jul 27 20:35:23.226382 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1352/2697] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:23 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:35:23.996940 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-64277f0d-a8c1-4803-aaa6-ad0311b54e30 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:23.997585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-64277f0d-a8c1-4803-aaa6-ad0311b54e30 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:24.003754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-64277f0d-a8c1-4803-aaa6-ad0311b54e30 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:24.004658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-64277f0d-a8c1-4803-aaa6-ad0311b54e30 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:24.005508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-64277f0d-a8c1-4803-aaa6-ad0311b54e30 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:24.006217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-64277f0d-a8c1-4803-aaa6-ad0311b54e30 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:24.073469 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-64277f0d-a8c1-4803-aaa6-ad0311b54e30 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:24.081650 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-64277f0d-a8c1-4803-aaa6-ad0311b54e30 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.088545 Jul 27 20:35:24.082812 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1346/2698] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:23 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:24.109183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-392f3973-044d-425d-b5bf-2296ccee0f31 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:24.109804 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-392f3973-044d-425d-b5bf-2296ccee0f31 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:24.116350 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-392f3973-044d-425d-b5bf-2296ccee0f31 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:24.116807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-392f3973-044d-425d-b5bf-2296ccee0f31 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:24.117607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-392f3973-044d-425d-b5bf-2296ccee0f31 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:24.118052 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-392f3973-044d-425d-b5bf-2296ccee0f31 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:24.181938 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-392f3973-044d-425d-b5bf-2296ccee0f31 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:24.189813 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-392f3973-044d-425d-b5bf-2296ccee0f31 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084583 Jul 27 20:35:24.190397 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1353/2699] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:24 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:24.246626 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cd969e3c-498d-49ea-992d-962803649ba2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:24.247291 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cd969e3c-498d-49ea-992d-962803649ba2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:24.253216 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd969e3c-498d-49ea-992d-962803649ba2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:24.253669 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd969e3c-498d-49ea-992d-962803649ba2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:24.254624 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd969e3c-498d-49ea-992d-962803649ba2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:24.255063 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd969e3c-498d-49ea-992d-962803649ba2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:24.386819 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cd969e3c-498d-49ea-992d-962803649ba2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:24.395239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cd969e3c-498d-49ea-992d-962803649ba2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151834 Jul 27 20:35:24.395803 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1347/2700] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:24 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:25.103909 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d020bc05-f7d8-4ff5-b78f-e2f29d6c7c3b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:25.104526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d020bc05-f7d8-4ff5-b78f-e2f29d6c7c3b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:25.110548 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d020bc05-f7d8-4ff5-b78f-e2f29d6c7c3b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:25.111123 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d020bc05-f7d8-4ff5-b78f-e2f29d6c7c3b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:25.111730 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d020bc05-f7d8-4ff5-b78f-e2f29d6c7c3b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:25.112164 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d020bc05-f7d8-4ff5-b78f-e2f29d6c7c3b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:25.172373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d020bc05-f7d8-4ff5-b78f-e2f29d6c7c3b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:25.180323 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d020bc05-f7d8-4ff5-b78f-e2f29d6c7c3b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.080300 Jul 27 20:35:25.180890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1354/2701] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:25 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:25.211867 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4ed1a403-46b0-4bc0-b1de-c91a9da85cba tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:25.212481 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4ed1a403-46b0-4bc0-b1de-c91a9da85cba tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:25.218902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ed1a403-46b0-4bc0-b1de-c91a9da85cba tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:25.219355 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ed1a403-46b0-4bc0-b1de-c91a9da85cba tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:25.220108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ed1a403-46b0-4bc0-b1de-c91a9da85cba tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:25.220541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ed1a403-46b0-4bc0-b1de-c91a9da85cba tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:25.281181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4ed1a403-46b0-4bc0-b1de-c91a9da85cba tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:25.288886 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4ed1a403-46b0-4bc0-b1de-c91a9da85cba tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081598 Jul 27 20:35:25.289556 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1348/2702] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:25 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:25.416191 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b1337a7e-eea3-4a41-9ec4-1978afdc2123 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:25.416811 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b1337a7e-eea3-4a41-9ec4-1978afdc2123 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:25.422949 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b1337a7e-eea3-4a41-9ec4-1978afdc2123 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:25.423356 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b1337a7e-eea3-4a41-9ec4-1978afdc2123 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:25.424117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b1337a7e-eea3-4a41-9ec4-1978afdc2123 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:25.424559 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b1337a7e-eea3-4a41-9ec4-1978afdc2123 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:25.555249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b1337a7e-eea3-4a41-9ec4-1978afdc2123 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:25.563086 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b1337a7e-eea3-4a41-9ec4-1978afdc2123 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150800 Jul 27 20:35:25.563655 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1355/2703] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:25 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:26.201789 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9fb4a365-c9dc-404c-b8b3-83e5d6c9f2ed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:26.202399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9fb4a365-c9dc-404c-b8b3-83e5d6c9f2ed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:26.208761 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9fb4a365-c9dc-404c-b8b3-83e5d6c9f2ed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:26.209239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9fb4a365-c9dc-404c-b8b3-83e5d6c9f2ed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:26.209992 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9fb4a365-c9dc-404c-b8b3-83e5d6c9f2ed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:26.210422 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9fb4a365-c9dc-404c-b8b3-83e5d6c9f2ed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:26.281851 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9fb4a365-c9dc-404c-b8b3-83e5d6c9f2ed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:26.289805 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9fb4a365-c9dc-404c-b8b3-83e5d6c9f2ed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.091834 Jul 27 20:35:26.290354 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1349/2704] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:26 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:26.309807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-48455a6c-1f4d-4602-a815-5344ee4308b0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:26.310417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-48455a6c-1f4d-4602-a815-5344ee4308b0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:26.317648 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48455a6c-1f4d-4602-a815-5344ee4308b0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:26.318092 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48455a6c-1f4d-4602-a815-5344ee4308b0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:26.318843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48455a6c-1f4d-4602-a815-5344ee4308b0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:26.319275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48455a6c-1f4d-4602-a815-5344ee4308b0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:26.382776 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-48455a6c-1f4d-4602-a815-5344ee4308b0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:26.390655 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-48455a6c-1f4d-4602-a815-5344ee4308b0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084603 Jul 27 20:35:26.391217 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1356/2705] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:26 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:26.583284 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c22a65bc-bfc2-4258-acaa-03079971c2a8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:26.583897 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c22a65bc-bfc2-4258-acaa-03079971c2a8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:26.590090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c22a65bc-bfc2-4258-acaa-03079971c2a8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:26.590541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c22a65bc-bfc2-4258-acaa-03079971c2a8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:26.591304 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c22a65bc-bfc2-4258-acaa-03079971c2a8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:26.591745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c22a65bc-bfc2-4258-acaa-03079971c2a8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:26.661297 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:35:26.661562 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:35:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 (ip 10.222.0.65) !!! Jul 27 20:35:26.718637 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c22a65bc-bfc2-4258-acaa-03079971c2a8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:26.727203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c22a65bc-bfc2-4258-acaa-03079971c2a8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.147960 Jul 27 20:35:26.727874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1350/2706] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:26 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:27.311268 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-70550b14-fc56-4140-b73f-4146b2f6e32b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:27.311880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-70550b14-fc56-4140-b73f-4146b2f6e32b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:27.318406 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-70550b14-fc56-4140-b73f-4146b2f6e32b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:27.318880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-70550b14-fc56-4140-b73f-4146b2f6e32b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:27.319633 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-70550b14-fc56-4140-b73f-4146b2f6e32b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:27.320066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-70550b14-fc56-4140-b73f-4146b2f6e32b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:27.380884 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-70550b14-fc56-4140-b73f-4146b2f6e32b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:27.384238 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:35:27.389827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-70550b14-fc56-4140-b73f-4146b2f6e32b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.082360 Jul 27 20:35:27.390392 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1357/2707] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:27 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:27.411783 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b82fa880-c4be-4d8e-ac4e-09acc12ee506 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:27.412431 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b82fa880-c4be-4d8e-ac4e-09acc12ee506 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:27.419068 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b82fa880-c4be-4d8e-ac4e-09acc12ee506 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:27.419522 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b82fa880-c4be-4d8e-ac4e-09acc12ee506 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:27.420283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b82fa880-c4be-4d8e-ac4e-09acc12ee506 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:27.420723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b82fa880-c4be-4d8e-ac4e-09acc12ee506 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:27.483054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b82fa880-c4be-4d8e-ac4e-09acc12ee506 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:27.491632 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b82fa880-c4be-4d8e-ac4e-09acc12ee506 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084488 Jul 27 20:35:27.492193 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1351/2708] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:27 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:27.748713 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b8f0a8c5-c573-4199-814b-4ed9f87f09ca tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:27.749347 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b8f0a8c5-c573-4199-814b-4ed9f87f09ca tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:27.755238 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b8f0a8c5-c573-4199-814b-4ed9f87f09ca tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:27.755682 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b8f0a8c5-c573-4199-814b-4ed9f87f09ca tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:27.756439 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b8f0a8c5-c573-4199-814b-4ed9f87f09ca tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:27.756869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b8f0a8c5-c573-4199-814b-4ed9f87f09ca tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:27.886296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b8f0a8c5-c573-4199-814b-4ed9f87f09ca tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:27.894187 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b8f0a8c5-c573-4199-814b-4ed9f87f09ca tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149616 Jul 27 20:35:27.895541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1358/2709] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:27 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:28.411282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-18fab691-9b94-482f-8462-bf4e71fee4bb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:28.411904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-18fab691-9b94-482f-8462-bf4e71fee4bb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:28.418189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18fab691-9b94-482f-8462-bf4e71fee4bb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:28.418643 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18fab691-9b94-482f-8462-bf4e71fee4bb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:28.419404 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18fab691-9b94-482f-8462-bf4e71fee4bb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:28.419845 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18fab691-9b94-482f-8462-bf4e71fee4bb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:28.483924 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-18fab691-9b94-482f-8462-bf4e71fee4bb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:28.492282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-18fab691-9b94-482f-8462-bf4e71fee4bb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.085184 Jul 27 20:35:28.492838 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1352/2710] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:28 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:28.511503 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c9a0aece-5cbf-494e-9311-42ceeb18d9af tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:28.512108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c9a0aece-5cbf-494e-9311-42ceeb18d9af tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:28.518528 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c9a0aece-5cbf-494e-9311-42ceeb18d9af tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:28.518976 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c9a0aece-5cbf-494e-9311-42ceeb18d9af tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:28.519773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c9a0aece-5cbf-494e-9311-42ceeb18d9af tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:28.520208 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c9a0aece-5cbf-494e-9311-42ceeb18d9af tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:28.581043 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c9a0aece-5cbf-494e-9311-42ceeb18d9af tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:28.589027 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c9a0aece-5cbf-494e-9311-42ceeb18d9af tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081290 Jul 27 20:35:28.589590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1359/2711] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:28 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:28.916291 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-81bb91ec-df35-4f7d-92b0-4f2a08320516 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:28.916913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-81bb91ec-df35-4f7d-92b0-4f2a08320516 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:28.922936 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81bb91ec-df35-4f7d-92b0-4f2a08320516 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:28.923386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81bb91ec-df35-4f7d-92b0-4f2a08320516 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:28.924148 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81bb91ec-df35-4f7d-92b0-4f2a08320516 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:28.924588 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81bb91ec-df35-4f7d-92b0-4f2a08320516 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:29.055982 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-81bb91ec-df35-4f7d-92b0-4f2a08320516 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:29.063957 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-81bb91ec-df35-4f7d-92b0-4f2a08320516 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151497 Jul 27 20:35:29.064528 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1353/2712] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:28 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:29.513728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c373e580-0467-41b1-b61b-4a6baeb12603 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:29.514351 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c373e580-0467-41b1-b61b-4a6baeb12603 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:29.521042 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c373e580-0467-41b1-b61b-4a6baeb12603 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:29.521499 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c373e580-0467-41b1-b61b-4a6baeb12603 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:29.522293 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c373e580-0467-41b1-b61b-4a6baeb12603 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:29.522736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c373e580-0467-41b1-b61b-4a6baeb12603 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:29.585720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c373e580-0467-41b1-b61b-4a6baeb12603 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:29.593717 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c373e580-0467-41b1-b61b-4a6baeb12603 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.083766 Jul 27 20:35:29.594450 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1360/2713] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:29 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:29.609133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-726c7a1f-3a72-4b3c-b161-54a179e16395 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:29.609766 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-726c7a1f-3a72-4b3c-b161-54a179e16395 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:29.617183 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-726c7a1f-3a72-4b3c-b161-54a179e16395 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:29.617638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-726c7a1f-3a72-4b3c-b161-54a179e16395 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:29.618412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-726c7a1f-3a72-4b3c-b161-54a179e16395 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:29.618849 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-726c7a1f-3a72-4b3c-b161-54a179e16395 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:29.680254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-726c7a1f-3a72-4b3c-b161-54a179e16395 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:29.688238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-726c7a1f-3a72-4b3c-b161-54a179e16395 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083072 Jul 27 20:35:29.688799 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1354/2714] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:29 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:30.086464 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d34c8d2f-b89b-4847-ac69-68fd6e75213c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:30.087075 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d34c8d2f-b89b-4847-ac69-68fd6e75213c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:30.093126 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d34c8d2f-b89b-4847-ac69-68fd6e75213c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:30.093571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d34c8d2f-b89b-4847-ac69-68fd6e75213c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:30.094324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d34c8d2f-b89b-4847-ac69-68fd6e75213c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:30.094757 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d34c8d2f-b89b-4847-ac69-68fd6e75213c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:30.222862 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d34c8d2f-b89b-4847-ac69-68fd6e75213c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:30.231020 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d34c8d2f-b89b-4847-ac69-68fd6e75213c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148399 Jul 27 20:35:30.231585 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1361/2715] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:30 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:30.615985 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a4af54bc-bc48-4819-8fa5-1d40c5568e5b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:30.616596 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a4af54bc-bc48-4819-8fa5-1d40c5568e5b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:30.623072 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a4af54bc-bc48-4819-8fa5-1d40c5568e5b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:30.623512 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a4af54bc-bc48-4819-8fa5-1d40c5568e5b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:30.624262 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a4af54bc-bc48-4819-8fa5-1d40c5568e5b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:30.624692 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a4af54bc-bc48-4819-8fa5-1d40c5568e5b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:30.684943 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a4af54bc-bc48-4819-8fa5-1d40c5568e5b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:30.693317 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a4af54bc-bc48-4819-8fa5-1d40c5568e5b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.081074 Jul 27 20:35:30.693903 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1355/2716] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:30 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:30.709437 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2080c908-285f-4157-a6bc-656af4a32b96 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:30.710079 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2080c908-285f-4157-a6bc-656af4a32b96 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:30.712365 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=84 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:35:30.717860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2080c908-285f-4157-a6bc-656af4a32b96 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:30.718314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2080c908-285f-4157-a6bc-656af4a32b96 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:30.719073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2080c908-285f-4157-a6bc-656af4a32b96 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:30.719515 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2080c908-285f-4157-a6bc-656af4a32b96 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:30.780389 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2080c908-285f-4157-a6bc-656af4a32b96 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:30.788977 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2080c908-285f-4157-a6bc-656af4a32b96 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084055 Jul 27 20:35:30.789549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1362/2717] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:30 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:31.252609 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f9361686-0f49-4fd6-bf02-3888e03e98f9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:31.253245 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f9361686-0f49-4fd6-bf02-3888e03e98f9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:31.259958 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9361686-0f49-4fd6-bf02-3888e03e98f9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:31.260408 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9361686-0f49-4fd6-bf02-3888e03e98f9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:31.261211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9361686-0f49-4fd6-bf02-3888e03e98f9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:31.261683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9361686-0f49-4fd6-bf02-3888e03e98f9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:31.395301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f9361686-0f49-4fd6-bf02-3888e03e98f9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:31.403229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f9361686-0f49-4fd6-bf02-3888e03e98f9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.154410 Jul 27 20:35:31.403801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1356/2718] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:31 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:31.714798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-491081b4-6685-49a9-88c4-164d2947747a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:31.715454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-491081b4-6685-49a9-88c4-164d2947747a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:31.722177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-491081b4-6685-49a9-88c4-164d2947747a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:31.723384 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-491081b4-6685-49a9-88c4-164d2947747a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:31.724193 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-491081b4-6685-49a9-88c4-164d2947747a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:31.724669 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-491081b4-6685-49a9-88c4-164d2947747a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:31.787784 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-491081b4-6685-49a9-88c4-164d2947747a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:31.795681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-491081b4-6685-49a9-88c4-164d2947747a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.084782 Jul 27 20:35:31.796257 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1363/2719] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:31 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:31.809328 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1e4a9a6b-c122-49b2-8a38-65a6d7c6242f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:31.809935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1e4a9a6b-c122-49b2-8a38-65a6d7c6242f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:31.812205 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=80 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:35:31.818231 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1e4a9a6b-c122-49b2-8a38-65a6d7c6242f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:31.818683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1e4a9a6b-c122-49b2-8a38-65a6d7c6242f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:31.819449 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1e4a9a6b-c122-49b2-8a38-65a6d7c6242f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:31.819890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1e4a9a6b-c122-49b2-8a38-65a6d7c6242f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:31.880497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1e4a9a6b-c122-49b2-8a38-65a6d7c6242f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:31.888355 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1e4a9a6b-c122-49b2-8a38-65a6d7c6242f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082794 Jul 27 20:35:31.888913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1357/2720] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:31 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:32.423565 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5e946a56-d239-4b37-8191-8289e2d44bdc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:32.424182 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5e946a56-d239-4b37-8191-8289e2d44bdc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:32.431045 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5e946a56-d239-4b37-8191-8289e2d44bdc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:32.431495 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5e946a56-d239-4b37-8191-8289e2d44bdc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:32.432288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5e946a56-d239-4b37-8191-8289e2d44bdc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:32.432724 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5e946a56-d239-4b37-8191-8289e2d44bdc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:32.559585 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5e946a56-d239-4b37-8191-8289e2d44bdc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:32.567555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5e946a56-d239-4b37-8191-8289e2d44bdc tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.147817 Jul 27 20:35:32.568120 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1364/2721] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:32 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:32.818609 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-49958722-7e20-43b0-aece-90d78b3bd097 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:32.819131 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-49958722-7e20-43b0-aece-90d78b3bd097 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:32.825663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49958722-7e20-43b0-aece-90d78b3bd097 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:32.826116 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49958722-7e20-43b0-aece-90d78b3bd097 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:32.826878 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49958722-7e20-43b0-aece-90d78b3bd097 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:32.827321 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49958722-7e20-43b0-aece-90d78b3bd097 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:32.887739 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-49958722-7e20-43b0-aece-90d78b3bd097 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:32.896815 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-49958722-7e20-43b0-aece-90d78b3bd097 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.082856 Jul 27 20:35:32.897408 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1358/2722] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:32 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:32.909421 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-63b781ba-dca6-4345-a33f-195eee6e9402 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:32.910898 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-63b781ba-dca6-4345-a33f-195eee6e9402 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:32.917037 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63b781ba-dca6-4345-a33f-195eee6e9402 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:32.917491 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63b781ba-dca6-4345-a33f-195eee6e9402 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:32.918259 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63b781ba-dca6-4345-a33f-195eee6e9402 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:32.918701 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63b781ba-dca6-4345-a33f-195eee6e9402 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:32.979660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-63b781ba-dca6-4345-a33f-195eee6e9402 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:32.987620 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-63b781ba-dca6-4345-a33f-195eee6e9402 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082061 Jul 27 20:35:32.988213 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1365/2723] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:32 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:33.588354 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f1a8d7da-b4aa-4337-b014-c6513f78b8c0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:33.588955 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f1a8d7da-b4aa-4337-b014-c6513f78b8c0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:33.594948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1a8d7da-b4aa-4337-b014-c6513f78b8c0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:33.595387 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1a8d7da-b4aa-4337-b014-c6513f78b8c0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:33.596129 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1a8d7da-b4aa-4337-b014-c6513f78b8c0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:33.596568 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1a8d7da-b4aa-4337-b014-c6513f78b8c0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:33.726857 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f1a8d7da-b4aa-4337-b014-c6513f78b8c0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:33.734660 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f1a8d7da-b4aa-4337-b014-c6513f78b8c0 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150107 Jul 27 20:35:33.735211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1359/2724] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:33 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:33.917917 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c3c14edc-75a1-4c46-9577-dad4917a2590 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:33.918528 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c3c14edc-75a1-4c46-9577-dad4917a2590 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:33.924692 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c3c14edc-75a1-4c46-9577-dad4917a2590 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:33.925176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c3c14edc-75a1-4c46-9577-dad4917a2590 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:33.926730 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c3c14edc-75a1-4c46-9577-dad4917a2590 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:33.927160 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c3c14edc-75a1-4c46-9577-dad4917a2590 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:33.991173 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c3c14edc-75a1-4c46-9577-dad4917a2590 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:33.999582 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c3c14edc-75a1-4c46-9577-dad4917a2590 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.085670 Jul 27 20:35:34.000132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1366/2725] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:33 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:34.007680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-115c88c3-0a59-43d3-b2aa-0ff72fc19a48 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:34.008434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-115c88c3-0a59-43d3-b2aa-0ff72fc19a48 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:34.015090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-115c88c3-0a59-43d3-b2aa-0ff72fc19a48 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:34.015541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-115c88c3-0a59-43d3-b2aa-0ff72fc19a48 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:34.016306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-115c88c3-0a59-43d3-b2aa-0ff72fc19a48 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:34.016741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-115c88c3-0a59-43d3-b2aa-0ff72fc19a48 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:34.020744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:35:34.081424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-115c88c3-0a59-43d3-b2aa-0ff72fc19a48 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:34.090275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-115c88c3-0a59-43d3-b2aa-0ff72fc19a48 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.086494 Jul 27 20:35:34.090864 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1360/2726] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:34 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:34.757505 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-43c58d80-dc68-47f5-883f-39d8617d920f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:34.758121 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-43c58d80-dc68-47f5-883f-39d8617d920f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:34.764182 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-43c58d80-dc68-47f5-883f-39d8617d920f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:34.764637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-43c58d80-dc68-47f5-883f-39d8617d920f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:34.765436 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-43c58d80-dc68-47f5-883f-39d8617d920f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:34.765882 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-43c58d80-dc68-47f5-883f-39d8617d920f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:34.896989 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-43c58d80-dc68-47f5-883f-39d8617d920f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:34.904747 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-43c58d80-dc68-47f5-883f-39d8617d920f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151801 Jul 27 20:35:34.905337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1367/2727] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:34 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:35.020620 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7801b571-c2aa-4ad0-a8a5-56428394b773 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:35.021189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7801b571-c2aa-4ad0-a8a5-56428394b773 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:35.027545 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7801b571-c2aa-4ad0-a8a5-56428394b773 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:35.027992 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7801b571-c2aa-4ad0-a8a5-56428394b773 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:35.028737 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7801b571-c2aa-4ad0-a8a5-56428394b773 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:35.029211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7801b571-c2aa-4ad0-a8a5-56428394b773 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:35.091205 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7801b571-c2aa-4ad0-a8a5-56428394b773 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:35.099108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7801b571-c2aa-4ad0-a8a5-56428394b773 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.083167 Jul 27 20:35:35.099672 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1361/2728] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:35 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:35.110805 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-202fbf4b-cd6d-477f-b477-b3e6af75ba50 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:35.111431 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-202fbf4b-cd6d-477f-b477-b3e6af75ba50 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:35.118706 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-202fbf4b-cd6d-477f-b477-b3e6af75ba50 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:35.119164 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-202fbf4b-cd6d-477f-b477-b3e6af75ba50 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:35.119930 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-202fbf4b-cd6d-477f-b477-b3e6af75ba50 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:35.120375 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-202fbf4b-cd6d-477f-b477-b3e6af75ba50 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:35.181725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-202fbf4b-cd6d-477f-b477-b3e6af75ba50 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:35.189532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-202fbf4b-cd6d-477f-b477-b3e6af75ba50 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082585 Jul 27 20:35:35.190095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1368/2729] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:35 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:35.926504 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-107eafc8-fc4a-44e4-b91d-096757e05e33 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:35.927111 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-107eafc8-fc4a-44e4-b91d-096757e05e33 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:35.933160 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-107eafc8-fc4a-44e4-b91d-096757e05e33 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:35.933611 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-107eafc8-fc4a-44e4-b91d-096757e05e33 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:35.934383 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-107eafc8-fc4a-44e4-b91d-096757e05e33 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:35.934801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-107eafc8-fc4a-44e4-b91d-096757e05e33 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:36.069564 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-107eafc8-fc4a-44e4-b91d-096757e05e33 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:36.077593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-107eafc8-fc4a-44e4-b91d-096757e05e33 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.155396 Jul 27 20:35:36.078425 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1362/2730] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:35 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:36.120322 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b40978f5-e3de-4135-a4c0-3acf601ba023 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:36.120945 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b40978f5-e3de-4135-a4c0-3acf601ba023 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:36.127445 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b40978f5-e3de-4135-a4c0-3acf601ba023 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:36.127903 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b40978f5-e3de-4135-a4c0-3acf601ba023 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:36.129354 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b40978f5-e3de-4135-a4c0-3acf601ba023 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:36.129800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b40978f5-e3de-4135-a4c0-3acf601ba023 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:36.188931 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b40978f5-e3de-4135-a4c0-3acf601ba023 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:36.197235 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b40978f5-e3de-4135-a4c0-3acf601ba023 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.080761 Jul 27 20:35:36.197794 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1369/2731] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:36 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:36.211629 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7dea4834-4267-401d-83cc-82fe711a6d49 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:36.212233 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7dea4834-4267-401d-83cc-82fe711a6d49 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:36.218196 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7dea4834-4267-401d-83cc-82fe711a6d49 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:36.218635 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7dea4834-4267-401d-83cc-82fe711a6d49 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:36.219392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7dea4834-4267-401d-83cc-82fe711a6d49 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:36.219818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7dea4834-4267-401d-83cc-82fe711a6d49 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:36.290257 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7dea4834-4267-401d-83cc-82fe711a6d49 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:36.298132 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7dea4834-4267-401d-83cc-82fe711a6d49 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.090391 Jul 27 20:35:36.298692 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1363/2732] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:36 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:37.098125 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-32922aea-ed5a-41e1-87db-1ae1c9afbdf4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:37.098774 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-32922aea-ed5a-41e1-87db-1ae1c9afbdf4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:37.104866 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-32922aea-ed5a-41e1-87db-1ae1c9afbdf4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:37.105365 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-32922aea-ed5a-41e1-87db-1ae1c9afbdf4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:37.106128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-32922aea-ed5a-41e1-87db-1ae1c9afbdf4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:37.106569 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-32922aea-ed5a-41e1-87db-1ae1c9afbdf4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:37.218064 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d8e441f8-76c8-409e-8ffc-09289c3a127a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:37.218703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d8e441f8-76c8-409e-8ffc-09289c3a127a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:37.225387 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8e441f8-76c8-409e-8ffc-09289c3a127a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:37.225844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8e441f8-76c8-409e-8ffc-09289c3a127a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:37.226609 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8e441f8-76c8-409e-8ffc-09289c3a127a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:37.227048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8e441f8-76c8-409e-8ffc-09289c3a127a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:37.238244 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-32922aea-ed5a-41e1-87db-1ae1c9afbdf4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:37.246378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-32922aea-ed5a-41e1-87db-1ae1c9afbdf4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152258 Jul 27 20:35:37.246939 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1370/2733] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:37 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:37.289154 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d8e441f8-76c8-409e-8ffc-09289c3a127a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:37.299136 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d8e441f8-76c8-409e-8ffc-09289c3a127a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.085033 Jul 27 20:35:37.299645 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1364/2734] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:37 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:37.319808 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f3031755-928d-4a4b-ae14-f18619a93fb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:37.320459 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f3031755-928d-4a4b-ae14-f18619a93fb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:37.326586 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f3031755-928d-4a4b-ae14-f18619a93fb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:37.327042 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f3031755-928d-4a4b-ae14-f18619a93fb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:37.328051 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f3031755-928d-4a4b-ae14-f18619a93fb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:37.328493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f3031755-928d-4a4b-ae14-f18619a93fb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:37.388540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f3031755-928d-4a4b-ae14-f18619a93fb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:37.396555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f3031755-928d-4a4b-ae14-f18619a93fb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081300 Jul 27 20:35:37.397154 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1371/2735] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:37 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:38.267847 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-611892af-58d5-4616-8f1a-e37f101630de tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:38.268464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-611892af-58d5-4616-8f1a-e37f101630de tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:38.275320 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-611892af-58d5-4616-8f1a-e37f101630de tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:38.275772 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-611892af-58d5-4616-8f1a-e37f101630de tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:38.276536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-611892af-58d5-4616-8f1a-e37f101630de tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:38.277047 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-611892af-58d5-4616-8f1a-e37f101630de tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:38.320558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-df9ea9ce-658c-45d0-92d3-383926c5dcb6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:38.321226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-df9ea9ce-658c-45d0-92d3-383926c5dcb6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:38.327409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-df9ea9ce-658c-45d0-92d3-383926c5dcb6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:38.328069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-df9ea9ce-658c-45d0-92d3-383926c5dcb6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:38.328836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-df9ea9ce-658c-45d0-92d3-383926c5dcb6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:38.329298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-df9ea9ce-658c-45d0-92d3-383926c5dcb6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:38.392159 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-df9ea9ce-658c-45d0-92d3-383926c5dcb6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:38.401301 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-df9ea9ce-658c-45d0-92d3-383926c5dcb6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.084534 Jul 27 20:35:38.401540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1372/2736] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:38 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:35:38.416130 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-611892af-58d5-4616-8f1a-e37f101630de tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:38.417737 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5936a7b1-7331-43db-aead-c993d0e9369b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:38.418352 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5936a7b1-7331-43db-aead-c993d0e9369b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:38.424314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5936a7b1-7331-43db-aead-c993d0e9369b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:38.424485 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-611892af-58d5-4616-8f1a-e37f101630de tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.160305 Jul 27 20:35:38.424763 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5936a7b1-7331-43db-aead-c993d0e9369b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:38.426059 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1365/2737] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:38 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:38.426222 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5936a7b1-7331-43db-aead-c993d0e9369b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:38.426563 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5936a7b1-7331-43db-aead-c993d0e9369b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:38.490256 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5936a7b1-7331-43db-aead-c993d0e9369b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:38.498132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5936a7b1-7331-43db-aead-c993d0e9369b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084273 Jul 27 20:35:38.498691 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1373/2738] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:38 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:39.424702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b3c64d66-d3f0-4a83-9da1-9f25aaa5d275 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:39.425392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b3c64d66-d3f0-4a83-9da1-9f25aaa5d275 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:39.431868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3c64d66-d3f0-4a83-9da1-9f25aaa5d275 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:39.432307 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3c64d66-d3f0-4a83-9da1-9f25aaa5d275 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:39.433094 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3c64d66-d3f0-4a83-9da1-9f25aaa5d275 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:39.433525 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3c64d66-d3f0-4a83-9da1-9f25aaa5d275 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:39.445841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-51ce3ee9-6055-4eb7-aea7-eb41442e1197 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:39.446491 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-51ce3ee9-6055-4eb7-aea7-eb41442e1197 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:39.453235 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-51ce3ee9-6055-4eb7-aea7-eb41442e1197 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:39.453692 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-51ce3ee9-6055-4eb7-aea7-eb41442e1197 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:39.454465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-51ce3ee9-6055-4eb7-aea7-eb41442e1197 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:39.454910 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-51ce3ee9-6055-4eb7-aea7-eb41442e1197 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:39.474661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:35:39.496503 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b3c64d66-d3f0-4a83-9da1-9f25aaa5d275 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:39.505129 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b3c64d66-d3f0-4a83-9da1-9f25aaa5d275 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.084156 Jul 27 20:35:39.505705 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1366/2739] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:39 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:39.519840 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bb34076f-10be-4a7b-b66b-c09d52982f39 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:39.520484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bb34076f-10be-4a7b-b66b-c09d52982f39 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:39.526472 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb34076f-10be-4a7b-b66b-c09d52982f39 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:39.526925 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb34076f-10be-4a7b-b66b-c09d52982f39 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:39.527693 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb34076f-10be-4a7b-b66b-c09d52982f39 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:39.528165 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb34076f-10be-4a7b-b66b-c09d52982f39 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:39.588046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-51ce3ee9-6055-4eb7-aea7-eb41442e1197 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:39.590776 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bb34076f-10be-4a7b-b66b-c09d52982f39 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:39.597891 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-51ce3ee9-6055-4eb7-aea7-eb41442e1197 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.155184 Jul 27 20:35:39.601777 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1374/2740] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:39 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:35:39.602495 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bb34076f-10be-4a7b-b66b-c09d52982f39 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085504 Jul 27 20:35:39.602495 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1367/2741] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:39 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:35:40.526158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-40601ab0-a71e-48b5-ace4-39ddb4f21aed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:40.526854 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-40601ab0-a71e-48b5-ace4-39ddb4f21aed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:40.533499 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-40601ab0-a71e-48b5-ace4-39ddb4f21aed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:40.533958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-40601ab0-a71e-48b5-ace4-39ddb4f21aed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:40.535342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-40601ab0-a71e-48b5-ace4-39ddb4f21aed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:40.535974 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-40601ab0-a71e-48b5-ace4-39ddb4f21aed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:40.599373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-40601ab0-a71e-48b5-ace4-39ddb4f21aed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:40.607547 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-40601ab0-a71e-48b5-ace4-39ddb4f21aed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.085243 Jul 27 20:35:40.608149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1375/2742] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:40 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:40.619432 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3732f271-8bbc-4b73-ad4f-393f649e1b6a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:40.620143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3732f271-8bbc-4b73-ad4f-393f649e1b6a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:40.621667 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7c083adc-e7eb-4506-872c-5b7d7468ae4c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:40.622272 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7c083adc-e7eb-4506-872c-5b7d7468ae4c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:40.626960 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3732f271-8bbc-4b73-ad4f-393f649e1b6a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:40.627416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3732f271-8bbc-4b73-ad4f-393f649e1b6a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:40.627972 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7c083adc-e7eb-4506-872c-5b7d7468ae4c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:40.628917 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3732f271-8bbc-4b73-ad4f-393f649e1b6a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:40.629113 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7c083adc-e7eb-4506-872c-5b7d7468ae4c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:40.629404 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3732f271-8bbc-4b73-ad4f-393f649e1b6a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:40.629896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7c083adc-e7eb-4506-872c-5b7d7468ae4c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:40.630337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7c083adc-e7eb-4506-872c-5b7d7468ae4c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:40.691408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7c083adc-e7eb-4506-872c-5b7d7468ae4c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:40.699210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7c083adc-e7eb-4506-872c-5b7d7468ae4c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081189 Jul 27 20:35:40.699781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1376/2743] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:40 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:35:40.761572 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3732f271-8bbc-4b73-ad4f-393f649e1b6a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:40.770323 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3732f271-8bbc-4b73-ad4f-393f649e1b6a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.154862 Jul 27 20:35:40.770894 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1368/2744] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:40 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:41.628062 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f067f64c-9fde-401b-a300-dc870f5c9d6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:41.629218 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f067f64c-9fde-401b-a300-dc870f5c9d6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:41.635706 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f067f64c-9fde-401b-a300-dc870f5c9d6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:41.636155 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f067f64c-9fde-401b-a300-dc870f5c9d6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:41.636911 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f067f64c-9fde-401b-a300-dc870f5c9d6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:41.637375 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f067f64c-9fde-401b-a300-dc870f5c9d6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:41.701693 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f067f64c-9fde-401b-a300-dc870f5c9d6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:41.709925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f067f64c-9fde-401b-a300-dc870f5c9d6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.085698 Jul 27 20:35:41.710488 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1377/2745] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:41 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:41.720866 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3bd17e8b-c3f1-4414-8f37-f4a6493a408e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:41.721509 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3bd17e8b-c3f1-4414-8f37-f4a6493a408e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:41.728535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3bd17e8b-c3f1-4414-8f37-f4a6493a408e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:41.729002 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3bd17e8b-c3f1-4414-8f37-f4a6493a408e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:41.729763 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3bd17e8b-c3f1-4414-8f37-f4a6493a408e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:41.730201 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3bd17e8b-c3f1-4414-8f37-f4a6493a408e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:41.790986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3bd17e8b-c3f1-4414-8f37-f4a6493a408e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:41.791433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-940c5691-417a-4c5e-a42c-01ce3b32fbc9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:41.792206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-940c5691-417a-4c5e-a42c-01ce3b32fbc9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:41.798277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-940c5691-417a-4c5e-a42c-01ce3b32fbc9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:41.798806 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-940c5691-417a-4c5e-a42c-01ce3b32fbc9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:41.799023 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3bd17e8b-c3f1-4414-8f37-f4a6493a408e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081973 Jul 27 20:35:41.799575 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1369/2746] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:41 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:41.799756 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-940c5691-417a-4c5e-a42c-01ce3b32fbc9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:41.800601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-940c5691-417a-4c5e-a42c-01ce3b32fbc9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:41.928991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-940c5691-417a-4c5e-a42c-01ce3b32fbc9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:41.936794 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-940c5691-417a-4c5e-a42c-01ce3b32fbc9 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149425 Jul 27 20:35:41.937389 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1378/2747] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:41 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:35:42.730775 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1df68558-f845-44e8-be1b-4f541566e50c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:42.731421 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1df68558-f845-44e8-be1b-4f541566e50c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:42.737822 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1df68558-f845-44e8-be1b-4f541566e50c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:42.738278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1df68558-f845-44e8-be1b-4f541566e50c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:42.739025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1df68558-f845-44e8-be1b-4f541566e50c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:42.739460 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1df68558-f845-44e8-be1b-4f541566e50c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:42.800910 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1df68558-f845-44e8-be1b-4f541566e50c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:42.808679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1df68558-f845-44e8-be1b-4f541566e50c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.081740 Jul 27 20:35:42.809277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1370/2748] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:42 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:42.820418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-56ba5716-866e-4b69-84f1-1187e326bc84 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:42.821098 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-56ba5716-866e-4b69-84f1-1187e326bc84 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:42.827153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56ba5716-866e-4b69-84f1-1187e326bc84 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:42.827610 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56ba5716-866e-4b69-84f1-1187e326bc84 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:42.828643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56ba5716-866e-4b69-84f1-1187e326bc84 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:42.829117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56ba5716-866e-4b69-84f1-1187e326bc84 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:42.890967 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-56ba5716-866e-4b69-84f1-1187e326bc84 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:42.899720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-56ba5716-866e-4b69-84f1-1187e326bc84 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083932 Jul 27 20:35:42.900289 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1379/2749] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:42 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:42.957264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9a48162b-b3e6-4b5c-8bec-19d5c6d39b37 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:42.957867 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9a48162b-b3e6-4b5c-8bec-19d5c6d39b37 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:42.963776 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a48162b-b3e6-4b5c-8bec-19d5c6d39b37 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:42.964217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a48162b-b3e6-4b5c-8bec-19d5c6d39b37 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:42.964979 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a48162b-b3e6-4b5c-8bec-19d5c6d39b37 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:42.965414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a48162b-b3e6-4b5c-8bec-19d5c6d39b37 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:43.094188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9a48162b-b3e6-4b5c-8bec-19d5c6d39b37 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:43.102267 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9a48162b-b3e6-4b5c-8bec-19d5c6d39b37 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149828 Jul 27 20:35:43.103046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1371/2750] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:42 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:43.829991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c73426d4-617d-4db6-b8c7-52d2c9fce0a8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:43.830608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c73426d4-617d-4db6-b8c7-52d2c9fce0a8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:43.837331 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c73426d4-617d-4db6-b8c7-52d2c9fce0a8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:43.837785 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c73426d4-617d-4db6-b8c7-52d2c9fce0a8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:43.838552 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c73426d4-617d-4db6-b8c7-52d2c9fce0a8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:43.838994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c73426d4-617d-4db6-b8c7-52d2c9fce0a8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:43.902856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c73426d4-617d-4db6-b8c7-52d2c9fce0a8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:43.911506 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c73426d4-617d-4db6-b8c7-52d2c9fce0a8 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.085708 Jul 27 20:35:43.912085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1380/2751] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:43 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:43.919708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6ba74bf9-86a4-4853-90cf-68c858ec854b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:43.920324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6ba74bf9-86a4-4853-90cf-68c858ec854b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:43.927573 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ba74bf9-86a4-4853-90cf-68c858ec854b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:43.928017 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ba74bf9-86a4-4853-90cf-68c858ec854b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:43.928774 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ba74bf9-86a4-4853-90cf-68c858ec854b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:43.929240 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ba74bf9-86a4-4853-90cf-68c858ec854b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:43.992311 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6ba74bf9-86a4-4853-90cf-68c858ec854b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:44.000502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6ba74bf9-86a4-4853-90cf-68c858ec854b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084574 Jul 27 20:35:44.001083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1372/2752] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:43 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:44.123411 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5f20dad1-3f5c-41dd-a8ad-60fe7a2a9a03 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:44.123953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5f20dad1-3f5c-41dd-a8ad-60fe7a2a9a03 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:44.130831 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5f20dad1-3f5c-41dd-a8ad-60fe7a2a9a03 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:44.131312 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5f20dad1-3f5c-41dd-a8ad-60fe7a2a9a03 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:44.132073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5f20dad1-3f5c-41dd-a8ad-60fe7a2a9a03 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:44.132517 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5f20dad1-3f5c-41dd-a8ad-60fe7a2a9a03 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:44.261856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5f20dad1-3f5c-41dd-a8ad-60fe7a2a9a03 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:44.269934 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5f20dad1-3f5c-41dd-a8ad-60fe7a2a9a03 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150307 Jul 27 20:35:44.270498 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1381/2753] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:44 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:44.932064 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-19e8ca29-dfd2-4b39-b09a-646c5dbe36e0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:44.932714 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-19e8ca29-dfd2-4b39-b09a-646c5dbe36e0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:44.939364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19e8ca29-dfd2-4b39-b09a-646c5dbe36e0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:44.939840 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19e8ca29-dfd2-4b39-b09a-646c5dbe36e0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:44.940602 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19e8ca29-dfd2-4b39-b09a-646c5dbe36e0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:44.941144 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19e8ca29-dfd2-4b39-b09a-646c5dbe36e0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:45.000826 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-19e8ca29-dfd2-4b39-b09a-646c5dbe36e0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:45.008774 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-19e8ca29-dfd2-4b39-b09a-646c5dbe36e0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.080571 Jul 27 20:35:45.009372 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1373/2754] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:44 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:45.022890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-83063bf3-b1f4-4e1d-91d8-a1f1f9c8fb83 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:45.023514 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-83063bf3-b1f4-4e1d-91d8-a1f1f9c8fb83 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:45.030205 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-83063bf3-b1f4-4e1d-91d8-a1f1f9c8fb83 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:45.030687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-83063bf3-b1f4-4e1d-91d8-a1f1f9c8fb83 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:45.031485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-83063bf3-b1f4-4e1d-91d8-a1f1f9c8fb83 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:45.031927 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-83063bf3-b1f4-4e1d-91d8-a1f1f9c8fb83 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:45.094661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-83063bf3-b1f4-4e1d-91d8-a1f1f9c8fb83 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:45.102730 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-83063bf3-b1f4-4e1d-91d8-a1f1f9c8fb83 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084357 Jul 27 20:35:45.103294 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1382/2755] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:45 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:45.290943 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9650ae7b-c09d-4bda-b3cd-9d17371a9681 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:45.291486 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9650ae7b-c09d-4bda-b3cd-9d17371a9681 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:45.297522 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9650ae7b-c09d-4bda-b3cd-9d17371a9681 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:45.297973 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9650ae7b-c09d-4bda-b3cd-9d17371a9681 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:45.298730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9650ae7b-c09d-4bda-b3cd-9d17371a9681 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:45.299168 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9650ae7b-c09d-4bda-b3cd-9d17371a9681 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:45.432358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9650ae7b-c09d-4bda-b3cd-9d17371a9681 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:45.440143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9650ae7b-c09d-4bda-b3cd-9d17371a9681 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153154 Jul 27 20:35:45.440702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1374/2756] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:45 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:46.030480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-76c656c3-8bf3-4c9a-827d-0a39fed3d328 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:46.031213 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-76c656c3-8bf3-4c9a-827d-0a39fed3d328 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:46.037793 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-76c656c3-8bf3-4c9a-827d-0a39fed3d328 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:46.038239 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-76c656c3-8bf3-4c9a-827d-0a39fed3d328 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:46.038988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-76c656c3-8bf3-4c9a-827d-0a39fed3d328 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:46.039421 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-76c656c3-8bf3-4c9a-827d-0a39fed3d328 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:46.101504 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-76c656c3-8bf3-4c9a-827d-0a39fed3d328 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:46.109468 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-76c656c3-8bf3-4c9a-827d-0a39fed3d328 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.082832 Jul 27 20:35:46.110033 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1383/2757] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:46 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:46.123487 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-37eef057-9f09-4af8-9e99-8a78f53c39e1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:46.124148 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-37eef057-9f09-4af8-9e99-8a78f53c39e1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:46.131154 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37eef057-9f09-4af8-9e99-8a78f53c39e1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:46.131595 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37eef057-9f09-4af8-9e99-8a78f53c39e1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:46.132341 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37eef057-9f09-4af8-9e99-8a78f53c39e1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:46.132764 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37eef057-9f09-4af8-9e99-8a78f53c39e1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:46.195149 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-37eef057-9f09-4af8-9e99-8a78f53c39e1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:46.203189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-37eef057-9f09-4af8-9e99-8a78f53c39e1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083277 Jul 27 20:35:46.203766 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1375/2758] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:46 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:46.463172 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cf72eb97-59c7-4e0c-81bd-114dd2fbef73 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:46.464095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cf72eb97-59c7-4e0c-81bd-114dd2fbef73 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:46.470111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf72eb97-59c7-4e0c-81bd-114dd2fbef73 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:46.470569 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf72eb97-59c7-4e0c-81bd-114dd2fbef73 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:46.471359 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf72eb97-59c7-4e0c-81bd-114dd2fbef73 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:46.471807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf72eb97-59c7-4e0c-81bd-114dd2fbef73 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:46.756759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cf72eb97-59c7-4e0c-81bd-114dd2fbef73 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:46.764699 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cf72eb97-59c7-4e0c-81bd-114dd2fbef73 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.305450 Jul 27 20:35:46.765299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1384/2759] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:46 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:47.132148 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-913c235e-11ec-4f81-80c3-0e287112cf7c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:47.132751 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-913c235e-11ec-4f81-80c3-0e287112cf7c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:47.139207 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-913c235e-11ec-4f81-80c3-0e287112cf7c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:47.139648 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-913c235e-11ec-4f81-80c3-0e287112cf7c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:47.140393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-913c235e-11ec-4f81-80c3-0e287112cf7c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:47.140820 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-913c235e-11ec-4f81-80c3-0e287112cf7c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:47.200307 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-913c235e-11ec-4f81-80c3-0e287112cf7c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:47.203887 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:35:47.208911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-913c235e-11ec-4f81-80c3-0e287112cf7c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.081320 Jul 27 20:35:47.209501 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1376/2760] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:47 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:47.224779 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1512e49d-0a0f-4ab3-b551-2318a5490980 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:47.225449 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1512e49d-0a0f-4ab3-b551-2318a5490980 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:47.232002 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1512e49d-0a0f-4ab3-b551-2318a5490980 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:47.232457 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1512e49d-0a0f-4ab3-b551-2318a5490980 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:47.233247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1512e49d-0a0f-4ab3-b551-2318a5490980 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:47.233697 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1512e49d-0a0f-4ab3-b551-2318a5490980 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:47.294590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1512e49d-0a0f-4ab3-b551-2318a5490980 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:47.303196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1512e49d-0a0f-4ab3-b551-2318a5490980 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082405 Jul 27 20:35:47.303745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1385/2761] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:47 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:47.786122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ff82f579-418c-4a26-9d36-481652b9d93a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:47.786735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ff82f579-418c-4a26-9d36-481652b9d93a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:47.793746 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff82f579-418c-4a26-9d36-481652b9d93a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:47.794198 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff82f579-418c-4a26-9d36-481652b9d93a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:47.794961 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff82f579-418c-4a26-9d36-481652b9d93a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:47.795400 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff82f579-418c-4a26-9d36-481652b9d93a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:47.923399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ff82f579-418c-4a26-9d36-481652b9d93a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:47.931613 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ff82f579-418c-4a26-9d36-481652b9d93a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150025 Jul 27 20:35:47.932424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1377/2762] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:47 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:48.229628 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-56a0046a-6108-4b58-88b7-1faeac0e871c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:48.230233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-56a0046a-6108-4b58-88b7-1faeac0e871c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:48.236635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56a0046a-6108-4b58-88b7-1faeac0e871c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:48.237110 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56a0046a-6108-4b58-88b7-1faeac0e871c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:48.237882 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56a0046a-6108-4b58-88b7-1faeac0e871c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:48.238314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56a0046a-6108-4b58-88b7-1faeac0e871c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:48.297614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-56a0046a-6108-4b58-88b7-1faeac0e871c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:48.305406 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-56a0046a-6108-4b58-88b7-1faeac0e871c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.079573 Jul 27 20:35:48.305954 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1386/2763] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:48 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:48.323488 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6af0e6a7-de94-4b67-8224-ea805722d7b8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:48.324096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6af0e6a7-de94-4b67-8224-ea805722d7b8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:48.330280 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6af0e6a7-de94-4b67-8224-ea805722d7b8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:48.330722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6af0e6a7-de94-4b67-8224-ea805722d7b8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:48.332050 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6af0e6a7-de94-4b67-8224-ea805722d7b8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:48.332480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6af0e6a7-de94-4b67-8224-ea805722d7b8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:48.395636 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6af0e6a7-de94-4b67-8224-ea805722d7b8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:48.403564 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6af0e6a7-de94-4b67-8224-ea805722d7b8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083841 Jul 27 20:35:48.404131 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1378/2764] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:48 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:48.952698 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c7068108-9aad-4081-ad56-bd084c929a2c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:48.953597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c7068108-9aad-4081-ad56-bd084c929a2c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:48.959992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c7068108-9aad-4081-ad56-bd084c929a2c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:48.960455 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c7068108-9aad-4081-ad56-bd084c929a2c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:48.961285 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c7068108-9aad-4081-ad56-bd084c929a2c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:48.961735 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c7068108-9aad-4081-ad56-bd084c929a2c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:49.097674 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c7068108-9aad-4081-ad56-bd084c929a2c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:49.105833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c7068108-9aad-4081-ad56-bd084c929a2c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.156976 Jul 27 20:35:49.106371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1387/2765] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:48 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:49.326626 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3b82d41e-deed-4d54-913e-ee7d2e82a443 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:49.327245 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3b82d41e-deed-4d54-913e-ee7d2e82a443 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:49.334334 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b82d41e-deed-4d54-913e-ee7d2e82a443 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:49.334786 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b82d41e-deed-4d54-913e-ee7d2e82a443 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:49.335547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b82d41e-deed-4d54-913e-ee7d2e82a443 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:49.335988 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b82d41e-deed-4d54-913e-ee7d2e82a443 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:49.397138 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3b82d41e-deed-4d54-913e-ee7d2e82a443 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:49.405068 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3b82d41e-deed-4d54-913e-ee7d2e82a443 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.082345 Jul 27 20:35:49.405627 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1379/2766] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:49 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:49.423596 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a05c204b-7fa1-4532-85da-7dde14e05450 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:49.424224 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a05c204b-7fa1-4532-85da-7dde14e05450 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:49.431579 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a05c204b-7fa1-4532-85da-7dde14e05450 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:49.432033 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a05c204b-7fa1-4532-85da-7dde14e05450 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:49.432800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a05c204b-7fa1-4532-85da-7dde14e05450 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:49.433274 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a05c204b-7fa1-4532-85da-7dde14e05450 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:49.494479 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a05c204b-7fa1-4532-85da-7dde14e05450 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:49.502434 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a05c204b-7fa1-4532-85da-7dde14e05450 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082717 Jul 27 20:35:49.503011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1388/2767] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:49 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:50.127010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-22939b28-17cc-4f15-8c03-fd41ee44f698 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:50.127697 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-22939b28-17cc-4f15-8c03-fd41ee44f698 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:50.133748 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-22939b28-17cc-4f15-8c03-fd41ee44f698 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:50.134242 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-22939b28-17cc-4f15-8c03-fd41ee44f698 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:50.134940 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-22939b28-17cc-4f15-8c03-fd41ee44f698 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:50.135366 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-22939b28-17cc-4f15-8c03-fd41ee44f698 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:50.262642 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-22939b28-17cc-4f15-8c03-fd41ee44f698 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:50.271483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-22939b28-17cc-4f15-8c03-fd41ee44f698 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148380 Jul 27 20:35:50.272053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1380/2768] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:50 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:50.425779 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d7cfdc02-4d2c-4287-878b-700c0b46c171 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:50.426308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d7cfdc02-4d2c-4287-878b-700c0b46c171 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:50.432646 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d7cfdc02-4d2c-4287-878b-700c0b46c171 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:50.433123 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d7cfdc02-4d2c-4287-878b-700c0b46c171 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:50.433875 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d7cfdc02-4d2c-4287-878b-700c0b46c171 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:50.434311 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d7cfdc02-4d2c-4287-878b-700c0b46c171 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:50.494727 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d7cfdc02-4d2c-4287-878b-700c0b46c171 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:50.502633 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d7cfdc02-4d2c-4287-878b-700c0b46c171 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.080710 Jul 27 20:35:50.503707 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1389/2769] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:50 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:50.524034 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d4c6f47f-3ae8-4862-af80-916a88d2bb39 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:50.524640 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d4c6f47f-3ae8-4862-af80-916a88d2bb39 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:50.530951 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4c6f47f-3ae8-4862-af80-916a88d2bb39 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:50.531390 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4c6f47f-3ae8-4862-af80-916a88d2bb39 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:50.532134 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4c6f47f-3ae8-4862-af80-916a88d2bb39 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:50.532567 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4c6f47f-3ae8-4862-af80-916a88d2bb39 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:50.597993 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d4c6f47f-3ae8-4862-af80-916a88d2bb39 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:50.606099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d4c6f47f-3ae8-4862-af80-916a88d2bb39 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085784 Jul 27 20:35:50.606661 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1381/2770] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:50 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:35:51.293335 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7ebeea16-902c-4c59-ba69-c2b86782dc64 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:51.293958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7ebeea16-902c-4c59-ba69-c2b86782dc64 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:51.300797 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7ebeea16-902c-4c59-ba69-c2b86782dc64 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:51.301468 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7ebeea16-902c-4c59-ba69-c2b86782dc64 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:51.302249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7ebeea16-902c-4c59-ba69-c2b86782dc64 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:51.302695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7ebeea16-902c-4c59-ba69-c2b86782dc64 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:51.437095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7ebeea16-902c-4c59-ba69-c2b86782dc64 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:51.445399 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7ebeea16-902c-4c59-ba69-c2b86782dc64 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.155914 Jul 27 20:35:51.445956 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1390/2771] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:51 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:51.524408 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8e18a23d-8657-45ac-ba3a-6e2ff69f4aa0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:51.525029 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8e18a23d-8657-45ac-ba3a-6e2ff69f4aa0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:51.531079 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e18a23d-8657-45ac-ba3a-6e2ff69f4aa0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:51.531519 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e18a23d-8657-45ac-ba3a-6e2ff69f4aa0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:51.532266 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e18a23d-8657-45ac-ba3a-6e2ff69f4aa0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:51.532696 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e18a23d-8657-45ac-ba3a-6e2ff69f4aa0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:51.591929 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8e18a23d-8657-45ac-ba3a-6e2ff69f4aa0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:51.600538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8e18a23d-8657-45ac-ba3a-6e2ff69f4aa0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.079928 Jul 27 20:35:51.601126 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1382/2772] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:51 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:51.627315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f8afa4aa-073d-420c-8996-157047e509b9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:51.627959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f8afa4aa-073d-420c-8996-157047e509b9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:51.634095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f8afa4aa-073d-420c-8996-157047e509b9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:51.634557 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f8afa4aa-073d-420c-8996-157047e509b9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:51.635321 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f8afa4aa-073d-420c-8996-157047e509b9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:51.635811 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f8afa4aa-073d-420c-8996-157047e509b9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:51.639839 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:35:51.698820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f8afa4aa-073d-420c-8996-157047e509b9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:51.707634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f8afa4aa-073d-420c-8996-157047e509b9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084235 Jul 27 20:35:51.708195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1391/2773] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:51 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:52.466908 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9f9a9049-7b4e-493b-b972-2cbe211e9dc1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:52.467515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9f9a9049-7b4e-493b-b972-2cbe211e9dc1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:52.474193 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f9a9049-7b4e-493b-b972-2cbe211e9dc1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:52.474641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f9a9049-7b4e-493b-b972-2cbe211e9dc1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:52.475396 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f9a9049-7b4e-493b-b972-2cbe211e9dc1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:52.475826 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f9a9049-7b4e-493b-b972-2cbe211e9dc1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:52.602022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9f9a9049-7b4e-493b-b972-2cbe211e9dc1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:52.609971 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9f9a9049-7b4e-493b-b972-2cbe211e9dc1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.146952 Jul 27 20:35:52.610537 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1383/2774] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:52 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:52.621583 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c0b54647-fb23-41e8-bf3a-48573baf4fed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:52.622199 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c0b54647-fb23-41e8-bf3a-48573baf4fed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:52.629301 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c0b54647-fb23-41e8-bf3a-48573baf4fed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:52.629768 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c0b54647-fb23-41e8-bf3a-48573baf4fed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:52.630517 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c0b54647-fb23-41e8-bf3a-48573baf4fed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:52.630958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c0b54647-fb23-41e8-bf3a-48573baf4fed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:52.690077 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c0b54647-fb23-41e8-bf3a-48573baf4fed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:52.698603 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c0b54647-fb23-41e8-bf3a-48573baf4fed tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.080819 Jul 27 20:35:52.699200 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1392/2775] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:52 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:52.728249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-03aebba2-3909-4315-a281-c663d327b41d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:52.728862 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-03aebba2-3909-4315-a281-c663d327b41d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:52.734867 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03aebba2-3909-4315-a281-c663d327b41d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:52.735345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03aebba2-3909-4315-a281-c663d327b41d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:52.736146 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03aebba2-3909-4315-a281-c663d327b41d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:52.736586 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03aebba2-3909-4315-a281-c663d327b41d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:52.796553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-03aebba2-3909-4315-a281-c663d327b41d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:52.804685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-03aebba2-3909-4315-a281-c663d327b41d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.080387 Jul 27 20:35:52.805283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1384/2776] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:52 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:53.630514 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6ef51e0c-fdb6-4f2f-a495-f4182f76b433 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:53.631127 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6ef51e0c-fdb6-4f2f-a495-f4182f76b433 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:53.637610 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ef51e0c-fdb6-4f2f-a495-f4182f76b433 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:53.638055 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ef51e0c-fdb6-4f2f-a495-f4182f76b433 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:53.638811 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ef51e0c-fdb6-4f2f-a495-f4182f76b433 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:53.639244 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ef51e0c-fdb6-4f2f-a495-f4182f76b433 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:53.719814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-96a98c78-c4d4-4976-9561-4a3bad78ae69 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:53.720456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-96a98c78-c4d4-4976-9561-4a3bad78ae69 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:53.727664 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96a98c78-c4d4-4976-9561-4a3bad78ae69 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:53.728111 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96a98c78-c4d4-4976-9561-4a3bad78ae69 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:53.728882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96a98c78-c4d4-4976-9561-4a3bad78ae69 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:53.729348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96a98c78-c4d4-4976-9561-4a3bad78ae69 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:53.776285 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6ef51e0c-fdb6-4f2f-a495-f4182f76b433 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:53.784277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6ef51e0c-fdb6-4f2f-a495-f4182f76b433 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.157532 Jul 27 20:35:53.785555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1393/2777] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:53 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:53.797755 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-96a98c78-c4d4-4976-9561-4a3bad78ae69 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:53.805662 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-96a98c78-c4d4-4976-9561-4a3bad78ae69 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.089765 Jul 27 20:35:53.806213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1385/2778] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:53 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:53.826495 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-69e71bd5-fe82-4d5f-9cd6-7ef67c34fcda tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:53.827107 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-69e71bd5-fe82-4d5f-9cd6-7ef67c34fcda tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:53.834161 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69e71bd5-fe82-4d5f-9cd6-7ef67c34fcda tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:53.834613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69e71bd5-fe82-4d5f-9cd6-7ef67c34fcda tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:53.835377 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69e71bd5-fe82-4d5f-9cd6-7ef67c34fcda tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:53.835818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69e71bd5-fe82-4d5f-9cd6-7ef67c34fcda tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:53.896068 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-69e71bd5-fe82-4d5f-9cd6-7ef67c34fcda tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:53.903967 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-69e71bd5-fe82-4d5f-9cd6-7ef67c34fcda tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081266 Jul 27 20:35:53.904532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1394/2779] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:53 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:54.806355 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e3006f91-ace2-40ef-97db-9e74ce326383 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:54.806972 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e3006f91-ace2-40ef-97db-9e74ce326383 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:54.813392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e3006f91-ace2-40ef-97db-9e74ce326383 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:54.813834 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e3006f91-ace2-40ef-97db-9e74ce326383 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:54.814585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e3006f91-ace2-40ef-97db-9e74ce326383 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:54.815010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e3006f91-ace2-40ef-97db-9e74ce326383 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:54.834038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f0598bfa-7ace-4fc2-af6f-63d14df0305b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:54.834656 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f0598bfa-7ace-4fc2-af6f-63d14df0305b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:54.841267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0598bfa-7ace-4fc2-af6f-63d14df0305b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:54.841725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0598bfa-7ace-4fc2-af6f-63d14df0305b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:54.842499 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0598bfa-7ace-4fc2-af6f-63d14df0305b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:54.842938 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0598bfa-7ace-4fc2-af6f-63d14df0305b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:54.906990 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f0598bfa-7ace-4fc2-af6f-63d14df0305b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:54.917002 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f0598bfa-7ace-4fc2-af6f-63d14df0305b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.086803 Jul 27 20:35:54.917601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1395/2780] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:54 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:54.926780 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7807b407-14a5-4c78-9a27-5bcfb277a8b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:54.927524 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7807b407-14a5-4c78-9a27-5bcfb277a8b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:54.933965 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7807b407-14a5-4c78-9a27-5bcfb277a8b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:54.934523 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7807b407-14a5-4c78-9a27-5bcfb277a8b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:54.935482 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7807b407-14a5-4c78-9a27-5bcfb277a8b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:54.936001 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7807b407-14a5-4c78-9a27-5bcfb277a8b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:54.970051 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e3006f91-ace2-40ef-97db-9e74ce326383 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:54.978692 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e3006f91-ace2-40ef-97db-9e74ce326383 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.176139 Jul 27 20:35:54.979268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1386/2781] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:54 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:55.000152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7807b407-14a5-4c78-9a27-5bcfb277a8b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:55.008411 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7807b407-14a5-4c78-9a27-5bcfb277a8b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.086019 Jul 27 20:35:55.009183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1396/2782] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:54 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:55.938467 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8e930fcd-5a43-4add-91fa-9340ba8b945f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:55.939080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8e930fcd-5a43-4add-91fa-9340ba8b945f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:55.946284 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e930fcd-5a43-4add-91fa-9340ba8b945f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:55.946731 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e930fcd-5a43-4add-91fa-9340ba8b945f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:55.947487 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e930fcd-5a43-4add-91fa-9340ba8b945f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:55.947920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e930fcd-5a43-4add-91fa-9340ba8b945f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:55.999693 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c463f5a1-b2eb-4403-9c34-ca9f79ba3704 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:56.000355 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c463f5a1-b2eb-4403-9c34-ca9f79ba3704 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:56.007370 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c463f5a1-b2eb-4403-9c34-ca9f79ba3704 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:56.007821 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c463f5a1-b2eb-4403-9c34-ca9f79ba3704 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:56.008639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c463f5a1-b2eb-4403-9c34-ca9f79ba3704 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:56.009102 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c463f5a1-b2eb-4403-9c34-ca9f79ba3704 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:56.009230 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8e930fcd-5a43-4add-91fa-9340ba8b945f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:56.017540 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8e930fcd-5a43-4add-91fa-9340ba8b945f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.082891 Jul 27 20:35:56.018153 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1387/2783] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:55 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:56.029428 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9f3f155d-a54c-498c-b918-f624d0f40bbd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:56.030031 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9f3f155d-a54c-498c-b918-f624d0f40bbd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:56.035957 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f3f155d-a54c-498c-b918-f624d0f40bbd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:56.036406 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f3f155d-a54c-498c-b918-f624d0f40bbd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:56.037187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f3f155d-a54c-498c-b918-f624d0f40bbd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:56.037616 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f3f155d-a54c-498c-b918-f624d0f40bbd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:56.105560 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9f3f155d-a54c-498c-b918-f624d0f40bbd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:56.115407 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9f3f155d-a54c-498c-b918-f624d0f40bbd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.089520 Jul 27 20:35:56.115988 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1388/2784] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:56 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:35:56.150512 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c463f5a1-b2eb-4403-9c34-ca9f79ba3704 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:56.158482 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c463f5a1-b2eb-4403-9c34-ca9f79ba3704 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.162633 Jul 27 20:35:56.159074 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1397/2785] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:55 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:57.039376 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-597afd99-68aa-4936-b334-a71eb29161c3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:57.039994 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-597afd99-68aa-4936-b334-a71eb29161c3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:57.046598 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-597afd99-68aa-4936-b334-a71eb29161c3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:57.047049 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-597afd99-68aa-4936-b334-a71eb29161c3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:57.047815 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-597afd99-68aa-4936-b334-a71eb29161c3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:57.048255 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-597afd99-68aa-4936-b334-a71eb29161c3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:57.115907 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-597afd99-68aa-4936-b334-a71eb29161c3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:57.123793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-597afd99-68aa-4936-b334-a71eb29161c3 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.088321 Jul 27 20:35:57.124353 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1389/2786] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:57 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:57.135515 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e838655c-1673-486f-9c19-2c2e1b1b66a1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:57.136211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e838655c-1673-486f-9c19-2c2e1b1b66a1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:57.142763 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e838655c-1673-486f-9c19-2c2e1b1b66a1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:57.143211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e838655c-1673-486f-9c19-2c2e1b1b66a1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:57.143994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e838655c-1673-486f-9c19-2c2e1b1b66a1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:57.144421 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e838655c-1673-486f-9c19-2c2e1b1b66a1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:57.180193 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-28561782-f07a-4830-b544-8f435ffb68d8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:57.180803 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-28561782-f07a-4830-b544-8f435ffb68d8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:57.186919 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28561782-f07a-4830-b544-8f435ffb68d8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:57.187374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28561782-f07a-4830-b544-8f435ffb68d8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:57.188146 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28561782-f07a-4830-b544-8f435ffb68d8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:57.188581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28561782-f07a-4830-b544-8f435ffb68d8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:57.207060 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e838655c-1673-486f-9c19-2c2e1b1b66a1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:57.215122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e838655c-1673-486f-9c19-2c2e1b1b66a1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083478 Jul 27 20:35:57.215691 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1398/2787] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:57 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:57.316293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-28561782-f07a-4830-b544-8f435ffb68d8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:57.324205 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-28561782-f07a-4830-b544-8f435ffb68d8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.147792 Jul 27 20:35:57.324770 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1390/2788] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:57 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:35:58.145925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6ecc3d42-a072-41b4-b89a-4ad0f5cc7bb4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:58.146559 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6ecc3d42-a072-41b4-b89a-4ad0f5cc7bb4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:58.153087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ecc3d42-a072-41b4-b89a-4ad0f5cc7bb4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:58.153537 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ecc3d42-a072-41b4-b89a-4ad0f5cc7bb4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:58.154295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ecc3d42-a072-41b4-b89a-4ad0f5cc7bb4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:58.154727 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ecc3d42-a072-41b4-b89a-4ad0f5cc7bb4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:58.214149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6ecc3d42-a072-41b4-b89a-4ad0f5cc7bb4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:58.222483 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6ecc3d42-a072-41b4-b89a-4ad0f5cc7bb4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.080382 Jul 27 20:35:58.223042 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1399/2789] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:58 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:58.237105 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1d68effb-e924-45eb-afbf-df2a4cee1cb1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:58.238605 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1d68effb-e924-45eb-afbf-df2a4cee1cb1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:58.246676 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d68effb-e924-45eb-afbf-df2a4cee1cb1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:58.247118 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d68effb-e924-45eb-afbf-df2a4cee1cb1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:58.247875 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d68effb-e924-45eb-afbf-df2a4cee1cb1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:58.248309 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d68effb-e924-45eb-afbf-df2a4cee1cb1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:58.309113 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1d68effb-e924-45eb-afbf-df2a4cee1cb1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:58.317159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1d68effb-e924-45eb-afbf-df2a4cee1cb1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083871 Jul 27 20:35:58.317716 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1391/2790] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:58 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:58.345504 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a271eb7b-4771-4c5b-b1d8-454f91b3907b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:58.346054 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a271eb7b-4771-4c5b-b1d8-454f91b3907b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:58.352746 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a271eb7b-4771-4c5b-b1d8-454f91b3907b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:58.353228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a271eb7b-4771-4c5b-b1d8-454f91b3907b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:58.353982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a271eb7b-4771-4c5b-b1d8-454f91b3907b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:58.354415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a271eb7b-4771-4c5b-b1d8-454f91b3907b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:58.483615 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a271eb7b-4771-4c5b-b1d8-454f91b3907b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:58.491510 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a271eb7b-4771-4c5b-b1d8-454f91b3907b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149892 Jul 27 20:35:58.492106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1400/2791] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:58 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:59.243172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e1967908-e5fb-4051-97c9-dea28d2e6879 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:59.243777 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e1967908-e5fb-4051-97c9-dea28d2e6879 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:59.250335 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1967908-e5fb-4051-97c9-dea28d2e6879 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:59.250778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1967908-e5fb-4051-97c9-dea28d2e6879 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:59.251522 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1967908-e5fb-4051-97c9-dea28d2e6879 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:59.251949 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1967908-e5fb-4051-97c9-dea28d2e6879 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:59.316172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e1967908-e5fb-4051-97c9-dea28d2e6879 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:59.323975 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e1967908-e5fb-4051-97c9-dea28d2e6879 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.084641 Jul 27 20:35:59.324531 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1392/2792] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:59 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:59.337016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-76be8942-d5d3-44a0-8063-38aa793d6fde tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:59.337643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-76be8942-d5d3-44a0-8063-38aa793d6fde tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:59.344058 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-76be8942-d5d3-44a0-8063-38aa793d6fde tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:59.344512 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-76be8942-d5d3-44a0-8063-38aa793d6fde tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:59.345313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-76be8942-d5d3-44a0-8063-38aa793d6fde tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:59.345785 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-76be8942-d5d3-44a0-8063-38aa793d6fde tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:59.407212 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-76be8942-d5d3-44a0-8063-38aa793d6fde tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:59.418655 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-76be8942-d5d3-44a0-8063-38aa793d6fde tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085499 Jul 27 20:35:59.419267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1401/2793] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:59 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:35:59.511559 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1e490e45-dd79-430e-991e-cdc7e7df8a7e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:35:59.512164 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1e490e45-dd79-430e-991e-cdc7e7df8a7e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:35:59.518265 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1e490e45-dd79-430e-991e-cdc7e7df8a7e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:59.518918 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1e490e45-dd79-430e-991e-cdc7e7df8a7e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:59.519777 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1e490e45-dd79-430e-991e-cdc7e7df8a7e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:35:59.520215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1e490e45-dd79-430e-991e-cdc7e7df8a7e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:35:59.538193 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:35:59.652043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1e490e45-dd79-430e-991e-cdc7e7df8a7e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:35:59.660566 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1e490e45-dd79-430e-991e-cdc7e7df8a7e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152800 Jul 27 20:35:59.661159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1393/2794] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:35:59 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:00.345506 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-40f84810-451a-46d6-8256-02f2f25c2035 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:00.346088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-40f84810-451a-46d6-8256-02f2f25c2035 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:00.353371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-40f84810-451a-46d6-8256-02f2f25c2035 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:00.353831 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-40f84810-451a-46d6-8256-02f2f25c2035 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:00.354599 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-40f84810-451a-46d6-8256-02f2f25c2035 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:00.355046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-40f84810-451a-46d6-8256-02f2f25c2035 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:00.416320 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-40f84810-451a-46d6-8256-02f2f25c2035 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:00.424406 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-40f84810-451a-46d6-8256-02f2f25c2035 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.082827 Jul 27 20:36:00.425603 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1402/2795] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:00 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:00.446091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a10c2a31-2622-41ce-870a-d837f6c4740c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:00.446698 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a10c2a31-2622-41ce-870a-d837f6c4740c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:00.453446 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a10c2a31-2622-41ce-870a-d837f6c4740c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:00.453891 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a10c2a31-2622-41ce-870a-d837f6c4740c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:00.454641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a10c2a31-2622-41ce-870a-d837f6c4740c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:00.455069 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a10c2a31-2622-41ce-870a-d837f6c4740c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:00.515597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a10c2a31-2622-41ce-870a-d837f6c4740c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:00.523941 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a10c2a31-2622-41ce-870a-d837f6c4740c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081636 Jul 27 20:36:00.524506 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1394/2796] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:00 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:00.681376 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2d12916d-3586-4731-8590-7022d1c36007 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:00.681999 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2d12916d-3586-4731-8590-7022d1c36007 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:00.688023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d12916d-3586-4731-8590-7022d1c36007 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:00.688487 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d12916d-3586-4731-8590-7022d1c36007 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:00.689279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d12916d-3586-4731-8590-7022d1c36007 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:00.689724 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d12916d-3586-4731-8590-7022d1c36007 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:00.818876 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2d12916d-3586-4731-8590-7022d1c36007 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:00.826828 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2d12916d-3586-4731-8590-7022d1c36007 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149306 Jul 27 20:36:00.827390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1403/2797] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:00 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:01.446525 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0355680b-60f0-452a-b684-501481183b18 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:01.447163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0355680b-60f0-452a-b684-501481183b18 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:01.453949 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0355680b-60f0-452a-b684-501481183b18 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:01.454397 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0355680b-60f0-452a-b684-501481183b18 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:01.455156 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0355680b-60f0-452a-b684-501481183b18 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:01.455590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0355680b-60f0-452a-b684-501481183b18 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:01.519155 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0355680b-60f0-452a-b684-501481183b18 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:01.526998 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0355680b-60f0-452a-b684-501481183b18 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.084368 Jul 27 20:36:01.527557 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1395/2798] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:01 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:01.544987 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f5ffbef9-3cbf-476c-b1ba-cb63f027d9b8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:01.545601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f5ffbef9-3cbf-476c-b1ba-cb63f027d9b8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:01.547862 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=84 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:36:01.554113 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f5ffbef9-3cbf-476c-b1ba-cb63f027d9b8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:01.554561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f5ffbef9-3cbf-476c-b1ba-cb63f027d9b8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:01.555311 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f5ffbef9-3cbf-476c-b1ba-cb63f027d9b8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:01.555746 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f5ffbef9-3cbf-476c-b1ba-cb63f027d9b8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:01.617061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f5ffbef9-3cbf-476c-b1ba-cb63f027d9b8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:01.625004 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f5ffbef9-3cbf-476c-b1ba-cb63f027d9b8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083838 Jul 27 20:36:01.625562 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1404/2799] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:01 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:01.849263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ef4ce5a4-e79a-4920-81cb-ed017abcb632 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:01.849786 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ef4ce5a4-e79a-4920-81cb-ed017abcb632 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:01.851600 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=78 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:36:01.858123 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef4ce5a4-e79a-4920-81cb-ed017abcb632 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:01.858595 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef4ce5a4-e79a-4920-81cb-ed017abcb632 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:01.859532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef4ce5a4-e79a-4920-81cb-ed017abcb632 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:01.860001 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef4ce5a4-e79a-4920-81cb-ed017abcb632 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:02.009349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ef4ce5a4-e79a-4920-81cb-ed017abcb632 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:02.014315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ef4ce5a4-e79a-4920-81cb-ed017abcb632 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.169038 Jul 27 20:36:02.014885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1396/2800] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:01 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:02.547850 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1dc1943a-02d8-4461-8eb4-c0b2e6452f46 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:02.548482 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1dc1943a-02d8-4461-8eb4-c0b2e6452f46 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:02.555679 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1dc1943a-02d8-4461-8eb4-c0b2e6452f46 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:02.556335 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1dc1943a-02d8-4461-8eb4-c0b2e6452f46 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:02.557135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1dc1943a-02d8-4461-8eb4-c0b2e6452f46 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:02.557581 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1dc1943a-02d8-4461-8eb4-c0b2e6452f46 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:02.618580 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1dc1943a-02d8-4461-8eb4-c0b2e6452f46 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:02.626608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1dc1943a-02d8-4461-8eb4-c0b2e6452f46 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.082602 Jul 27 20:36:02.627176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1405/2801] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:02 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:02.755811 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-04aee7b3-b55a-4380-ac51-44ef7d345835 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:02.756458 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-04aee7b3-b55a-4380-ac51-44ef7d345835 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:02.762473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04aee7b3-b55a-4380-ac51-44ef7d345835 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:02.762919 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04aee7b3-b55a-4380-ac51-44ef7d345835 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:02.763688 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04aee7b3-b55a-4380-ac51-44ef7d345835 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:02.764126 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04aee7b3-b55a-4380-ac51-44ef7d345835 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:02.828324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-04aee7b3-b55a-4380-ac51-44ef7d345835 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:02.836852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-04aee7b3-b55a-4380-ac51-44ef7d345835 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.194259 Jul 27 20:36:02.837451 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1397/2802] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:02 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:03.169626 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ab115dd2-641f-4d5e-828c-d24ca6fd7ecf tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:03.170244 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ab115dd2-641f-4d5e-828c-d24ca6fd7ecf tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:03.176292 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ab115dd2-641f-4d5e-828c-d24ca6fd7ecf tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:03.176747 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ab115dd2-641f-4d5e-828c-d24ca6fd7ecf tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:03.177540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ab115dd2-641f-4d5e-828c-d24ca6fd7ecf tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:03.177983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ab115dd2-641f-4d5e-828c-d24ca6fd7ecf tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:03.307310 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ab115dd2-641f-4d5e-828c-d24ca6fd7ecf tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:03.316262 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ab115dd2-641f-4d5e-828c-d24ca6fd7ecf tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.284289 Jul 27 20:36:03.316997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1406/2803] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:03 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:03.647574 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f7975919-0655-4d99-9a1a-3cfa920a17bb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:03.648191 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f7975919-0655-4d99-9a1a-3cfa920a17bb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:03.654684 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f7975919-0655-4d99-9a1a-3cfa920a17bb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:03.655135 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f7975919-0655-4d99-9a1a-3cfa920a17bb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:03.655887 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f7975919-0655-4d99-9a1a-3cfa920a17bb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:03.656327 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f7975919-0655-4d99-9a1a-3cfa920a17bb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:03.717029 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f7975919-0655-4d99-9a1a-3cfa920a17bb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:03.725609 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f7975919-0655-4d99-9a1a-3cfa920a17bb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.081894 Jul 27 20:36:03.726174 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1398/2804] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:03 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:03.858379 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ac77e9ee-13b3-478e-9eda-5d2c1a6b0fe8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:03.859002 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ac77e9ee-13b3-478e-9eda-5d2c1a6b0fe8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:03.865741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ac77e9ee-13b3-478e-9eda-5d2c1a6b0fe8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:03.866145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ac77e9ee-13b3-478e-9eda-5d2c1a6b0fe8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:03.866917 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ac77e9ee-13b3-478e-9eda-5d2c1a6b0fe8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:03.867367 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ac77e9ee-13b3-478e-9eda-5d2c1a6b0fe8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:03.929585 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ac77e9ee-13b3-478e-9eda-5d2c1a6b0fe8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:03.933030 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:36:03.938636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ac77e9ee-13b3-478e-9eda-5d2c1a6b0fe8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084123 Jul 27 20:36:03.939199 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1407/2805] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:03 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:04.340002 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0ee78f19-0136-4ed5-b51d-56db88f0ff0f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:04.340608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0ee78f19-0136-4ed5-b51d-56db88f0ff0f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:04.347389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ee78f19-0136-4ed5-b51d-56db88f0ff0f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:04.347841 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ee78f19-0136-4ed5-b51d-56db88f0ff0f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:04.348587 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ee78f19-0136-4ed5-b51d-56db88f0ff0f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:04.349057 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ee78f19-0136-4ed5-b51d-56db88f0ff0f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:04.480929 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0ee78f19-0136-4ed5-b51d-56db88f0ff0f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:04.488910 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0ee78f19-0136-4ed5-b51d-56db88f0ff0f tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152745 Jul 27 20:36:04.489504 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1399/2806] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:04 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:04.747889 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-977f9200-0691-416d-b4c8-f6a3b7af86e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:04.748517 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-977f9200-0691-416d-b4c8-f6a3b7af86e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:04.755283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-977f9200-0691-416d-b4c8-f6a3b7af86e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:04.755738 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-977f9200-0691-416d-b4c8-f6a3b7af86e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:04.756504 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-977f9200-0691-416d-b4c8-f6a3b7af86e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:04.756945 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-977f9200-0691-416d-b4c8-f6a3b7af86e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:04.818118 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-977f9200-0691-416d-b4c8-f6a3b7af86e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:04.825938 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-977f9200-0691-416d-b4c8-f6a3b7af86e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.081970 Jul 27 20:36:04.826489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1408/2807] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:04 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:04.959632 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d9bf662c-0c03-4a68-82b8-9dfb09fa6bba tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:04.960237 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d9bf662c-0c03-4a68-82b8-9dfb09fa6bba tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:04.966623 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d9bf662c-0c03-4a68-82b8-9dfb09fa6bba tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:04.967064 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d9bf662c-0c03-4a68-82b8-9dfb09fa6bba tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:04.967816 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d9bf662c-0c03-4a68-82b8-9dfb09fa6bba tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:04.968245 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d9bf662c-0c03-4a68-82b8-9dfb09fa6bba tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:05.029110 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d9bf662c-0c03-4a68-82b8-9dfb09fa6bba tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:05.038439 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d9bf662c-0c03-4a68-82b8-9dfb09fa6bba tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082718 Jul 27 20:36:05.039007 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1400/2808] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:04 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:05.510040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0487c58d-9aa7-4032-a870-21505c99ac58 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:05.510711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0487c58d-9aa7-4032-a870-21505c99ac58 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:05.517235 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0487c58d-9aa7-4032-a870-21505c99ac58 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:05.517693 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0487c58d-9aa7-4032-a870-21505c99ac58 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:05.518521 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0487c58d-9aa7-4032-a870-21505c99ac58 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:05.519165 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0487c58d-9aa7-4032-a870-21505c99ac58 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:05.645817 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0487c58d-9aa7-4032-a870-21505c99ac58 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:05.653770 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0487c58d-9aa7-4032-a870-21505c99ac58 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.147939 Jul 27 20:36:05.654339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1409/2809] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:05 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:05.848806 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bbda6ccd-d4bf-424c-bfb8-b7b2a05fd17f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:05.849395 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bbda6ccd-d4bf-424c-bfb8-b7b2a05fd17f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:05.855293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bbda6ccd-d4bf-424c-bfb8-b7b2a05fd17f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:05.855742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bbda6ccd-d4bf-424c-bfb8-b7b2a05fd17f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:05.856484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bbda6ccd-d4bf-424c-bfb8-b7b2a05fd17f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:05.856913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bbda6ccd-d4bf-424c-bfb8-b7b2a05fd17f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:05.916425 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bbda6ccd-d4bf-424c-bfb8-b7b2a05fd17f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:05.924248 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bbda6ccd-d4bf-424c-bfb8-b7b2a05fd17f tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.079924 Jul 27 20:36:05.924863 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1401/2810] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:05 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:06.059810 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1025c974-bf02-4e23-91e5-4dae1a739cde tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:06.060434 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1025c974-bf02-4e23-91e5-4dae1a739cde tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:06.066477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1025c974-bf02-4e23-91e5-4dae1a739cde tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:06.066931 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1025c974-bf02-4e23-91e5-4dae1a739cde tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:06.067697 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1025c974-bf02-4e23-91e5-4dae1a739cde tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:06.068148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1025c974-bf02-4e23-91e5-4dae1a739cde tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:06.132023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1025c974-bf02-4e23-91e5-4dae1a739cde tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:06.140017 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1025c974-bf02-4e23-91e5-4dae1a739cde tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084191 Jul 27 20:36:06.140589 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1410/2811] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:06 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:06.675934 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-28e89b6f-aa17-4f7d-abe7-df419edd2b3e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:06.676541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-28e89b6f-aa17-4f7d-abe7-df419edd2b3e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:06.683071 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28e89b6f-aa17-4f7d-abe7-df419edd2b3e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:06.683517 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28e89b6f-aa17-4f7d-abe7-df419edd2b3e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:06.684282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28e89b6f-aa17-4f7d-abe7-df419edd2b3e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:06.684713 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28e89b6f-aa17-4f7d-abe7-df419edd2b3e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:06.819922 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-28e89b6f-aa17-4f7d-abe7-df419edd2b3e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:06.827740 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-28e89b6f-aa17-4f7d-abe7-df419edd2b3e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.156273 Jul 27 20:36:06.828558 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1402/2812] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:06 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:06.945832 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bc9b4893-a80e-4df4-8d01-3619132fb345 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:06.946438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bc9b4893-a80e-4df4-8d01-3619132fb345 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:06.953384 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bc9b4893-a80e-4df4-8d01-3619132fb345 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:06.953846 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bc9b4893-a80e-4df4-8d01-3619132fb345 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:06.954612 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bc9b4893-a80e-4df4-8d01-3619132fb345 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:06.955054 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bc9b4893-a80e-4df4-8d01-3619132fb345 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:07.015527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bc9b4893-a80e-4df4-8d01-3619132fb345 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:07.023659 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bc9b4893-a80e-4df4-8d01-3619132fb345 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.081823 Jul 27 20:36:07.024234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1411/2813] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:06 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:07.161928 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a454391c-7aa2-40ca-8c4f-4388d614360d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:07.162533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a454391c-7aa2-40ca-8c4f-4388d614360d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:07.168435 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a454391c-7aa2-40ca-8c4f-4388d614360d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:07.168879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a454391c-7aa2-40ca-8c4f-4388d614360d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:07.169677 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a454391c-7aa2-40ca-8c4f-4388d614360d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:07.170093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a454391c-7aa2-40ca-8c4f-4388d614360d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:07.229926 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a454391c-7aa2-40ca-8c4f-4388d614360d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:07.238253 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a454391c-7aa2-40ca-8c4f-4388d614360d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.080900 Jul 27 20:36:07.238808 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1403/2814] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:07 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:07.850326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b978c7b5-329b-47ce-adf0-8e379affc2ae tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:07.850943 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b978c7b5-329b-47ce-adf0-8e379affc2ae tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:07.856993 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b978c7b5-329b-47ce-adf0-8e379affc2ae tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:07.857438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b978c7b5-329b-47ce-adf0-8e379affc2ae tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:07.858198 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b978c7b5-329b-47ce-adf0-8e379affc2ae tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:07.858639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b978c7b5-329b-47ce-adf0-8e379affc2ae tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:07.985559 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b978c7b5-329b-47ce-adf0-8e379affc2ae tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:07.993997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b978c7b5-329b-47ce-adf0-8e379affc2ae tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148102 Jul 27 20:36:07.994561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1412/2815] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:07 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:08.045018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3b9b7543-0fe6-48fd-818d-28e9035f7ffe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:08.045632 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3b9b7543-0fe6-48fd-818d-28e9035f7ffe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:08.052719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b9b7543-0fe6-48fd-818d-28e9035f7ffe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:08.053196 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b9b7543-0fe6-48fd-818d-28e9035f7ffe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:08.053989 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b9b7543-0fe6-48fd-818d-28e9035f7ffe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:08.054423 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b9b7543-0fe6-48fd-818d-28e9035f7ffe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:08.118281 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3b9b7543-0fe6-48fd-818d-28e9035f7ffe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:08.126129 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3b9b7543-0fe6-48fd-818d-28e9035f7ffe tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.084908 Jul 27 20:36:08.126693 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1404/2816] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:08 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:08.258645 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f88864aa-2603-4383-a46c-e2f4e96298ab tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:08.259180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f88864aa-2603-4383-a46c-e2f4e96298ab tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:08.265371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f88864aa-2603-4383-a46c-e2f4e96298ab tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:08.265825 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f88864aa-2603-4383-a46c-e2f4e96298ab tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:08.266574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f88864aa-2603-4383-a46c-e2f4e96298ab tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:08.267009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f88864aa-2603-4383-a46c-e2f4e96298ab tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:08.332699 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f88864aa-2603-4383-a46c-e2f4e96298ab tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:08.340555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f88864aa-2603-4383-a46c-e2f4e96298ab tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085810 Jul 27 20:36:08.341133 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1413/2817] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:08 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:09.014203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-74c04a0f-0ce5-4e93-aa0a-a603ccf5d24d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:09.014825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-74c04a0f-0ce5-4e93-aa0a-a603ccf5d24d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:09.021576 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74c04a0f-0ce5-4e93-aa0a-a603ccf5d24d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:09.022030 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74c04a0f-0ce5-4e93-aa0a-a603ccf5d24d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:09.022791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74c04a0f-0ce5-4e93-aa0a-a603ccf5d24d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:09.023229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74c04a0f-0ce5-4e93-aa0a-a603ccf5d24d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:09.148174 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fe731ec2-b453-4a47-b385-3364312d0f0d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:09.148788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fe731ec2-b453-4a47-b385-3364312d0f0d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:09.155204 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fe731ec2-b453-4a47-b385-3364312d0f0d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:09.155652 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fe731ec2-b453-4a47-b385-3364312d0f0d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:09.156418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fe731ec2-b453-4a47-b385-3364312d0f0d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:09.156555 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-74c04a0f-0ce5-4e93-aa0a-a603ccf5d24d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:09.156854 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fe731ec2-b453-4a47-b385-3364312d0f0d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:09.164632 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-74c04a0f-0ce5-4e93-aa0a-a603ccf5d24d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.154329 Jul 27 20:36:09.165229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1405/2818] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:09 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:09.216733 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fe731ec2-b453-4a47-b385-3364312d0f0d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:09.224576 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fe731ec2-b453-4a47-b385-3364312d0f0d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.080251 Jul 27 20:36:09.225170 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1414/2819] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:09 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:09.361423 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e6bc671a-8ffb-4661-b00b-3fe054873161 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:09.362034 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e6bc671a-8ffb-4661-b00b-3fe054873161 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:09.368123 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e6bc671a-8ffb-4661-b00b-3fe054873161 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:09.368578 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e6bc671a-8ffb-4661-b00b-3fe054873161 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:09.369366 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e6bc671a-8ffb-4661-b00b-3fe054873161 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:09.369872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e6bc671a-8ffb-4661-b00b-3fe054873161 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:09.430353 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e6bc671a-8ffb-4661-b00b-3fe054873161 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:09.438402 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e6bc671a-8ffb-4661-b00b-3fe054873161 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.080872 Jul 27 20:36:09.438976 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1406/2820] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:09 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:10.185530 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-11cb2ba1-8c07-4531-8b18-999386b98756 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:10.186142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-11cb2ba1-8c07-4531-8b18-999386b98756 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:10.193117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-11cb2ba1-8c07-4531-8b18-999386b98756 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:10.193571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-11cb2ba1-8c07-4531-8b18-999386b98756 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:10.194334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-11cb2ba1-8c07-4531-8b18-999386b98756 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:10.194774 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-11cb2ba1-8c07-4531-8b18-999386b98756 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:10.245268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a0ae4f80-8209-4be3-b7bd-34c7e0e49d54 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:10.245877 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a0ae4f80-8209-4be3-b7bd-34c7e0e49d54 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:10.252266 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0ae4f80-8209-4be3-b7bd-34c7e0e49d54 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:10.252742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0ae4f80-8209-4be3-b7bd-34c7e0e49d54 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:10.253667 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0ae4f80-8209-4be3-b7bd-34c7e0e49d54 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:10.254106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0ae4f80-8209-4be3-b7bd-34c7e0e49d54 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:10.318537 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a0ae4f80-8209-4be3-b7bd-34c7e0e49d54 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:10.326559 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a0ae4f80-8209-4be3-b7bd-34c7e0e49d54 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.085083 Jul 27 20:36:10.326720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-11cb2ba1-8c07-4531-8b18-999386b98756 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:10.327060 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1407/2821] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:10 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:10.335559 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-11cb2ba1-8c07-4531-8b18-999386b98756 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153867 Jul 27 20:36:10.336125 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1415/2822] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:10 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:10.460092 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-013e3d5c-6bdd-46ed-8d65-be07d7acc18e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:10.460691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-013e3d5c-6bdd-46ed-8d65-be07d7acc18e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:10.466635 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-013e3d5c-6bdd-46ed-8d65-be07d7acc18e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:10.467077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-013e3d5c-6bdd-46ed-8d65-be07d7acc18e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:10.467819 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-013e3d5c-6bdd-46ed-8d65-be07d7acc18e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:10.468246 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-013e3d5c-6bdd-46ed-8d65-be07d7acc18e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:10.527691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-013e3d5c-6bdd-46ed-8d65-be07d7acc18e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:10.536230 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-013e3d5c-6bdd-46ed-8d65-be07d7acc18e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.080519 Jul 27 20:36:10.536796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1408/2823] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:10 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:11.348170 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5a1b3eab-6f16-4f3d-ada0-f3d6ac773883 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:11.348718 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5a1b3eab-6f16-4f3d-ada0-f3d6ac773883 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:11.355219 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5a1b3eab-6f16-4f3d-ada0-f3d6ac773883 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:11.355664 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5a1b3eab-6f16-4f3d-ada0-f3d6ac773883 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:11.356421 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5a1b3eab-6f16-4f3d-ada0-f3d6ac773883 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:11.356857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5a1b3eab-6f16-4f3d-ada0-f3d6ac773883 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:11.357072 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-68d62979-60e5-42a8-b401-8a135a0514a7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:11.357718 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-68d62979-60e5-42a8-b401-8a135a0514a7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:11.364745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68d62979-60e5-42a8-b401-8a135a0514a7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:11.365217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68d62979-60e5-42a8-b401-8a135a0514a7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:11.365974 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68d62979-60e5-42a8-b401-8a135a0514a7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:11.366417 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68d62979-60e5-42a8-b401-8a135a0514a7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:11.419586 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5a1b3eab-6f16-4f3d-ada0-f3d6ac773883 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:11.428126 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5a1b3eab-6f16-4f3d-ada0-f3d6ac773883 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.083941 Jul 27 20:36:11.428690 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1416/2824] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:11 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:11.500104 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-68d62979-60e5-42a8-b401-8a135a0514a7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:11.508196 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-68d62979-60e5-42a8-b401-8a135a0514a7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.154910 Jul 27 20:36:11.508761 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1409/2825] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:11 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:11.556408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7c548470-aa77-46c8-a0fa-c357e1f7f84e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:11.557042 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7c548470-aa77-46c8-a0fa-c357e1f7f84e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:11.562986 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7c548470-aa77-46c8-a0fa-c357e1f7f84e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:11.563435 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7c548470-aa77-46c8-a0fa-c357e1f7f84e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:11.564186 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7c548470-aa77-46c8-a0fa-c357e1f7f84e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:11.564625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7c548470-aa77-46c8-a0fa-c357e1f7f84e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:11.627365 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7c548470-aa77-46c8-a0fa-c357e1f7f84e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:11.636046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7c548470-aa77-46c8-a0fa-c357e1f7f84e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083391 Jul 27 20:36:11.636613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1417/2826] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:11 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:12.449550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8b563642-1e27-4ed7-ab4a-930883574877 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:12.450172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8b563642-1e27-4ed7-ab4a-930883574877 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:12.457625 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b563642-1e27-4ed7-ab4a-930883574877 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:12.458072 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b563642-1e27-4ed7-ab4a-930883574877 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:12.458836 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b563642-1e27-4ed7-ab4a-930883574877 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:12.459270 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b563642-1e27-4ed7-ab4a-930883574877 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:12.463203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:36:12.520276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8b563642-1e27-4ed7-ab4a-930883574877 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:12.528628 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8b563642-1e27-4ed7-ab4a-930883574877 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.082855 Jul 27 20:36:12.528834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ae89ec95-44df-4fc6-9433-b110a8753468 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:12.529277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1410/2827] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:12 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:12.529471 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ae89ec95-44df-4fc6-9433-b110a8753468 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:12.535900 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ae89ec95-44df-4fc6-9433-b110a8753468 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:12.536351 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ae89ec95-44df-4fc6-9433-b110a8753468 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:12.537139 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ae89ec95-44df-4fc6-9433-b110a8753468 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:12.537582 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ae89ec95-44df-4fc6-9433-b110a8753468 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:12.657222 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4f38ea03-2c15-479d-af09-997efff39a2f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:12.657853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4f38ea03-2c15-479d-af09-997efff39a2f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:12.663880 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4f38ea03-2c15-479d-af09-997efff39a2f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:12.664329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4f38ea03-2c15-479d-af09-997efff39a2f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:12.665106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ae89ec95-44df-4fc6-9433-b110a8753468 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:12.665260 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4f38ea03-2c15-479d-af09-997efff39a2f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:12.665540 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4f38ea03-2c15-479d-af09-997efff39a2f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:12.673133 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ae89ec95-44df-4fc6-9433-b110a8753468 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148046 Jul 27 20:36:12.673711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1418/2828] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:12 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:12.726523 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4f38ea03-2c15-479d-af09-997efff39a2f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:12.734350 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4f38ea03-2c15-479d-af09-997efff39a2f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081000 Jul 27 20:36:12.734903 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1411/2829] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:12 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:13.549378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e9477b0b-022c-49bc-a766-228b74f436e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:13.550108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e9477b0b-022c-49bc-a766-228b74f436e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:13.556796 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e9477b0b-022c-49bc-a766-228b74f436e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:13.557288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e9477b0b-022c-49bc-a766-228b74f436e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:13.558301 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e9477b0b-022c-49bc-a766-228b74f436e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:13.558851 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e9477b0b-022c-49bc-a766-228b74f436e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:13.621994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e9477b0b-022c-49bc-a766-228b74f436e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:13.630820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e9477b0b-022c-49bc-a766-228b74f436e4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.085412 Jul 27 20:36:13.631390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1419/2830] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:13 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:13.694773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9271de34-4e00-4e86-ad4c-7a095210fb9b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:13.695413 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9271de34-4e00-4e86-ad4c-7a095210fb9b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:13.701857 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9271de34-4e00-4e86-ad4c-7a095210fb9b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:13.702298 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9271de34-4e00-4e86-ad4c-7a095210fb9b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:13.703313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9271de34-4e00-4e86-ad4c-7a095210fb9b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:13.703741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9271de34-4e00-4e86-ad4c-7a095210fb9b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:13.757423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-81ac0e52-8b8e-450e-9599-5713b40ab2e5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:13.758172 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-81ac0e52-8b8e-450e-9599-5713b40ab2e5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:13.764253 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-81ac0e52-8b8e-450e-9599-5713b40ab2e5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:13.764714 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-81ac0e52-8b8e-450e-9599-5713b40ab2e5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:13.765506 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-81ac0e52-8b8e-450e-9599-5713b40ab2e5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:13.765951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-81ac0e52-8b8e-450e-9599-5713b40ab2e5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:13.830121 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-81ac0e52-8b8e-450e-9599-5713b40ab2e5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:13.839321 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-81ac0e52-8b8e-450e-9599-5713b40ab2e5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085689 Jul 27 20:36:13.839898 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1420/2831] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:13 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:13.840552 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9271de34-4e00-4e86-ad4c-7a095210fb9b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:13.848903 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9271de34-4e00-4e86-ad4c-7a095210fb9b tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.158020 Jul 27 20:36:13.849475 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1412/2832] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:13 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:14.651710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5a4e1f82-a0c6-47fe-ad31-a1a2058aaa87 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:14.652323 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5a4e1f82-a0c6-47fe-ad31-a1a2058aaa87 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:14.658804 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5a4e1f82-a0c6-47fe-ad31-a1a2058aaa87 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:14.659254 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5a4e1f82-a0c6-47fe-ad31-a1a2058aaa87 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:14.660006 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5a4e1f82-a0c6-47fe-ad31-a1a2058aaa87 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:14.660443 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5a4e1f82-a0c6-47fe-ad31-a1a2058aaa87 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:14.720670 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5a4e1f82-a0c6-47fe-ad31-a1a2058aaa87 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:14.728512 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5a4e1f82-a0c6-47fe-ad31-a1a2058aaa87 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.080714 Jul 27 20:36:14.729090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1421/2833] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:14 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:14.860849 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0c85d9f5-743f-4bbb-9c2a-9503641fe488 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:14.862134 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0c85d9f5-743f-4bbb-9c2a-9503641fe488 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:14.868846 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c85d9f5-743f-4bbb-9c2a-9503641fe488 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:14.869330 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c85d9f5-743f-4bbb-9c2a-9503641fe488 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:14.869826 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b3b993b3-7245-4731-ab2c-d7e091fe8a27 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:14.870098 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c85d9f5-743f-4bbb-9c2a-9503641fe488 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:14.870447 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b3b993b3-7245-4731-ab2c-d7e091fe8a27 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:14.870574 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c85d9f5-743f-4bbb-9c2a-9503641fe488 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:14.876334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b3b993b3-7245-4731-ab2c-d7e091fe8a27 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:14.876783 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b3b993b3-7245-4731-ab2c-d7e091fe8a27 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:14.878337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b3b993b3-7245-4731-ab2c-d7e091fe8a27 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:14.878892 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b3b993b3-7245-4731-ab2c-d7e091fe8a27 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:14.936666 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0c85d9f5-743f-4bbb-9c2a-9503641fe488 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:14.948130 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0c85d9f5-743f-4bbb-9c2a-9503641fe488 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.090667 Jul 27 20:36:14.948940 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1413/2834] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:14 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:15.011379 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b3b993b3-7245-4731-ab2c-d7e091fe8a27 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:15.019984 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b3b993b3-7245-4731-ab2c-d7e091fe8a27 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153937 Jul 27 20:36:15.020554 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1422/2835] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:14 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:15.749090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9a1870ef-0fab-45bb-8e3b-ac990d6625ec tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:15.749757 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9a1870ef-0fab-45bb-8e3b-ac990d6625ec tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:15.756496 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a1870ef-0fab-45bb-8e3b-ac990d6625ec tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:15.756946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a1870ef-0fab-45bb-8e3b-ac990d6625ec tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:15.757741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a1870ef-0fab-45bb-8e3b-ac990d6625ec tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:15.758180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a1870ef-0fab-45bb-8e3b-ac990d6625ec tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:15.818004 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9a1870ef-0fab-45bb-8e3b-ac990d6625ec tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:15.825872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9a1870ef-0fab-45bb-8e3b-ac990d6625ec tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.080760 Jul 27 20:36:15.826443 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1414/2836] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:15 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:15.969455 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c393bea0-30df-4dbe-978e-1ecc3cc980b1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:15.970074 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c393bea0-30df-4dbe-978e-1ecc3cc980b1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:15.977100 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c393bea0-30df-4dbe-978e-1ecc3cc980b1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:15.977555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c393bea0-30df-4dbe-978e-1ecc3cc980b1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:15.978324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c393bea0-30df-4dbe-978e-1ecc3cc980b1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:15.978763 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c393bea0-30df-4dbe-978e-1ecc3cc980b1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:16.039898 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c393bea0-30df-4dbe-978e-1ecc3cc980b1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:16.040821 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a5419881-7e13-436f-ba2a-8573bcd0097c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:16.041457 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a5419881-7e13-436f-ba2a-8573bcd0097c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:16.047793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a5419881-7e13-436f-ba2a-8573bcd0097c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:16.047961 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c393bea0-30df-4dbe-978e-1ecc3cc980b1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082402 Jul 27 20:36:16.048236 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a5419881-7e13-436f-ba2a-8573bcd0097c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:16.048471 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1423/2837] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:15 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:16.048999 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a5419881-7e13-436f-ba2a-8573bcd0097c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:16.050386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a5419881-7e13-436f-ba2a-8573bcd0097c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:16.182245 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a5419881-7e13-436f-ba2a-8573bcd0097c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:16.190556 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a5419881-7e13-436f-ba2a-8573bcd0097c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153076 Jul 27 20:36:16.191275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1415/2838] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:16 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:16.847420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-81916892-7652-4c74-9f97-4d39e5699c6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:16.848030 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-81916892-7652-4c74-9f97-4d39e5699c6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:16.854044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-81916892-7652-4c74-9f97-4d39e5699c6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:16.854492 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-81916892-7652-4c74-9f97-4d39e5699c6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:16.855244 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-81916892-7652-4c74-9f97-4d39e5699c6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:16.855676 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-81916892-7652-4c74-9f97-4d39e5699c6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:16.873633 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:36:16.919533 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-81916892-7652-4c74-9f97-4d39e5699c6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:16.927418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-81916892-7652-4c74-9f97-4d39e5699c6c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.083912 Jul 27 20:36:16.927976 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1424/2839] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:16 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:17.070843 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4358d654-2322-48fa-9a31-178d08a014cf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:17.071597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4358d654-2322-48fa-9a31-178d08a014cf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:17.078437 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4358d654-2322-48fa-9a31-178d08a014cf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:17.078885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4358d654-2322-48fa-9a31-178d08a014cf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:17.079648 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4358d654-2322-48fa-9a31-178d08a014cf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:17.080087 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4358d654-2322-48fa-9a31-178d08a014cf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:17.140994 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4358d654-2322-48fa-9a31-178d08a014cf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:17.149401 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4358d654-2322-48fa-9a31-178d08a014cf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083324 Jul 27 20:36:17.149958 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1416/2840] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:17 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:17.212253 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b884be99-ea2a-48ae-bf11-a4e87f9fa943 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:17.212878 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b884be99-ea2a-48ae-bf11-a4e87f9fa943 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:17.219336 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b884be99-ea2a-48ae-bf11-a4e87f9fa943 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:17.219793 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b884be99-ea2a-48ae-bf11-a4e87f9fa943 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:17.220561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b884be99-ea2a-48ae-bf11-a4e87f9fa943 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:17.221666 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b884be99-ea2a-48ae-bf11-a4e87f9fa943 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:17.349081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b884be99-ea2a-48ae-bf11-a4e87f9fa943 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:17.356924 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b884be99-ea2a-48ae-bf11-a4e87f9fa943 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148575 Jul 27 20:36:17.357508 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1425/2841] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:17 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:17.948610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ad258ec5-2e09-4190-a9a8-c4cd0bd25a9c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:17.949292 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ad258ec5-2e09-4190-a9a8-c4cd0bd25a9c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:17.955934 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ad258ec5-2e09-4190-a9a8-c4cd0bd25a9c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:17.956416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ad258ec5-2e09-4190-a9a8-c4cd0bd25a9c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:17.957213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ad258ec5-2e09-4190-a9a8-c4cd0bd25a9c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:17.957656 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ad258ec5-2e09-4190-a9a8-c4cd0bd25a9c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:18.017218 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ad258ec5-2e09-4190-a9a8-c4cd0bd25a9c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:18.025857 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ad258ec5-2e09-4190-a9a8-c4cd0bd25a9c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.081198 Jul 27 20:36:18.026418 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1417/2842] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:17 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:18.170877 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-71ffb849-5dbd-42e8-9d99-688b7dcfd51c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:18.171498 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-71ffb849-5dbd-42e8-9d99-688b7dcfd51c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:18.177621 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-71ffb849-5dbd-42e8-9d99-688b7dcfd51c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:18.178082 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-71ffb849-5dbd-42e8-9d99-688b7dcfd51c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:18.178850 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-71ffb849-5dbd-42e8-9d99-688b7dcfd51c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:18.179296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-71ffb849-5dbd-42e8-9d99-688b7dcfd51c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:18.240285 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-71ffb849-5dbd-42e8-9d99-688b7dcfd51c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:18.248149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-71ffb849-5dbd-42e8-9d99-688b7dcfd51c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081126 Jul 27 20:36:18.248707 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1426/2843] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:18 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:18.379276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5f9630b4-aaa9-4142-a28e-b7b1d4015d90 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:18.379890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5f9630b4-aaa9-4142-a28e-b7b1d4015d90 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:18.386055 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5f9630b4-aaa9-4142-a28e-b7b1d4015d90 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:18.386505 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5f9630b4-aaa9-4142-a28e-b7b1d4015d90 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:18.387262 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5f9630b4-aaa9-4142-a28e-b7b1d4015d90 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:18.387697 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5f9630b4-aaa9-4142-a28e-b7b1d4015d90 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:18.516579 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5f9630b4-aaa9-4142-a28e-b7b1d4015d90 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:18.525139 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5f9630b4-aaa9-4142-a28e-b7b1d4015d90 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150452 Jul 27 20:36:18.525700 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1418/2844] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:18 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:19.047327 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-db09fcc9-3a42-453d-bb88-2f45e01de5a0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:19.047953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-db09fcc9-3a42-453d-bb88-2f45e01de5a0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:19.054781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-db09fcc9-3a42-453d-bb88-2f45e01de5a0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:19.055245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-db09fcc9-3a42-453d-bb88-2f45e01de5a0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:19.056011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-db09fcc9-3a42-453d-bb88-2f45e01de5a0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:19.056461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-db09fcc9-3a42-453d-bb88-2f45e01de5a0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:19.120468 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-db09fcc9-3a42-453d-bb88-2f45e01de5a0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:19.128491 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-db09fcc9-3a42-453d-bb88-2f45e01de5a0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.085055 Jul 27 20:36:19.129081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1427/2845] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:19 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:19.269185 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ea275750-bdfa-409f-b905-a65bd7a5d303 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:19.269788 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ea275750-bdfa-409f-b905-a65bd7a5d303 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:19.276216 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ea275750-bdfa-409f-b905-a65bd7a5d303 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:19.276677 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ea275750-bdfa-409f-b905-a65bd7a5d303 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:19.277426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ea275750-bdfa-409f-b905-a65bd7a5d303 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:19.277885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ea275750-bdfa-409f-b905-a65bd7a5d303 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:19.338623 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ea275750-bdfa-409f-b905-a65bd7a5d303 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:19.347009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ea275750-bdfa-409f-b905-a65bd7a5d303 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082375 Jul 27 20:36:19.347630 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1419/2846] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:19 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:19.546103 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6da9e694-eac5-400f-90d9-110f2d72d691 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:19.546723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6da9e694-eac5-400f-90d9-110f2d72d691 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:19.553574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6da9e694-eac5-400f-90d9-110f2d72d691 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:19.554032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6da9e694-eac5-400f-90d9-110f2d72d691 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:19.554800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6da9e694-eac5-400f-90d9-110f2d72d691 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:19.555243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6da9e694-eac5-400f-90d9-110f2d72d691 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:19.683495 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6da9e694-eac5-400f-90d9-110f2d72d691 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:19.692076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6da9e694-eac5-400f-90d9-110f2d72d691 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149848 Jul 27 20:36:19.692644 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1428/2847] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:19 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:20.149875 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-42583a70-f3d2-45ae-9164-ea2047e36deb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:20.150410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-42583a70-f3d2-45ae-9164-ea2047e36deb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:20.156479 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-42583a70-f3d2-45ae-9164-ea2047e36deb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:20.156929 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-42583a70-f3d2-45ae-9164-ea2047e36deb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:20.157723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-42583a70-f3d2-45ae-9164-ea2047e36deb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:20.158162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-42583a70-f3d2-45ae-9164-ea2047e36deb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:20.221143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-42583a70-f3d2-45ae-9164-ea2047e36deb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:20.229036 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-42583a70-f3d2-45ae-9164-ea2047e36deb tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.083052 Jul 27 20:36:20.229592 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1420/2848] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:20 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:20.368393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f31908e8-df80-46cc-b951-7cf48cf28235 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:20.369023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f31908e8-df80-46cc-b951-7cf48cf28235 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:20.375016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f31908e8-df80-46cc-b951-7cf48cf28235 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:20.375464 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f31908e8-df80-46cc-b951-7cf48cf28235 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:20.376214 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f31908e8-df80-46cc-b951-7cf48cf28235 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:20.376650 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f31908e8-df80-46cc-b951-7cf48cf28235 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:20.437953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f31908e8-df80-46cc-b951-7cf48cf28235 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:20.446076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f31908e8-df80-46cc-b951-7cf48cf28235 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081585 Jul 27 20:36:20.446622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1429/2849] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:20 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:20.714048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9753a2c9-66ee-43a2-9e7f-cf8334a94d18 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:20.714582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9753a2c9-66ee-43a2-9e7f-cf8334a94d18 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:20.721694 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9753a2c9-66ee-43a2-9e7f-cf8334a94d18 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:20.722242 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9753a2c9-66ee-43a2-9e7f-cf8334a94d18 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:20.723000 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9753a2c9-66ee-43a2-9e7f-cf8334a94d18 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:20.723440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9753a2c9-66ee-43a2-9e7f-cf8334a94d18 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:20.853103 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9753a2c9-66ee-43a2-9e7f-cf8334a94d18 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:20.861028 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9753a2c9-66ee-43a2-9e7f-cf8334a94d18 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151000 Jul 27 20:36:20.862161 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1421/2850] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:20 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:21.250587 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9a72828f-bb73-40a6-908d-3f9510ebad36 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:21.251206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9a72828f-bb73-40a6-908d-3f9510ebad36 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:21.257778 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9a72828f-bb73-40a6-908d-3f9510ebad36 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:21.258229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9a72828f-bb73-40a6-908d-3f9510ebad36 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:21.258987 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9a72828f-bb73-40a6-908d-3f9510ebad36 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:21.259429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9a72828f-bb73-40a6-908d-3f9510ebad36 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:21.318343 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9a72828f-bb73-40a6-908d-3f9510ebad36 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:21.326179 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9a72828f-bb73-40a6-908d-3f9510ebad36 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.079395 Jul 27 20:36:21.326689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1430/2851] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:21 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:21.467176 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c07cd9e9-737f-4f0a-a0a3-0c08c7c815d0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:21.467918 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c07cd9e9-737f-4f0a-a0a3-0c08c7c815d0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:21.474755 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c07cd9e9-737f-4f0a-a0a3-0c08c7c815d0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:21.475224 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c07cd9e9-737f-4f0a-a0a3-0c08c7c815d0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:21.475974 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c07cd9e9-737f-4f0a-a0a3-0c08c7c815d0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:21.476415 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c07cd9e9-737f-4f0a-a0a3-0c08c7c815d0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:21.538793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c07cd9e9-737f-4f0a-a0a3-0c08c7c815d0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:21.546744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c07cd9e9-737f-4f0a-a0a3-0c08c7c815d0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083684 Jul 27 20:36:21.547308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1422/2852] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:21 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:21.882875 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ae5535e4-8fdb-4cd4-946f-b07d36d21796 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:21.883430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ae5535e4-8fdb-4cd4-946f-b07d36d21796 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:21.889464 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ae5535e4-8fdb-4cd4-946f-b07d36d21796 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:21.889913 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ae5535e4-8fdb-4cd4-946f-b07d36d21796 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:21.890673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ae5535e4-8fdb-4cd4-946f-b07d36d21796 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:21.891110 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ae5535e4-8fdb-4cd4-946f-b07d36d21796 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:22.022935 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ae5535e4-8fdb-4cd4-946f-b07d36d21796 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:22.030895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ae5535e4-8fdb-4cd4-946f-b07d36d21796 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152054 Jul 27 20:36:22.031463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1431/2853] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:21 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:22.347741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d0fe34a7-cd4c-4bd5-92e4-39bb9e97b4ac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:22.348802 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d0fe34a7-cd4c-4bd5-92e4-39bb9e97b4ac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:22.356466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d0fe34a7-cd4c-4bd5-92e4-39bb9e97b4ac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:22.356921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d0fe34a7-cd4c-4bd5-92e4-39bb9e97b4ac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:22.357722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d0fe34a7-cd4c-4bd5-92e4-39bb9e97b4ac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:22.358162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d0fe34a7-cd4c-4bd5-92e4-39bb9e97b4ac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:22.418164 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d0fe34a7-cd4c-4bd5-92e4-39bb9e97b4ac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:22.426691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d0fe34a7-cd4c-4bd5-92e4-39bb9e97b4ac tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.083642 Jul 27 20:36:22.427253 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1423/2854] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:22 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:22.568450 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-86c58c20-1ab2-48ab-b0ac-d57d45a28db2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:22.569094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-86c58c20-1ab2-48ab-b0ac-d57d45a28db2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:22.575747 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-86c58c20-1ab2-48ab-b0ac-d57d45a28db2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:22.576200 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-86c58c20-1ab2-48ab-b0ac-d57d45a28db2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:22.576982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-86c58c20-1ab2-48ab-b0ac-d57d45a28db2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:22.577435 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-86c58c20-1ab2-48ab-b0ac-d57d45a28db2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:22.638532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-86c58c20-1ab2-48ab-b0ac-d57d45a28db2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:22.648311 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-86c58c20-1ab2-48ab-b0ac-d57d45a28db2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084367 Jul 27 20:36:22.648873 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1432/2855] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:22 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:23.052038 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8b4591b5-75d5-4359-aef4-f4aec41e7fca tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:23.052587 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8b4591b5-75d5-4359-aef4-f4aec41e7fca tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:23.058653 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b4591b5-75d5-4359-aef4-f4aec41e7fca tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:23.059107 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b4591b5-75d5-4359-aef4-f4aec41e7fca tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:23.059872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b4591b5-75d5-4359-aef4-f4aec41e7fca tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:23.060311 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b4591b5-75d5-4359-aef4-f4aec41e7fca tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:23.187671 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8b4591b5-75d5-4359-aef4-f4aec41e7fca tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:23.195639 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8b4591b5-75d5-4359-aef4-f4aec41e7fca tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.147696 Jul 27 20:36:23.196201 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1424/2856] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:23 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:23.447626 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2de0fd30-2d42-452c-8f91-4eec15911028 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:23.448255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2de0fd30-2d42-452c-8f91-4eec15911028 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:23.454958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2de0fd30-2d42-452c-8f91-4eec15911028 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:23.456063 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2de0fd30-2d42-452c-8f91-4eec15911028 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:23.457265 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2de0fd30-2d42-452c-8f91-4eec15911028 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:23.457373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2de0fd30-2d42-452c-8f91-4eec15911028 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:23.517515 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2de0fd30-2d42-452c-8f91-4eec15911028 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:23.526105 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2de0fd30-2d42-452c-8f91-4eec15911028 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.082343 Jul 27 20:36:23.526667 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1433/2857] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:23 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:23.669911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ba17a710-214d-4cbc-bcda-c9ceea153fdf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:23.670526 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ba17a710-214d-4cbc-bcda-c9ceea153fdf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:23.677199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba17a710-214d-4cbc-bcda-c9ceea153fdf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:23.677652 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba17a710-214d-4cbc-bcda-c9ceea153fdf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:23.678410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba17a710-214d-4cbc-bcda-c9ceea153fdf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:23.678846 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba17a710-214d-4cbc-bcda-c9ceea153fdf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:23.743602 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ba17a710-214d-4cbc-bcda-c9ceea153fdf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:23.751501 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ba17a710-214d-4cbc-bcda-c9ceea153fdf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085426 Jul 27 20:36:23.752568 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1425/2858] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:23 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:24.217766 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-06f20fdf-d8cf-4d3e-a200-6203abc58ef3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:24.218382 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-06f20fdf-d8cf-4d3e-a200-6203abc58ef3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:24.225816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-06f20fdf-d8cf-4d3e-a200-6203abc58ef3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:24.226270 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-06f20fdf-d8cf-4d3e-a200-6203abc58ef3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:24.227029 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-06f20fdf-d8cf-4d3e-a200-6203abc58ef3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:24.227469 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-06f20fdf-d8cf-4d3e-a200-6203abc58ef3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:24.357381 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-06f20fdf-d8cf-4d3e-a200-6203abc58ef3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:24.369375 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-06f20fdf-d8cf-4d3e-a200-6203abc58ef3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.155392 Jul 27 20:36:24.369955 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1434/2859] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:24 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:24.547705 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c9041457-7991-445f-b1e7-97688e79ee67 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:24.548312 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c9041457-7991-445f-b1e7-97688e79ee67 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:24.554438 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9041457-7991-445f-b1e7-97688e79ee67 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:24.554884 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9041457-7991-445f-b1e7-97688e79ee67 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:24.555637 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9041457-7991-445f-b1e7-97688e79ee67 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:24.556071 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9041457-7991-445f-b1e7-97688e79ee67 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:24.616455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c9041457-7991-445f-b1e7-97688e79ee67 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:24.619856 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:36:24.625550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c9041457-7991-445f-b1e7-97688e79ee67 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.081677 Jul 27 20:36:24.626119 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1426/2860] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:24 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:24.773360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6070129a-af16-443a-89ff-1efbc5312d0d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:24.773969 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6070129a-af16-443a-89ff-1efbc5312d0d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:24.780045 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6070129a-af16-443a-89ff-1efbc5312d0d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:24.780494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6070129a-af16-443a-89ff-1efbc5312d0d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:24.781272 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6070129a-af16-443a-89ff-1efbc5312d0d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:24.781713 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6070129a-af16-443a-89ff-1efbc5312d0d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:24.842102 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6070129a-af16-443a-89ff-1efbc5312d0d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:24.850966 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6070129a-af16-443a-89ff-1efbc5312d0d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081427 Jul 27 20:36:24.851526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1435/2861] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:24 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:25.390377 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b190300b-4c10-485a-8bbb-ff63ecafb549 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:25.391028 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b190300b-4c10-485a-8bbb-ff63ecafb549 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:25.398131 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b190300b-4c10-485a-8bbb-ff63ecafb549 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:25.398582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b190300b-4c10-485a-8bbb-ff63ecafb549 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:25.399354 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b190300b-4c10-485a-8bbb-ff63ecafb549 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:25.399794 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b190300b-4c10-485a-8bbb-ff63ecafb549 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:25.529053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b190300b-4c10-485a-8bbb-ff63ecafb549 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:25.538057 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b190300b-4c10-485a-8bbb-ff63ecafb549 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151487 Jul 27 20:36:25.538634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1427/2862] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:25 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:25.647696 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5953eeed-366d-446e-aca1-50b5a77165d0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:25.648240 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5953eeed-366d-446e-aca1-50b5a77165d0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:25.654699 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5953eeed-366d-446e-aca1-50b5a77165d0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:25.655180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5953eeed-366d-446e-aca1-50b5a77165d0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:25.656049 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5953eeed-366d-446e-aca1-50b5a77165d0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:25.656489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5953eeed-366d-446e-aca1-50b5a77165d0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:25.715905 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5953eeed-366d-446e-aca1-50b5a77165d0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:25.723745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5953eeed-366d-446e-aca1-50b5a77165d0 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.080857 Jul 27 20:36:25.724308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1436/2863] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:25 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:25.871854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7285f1cd-ee4c-4ffa-90ea-6d2b18c19dc9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:25.872463 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7285f1cd-ee4c-4ffa-90ea-6d2b18c19dc9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:25.879197 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7285f1cd-ee4c-4ffa-90ea-6d2b18c19dc9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:25.879642 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7285f1cd-ee4c-4ffa-90ea-6d2b18c19dc9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:25.880403 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7285f1cd-ee4c-4ffa-90ea-6d2b18c19dc9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:25.880838 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7285f1cd-ee4c-4ffa-90ea-6d2b18c19dc9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:25.943339 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7285f1cd-ee4c-4ffa-90ea-6d2b18c19dc9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:25.951090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7285f1cd-ee4c-4ffa-90ea-6d2b18c19dc9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083091 Jul 27 20:36:25.951651 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1428/2864] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:25 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:26.559092 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-eb72e309-be40-4318-ae0a-765d48e99f75 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:26.559741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-eb72e309-be40-4318-ae0a-765d48e99f75 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:26.565797 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eb72e309-be40-4318-ae0a-765d48e99f75 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:26.566252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eb72e309-be40-4318-ae0a-765d48e99f75 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:26.567013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eb72e309-be40-4318-ae0a-765d48e99f75 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:26.567457 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eb72e309-be40-4318-ae0a-765d48e99f75 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:26.696117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-eb72e309-be40-4318-ae0a-765d48e99f75 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:26.704324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-eb72e309-be40-4318-ae0a-765d48e99f75 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149140 Jul 27 20:36:26.704894 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1437/2865] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:26 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:26.744541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b01aa090-1923-4237-942b-1cb3c3845eb4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:26.745203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b01aa090-1923-4237-942b-1cb3c3845eb4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:26.751663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b01aa090-1923-4237-942b-1cb3c3845eb4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:26.752181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b01aa090-1923-4237-942b-1cb3c3845eb4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:26.753195 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b01aa090-1923-4237-942b-1cb3c3845eb4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:26.753637 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b01aa090-1923-4237-942b-1cb3c3845eb4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:26.815626 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b01aa090-1923-4237-942b-1cb3c3845eb4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:26.823465 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b01aa090-1923-4237-942b-1cb3c3845eb4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.082726 Jul 27 20:36:26.824023 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1429/2866] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:26 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:26.972816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0ca52615-9b36-4197-99ff-aa4005ff5999 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:26.973454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0ca52615-9b36-4197-99ff-aa4005ff5999 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:26.979443 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0ca52615-9b36-4197-99ff-aa4005ff5999 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:26.979889 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0ca52615-9b36-4197-99ff-aa4005ff5999 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:26.980642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0ca52615-9b36-4197-99ff-aa4005ff5999 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:26.981106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0ca52615-9b36-4197-99ff-aa4005ff5999 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:27.041097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0ca52615-9b36-4197-99ff-aa4005ff5999 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:27.049729 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0ca52615-9b36-4197-99ff-aa4005ff5999 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.080213 Jul 27 20:36:27.050287 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1438/2867] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:26 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:27.725607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b28a01fc-18ea-4ac8-a0a4-f8c41f3d0b0d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:27.726191 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b28a01fc-18ea-4ac8-a0a4-f8c41f3d0b0d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:27.732478 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b28a01fc-18ea-4ac8-a0a4-f8c41f3d0b0d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:27.732989 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b28a01fc-18ea-4ac8-a0a4-f8c41f3d0b0d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:27.733739 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b28a01fc-18ea-4ac8-a0a4-f8c41f3d0b0d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:27.734166 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b28a01fc-18ea-4ac8-a0a4-f8c41f3d0b0d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:27.846890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-203c00b7-f93f-4439-9756-18c34147458e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:27.847547 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-203c00b7-f93f-4439-9756-18c34147458e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:27.854226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-203c00b7-f93f-4439-9756-18c34147458e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:27.854690 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-203c00b7-f93f-4439-9756-18c34147458e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:27.855470 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-203c00b7-f93f-4439-9756-18c34147458e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:27.855917 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-203c00b7-f93f-4439-9756-18c34147458e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:27.863570 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b28a01fc-18ea-4ac8-a0a4-f8c41f3d0b0d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:27.871444 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b28a01fc-18ea-4ac8-a0a4-f8c41f3d0b0d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150281 Jul 27 20:36:27.871998 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1430/2868] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:27 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:27.917683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-203c00b7-f93f-4439-9756-18c34147458e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:27.926297 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-203c00b7-f93f-4439-9756-18c34147458e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.084509 Jul 27 20:36:27.926871 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1439/2869] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:27 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:28.070346 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7c9ed6ce-032d-4c15-ae79-6d30693d7c2b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:28.070958 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7c9ed6ce-032d-4c15-ae79-6d30693d7c2b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:28.077077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c9ed6ce-032d-4c15-ae79-6d30693d7c2b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:28.077532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c9ed6ce-032d-4c15-ae79-6d30693d7c2b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:28.078562 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c9ed6ce-032d-4c15-ae79-6d30693d7c2b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:28.078999 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c9ed6ce-032d-4c15-ae79-6d30693d7c2b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:28.139438 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7c9ed6ce-032d-4c15-ae79-6d30693d7c2b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:28.147349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7c9ed6ce-032d-4c15-ae79-6d30693d7c2b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.080864 Jul 27 20:36:28.147913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1431/2870] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:28 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:28.894451 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f1f2c90a-35ca-42a3-9320-62d0ce8ba3b2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:28.895073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f1f2c90a-35ca-42a3-9320-62d0ce8ba3b2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:28.901628 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f1f2c90a-35ca-42a3-9320-62d0ce8ba3b2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:28.902087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f1f2c90a-35ca-42a3-9320-62d0ce8ba3b2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:28.902852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f1f2c90a-35ca-42a3-9320-62d0ce8ba3b2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:28.903297 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f1f2c90a-35ca-42a3-9320-62d0ce8ba3b2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:28.947147 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-aa5f272a-7d85-4387-adab-7d853bf69efd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:28.947744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-aa5f272a-7d85-4387-adab-7d853bf69efd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:28.954575 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa5f272a-7d85-4387-adab-7d853bf69efd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:28.955148 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa5f272a-7d85-4387-adab-7d853bf69efd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:28.955955 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa5f272a-7d85-4387-adab-7d853bf69efd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:28.957002 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa5f272a-7d85-4387-adab-7d853bf69efd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:29.021739 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aa5f272a-7d85-4387-adab-7d853bf69efd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:29.029665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-aa5f272a-7d85-4387-adab-7d853bf69efd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.086272 Jul 27 20:36:29.035525 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1432/2871] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:28 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:29.038284 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f1f2c90a-35ca-42a3-9320-62d0ce8ba3b2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:29.047815 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f1f2c90a-35ca-42a3-9320-62d0ce8ba3b2 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.157882 Jul 27 20:36:29.048389 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1440/2872] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:28 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:29.168530 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-71a2a6ab-9087-494c-b020-71c0c0baf318 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:29.169090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-71a2a6ab-9087-494c-b020-71c0c0baf318 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:29.175575 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71a2a6ab-9087-494c-b020-71c0c0baf318 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:29.176020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71a2a6ab-9087-494c-b020-71c0c0baf318 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:29.176773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71a2a6ab-9087-494c-b020-71c0c0baf318 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:29.177237 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71a2a6ab-9087-494c-b020-71c0c0baf318 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:29.237554 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-71a2a6ab-9087-494c-b020-71c0c0baf318 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:29.245466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-71a2a6ab-9087-494c-b020-71c0c0baf318 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.080925 Jul 27 20:36:29.246025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1433/2873] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:29 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:30.052190 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9f550933-89cb-4489-b2a4-8027df640a28 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:30.052801 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9f550933-89cb-4489-b2a4-8027df640a28 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:30.059518 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9f550933-89cb-4489-b2a4-8027df640a28 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:30.059976 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9f550933-89cb-4489-b2a4-8027df640a28 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:30.060740 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9f550933-89cb-4489-b2a4-8027df640a28 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:30.061212 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9f550933-89cb-4489-b2a4-8027df640a28 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:30.065868 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:36:30.069466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-12c4561f-9567-4c0a-b18f-13c83fc58197 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:30.070036 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-12c4561f-9567-4c0a-b18f-13c83fc58197 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:30.078865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12c4561f-9567-4c0a-b18f-13c83fc58197 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:30.079306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12c4561f-9567-4c0a-b18f-13c83fc58197 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:30.080077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12c4561f-9567-4c0a-b18f-13c83fc58197 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:30.080755 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12c4561f-9567-4c0a-b18f-13c83fc58197 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:30.126186 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9f550933-89cb-4489-b2a4-8027df640a28 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:30.135196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9f550933-89cb-4489-b2a4-8027df640a28 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.087291 Jul 27 20:36:30.135889 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1441/2874] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:30 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:30.213248 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-12c4561f-9567-4c0a-b18f-13c83fc58197 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:30.221922 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-12c4561f-9567-4c0a-b18f-13c83fc58197 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.156313 Jul 27 20:36:30.222492 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1434/2875] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:30 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:30.266958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cc7170db-3581-4f1d-9aa2-b11e0d695b0b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:30.267709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cc7170db-3581-4f1d-9aa2-b11e0d695b0b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:30.273652 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc7170db-3581-4f1d-9aa2-b11e0d695b0b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:30.274101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc7170db-3581-4f1d-9aa2-b11e0d695b0b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:30.274866 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc7170db-3581-4f1d-9aa2-b11e0d695b0b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:30.275299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc7170db-3581-4f1d-9aa2-b11e0d695b0b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:30.340604 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cc7170db-3581-4f1d-9aa2-b11e0d695b0b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:30.349625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cc7170db-3581-4f1d-9aa2-b11e0d695b0b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.086474 Jul 27 20:36:30.350194 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1442/2876] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:30 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:31.156942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5fe58c3d-6c46-4ccf-a4c7-027f007e6a48 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:31.157571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5fe58c3d-6c46-4ccf-a4c7-027f007e6a48 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:31.164441 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5fe58c3d-6c46-4ccf-a4c7-027f007e6a48 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:31.164890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5fe58c3d-6c46-4ccf-a4c7-027f007e6a48 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:31.165695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5fe58c3d-6c46-4ccf-a4c7-027f007e6a48 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:31.166107 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5fe58c3d-6c46-4ccf-a4c7-027f007e6a48 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:31.230340 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5fe58c3d-6c46-4ccf-a4c7-027f007e6a48 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:31.239043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5fe58c3d-6c46-4ccf-a4c7-027f007e6a48 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.085948 Jul 27 20:36:31.239600 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1435/2877] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:31 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:31.243199 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-602cfd92-d196-400b-bc04-e81f2e11c558 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:31.243825 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-602cfd92-d196-400b-bc04-e81f2e11c558 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:31.250371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-602cfd92-d196-400b-bc04-e81f2e11c558 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:31.250824 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-602cfd92-d196-400b-bc04-e81f2e11c558 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:31.251591 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-602cfd92-d196-400b-bc04-e81f2e11c558 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:31.252215 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-602cfd92-d196-400b-bc04-e81f2e11c558 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:31.371682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bf608c7f-6ab2-464c-aed0-4b330edfa86b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:31.372302 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bf608c7f-6ab2-464c-aed0-4b330edfa86b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:31.378277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf608c7f-6ab2-464c-aed0-4b330edfa86b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:31.378720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf608c7f-6ab2-464c-aed0-4b330edfa86b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:31.379486 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf608c7f-6ab2-464c-aed0-4b330edfa86b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:31.379922 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf608c7f-6ab2-464c-aed0-4b330edfa86b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:31.384356 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-602cfd92-d196-400b-bc04-e81f2e11c558 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:31.393127 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-602cfd92-d196-400b-bc04-e81f2e11c558 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153291 Jul 27 20:36:31.393721 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1443/2878] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:31 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:31.442071 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bf608c7f-6ab2-464c-aed0-4b330edfa86b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:31.449983 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bf608c7f-6ab2-464c-aed0-4b330edfa86b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082113 Jul 27 20:36:31.450559 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1436/2879] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:31 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:32.259223 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e36eaa04-9c3e-45e8-b893-aeed6dd697e6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:32.259839 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e36eaa04-9c3e-45e8-b893-aeed6dd697e6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:32.262158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=80 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:36:32.267792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e36eaa04-9c3e-45e8-b893-aeed6dd697e6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:32.268240 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e36eaa04-9c3e-45e8-b893-aeed6dd697e6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:32.269030 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e36eaa04-9c3e-45e8-b893-aeed6dd697e6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:32.269472 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e36eaa04-9c3e-45e8-b893-aeed6dd697e6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:32.329638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e36eaa04-9c3e-45e8-b893-aeed6dd697e6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:32.337619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e36eaa04-9c3e-45e8-b893-aeed6dd697e6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.082362 Jul 27 20:36:32.338187 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1444/2880] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:32 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:32.417506 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-df671f83-67ea-4234-9837-7ab2f1e9e302 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:32.418114 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-df671f83-67ea-4234-9837-7ab2f1e9e302 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:32.420410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=82 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:36:32.427642 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-df671f83-67ea-4234-9837-7ab2f1e9e302 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:32.428093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-df671f83-67ea-4234-9837-7ab2f1e9e302 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:32.428861 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-df671f83-67ea-4234-9837-7ab2f1e9e302 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:32.429322 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-df671f83-67ea-4234-9837-7ab2f1e9e302 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:32.471901 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-dd3f85f2-0dd2-464f-979f-2af29a93c8d3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:32.472515 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-dd3f85f2-0dd2-464f-979f-2af29a93c8d3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:32.478827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dd3f85f2-0dd2-464f-979f-2af29a93c8d3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:32.479326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dd3f85f2-0dd2-464f-979f-2af29a93c8d3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:32.480129 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dd3f85f2-0dd2-464f-979f-2af29a93c8d3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:32.480633 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dd3f85f2-0dd2-464f-979f-2af29a93c8d3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:32.543964 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-dd3f85f2-0dd2-464f-979f-2af29a93c8d3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:32.552496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-dd3f85f2-0dd2-464f-979f-2af29a93c8d3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085081 Jul 27 20:36:32.553325 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1445/2881] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:32 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:32.562327 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-df671f83-67ea-4234-9837-7ab2f1e9e302 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:32.570673 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-df671f83-67ea-4234-9837-7ab2f1e9e302 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.156961 Jul 27 20:36:32.571238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1437/2882] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:32 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:33.358736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-10f3d774-2048-4f61-96fa-572670e8a5d2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:33.359296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-10f3d774-2048-4f61-96fa-572670e8a5d2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:33.366171 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-10f3d774-2048-4f61-96fa-572670e8a5d2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:33.366656 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-10f3d774-2048-4f61-96fa-572670e8a5d2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:33.367440 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-10f3d774-2048-4f61-96fa-572670e8a5d2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:33.367887 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-10f3d774-2048-4f61-96fa-572670e8a5d2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:33.429009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-10f3d774-2048-4f61-96fa-572670e8a5d2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:33.437056 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-10f3d774-2048-4f61-96fa-572670e8a5d2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.082284 Jul 27 20:36:33.437621 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1446/2883] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:33 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:33.573651 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-eea9399f-bad4-4824-9392-2bf8af84bbaf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:33.574271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-eea9399f-bad4-4824-9392-2bf8af84bbaf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:33.581306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eea9399f-bad4-4824-9392-2bf8af84bbaf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:33.581756 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eea9399f-bad4-4824-9392-2bf8af84bbaf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:33.582528 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eea9399f-bad4-4824-9392-2bf8af84bbaf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:33.582967 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eea9399f-bad4-4824-9392-2bf8af84bbaf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:33.591586 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f0c57e50-0d42-449b-b6de-b8ded38f1fb4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:33.592205 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f0c57e50-0d42-449b-b6de-b8ded38f1fb4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:33.598343 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0c57e50-0d42-449b-b6de-b8ded38f1fb4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:33.598801 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0c57e50-0d42-449b-b6de-b8ded38f1fb4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:33.599587 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0c57e50-0d42-449b-b6de-b8ded38f1fb4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:33.600029 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0c57e50-0d42-449b-b6de-b8ded38f1fb4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:33.645534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eea9399f-bad4-4824-9392-2bf8af84bbaf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:33.653555 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-eea9399f-bad4-4824-9392-2bf8af84bbaf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083735 Jul 27 20:36:33.654123 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1438/2884] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:33 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:33.740891 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f0c57e50-0d42-449b-b6de-b8ded38f1fb4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:33.748954 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f0c57e50-0d42-449b-b6de-b8ded38f1fb4 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.161214 Jul 27 20:36:33.749532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1447/2885] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:33 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:34.461676 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7821bec3-f576-41ce-b7f0-48e4a1755d34 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:34.462670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7821bec3-f576-41ce-b7f0-48e4a1755d34 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:34.471276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7821bec3-f576-41ce-b7f0-48e4a1755d34 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:34.471913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7821bec3-f576-41ce-b7f0-48e4a1755d34 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:34.473010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7821bec3-f576-41ce-b7f0-48e4a1755d34 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:34.473619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7821bec3-f576-41ce-b7f0-48e4a1755d34 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:34.539685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7821bec3-f576-41ce-b7f0-48e4a1755d34 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:34.547920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7821bec3-f576-41ce-b7f0-48e4a1755d34 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.092456 Jul 27 20:36:34.548491 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1439/2886] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:34 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:34.676089 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f5a4aae3-8e2e-4897-ac13-e46e62ae6b56 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:34.676789 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f5a4aae3-8e2e-4897-ac13-e46e62ae6b56 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:34.683643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f5a4aae3-8e2e-4897-ac13-e46e62ae6b56 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:34.684097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f5a4aae3-8e2e-4897-ac13-e46e62ae6b56 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:34.684877 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f5a4aae3-8e2e-4897-ac13-e46e62ae6b56 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:34.685382 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f5a4aae3-8e2e-4897-ac13-e46e62ae6b56 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:34.752100 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f5a4aae3-8e2e-4897-ac13-e46e62ae6b56 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:34.760330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f5a4aae3-8e2e-4897-ac13-e46e62ae6b56 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.089823 Jul 27 20:36:34.760920 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1448/2887] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:34 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:34.772003 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dce96232-d53f-4c39-b5c2-9bd4d88f8ae8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:34.772604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dce96232-d53f-4c39-b5c2-9bd4d88f8ae8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:34.779020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dce96232-d53f-4c39-b5c2-9bd4d88f8ae8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:34.779459 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dce96232-d53f-4c39-b5c2-9bd4d88f8ae8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:34.780210 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dce96232-d53f-4c39-b5c2-9bd4d88f8ae8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:34.780635 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dce96232-d53f-4c39-b5c2-9bd4d88f8ae8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:34.935092 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dce96232-d53f-4c39-b5c2-9bd4d88f8ae8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:34.943117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dce96232-d53f-4c39-b5c2-9bd4d88f8ae8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.176500 Jul 27 20:36:34.943689 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1440/2888] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:34 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:35.569828 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-598342f4-1aaa-43de-b613-81b9bad6480b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:35.570441 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-598342f4-1aaa-43de-b613-81b9bad6480b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:35.576404 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-598342f4-1aaa-43de-b613-81b9bad6480b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:35.576851 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-598342f4-1aaa-43de-b613-81b9bad6480b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:35.577745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-598342f4-1aaa-43de-b613-81b9bad6480b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:35.578466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-598342f4-1aaa-43de-b613-81b9bad6480b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:35.651325 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-598342f4-1aaa-43de-b613-81b9bad6480b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:35.665108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-598342f4-1aaa-43de-b613-81b9bad6480b tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.099047 Jul 27 20:36:35.665680 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1449/2889] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:35 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:35.781911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fc4106d5-a12f-4ae9-8509-46817c465c72 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:35.782534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fc4106d5-a12f-4ae9-8509-46817c465c72 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:35.789832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc4106d5-a12f-4ae9-8509-46817c465c72 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:35.790332 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc4106d5-a12f-4ae9-8509-46817c465c72 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:35.791173 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc4106d5-a12f-4ae9-8509-46817c465c72 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:35.791635 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc4106d5-a12f-4ae9-8509-46817c465c72 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:35.854876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fc4106d5-a12f-4ae9-8509-46817c465c72 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:35.863556 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fc4106d5-a12f-4ae9-8509-46817c465c72 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085505 Jul 27 20:36:35.864128 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1441/2890] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:35 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:35.964332 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fd363507-a573-46d9-83ff-41077bcf9186 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:35.964947 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fd363507-a573-46d9-83ff-41077bcf9186 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:35.972023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fd363507-a573-46d9-83ff-41077bcf9186 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:35.972476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fd363507-a573-46d9-83ff-41077bcf9186 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:35.973278 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fd363507-a573-46d9-83ff-41077bcf9186 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:35.973721 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fd363507-a573-46d9-83ff-41077bcf9186 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:36.107288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fd363507-a573-46d9-83ff-41077bcf9186 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:36.115745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fd363507-a573-46d9-83ff-41077bcf9186 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.155316 Jul 27 20:36:36.116314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1450/2891] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:35 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:36.690369 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e8c3950e-9239-43c1-938a-1628e54ad252 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:36.690994 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e8c3950e-9239-43c1-938a-1628e54ad252 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:36.697085 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e8c3950e-9239-43c1-938a-1628e54ad252 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:36.697537 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e8c3950e-9239-43c1-938a-1628e54ad252 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:36.698299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e8c3950e-9239-43c1-938a-1628e54ad252 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:36.698735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e8c3950e-9239-43c1-938a-1628e54ad252 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:36.760675 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e8c3950e-9239-43c1-938a-1628e54ad252 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:36.768759 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e8c3950e-9239-43c1-938a-1628e54ad252 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.083472 Jul 27 20:36:36.769358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1442/2892] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:36 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:36.884729 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-26b0f5da-2685-4615-89e2-caba67f99247 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:36.885370 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-26b0f5da-2685-4615-89e2-caba67f99247 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:36.891596 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-26b0f5da-2685-4615-89e2-caba67f99247 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:36.892047 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-26b0f5da-2685-4615-89e2-caba67f99247 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:36.893285 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-26b0f5da-2685-4615-89e2-caba67f99247 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:36.893736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-26b0f5da-2685-4615-89e2-caba67f99247 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:36.959743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-26b0f5da-2685-4615-89e2-caba67f99247 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:36.968072 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-26b0f5da-2685-4615-89e2-caba67f99247 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.087443 Jul 27 20:36:36.968686 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1451/2893] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:36 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:37.137203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0f294944-5e79-4b78-ac43-5c328be8b86a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:37.137981 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0f294944-5e79-4b78-ac43-5c328be8b86a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:37.145022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f294944-5e79-4b78-ac43-5c328be8b86a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:37.145477 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f294944-5e79-4b78-ac43-5c328be8b86a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:37.146250 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f294944-5e79-4b78-ac43-5c328be8b86a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:37.146689 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f294944-5e79-4b78-ac43-5c328be8b86a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:37.168618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:36:37.286743 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0f294944-5e79-4b78-ac43-5c328be8b86a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:37.294917 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0f294944-5e79-4b78-ac43-5c328be8b86a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.161631 Jul 27 20:36:37.295483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1443/2894] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:37 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:37.790123 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-480b518b-562d-45ec-a1c8-396f3d2138f6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:37.790765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-480b518b-562d-45ec-a1c8-396f3d2138f6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:37.797420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-480b518b-562d-45ec-a1c8-396f3d2138f6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:37.797879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-480b518b-562d-45ec-a1c8-396f3d2138f6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:37.799358 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-480b518b-562d-45ec-a1c8-396f3d2138f6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:37.799804 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-480b518b-562d-45ec-a1c8-396f3d2138f6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:37.862266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-480b518b-562d-45ec-a1c8-396f3d2138f6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:37.870789 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-480b518b-562d-45ec-a1c8-396f3d2138f6 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.084555 Jul 27 20:36:37.871353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1452/2895] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:37 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:37.992446 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-de2fbddc-b978-4fbc-8caf-75ed029045b4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:37.993083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-de2fbddc-b978-4fbc-8caf-75ed029045b4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:37.999085 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-de2fbddc-b978-4fbc-8caf-75ed029045b4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:37.999524 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-de2fbddc-b978-4fbc-8caf-75ed029045b4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:38.000273 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-de2fbddc-b978-4fbc-8caf-75ed029045b4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:38.000703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-de2fbddc-b978-4fbc-8caf-75ed029045b4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:38.063208 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-de2fbddc-b978-4fbc-8caf-75ed029045b4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:38.071346 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-de2fbddc-b978-4fbc-8caf-75ed029045b4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082664 Jul 27 20:36:38.072117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1444/2896] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:37 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:38.316472 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-205b4bed-4f88-414e-a1fb-f79970abecb3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:38.317060 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-205b4bed-4f88-414e-a1fb-f79970abecb3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:38.323028 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-205b4bed-4f88-414e-a1fb-f79970abecb3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:38.323475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-205b4bed-4f88-414e-a1fb-f79970abecb3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:38.324233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-205b4bed-4f88-414e-a1fb-f79970abecb3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:38.324670 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-205b4bed-4f88-414e-a1fb-f79970abecb3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:38.469172 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-205b4bed-4f88-414e-a1fb-f79970abecb3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:38.477883 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-205b4bed-4f88-414e-a1fb-f79970abecb3 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.166004 Jul 27 20:36:38.478453 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1453/2897] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:38 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:38.891291 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-054bf2cc-ccfb-45ad-85e0-dce2b653741a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:38.892013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-054bf2cc-ccfb-45ad-85e0-dce2b653741a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:38.899092 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-054bf2cc-ccfb-45ad-85e0-dce2b653741a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:38.899638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-054bf2cc-ccfb-45ad-85e0-dce2b653741a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:38.900418 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-054bf2cc-ccfb-45ad-85e0-dce2b653741a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:38.900855 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-054bf2cc-ccfb-45ad-85e0-dce2b653741a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:38.984688 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-054bf2cc-ccfb-45ad-85e0-dce2b653741a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:38.992852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-054bf2cc-ccfb-45ad-85e0-dce2b653741a tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.105377 Jul 27 20:36:38.993461 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1445/2898] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:38 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:39.093636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b0c75e0a-bd43-4529-841e-995e250c4bd4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:39.094301 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b0c75e0a-bd43-4529-841e-995e250c4bd4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:39.101839 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b0c75e0a-bd43-4529-841e-995e250c4bd4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:39.102304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b0c75e0a-bd43-4529-841e-995e250c4bd4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:39.103083 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b0c75e0a-bd43-4529-841e-995e250c4bd4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:39.103528 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b0c75e0a-bd43-4529-841e-995e250c4bd4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:39.170456 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b0c75e0a-bd43-4529-841e-995e250c4bd4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:39.178616 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b0c75e0a-bd43-4529-841e-995e250c4bd4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.088831 Jul 27 20:36:39.179223 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1454/2899] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:39 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:39.500253 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7764552d-8214-430e-86ce-40eb9aa26ab1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:39.500856 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7764552d-8214-430e-86ce-40eb9aa26ab1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:39.507657 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7764552d-8214-430e-86ce-40eb9aa26ab1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:39.508096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7764552d-8214-430e-86ce-40eb9aa26ab1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:39.508843 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7764552d-8214-430e-86ce-40eb9aa26ab1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:39.509305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7764552d-8214-430e-86ce-40eb9aa26ab1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:39.639052 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7764552d-8214-430e-86ce-40eb9aa26ab1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:39.647532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7764552d-8214-430e-86ce-40eb9aa26ab1 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151086 Jul 27 20:36:39.648092 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1446/2900] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:39 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:40.014148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-84f8bac8-3036-4c62-aeba-6aa16700c5de tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:40.014773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-84f8bac8-3036-4c62-aeba-6aa16700c5de tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:40.021460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84f8bac8-3036-4c62-aeba-6aa16700c5de tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:40.021918 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84f8bac8-3036-4c62-aeba-6aa16700c5de tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:40.022692 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84f8bac8-3036-4c62-aeba-6aa16700c5de tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:40.023138 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-84f8bac8-3036-4c62-aeba-6aa16700c5de tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:40.084850 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-84f8bac8-3036-4c62-aeba-6aa16700c5de tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:40.092874 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-84f8bac8-3036-4c62-aeba-6aa16700c5de tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.082582 Jul 27 20:36:40.093463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1455/2901] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:40 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:40.199841 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-eb8e47ac-48d9-4430-9c8c-543baac79832 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:40.200450 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-eb8e47ac-48d9-4430-9c8c-543baac79832 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:40.207360 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eb8e47ac-48d9-4430-9c8c-543baac79832 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:40.207810 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eb8e47ac-48d9-4430-9c8c-543baac79832 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:40.208568 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eb8e47ac-48d9-4430-9c8c-543baac79832 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:40.209030 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eb8e47ac-48d9-4430-9c8c-543baac79832 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:40.270168 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eb8e47ac-48d9-4430-9c8c-543baac79832 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:40.277993 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-eb8e47ac-48d9-4430-9c8c-543baac79832 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082028 Jul 27 20:36:40.278556 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1447/2902] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:40 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:40.668532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-41aed7ee-dc08-45bf-84c3-4302a6e5f4f5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:40.669183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-41aed7ee-dc08-45bf-84c3-4302a6e5f4f5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:40.676057 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41aed7ee-dc08-45bf-84c3-4302a6e5f4f5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:40.676515 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41aed7ee-dc08-45bf-84c3-4302a6e5f4f5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:40.677311 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41aed7ee-dc08-45bf-84c3-4302a6e5f4f5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:40.677757 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41aed7ee-dc08-45bf-84c3-4302a6e5f4f5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:40.753022 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:36:40.753274 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:36:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 (ip 10.222.0.65) !!! Jul 27 20:36:40.806533 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-41aed7ee-dc08-45bf-84c3-4302a6e5f4f5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:40.815558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-41aed7ee-dc08-45bf-84c3-4302a6e5f4f5 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150874 Jul 27 20:36:40.816156 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1456/2903] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:40 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:41.114311 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8659e7b5-88f4-45cb-9346-f1fed402123e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:41.114926 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8659e7b5-88f4-45cb-9346-f1fed402123e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:41.120932 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8659e7b5-88f4-45cb-9346-f1fed402123e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:41.121423 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8659e7b5-88f4-45cb-9346-f1fed402123e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:41.122189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8659e7b5-88f4-45cb-9346-f1fed402123e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:41.122626 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8659e7b5-88f4-45cb-9346-f1fed402123e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:41.186226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8659e7b5-88f4-45cb-9346-f1fed402123e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:41.194807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8659e7b5-88f4-45cb-9346-f1fed402123e tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.085044 Jul 27 20:36:41.195383 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1448/2904] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:41 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:41.300020 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-764a72a4-528b-427a-9ea8-e52e12740160 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:41.300638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-764a72a4-528b-427a-9ea8-e52e12740160 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:41.306690 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-764a72a4-528b-427a-9ea8-e52e12740160 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:41.307147 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-764a72a4-528b-427a-9ea8-e52e12740160 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:41.307913 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-764a72a4-528b-427a-9ea8-e52e12740160 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:41.308358 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-764a72a4-528b-427a-9ea8-e52e12740160 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:41.371550 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-764a72a4-528b-427a-9ea8-e52e12740160 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:41.374891 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:36:41.380859 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-764a72a4-528b-427a-9ea8-e52e12740160 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085341 Jul 27 20:36:41.381453 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1457/2905] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:41 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:41.836799 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0e886c34-e448-4817-b9d2-139547066b43 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:41.837503 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0e886c34-e448-4817-b9d2-139547066b43 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:41.843897 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e886c34-e448-4817-b9d2-139547066b43 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:41.844345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e886c34-e448-4817-b9d2-139547066b43 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:41.845145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e886c34-e448-4817-b9d2-139547066b43 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:41.846568 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e886c34-e448-4817-b9d2-139547066b43 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:41.977466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0e886c34-e448-4817-b9d2-139547066b43 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:41.985299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0e886c34-e448-4817-b9d2-139547066b43 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152413 Jul 27 20:36:41.985965 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1449/2906] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:41 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:42.216618 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-99a30040-db76-4f25-9abf-5abc364a78b2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:42.217192 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-99a30040-db76-4f25-9abf-5abc364a78b2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:42.223892 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-99a30040-db76-4f25-9abf-5abc364a78b2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:42.224341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-99a30040-db76-4f25-9abf-5abc364a78b2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:42.225126 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-99a30040-db76-4f25-9abf-5abc364a78b2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:42.225567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-99a30040-db76-4f25-9abf-5abc364a78b2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:42.285790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-99a30040-db76-4f25-9abf-5abc364a78b2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:42.293779 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-99a30040-db76-4f25-9abf-5abc364a78b2 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.081121 Jul 27 20:36:42.294350 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1458/2907] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:42 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:42.401820 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e6014d52-4105-41c7-af78-e6b5c972990b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:42.402428 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e6014d52-4105-41c7-af78-e6b5c972990b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:42.408449 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e6014d52-4105-41c7-af78-e6b5c972990b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:42.408896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e6014d52-4105-41c7-af78-e6b5c972990b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:42.409682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e6014d52-4105-41c7-af78-e6b5c972990b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:42.410116 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e6014d52-4105-41c7-af78-e6b5c972990b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:42.470619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e6014d52-4105-41c7-af78-e6b5c972990b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:42.478883 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e6014d52-4105-41c7-af78-e6b5c972990b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.080858 Jul 27 20:36:42.479446 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1450/2908] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:42 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:43.006577 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cf9c68b9-f583-4ef3-8ae6-83db08049f71 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:43.007221 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cf9c68b9-f583-4ef3-8ae6-83db08049f71 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:43.013394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf9c68b9-f583-4ef3-8ae6-83db08049f71 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:43.013983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf9c68b9-f583-4ef3-8ae6-83db08049f71 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:43.014753 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf9c68b9-f583-4ef3-8ae6-83db08049f71 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:43.015212 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf9c68b9-f583-4ef3-8ae6-83db08049f71 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:43.070634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:36:43.071166 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:36:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:36:43.143721 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cf9c68b9-f583-4ef3-8ae6-83db08049f71 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:43.151656 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cf9c68b9-f583-4ef3-8ae6-83db08049f71 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.148959 Jul 27 20:36:43.152259 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1459/2909] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:43 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:43.315306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b9ed313a-b225-4c65-9082-213277a29dad tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:43.315838 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b9ed313a-b225-4c65-9082-213277a29dad tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:43.322393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b9ed313a-b225-4c65-9082-213277a29dad tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:43.322842 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b9ed313a-b225-4c65-9082-213277a29dad tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:43.323603 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b9ed313a-b225-4c65-9082-213277a29dad tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:43.324042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b9ed313a-b225-4c65-9082-213277a29dad tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:43.384211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b9ed313a-b225-4c65-9082-213277a29dad tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:43.392668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b9ed313a-b225-4c65-9082-213277a29dad tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.080826 Jul 27 20:36:43.393403 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1451/2910] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:43 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:43.499668 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8212aa0c-2364-477e-9fa5-c7c0172c96ca tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:43.500280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8212aa0c-2364-477e-9fa5-c7c0172c96ca tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:43.507099 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8212aa0c-2364-477e-9fa5-c7c0172c96ca tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:43.507587 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8212aa0c-2364-477e-9fa5-c7c0172c96ca tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:43.508354 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8212aa0c-2364-477e-9fa5-c7c0172c96ca tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:43.508796 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8212aa0c-2364-477e-9fa5-c7c0172c96ca tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:43.574526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8212aa0c-2364-477e-9fa5-c7c0172c96ca tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:43.583717 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8212aa0c-2364-477e-9fa5-c7c0172c96ca tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.087897 Jul 27 20:36:43.584339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1460/2911] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:43 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:44.173945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d5040d83-9f7f-437d-9515-3932dbad12b8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:44.174566 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d5040d83-9f7f-437d-9515-3932dbad12b8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:44.180631 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5040d83-9f7f-437d-9515-3932dbad12b8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:44.181111 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5040d83-9f7f-437d-9515-3932dbad12b8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:44.181905 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5040d83-9f7f-437d-9515-3932dbad12b8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:44.182347 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5040d83-9f7f-437d-9515-3932dbad12b8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:44.310301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d5040d83-9f7f-437d-9515-3932dbad12b8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:44.318907 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d5040d83-9f7f-437d-9515-3932dbad12b8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149418 Jul 27 20:36:44.319463 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1452/2912] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:44 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:44.414793 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ae6e9f28-ce95-4da7-902c-db6d5b1d25ae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:44.415454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ae6e9f28-ce95-4da7-902c-db6d5b1d25ae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:44.421522 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ae6e9f28-ce95-4da7-902c-db6d5b1d25ae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:44.421975 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ae6e9f28-ce95-4da7-902c-db6d5b1d25ae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:44.422740 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ae6e9f28-ce95-4da7-902c-db6d5b1d25ae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:44.423185 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ae6e9f28-ce95-4da7-902c-db6d5b1d25ae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:44.484227 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ae6e9f28-ce95-4da7-902c-db6d5b1d25ae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:44.497602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ae6e9f28-ce95-4da7-902c-db6d5b1d25ae tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.086688 Jul 27 20:36:44.498178 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1461/2913] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:44 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:44.603871 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2ee7a714-d05d-4b87-9f4b-2397134b4655 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:44.604478 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2ee7a714-d05d-4b87-9f4b-2397134b4655 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:44.611474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ee7a714-d05d-4b87-9f4b-2397134b4655 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:44.612096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ee7a714-d05d-4b87-9f4b-2397134b4655 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:44.612855 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ee7a714-d05d-4b87-9f4b-2397134b4655 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:44.613311 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ee7a714-d05d-4b87-9f4b-2397134b4655 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:44.675147 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2ee7a714-d05d-4b87-9f4b-2397134b4655 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:44.682912 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2ee7a714-d05d-4b87-9f4b-2397134b4655 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082863 Jul 27 20:36:44.683475 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1453/2914] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:44 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:45.339498 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-00b8a9cd-0bb0-464e-a0ff-2aada0dd2978 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:45.340038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-00b8a9cd-0bb0-464e-a0ff-2aada0dd2978 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:45.347017 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00b8a9cd-0bb0-464e-a0ff-2aada0dd2978 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:45.347468 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00b8a9cd-0bb0-464e-a0ff-2aada0dd2978 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:45.348235 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00b8a9cd-0bb0-464e-a0ff-2aada0dd2978 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:45.348675 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00b8a9cd-0bb0-464e-a0ff-2aada0dd2978 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:45.476850 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-00b8a9cd-0bb0-464e-a0ff-2aada0dd2978 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:45.484944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-00b8a9cd-0bb0-464e-a0ff-2aada0dd2978 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149413 Jul 27 20:36:45.485528 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1462/2915] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:45 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:45.519346 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-65e1ab5f-43f7-4d23-8377-a3b3c346b56d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:45.519968 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-65e1ab5f-43f7-4d23-8377-a3b3c346b56d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:45.525911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65e1ab5f-43f7-4d23-8377-a3b3c346b56d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:45.526358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65e1ab5f-43f7-4d23-8377-a3b3c346b56d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:45.527113 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65e1ab5f-43f7-4d23-8377-a3b3c346b56d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:45.527546 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65e1ab5f-43f7-4d23-8377-a3b3c346b56d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:45.587449 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-65e1ab5f-43f7-4d23-8377-a3b3c346b56d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:45.596719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-65e1ab5f-43f7-4d23-8377-a3b3c346b56d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.081592 Jul 27 20:36:45.597259 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1454/2916] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:45 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:45.704142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-320c76d2-38ec-49bc-abff-ff48d408229c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:45.705319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-320c76d2-38ec-49bc-abff-ff48d408229c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:45.711299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-320c76d2-38ec-49bc-abff-ff48d408229c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:45.711754 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-320c76d2-38ec-49bc-abff-ff48d408229c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:45.712516 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-320c76d2-38ec-49bc-abff-ff48d408229c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:45.712948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-320c76d2-38ec-49bc-abff-ff48d408229c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:45.772929 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-320c76d2-38ec-49bc-abff-ff48d408229c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:45.780659 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-320c76d2-38ec-49bc-abff-ff48d408229c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.080808 Jul 27 20:36:45.781429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1463/2917] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:45 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:46.508029 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-907d3acf-474f-431a-a423-e4d5ab413523 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:46.508698 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-907d3acf-474f-431a-a423-e4d5ab413523 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:46.515237 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-907d3acf-474f-431a-a423-e4d5ab413523 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:46.515677 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-907d3acf-474f-431a-a423-e4d5ab413523 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:46.516757 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-907d3acf-474f-431a-a423-e4d5ab413523 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:46.517244 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-907d3acf-474f-431a-a423-e4d5ab413523 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:46.617582 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5a4ed244-66f8-483a-8b58-4335d5fa7b07 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:46.618282 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5a4ed244-66f8-483a-8b58-4335d5fa7b07 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:46.624910 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5a4ed244-66f8-483a-8b58-4335d5fa7b07 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:46.625400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5a4ed244-66f8-483a-8b58-4335d5fa7b07 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:46.626176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5a4ed244-66f8-483a-8b58-4335d5fa7b07 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:46.627201 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5a4ed244-66f8-483a-8b58-4335d5fa7b07 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:46.648121 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-907d3acf-474f-431a-a423-e4d5ab413523 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:46.656351 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-907d3acf-474f-431a-a423-e4d5ab413523 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152898 Jul 27 20:36:46.656915 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1455/2918] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:46 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:46.692030 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5a4ed244-66f8-483a-8b58-4335d5fa7b07 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:46.699959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5a4ed244-66f8-483a-8b58-4335d5fa7b07 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.086177 Jul 27 20:36:46.700528 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1464/2919] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:46 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:46.802481 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f38f2b41-6a90-41b0-ad6a-6880da49af55 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:46.803019 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f38f2b41-6a90-41b0-ad6a-6880da49af55 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:46.809528 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f38f2b41-6a90-41b0-ad6a-6880da49af55 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:46.809972 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f38f2b41-6a90-41b0-ad6a-6880da49af55 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:46.810721 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f38f2b41-6a90-41b0-ad6a-6880da49af55 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:46.811149 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f38f2b41-6a90-41b0-ad6a-6880da49af55 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:46.872229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f38f2b41-6a90-41b0-ad6a-6880da49af55 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:46.880686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f38f2b41-6a90-41b0-ad6a-6880da49af55 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082260 Jul 27 20:36:46.881270 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1456/2920] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:46 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:46.951279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:36:46.951438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:36:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:36:47.678320 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0292b0d1-bd21-4982-b648-0fd85d71580a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:47.678967 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0292b0d1-bd21-4982-b648-0fd85d71580a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:47.685785 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0292b0d1-bd21-4982-b648-0fd85d71580a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:47.686245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0292b0d1-bd21-4982-b648-0fd85d71580a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:47.687020 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0292b0d1-bd21-4982-b648-0fd85d71580a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:47.687472 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0292b0d1-bd21-4982-b648-0fd85d71580a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:47.722432 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-24848b52-a456-42c8-9415-693509947d03 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:47.723070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-24848b52-a456-42c8-9415-693509947d03 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:47.730159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-24848b52-a456-42c8-9415-693509947d03 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:47.730631 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-24848b52-a456-42c8-9415-693509947d03 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:47.731475 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-24848b52-a456-42c8-9415-693509947d03 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:47.731925 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-24848b52-a456-42c8-9415-693509947d03 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:47.795484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-24848b52-a456-42c8-9415-693509947d03 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:47.803678 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-24848b52-a456-42c8-9415-693509947d03 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.086038 Jul 27 20:36:47.804254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1457/2921] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:47 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:47.819728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0292b0d1-bd21-4982-b648-0fd85d71580a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:47.827660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0292b0d1-bd21-4982-b648-0fd85d71580a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.154041 Jul 27 20:36:47.828467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1465/2922] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:47 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:47.901977 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e05a08b6-788d-4985-8de0-1a5519c15902 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:47.902518 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e05a08b6-788d-4985-8de0-1a5519c15902 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:47.909336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e05a08b6-788d-4985-8de0-1a5519c15902 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:47.909792 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e05a08b6-788d-4985-8de0-1a5519c15902 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:47.910557 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e05a08b6-788d-4985-8de0-1a5519c15902 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:47.910997 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e05a08b6-788d-4985-8de0-1a5519c15902 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:47.974594 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e05a08b6-788d-4985-8de0-1a5519c15902 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:47.982753 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e05a08b6-788d-4985-8de0-1a5519c15902 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085060 Jul 27 20:36:47.983317 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1458/2923] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:47 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:48.824819 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4d409ab3-a6fb-41e7-b834-320934dfa865 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:48.825462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4d409ab3-a6fb-41e7-b834-320934dfa865 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:48.832484 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4d409ab3-a6fb-41e7-b834-320934dfa865 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:48.832905 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4d409ab3-a6fb-41e7-b834-320934dfa865 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:48.833679 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4d409ab3-a6fb-41e7-b834-320934dfa865 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:48.834117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4d409ab3-a6fb-41e7-b834-320934dfa865 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:48.849239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-35bdaac6-960a-4ac9-a415-bba03c7d9073 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:48.849994 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-35bdaac6-960a-4ac9-a415-bba03c7d9073 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:48.856313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35bdaac6-960a-4ac9-a415-bba03c7d9073 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:48.856753 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35bdaac6-960a-4ac9-a415-bba03c7d9073 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:48.857542 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35bdaac6-960a-4ac9-a415-bba03c7d9073 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:48.857975 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35bdaac6-960a-4ac9-a415-bba03c7d9073 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:48.895526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4d409ab3-a6fb-41e7-b834-320934dfa865 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:48.903828 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4d409ab3-a6fb-41e7-b834-320934dfa865 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.082885 Jul 27 20:36:48.904393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1466/2924] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:48 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:48.988095 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-35bdaac6-960a-4ac9-a415-bba03c7d9073 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:48.995912 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-35bdaac6-960a-4ac9-a415-bba03c7d9073 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150671 Jul 27 20:36:48.996472 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1459/2925] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:48 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:49.003869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-04b39f7f-bf50-4d17-b1b2-8dda74666978 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:49.004565 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-04b39f7f-bf50-4d17-b1b2-8dda74666978 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:49.010723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-04b39f7f-bf50-4d17-b1b2-8dda74666978 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:49.011169 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-04b39f7f-bf50-4d17-b1b2-8dda74666978 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:49.011920 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-04b39f7f-bf50-4d17-b1b2-8dda74666978 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:49.012357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-04b39f7f-bf50-4d17-b1b2-8dda74666978 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:49.077108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-04b39f7f-bf50-4d17-b1b2-8dda74666978 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:49.085424 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-04b39f7f-bf50-4d17-b1b2-8dda74666978 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085580 Jul 27 20:36:49.085975 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1467/2926] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:48 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:49.925745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cfb6daba-5e76-47fd-b014-79b0cc9c46cd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:49.926363 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cfb6daba-5e76-47fd-b014-79b0cc9c46cd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:49.932829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cfb6daba-5e76-47fd-b014-79b0cc9c46cd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:49.933315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cfb6daba-5e76-47fd-b014-79b0cc9c46cd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:49.934078 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cfb6daba-5e76-47fd-b014-79b0cc9c46cd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:49.934518 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cfb6daba-5e76-47fd-b014-79b0cc9c46cd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:49.938359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:36:49.996456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cfb6daba-5e76-47fd-b014-79b0cc9c46cd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:50.004981 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cfb6daba-5e76-47fd-b014-79b0cc9c46cd tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.083872 Jul 27 20:36:50.005540 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1460/2927] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:49 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:50.017511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c6b542ec-71e9-4216-b0be-84be1b3d6e61 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:50.018643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c6b542ec-71e9-4216-b0be-84be1b3d6e61 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:50.025147 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c6b542ec-71e9-4216-b0be-84be1b3d6e61 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:50.025594 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c6b542ec-71e9-4216-b0be-84be1b3d6e61 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:50.026395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c6b542ec-71e9-4216-b0be-84be1b3d6e61 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:50.026829 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c6b542ec-71e9-4216-b0be-84be1b3d6e61 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:50.105819 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cb2e3cc5-d1c9-4175-b906-b27e7cd8b3c2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:50.106630 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cb2e3cc5-d1c9-4175-b906-b27e7cd8b3c2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:50.112674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cb2e3cc5-d1c9-4175-b906-b27e7cd8b3c2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:50.113174 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cb2e3cc5-d1c9-4175-b906-b27e7cd8b3c2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:50.113941 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cb2e3cc5-d1c9-4175-b906-b27e7cd8b3c2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:50.114375 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cb2e3cc5-d1c9-4175-b906-b27e7cd8b3c2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:50.159351 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c6b542ec-71e9-4216-b0be-84be1b3d6e61 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:50.168131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c6b542ec-71e9-4216-b0be-84be1b3d6e61 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.154891 Jul 27 20:36:50.168700 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1468/2928] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:50 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:50.178745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cb2e3cc5-d1c9-4175-b906-b27e7cd8b3c2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:50.186653 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cb2e3cc5-d1c9-4175-b906-b27e7cd8b3c2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084656 Jul 27 20:36:50.187199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1461/2929] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:50 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:51.026372 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c2673716-e4cd-46b8-a90a-6dfa8e9f2432 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:51.026978 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c2673716-e4cd-46b8-a90a-6dfa8e9f2432 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:51.034001 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c2673716-e4cd-46b8-a90a-6dfa8e9f2432 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:51.034448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c2673716-e4cd-46b8-a90a-6dfa8e9f2432 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:51.035198 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c2673716-e4cd-46b8-a90a-6dfa8e9f2432 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:51.035632 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c2673716-e4cd-46b8-a90a-6dfa8e9f2432 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:51.095006 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c2673716-e4cd-46b8-a90a-6dfa8e9f2432 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:51.103658 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c2673716-e4cd-46b8-a90a-6dfa8e9f2432 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.081191 Jul 27 20:36:51.104211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1469/2930] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:51 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:51.188404 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3074c3c9-09f3-4672-849e-14dc41d8644c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:51.189543 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3074c3c9-09f3-4672-849e-14dc41d8644c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:51.196202 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3074c3c9-09f3-4672-849e-14dc41d8644c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:51.196658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3074c3c9-09f3-4672-849e-14dc41d8644c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:51.197447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3074c3c9-09f3-4672-849e-14dc41d8644c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:51.197880 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3074c3c9-09f3-4672-849e-14dc41d8644c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:51.207785 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ab9c3644-bd9c-4a7e-835a-61fbaac97393 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:51.208406 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ab9c3644-bd9c-4a7e-835a-61fbaac97393 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:51.214376 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ab9c3644-bd9c-4a7e-835a-61fbaac97393 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:51.214837 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ab9c3644-bd9c-4a7e-835a-61fbaac97393 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:51.215601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ab9c3644-bd9c-4a7e-835a-61fbaac97393 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:51.216048 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ab9c3644-bd9c-4a7e-835a-61fbaac97393 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:51.276682 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ab9c3644-bd9c-4a7e-835a-61fbaac97393 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:51.285360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ab9c3644-bd9c-4a7e-835a-61fbaac97393 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082230 Jul 27 20:36:51.285993 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1470/2931] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:51 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:51.328610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3074c3c9-09f3-4672-849e-14dc41d8644c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:51.337387 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3074c3c9-09f3-4672-849e-14dc41d8644c tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152750 Jul 27 20:36:51.337946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1462/2932] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:51 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:52.124301 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fd424b0b-e9a8-4a4c-b0cb-90f064e28524 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:52.124912 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fd424b0b-e9a8-4a4c-b0cb-90f064e28524 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:52.132182 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fd424b0b-e9a8-4a4c-b0cb-90f064e28524 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:52.132629 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fd424b0b-e9a8-4a4c-b0cb-90f064e28524 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:52.133408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fd424b0b-e9a8-4a4c-b0cb-90f064e28524 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:52.133854 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fd424b0b-e9a8-4a4c-b0cb-90f064e28524 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:52.196601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fd424b0b-e9a8-4a4c-b0cb-90f064e28524 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:52.205657 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fd424b0b-e9a8-4a4c-b0cb-90f064e28524 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.085247 Jul 27 20:36:52.206179 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1471/2933] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:52 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:52.305461 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4c34ea45-b42b-494a-9706-ca647d88cc3e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:52.306095 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4c34ea45-b42b-494a-9706-ca647d88cc3e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:52.312468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c34ea45-b42b-494a-9706-ca647d88cc3e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:52.312911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c34ea45-b42b-494a-9706-ca647d88cc3e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:52.313700 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c34ea45-b42b-494a-9706-ca647d88cc3e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:52.314718 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c34ea45-b42b-494a-9706-ca647d88cc3e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:52.357814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a6bcee29-0f46-4b27-87f1-004d8ce21369 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:52.358427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a6bcee29-0f46-4b27-87f1-004d8ce21369 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:52.364921 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6bcee29-0f46-4b27-87f1-004d8ce21369 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:52.365398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6bcee29-0f46-4b27-87f1-004d8ce21369 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:52.366156 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6bcee29-0f46-4b27-87f1-004d8ce21369 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:52.366588 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a6bcee29-0f46-4b27-87f1-004d8ce21369 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:52.379578 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4c34ea45-b42b-494a-9706-ca647d88cc3e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:52.387602 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4c34ea45-b42b-494a-9706-ca647d88cc3e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085983 Jul 27 20:36:52.388173 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1463/2934] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:52 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:52.492158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a6bcee29-0f46-4b27-87f1-004d8ce21369 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:52.500018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a6bcee29-0f46-4b27-87f1-004d8ce21369 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.145996 Jul 27 20:36:52.500580 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1472/2935] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:52 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:53.227938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-21a6b2b7-5f37-4027-b379-29cab3d718a4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:53.228550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-21a6b2b7-5f37-4027-b379-29cab3d718a4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:53.236768 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21a6b2b7-5f37-4027-b379-29cab3d718a4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:53.237242 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21a6b2b7-5f37-4027-b379-29cab3d718a4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:53.238013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21a6b2b7-5f37-4027-b379-29cab3d718a4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:53.238445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21a6b2b7-5f37-4027-b379-29cab3d718a4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:53.297541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-21a6b2b7-5f37-4027-b379-29cab3d718a4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:53.305806 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-21a6b2b7-5f37-4027-b379-29cab3d718a4 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.082527 Jul 27 20:36:53.306380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1464/2936] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:53 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:36:53.409500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f121b45d-d383-4b15-b85a-166cabd9cd73 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:53.410128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f121b45d-d383-4b15-b85a-166cabd9cd73 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:53.416667 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f121b45d-d383-4b15-b85a-166cabd9cd73 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:53.417159 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f121b45d-d383-4b15-b85a-166cabd9cd73 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:53.417926 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f121b45d-d383-4b15-b85a-166cabd9cd73 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:53.418371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f121b45d-d383-4b15-b85a-166cabd9cd73 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:53.481137 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f121b45d-d383-4b15-b85a-166cabd9cd73 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:53.489765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f121b45d-d383-4b15-b85a-166cabd9cd73 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084850 Jul 27 20:36:53.490327 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1473/2937] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:53 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:53.521297 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-06cbde3d-2fc5-4ea0-b500-c233e255a4c7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:53.521916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-06cbde3d-2fc5-4ea0-b500-c233e255a4c7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:53.528349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-06cbde3d-2fc5-4ea0-b500-c233e255a4c7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:53.528832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-06cbde3d-2fc5-4ea0-b500-c233e255a4c7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:53.529628 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-06cbde3d-2fc5-4ea0-b500-c233e255a4c7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:53.530069 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-06cbde3d-2fc5-4ea0-b500-c233e255a4c7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:53.664490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-06cbde3d-2fc5-4ea0-b500-c233e255a4c7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:53.672435 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-06cbde3d-2fc5-4ea0-b500-c233e255a4c7 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.155580 Jul 27 20:36:53.673019 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1465/2938] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:53 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:54.327496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-eebc29b3-43ba-4dda-abfe-da583d79b9f7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:54.328294 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-eebc29b3-43ba-4dda-abfe-da583d79b9f7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:54.334664 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eebc29b3-43ba-4dda-abfe-da583d79b9f7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:54.335115 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eebc29b3-43ba-4dda-abfe-da583d79b9f7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:54.335873 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eebc29b3-43ba-4dda-abfe-da583d79b9f7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:54.336315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eebc29b3-43ba-4dda-abfe-da583d79b9f7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:54.354211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:36:54.399525 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-eebc29b3-43ba-4dda-abfe-da583d79b9f7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:54.407432 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-eebc29b3-43ba-4dda-abfe-da583d79b9f7 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.083861 Jul 27 20:36:54.408502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1474/2939] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:54 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:54.510824 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-42546d71-11ba-4f0c-bcc4-3748dec2581f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:54.511437 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-42546d71-11ba-4f0c-bcc4-3748dec2581f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:54.518216 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-42546d71-11ba-4f0c-bcc4-3748dec2581f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:54.518671 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-42546d71-11ba-4f0c-bcc4-3748dec2581f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:54.519463 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-42546d71-11ba-4f0c-bcc4-3748dec2581f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:54.519902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-42546d71-11ba-4f0c-bcc4-3748dec2581f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:54.596299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-42546d71-11ba-4f0c-bcc4-3748dec2581f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:54.604300 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-42546d71-11ba-4f0c-bcc4-3748dec2581f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.097468 Jul 27 20:36:54.604866 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1466/2940] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:54 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:54.693370 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-25423a3b-9543-432b-9531-78baec0ca654 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:54.694034 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-25423a3b-9543-432b-9531-78baec0ca654 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:54.700515 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-25423a3b-9543-432b-9531-78baec0ca654 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:54.700991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-25423a3b-9543-432b-9531-78baec0ca654 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:54.701790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-25423a3b-9543-432b-9531-78baec0ca654 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:54.702217 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-25423a3b-9543-432b-9531-78baec0ca654 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:54.828439 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-25423a3b-9543-432b-9531-78baec0ca654 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:54.836849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-25423a3b-9543-432b-9531-78baec0ca654 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.147369 Jul 27 20:36:54.837445 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1475/2941] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:54 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:55.429509 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e6544d11-c94c-4ce6-b80f-ea6b25de2c31 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:55.430121 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e6544d11-c94c-4ce6-b80f-ea6b25de2c31 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:55.436166 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e6544d11-c94c-4ce6-b80f-ea6b25de2c31 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:55.436619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e6544d11-c94c-4ce6-b80f-ea6b25de2c31 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:55.437409 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e6544d11-c94c-4ce6-b80f-ea6b25de2c31 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:55.437849 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e6544d11-c94c-4ce6-b80f-ea6b25de2c31 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:55.502583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e6544d11-c94c-4ce6-b80f-ea6b25de2c31 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:55.510435 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e6544d11-c94c-4ce6-b80f-ea6b25de2c31 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.084807 Jul 27 20:36:55.510984 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1467/2942] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:55 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:55.624770 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1d3c88f4-131b-45b6-ab5d-d8adb84ab9fa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:55.625404 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1d3c88f4-131b-45b6-ab5d-d8adb84ab9fa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:55.631971 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1d3c88f4-131b-45b6-ab5d-d8adb84ab9fa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:55.632418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1d3c88f4-131b-45b6-ab5d-d8adb84ab9fa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:55.633196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1d3c88f4-131b-45b6-ab5d-d8adb84ab9fa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:55.633632 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1d3c88f4-131b-45b6-ab5d-d8adb84ab9fa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:55.693437 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1d3c88f4-131b-45b6-ab5d-d8adb84ab9fa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:55.701297 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1d3c88f4-131b-45b6-ab5d-d8adb84ab9fa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.080353 Jul 27 20:36:55.701846 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1476/2943] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:55 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:55.858169 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c8cd3411-02fd-4680-bdb4-04eb1a28550e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:55.858772 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c8cd3411-02fd-4680-bdb4-04eb1a28550e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:55.865967 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c8cd3411-02fd-4680-bdb4-04eb1a28550e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:55.866407 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c8cd3411-02fd-4680-bdb4-04eb1a28550e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:55.867157 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c8cd3411-02fd-4680-bdb4-04eb1a28550e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:55.867589 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c8cd3411-02fd-4680-bdb4-04eb1a28550e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:56.005837 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c8cd3411-02fd-4680-bdb4-04eb1a28550e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:56.013838 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c8cd3411-02fd-4680-bdb4-04eb1a28550e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.159494 Jul 27 20:36:56.014432 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1468/2944] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:55 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:56.531697 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a2bf7fd5-f53f-4322-aeeb-87a9c4ea498d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:56.532349 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a2bf7fd5-f53f-4322-aeeb-87a9c4ea498d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:56.538933 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a2bf7fd5-f53f-4322-aeeb-87a9c4ea498d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:56.539383 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a2bf7fd5-f53f-4322-aeeb-87a9c4ea498d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:56.540141 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a2bf7fd5-f53f-4322-aeeb-87a9c4ea498d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:56.540582 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a2bf7fd5-f53f-4322-aeeb-87a9c4ea498d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:56.604228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a2bf7fd5-f53f-4322-aeeb-87a9c4ea498d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:56.612336 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a2bf7fd5-f53f-4322-aeeb-87a9c4ea498d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.084594 Jul 27 20:36:56.612896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1477/2945] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:56 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:56.722026 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-40a7a9a1-152d-4033-a7fc-32fb498871e5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:56.722636 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-40a7a9a1-152d-4033-a7fc-32fb498871e5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:56.728568 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-40a7a9a1-152d-4033-a7fc-32fb498871e5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:56.729038 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-40a7a9a1-152d-4033-a7fc-32fb498871e5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:56.729787 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-40a7a9a1-152d-4033-a7fc-32fb498871e5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:56.730220 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-40a7a9a1-152d-4033-a7fc-32fb498871e5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:56.789452 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-40a7a9a1-152d-4033-a7fc-32fb498871e5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:56.797224 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-40a7a9a1-152d-4033-a7fc-32fb498871e5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.079061 Jul 27 20:36:56.797774 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1469/2946] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:56 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:57.034769 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-656ab1e8-c383-49a6-9558-2913ffefd754 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:57.035393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-656ab1e8-c383-49a6-9558-2913ffefd754 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:57.041994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-656ab1e8-c383-49a6-9558-2913ffefd754 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:57.042393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-656ab1e8-c383-49a6-9558-2913ffefd754 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:57.043165 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-656ab1e8-c383-49a6-9558-2913ffefd754 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:57.043612 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-656ab1e8-c383-49a6-9558-2913ffefd754 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:57.176079 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-656ab1e8-c383-49a6-9558-2913ffefd754 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:57.184139 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-656ab1e8-c383-49a6-9558-2913ffefd754 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153392 Jul 27 20:36:57.184717 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1478/2947] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:57 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:57.633424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-651bb6f8-d7a2-4ace-aa4d-452a8e50cc93 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:57.634062 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-651bb6f8-d7a2-4ace-aa4d-452a8e50cc93 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:57.640442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-651bb6f8-d7a2-4ace-aa4d-452a8e50cc93 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:57.640895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-651bb6f8-d7a2-4ace-aa4d-452a8e50cc93 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:57.641684 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-651bb6f8-d7a2-4ace-aa4d-452a8e50cc93 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:57.642608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-651bb6f8-d7a2-4ace-aa4d-452a8e50cc93 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:57.703491 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-651bb6f8-d7a2-4ace-aa4d-452a8e50cc93 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:57.711952 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-651bb6f8-d7a2-4ace-aa4d-452a8e50cc93 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.082391 Jul 27 20:36:57.712511 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1470/2948] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:57 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:57.818992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a16dc5f9-e30a-4b7d-a6bb-2b03c662b542 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:57.819614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a16dc5f9-e30a-4b7d-a6bb-2b03c662b542 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:57.825649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a16dc5f9-e30a-4b7d-a6bb-2b03c662b542 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:57.826105 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a16dc5f9-e30a-4b7d-a6bb-2b03c662b542 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:57.826871 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a16dc5f9-e30a-4b7d-a6bb-2b03c662b542 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:57.827316 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a16dc5f9-e30a-4b7d-a6bb-2b03c662b542 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:57.888668 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a16dc5f9-e30a-4b7d-a6bb-2b03c662b542 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:57.897184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a16dc5f9-e30a-4b7d-a6bb-2b03c662b542 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082014 Jul 27 20:36:57.897759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1479/2949] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:57 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:58.205170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1a8ad3f0-bef0-4065-823a-97dde6946c60 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:58.205700 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1a8ad3f0-bef0-4065-823a-97dde6946c60 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:58.211696 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1a8ad3f0-bef0-4065-823a-97dde6946c60 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:58.212147 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1a8ad3f0-bef0-4065-823a-97dde6946c60 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:58.212905 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1a8ad3f0-bef0-4065-823a-97dde6946c60 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:58.213402 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1a8ad3f0-bef0-4065-823a-97dde6946c60 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:58.344003 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1a8ad3f0-bef0-4065-823a-97dde6946c60 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:58.352716 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1a8ad3f0-bef0-4065-823a-97dde6946c60 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151817 Jul 27 20:36:58.353329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1471/2950] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:58 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:58.733679 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f2d6d7e3-7156-435e-9d0d-79a37bc04340 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:58.734332 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f2d6d7e3-7156-435e-9d0d-79a37bc04340 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:58.741048 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2d6d7e3-7156-435e-9d0d-79a37bc04340 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:58.741508 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2d6d7e3-7156-435e-9d0d-79a37bc04340 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:58.742275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2d6d7e3-7156-435e-9d0d-79a37bc04340 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:58.742719 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2d6d7e3-7156-435e-9d0d-79a37bc04340 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:58.802218 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f2d6d7e3-7156-435e-9d0d-79a37bc04340 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:58.810140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f2d6d7e3-7156-435e-9d0d-79a37bc04340 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.080431 Jul 27 20:36:58.810711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1480/2951] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:58 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:58.917659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-36944586-a3ae-4899-b38f-91867b622c18 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:58.918261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-36944586-a3ae-4899-b38f-91867b622c18 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:58.924763 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-36944586-a3ae-4899-b38f-91867b622c18 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:58.925234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-36944586-a3ae-4899-b38f-91867b622c18 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:58.925983 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-36944586-a3ae-4899-b38f-91867b622c18 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:58.926412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-36944586-a3ae-4899-b38f-91867b622c18 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:58.988060 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-36944586-a3ae-4899-b38f-91867b622c18 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:58.995882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-36944586-a3ae-4899-b38f-91867b622c18 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081976 Jul 27 20:36:58.996473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1472/2952] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:58 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:59.373682 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ba5afda7-1c02-4067-b319-d9b2e62f9a33 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:59.374231 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ba5afda7-1c02-4067-b319-d9b2e62f9a33 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:59.381001 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ba5afda7-1c02-4067-b319-d9b2e62f9a33 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:59.381463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ba5afda7-1c02-4067-b319-d9b2e62f9a33 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:59.382228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ba5afda7-1c02-4067-b319-d9b2e62f9a33 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:59.382673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ba5afda7-1c02-4067-b319-d9b2e62f9a33 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:59.510974 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ba5afda7-1c02-4067-b319-d9b2e62f9a33 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:59.518933 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ba5afda7-1c02-4067-b319-d9b2e62f9a33 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149238 Jul 27 20:36:59.519505 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1481/2953] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:59 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:36:59.832566 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7e6506f6-37d7-4498-ae47-dbe84a0ba743 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:36:59.833202 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7e6506f6-37d7-4498-ae47-dbe84a0ba743 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:36:59.839161 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7e6506f6-37d7-4498-ae47-dbe84a0ba743 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:59.839613 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7e6506f6-37d7-4498-ae47-dbe84a0ba743 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:59.840366 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7e6506f6-37d7-4498-ae47-dbe84a0ba743 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:36:59.840804 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7e6506f6-37d7-4498-ae47-dbe84a0ba743 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:36:59.901271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7e6506f6-37d7-4498-ae47-dbe84a0ba743 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:36:59.909642 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7e6506f6-37d7-4498-ae47-dbe84a0ba743 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.081808 Jul 27 20:36:59.910202 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1473/2954] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:36:59 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:00.018112 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e60aada5-a6f9-4d88-b88a-89ac917a40a1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:00.018737 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e60aada5-a6f9-4d88-b88a-89ac917a40a1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:00.025246 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e60aada5-a6f9-4d88-b88a-89ac917a40a1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:00.025704 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e60aada5-a6f9-4d88-b88a-89ac917a40a1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:00.026473 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e60aada5-a6f9-4d88-b88a-89ac917a40a1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:00.026919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e60aada5-a6f9-4d88-b88a-89ac917a40a1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:00.088111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e60aada5-a6f9-4d88-b88a-89ac917a40a1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:00.096931 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e60aada5-a6f9-4d88-b88a-89ac917a40a1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083320 Jul 27 20:37:00.097532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1482/2955] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:00 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:00.540674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cf4914ec-c3eb-4840-aaf7-8afc7d4b3f4d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:00.541324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cf4914ec-c3eb-4840-aaf7-8afc7d4b3f4d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:00.547878 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cf4914ec-c3eb-4840-aaf7-8afc7d4b3f4d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:00.549028 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cf4914ec-c3eb-4840-aaf7-8afc7d4b3f4d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:00.549680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cf4914ec-c3eb-4840-aaf7-8afc7d4b3f4d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:00.550120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cf4914ec-c3eb-4840-aaf7-8afc7d4b3f4d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:00.689970 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cf4914ec-c3eb-4840-aaf7-8afc7d4b3f4d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:00.697798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cf4914ec-c3eb-4840-aaf7-8afc7d4b3f4d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.160964 Jul 27 20:37:00.698358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1474/2956] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:00 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:00.931378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-913d8281-3e64-4367-b07f-72544968e909 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:00.932326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-913d8281-3e64-4367-b07f-72544968e909 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:00.942235 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-913d8281-3e64-4367-b07f-72544968e909 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:00.942695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-913d8281-3e64-4367-b07f-72544968e909 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:00.943480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-913d8281-3e64-4367-b07f-72544968e909 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:00.943930 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-913d8281-3e64-4367-b07f-72544968e909 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:01.004003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-913d8281-3e64-4367-b07f-72544968e909 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:01.011930 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-913d8281-3e64-4367-b07f-72544968e909 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.085328 Jul 27 20:37:01.012494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1483/2957] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:00 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:01.117413 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-58eedadf-8771-4c99-8bf0-232352dde977 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:01.118050 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-58eedadf-8771-4c99-8bf0-232352dde977 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:01.124031 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-58eedadf-8771-4c99-8bf0-232352dde977 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:01.124481 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-58eedadf-8771-4c99-8bf0-232352dde977 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:01.125273 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-58eedadf-8771-4c99-8bf0-232352dde977 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:01.125712 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-58eedadf-8771-4c99-8bf0-232352dde977 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:01.186448 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-58eedadf-8771-4c99-8bf0-232352dde977 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:01.194685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-58eedadf-8771-4c99-8bf0-232352dde977 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081133 Jul 27 20:37:01.195244 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1475/2958] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:01 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:01.718879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7ab52520-5a1b-48be-885f-aa2198e41418 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:01.719509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7ab52520-5a1b-48be-885f-aa2198e41418 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:01.726940 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7ab52520-5a1b-48be-885f-aa2198e41418 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:01.727457 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7ab52520-5a1b-48be-885f-aa2198e41418 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:01.728216 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7ab52520-5a1b-48be-885f-aa2198e41418 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:01.728656 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7ab52520-5a1b-48be-885f-aa2198e41418 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:01.858667 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7ab52520-5a1b-48be-885f-aa2198e41418 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:01.867829 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7ab52520-5a1b-48be-885f-aa2198e41418 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152830 Jul 27 20:37:01.868399 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1484/2959] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:01 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:02.077460 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4a4f3ec3-c486-4f6c-aa7c-c97c56effc2d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:02.078570 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4a4f3ec3-c486-4f6c-aa7c-c97c56effc2d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:02.085175 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a4f3ec3-c486-4f6c-aa7c-c97c56effc2d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:02.085625 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a4f3ec3-c486-4f6c-aa7c-c97c56effc2d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:02.086378 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a4f3ec3-c486-4f6c-aa7c-c97c56effc2d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:02.086812 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a4f3ec3-c486-4f6c-aa7c-c97c56effc2d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:02.149926 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4a4f3ec3-c486-4f6c-aa7c-c97c56effc2d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:02.153247 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:37:02.159655 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4a4f3ec3-c486-4f6c-aa7c-c97c56effc2d tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.130465 Jul 27 20:37:02.160221 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1476/2960] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:02 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:02.216066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6ba7b0cf-47b6-4475-a54b-c167f2b07042 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:02.216690 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6ba7b0cf-47b6-4475-a54b-c167f2b07042 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:02.223559 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ba7b0cf-47b6-4475-a54b-c167f2b07042 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:02.224020 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ba7b0cf-47b6-4475-a54b-c167f2b07042 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:02.224801 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ba7b0cf-47b6-4475-a54b-c167f2b07042 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:02.225251 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ba7b0cf-47b6-4475-a54b-c167f2b07042 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:02.286066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6ba7b0cf-47b6-4475-a54b-c167f2b07042 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:02.293980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6ba7b0cf-47b6-4475-a54b-c167f2b07042 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082072 Jul 27 20:37:02.294484 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1485/2961] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:02 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:02.888849 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7a18bfb7-a310-48b9-a215-2d49fc1eaedd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:02.889491 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7a18bfb7-a310-48b9-a215-2d49fc1eaedd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:02.891533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=80 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:37:02.897486 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a18bfb7-a310-48b9-a215-2d49fc1eaedd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:02.897938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a18bfb7-a310-48b9-a215-2d49fc1eaedd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:02.898715 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a18bfb7-a310-48b9-a215-2d49fc1eaedd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:02.899153 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a18bfb7-a310-48b9-a215-2d49fc1eaedd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:03.056384 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7a18bfb7-a310-48b9-a215-2d49fc1eaedd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:03.065018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7a18bfb7-a310-48b9-a215-2d49fc1eaedd tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.179914 Jul 27 20:37:03.066106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1477/2962] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:02 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:03.180769 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fe1848c5-9fc0-44c1-9008-1e68f6411271 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:03.181684 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fe1848c5-9fc0-44c1-9008-1e68f6411271 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:03.183438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=84 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:37:03.189827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fe1848c5-9fc0-44c1-9008-1e68f6411271 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:03.190280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fe1848c5-9fc0-44c1-9008-1e68f6411271 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:03.191061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fe1848c5-9fc0-44c1-9008-1e68f6411271 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:03.191505 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fe1848c5-9fc0-44c1-9008-1e68f6411271 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:03.261056 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fe1848c5-9fc0-44c1-9008-1e68f6411271 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:03.270378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fe1848c5-9fc0-44c1-9008-1e68f6411271 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.093716 Jul 27 20:37:03.271025 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1486/2963] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:03 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:03.315348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f521da17-f3ad-4b65-9dae-093049f83381 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:03.315985 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f521da17-f3ad-4b65-9dae-093049f83381 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:03.322615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f521da17-f3ad-4b65-9dae-093049f83381 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:03.323064 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f521da17-f3ad-4b65-9dae-093049f83381 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:03.323874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f521da17-f3ad-4b65-9dae-093049f83381 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:03.324314 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f521da17-f3ad-4b65-9dae-093049f83381 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:03.396809 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f521da17-f3ad-4b65-9dae-093049f83381 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:03.406444 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f521da17-f3ad-4b65-9dae-093049f83381 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.095353 Jul 27 20:37:03.407033 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1478/2964] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:03 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:04.087726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-722abad4-5644-4a93-88aa-45905f6fa643 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:04.088351 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-722abad4-5644-4a93-88aa-45905f6fa643 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:04.094604 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-722abad4-5644-4a93-88aa-45905f6fa643 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:04.095637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-722abad4-5644-4a93-88aa-45905f6fa643 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:04.096578 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-722abad4-5644-4a93-88aa-45905f6fa643 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:04.097051 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-722abad4-5644-4a93-88aa-45905f6fa643 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:04.225417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-722abad4-5644-4a93-88aa-45905f6fa643 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:04.233297 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-722abad4-5644-4a93-88aa-45905f6fa643 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149500 Jul 27 20:37:04.233883 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1487/2965] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:04 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:04.291693 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6b9819b9-0ce5-4bfd-b6f0-49ac0d7f3360 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:04.292309 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6b9819b9-0ce5-4bfd-b6f0-49ac0d7f3360 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:04.298907 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b9819b9-0ce5-4bfd-b6f0-49ac0d7f3360 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:04.299354 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b9819b9-0ce5-4bfd-b6f0-49ac0d7f3360 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:04.300113 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b9819b9-0ce5-4bfd-b6f0-49ac0d7f3360 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:04.300548 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b9819b9-0ce5-4bfd-b6f0-49ac0d7f3360 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:04.360703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6b9819b9-0ce5-4bfd-b6f0-49ac0d7f3360 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:04.368509 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6b9819b9-0ce5-4bfd-b6f0-49ac0d7f3360 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.080594 Jul 27 20:37:04.369094 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1479/2966] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:04 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:04.427939 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a858d531-0637-4bbc-a158-f068d9bc5821 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:04.428544 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a858d531-0637-4bbc-a158-f068d9bc5821 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:04.434484 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a858d531-0637-4bbc-a158-f068d9bc5821 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:04.434929 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a858d531-0637-4bbc-a158-f068d9bc5821 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:04.435680 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a858d531-0637-4bbc-a158-f068d9bc5821 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:04.436116 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a858d531-0637-4bbc-a158-f068d9bc5821 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:04.496774 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a858d531-0637-4bbc-a158-f068d9bc5821 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:04.504691 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a858d531-0637-4bbc-a158-f068d9bc5821 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.080539 Jul 27 20:37:04.505290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1488/2967] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:04 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:05.255472 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a1936caa-af65-434a-81c3-a90f268886d8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:05.256078 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a1936caa-af65-434a-81c3-a90f268886d8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:05.262081 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a1936caa-af65-434a-81c3-a90f268886d8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:05.262527 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a1936caa-af65-434a-81c3-a90f268886d8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:05.263282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a1936caa-af65-434a-81c3-a90f268886d8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:05.263716 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a1936caa-af65-434a-81c3-a90f268886d8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:05.388832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a1936caa-af65-434a-81c3-a90f268886d8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:05.389914 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5d753ccc-8ec2-4f29-8323-03ee033fbfab tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:05.390625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5d753ccc-8ec2-4f29-8323-03ee033fbfab tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:05.396991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a1936caa-af65-434a-81c3-a90f268886d8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.145987 Jul 27 20:37:05.397285 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5d753ccc-8ec2-4f29-8323-03ee033fbfab tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:05.397568 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1480/2968] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:05 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:05.397750 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5d753ccc-8ec2-4f29-8323-03ee033fbfab tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:05.398532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5d753ccc-8ec2-4f29-8323-03ee033fbfab tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:05.398981 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5d753ccc-8ec2-4f29-8323-03ee033fbfab tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:05.458890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5d753ccc-8ec2-4f29-8323-03ee033fbfab tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:05.466762 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5d753ccc-8ec2-4f29-8323-03ee033fbfab tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.080994 Jul 27 20:37:05.467323 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1489/2969] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:05 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:05.525634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bb859acc-eab6-4774-8ecd-80b1d080c8ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:05.526242 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bb859acc-eab6-4774-8ecd-80b1d080c8ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:05.532670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb859acc-eab6-4774-8ecd-80b1d080c8ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:05.533155 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb859acc-eab6-4774-8ecd-80b1d080c8ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:05.533907 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb859acc-eab6-4774-8ecd-80b1d080c8ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:05.534339 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb859acc-eab6-4774-8ecd-80b1d080c8ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:05.598189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bb859acc-eab6-4774-8ecd-80b1d080c8ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:05.605985 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bb859acc-eab6-4774-8ecd-80b1d080c8ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084223 Jul 27 20:37:05.606544 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1481/2970] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:05 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:06.418621 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-37277721-b259-4d1c-b19a-e89b36d44796 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:06.419248 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-37277721-b259-4d1c-b19a-e89b36d44796 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:06.426024 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-37277721-b259-4d1c-b19a-e89b36d44796 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:06.426477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-37277721-b259-4d1c-b19a-e89b36d44796 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:06.427276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-37277721-b259-4d1c-b19a-e89b36d44796 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:06.427720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-37277721-b259-4d1c-b19a-e89b36d44796 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:06.489140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7a3842ba-0e0f-42ec-a94c-2f9a9badfb26 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:06.489759 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7a3842ba-0e0f-42ec-a94c-2f9a9badfb26 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:06.495766 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a3842ba-0e0f-42ec-a94c-2f9a9badfb26 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:06.496219 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a3842ba-0e0f-42ec-a94c-2f9a9badfb26 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:06.497001 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a3842ba-0e0f-42ec-a94c-2f9a9badfb26 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:06.497444 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a3842ba-0e0f-42ec-a94c-2f9a9badfb26 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:06.558841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-37277721-b259-4d1c-b19a-e89b36d44796 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:06.559347 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7a3842ba-0e0f-42ec-a94c-2f9a9badfb26 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:06.567700 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-37277721-b259-4d1c-b19a-e89b36d44796 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.152894 Jul 27 20:37:06.567897 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7a3842ba-0e0f-42ec-a94c-2f9a9badfb26 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.083814 Jul 27 20:37:06.568291 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1490/2971] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:06 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:06.568579 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1482/2972] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:06 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:06.627872 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0463b2d0-cfec-4bba-858d-8c472e9a4ccd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:06.628489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0463b2d0-cfec-4bba-858d-8c472e9a4ccd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:06.634655 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0463b2d0-cfec-4bba-858d-8c472e9a4ccd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:06.635106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0463b2d0-cfec-4bba-858d-8c472e9a4ccd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:06.635860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0463b2d0-cfec-4bba-858d-8c472e9a4ccd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:06.636296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0463b2d0-cfec-4bba-858d-8c472e9a4ccd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:06.640252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:37:06.705900 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0463b2d0-cfec-4bba-858d-8c472e9a4ccd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:06.713796 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0463b2d0-cfec-4bba-858d-8c472e9a4ccd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.090492 Jul 27 20:37:06.714360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1491/2973] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:06 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:07.589179 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4a9276c5-702b-416d-918b-32704889315e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:07.589764 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4330dc5c-dfdd-41f6-851c-fc412349848c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:07.590140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4a9276c5-702b-416d-918b-32704889315e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:07.590262 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4330dc5c-dfdd-41f6-851c-fc412349848c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:07.597386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a9276c5-702b-416d-918b-32704889315e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:07.597577 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4330dc5c-dfdd-41f6-851c-fc412349848c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:07.597836 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a9276c5-702b-416d-918b-32704889315e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:07.597964 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4330dc5c-dfdd-41f6-851c-fc412349848c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:07.598604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a9276c5-702b-416d-918b-32704889315e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:07.598709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4330dc5c-dfdd-41f6-851c-fc412349848c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:07.599042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a9276c5-702b-416d-918b-32704889315e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:07.599153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4330dc5c-dfdd-41f6-851c-fc412349848c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:07.660475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4330dc5c-dfdd-41f6-851c-fc412349848c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:07.668436 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4330dc5c-dfdd-41f6-851c-fc412349848c tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.082763 Jul 27 20:37:07.669015 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1492/2974] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:07 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:07.730157 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4a9276c5-702b-416d-918b-32704889315e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:07.735120 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-88c770e6-6ba8-4aec-9e0d-61577d39dfcb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:07.735785 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-88c770e6-6ba8-4aec-9e0d-61577d39dfcb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:07.738619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4a9276c5-702b-416d-918b-32704889315e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153316 Jul 27 20:37:07.739198 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1483/2975] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:07 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:07.741874 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88c770e6-6ba8-4aec-9e0d-61577d39dfcb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:07.742330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88c770e6-6ba8-4aec-9e0d-61577d39dfcb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:07.743095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88c770e6-6ba8-4aec-9e0d-61577d39dfcb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:07.743533 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88c770e6-6ba8-4aec-9e0d-61577d39dfcb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:07.805477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-88c770e6-6ba8-4aec-9e0d-61577d39dfcb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:07.813313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-88c770e6-6ba8-4aec-9e0d-61577d39dfcb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082052 Jul 27 20:37:07.814423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1493/2976] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:07 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:08.690346 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3867e221-f651-4f40-bd91-a8a0cf53b703 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:08.691476 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3867e221-f651-4f40-bd91-a8a0cf53b703 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:08.699052 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3867e221-f651-4f40-bd91-a8a0cf53b703 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:08.699500 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3867e221-f651-4f40-bd91-a8a0cf53b703 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:08.700260 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3867e221-f651-4f40-bd91-a8a0cf53b703 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:08.700697 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3867e221-f651-4f40-bd91-a8a0cf53b703 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:08.759630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-32ddf0d0-dd4a-4db3-8e36-12502a8b58c8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:08.760251 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-32ddf0d0-dd4a-4db3-8e36-12502a8b58c8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:08.763348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3867e221-f651-4f40-bd91-a8a0cf53b703 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:08.767692 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-32ddf0d0-dd4a-4db3-8e36-12502a8b58c8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:08.768151 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-32ddf0d0-dd4a-4db3-8e36-12502a8b58c8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:08.768924 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-32ddf0d0-dd4a-4db3-8e36-12502a8b58c8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:08.769398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-32ddf0d0-dd4a-4db3-8e36-12502a8b58c8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:08.771914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3867e221-f651-4f40-bd91-a8a0cf53b703 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.086278 Jul 27 20:37:08.772480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1484/2977] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:08 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:08.835412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2b30a6c1-3a4d-4be5-9c23-f68827fc4711 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:08.836018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2b30a6c1-3a4d-4be5-9c23-f68827fc4711 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:08.842009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b30a6c1-3a4d-4be5-9c23-f68827fc4711 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:08.842460 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b30a6c1-3a4d-4be5-9c23-f68827fc4711 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:08.843222 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b30a6c1-3a4d-4be5-9c23-f68827fc4711 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:08.843660 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b30a6c1-3a4d-4be5-9c23-f68827fc4711 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:08.903528 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-32ddf0d0-dd4a-4db3-8e36-12502a8b58c8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:08.910246 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2b30a6c1-3a4d-4be5-9c23-f68827fc4711 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:08.912436 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-32ddf0d0-dd4a-4db3-8e36-12502a8b58c8 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.156641 Jul 27 20:37:08.913039 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1494/2978] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:08 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:08.918267 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2b30a6c1-3a4d-4be5-9c23-f68827fc4711 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.086698 Jul 27 20:37:08.918824 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1485/2979] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:08 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:09.793791 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-77529c07-9636-4006-945c-d2f3d26a46f5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:09.794448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-77529c07-9636-4006-945c-d2f3d26a46f5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:09.801537 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-77529c07-9636-4006-945c-d2f3d26a46f5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:09.801992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-77529c07-9636-4006-945c-d2f3d26a46f5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:09.802758 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-77529c07-9636-4006-945c-d2f3d26a46f5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:09.803203 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-77529c07-9636-4006-945c-d2f3d26a46f5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:09.864849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-77529c07-9636-4006-945c-d2f3d26a46f5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:09.872866 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-77529c07-9636-4006-945c-d2f3d26a46f5 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.083052 Jul 27 20:37:09.873450 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1495/2980] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:09 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:09.933405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d17fe9cd-efe5-4d17-af1b-c30fa301fb03 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:09.934258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d17fe9cd-efe5-4d17-af1b-c30fa301fb03 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:09.938649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-20bc5752-d54c-4180-871f-e205c8fd0937 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:09.939283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-20bc5752-d54c-4180-871f-e205c8fd0937 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:09.940954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d17fe9cd-efe5-4d17-af1b-c30fa301fb03 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:09.941429 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d17fe9cd-efe5-4d17-af1b-c30fa301fb03 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:09.942195 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d17fe9cd-efe5-4d17-af1b-c30fa301fb03 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:09.942631 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d17fe9cd-efe5-4d17-af1b-c30fa301fb03 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:09.945245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-20bc5752-d54c-4180-871f-e205c8fd0937 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:09.945696 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-20bc5752-d54c-4180-871f-e205c8fd0937 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:09.946449 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-20bc5752-d54c-4180-871f-e205c8fd0937 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:09.946886 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-20bc5752-d54c-4180-871f-e205c8fd0937 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:10.014106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-20bc5752-d54c-4180-871f-e205c8fd0937 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:10.022572 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-20bc5752-d54c-4180-871f-e205c8fd0937 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.087623 Jul 27 20:37:10.023285 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1496/2981] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:09 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:10.074810 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d17fe9cd-efe5-4d17-af1b-c30fa301fb03 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:10.083165 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d17fe9cd-efe5-4d17-af1b-c30fa301fb03 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153620 Jul 27 20:37:10.083733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1486/2982] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:09 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:10.895366 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-198703cf-ee49-4cb5-be23-2781a083e885 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:10.896001 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-198703cf-ee49-4cb5-be23-2781a083e885 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:10.902579 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-198703cf-ee49-4cb5-be23-2781a083e885 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:10.903034 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-198703cf-ee49-4cb5-be23-2781a083e885 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:10.903789 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-198703cf-ee49-4cb5-be23-2781a083e885 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:10.904230 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-198703cf-ee49-4cb5-be23-2781a083e885 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:10.964327 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-198703cf-ee49-4cb5-be23-2781a083e885 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:10.972384 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-198703cf-ee49-4cb5-be23-2781a083e885 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.081469 Jul 27 20:37:10.972950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1497/2983] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:10 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:11.043591 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9fc34976-610a-4e8c-977c-0bcbdfcd9f65 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:11.044208 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9fc34976-610a-4e8c-977c-0bcbdfcd9f65 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:11.050676 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9fc34976-610a-4e8c-977c-0bcbdfcd9f65 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:11.051118 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9fc34976-610a-4e8c-977c-0bcbdfcd9f65 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:11.051877 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9fc34976-610a-4e8c-977c-0bcbdfcd9f65 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:11.052310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9fc34976-610a-4e8c-977c-0bcbdfcd9f65 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:11.106356 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-41d5a5d8-41ea-4db5-b421-608894b41c5d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:11.107406 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-41d5a5d8-41ea-4db5-b421-608894b41c5d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:11.114112 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41d5a5d8-41ea-4db5-b421-608894b41c5d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:11.114480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9fc34976-610a-4e8c-977c-0bcbdfcd9f65 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:11.114627 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41d5a5d8-41ea-4db5-b421-608894b41c5d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:11.115313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41d5a5d8-41ea-4db5-b421-608894b41c5d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:11.115752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41d5a5d8-41ea-4db5-b421-608894b41c5d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:11.122449 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9fc34976-610a-4e8c-977c-0bcbdfcd9f65 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082631 Jul 27 20:37:11.123010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1487/2984] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:11 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:11.244421 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-41d5a5d8-41ea-4db5-b421-608894b41c5d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:11.252332 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-41d5a5d8-41ea-4db5-b421-608894b41c5d tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.150336 Jul 27 20:37:11.252894 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1498/2985] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:11 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:11.993335 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3e73b15d-aaa6-47ca-b8c3-ae3984db4628 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:11.993864 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3e73b15d-aaa6-47ca-b8c3-ae3984db4628 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:11.999990 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e73b15d-aaa6-47ca-b8c3-ae3984db4628 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:12.000391 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e73b15d-aaa6-47ca-b8c3-ae3984db4628 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:12.001816 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e73b15d-aaa6-47ca-b8c3-ae3984db4628 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:12.002354 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e73b15d-aaa6-47ca-b8c3-ae3984db4628 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:12.065164 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3e73b15d-aaa6-47ca-b8c3-ae3984db4628 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:12.073345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3e73b15d-aaa6-47ca-b8c3-ae3984db4628 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.083817 Jul 27 20:37:12.073911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1488/2986] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:11 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:12.144466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6d23ad22-809d-42e8-b0b8-5292b9d8847e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:12.145112 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6d23ad22-809d-42e8-b0b8-5292b9d8847e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:12.151742 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d23ad22-809d-42e8-b0b8-5292b9d8847e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:12.152295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d23ad22-809d-42e8-b0b8-5292b9d8847e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:12.153098 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d23ad22-809d-42e8-b0b8-5292b9d8847e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:12.153545 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d23ad22-809d-42e8-b0b8-5292b9d8847e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:12.215264 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6d23ad22-809d-42e8-b0b8-5292b9d8847e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:12.223760 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6d23ad22-809d-42e8-b0b8-5292b9d8847e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084433 Jul 27 20:37:12.224332 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1499/2987] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:12 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:12.273056 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5c0039e6-e1c3-48e5-b25d-7f37e03aa421 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:12.273599 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5c0039e6-e1c3-48e5-b25d-7f37e03aa421 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:12.279619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c0039e6-e1c3-48e5-b25d-7f37e03aa421 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:12.280059 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c0039e6-e1c3-48e5-b25d-7f37e03aa421 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:12.280802 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c0039e6-e1c3-48e5-b25d-7f37e03aa421 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:12.281262 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c0039e6-e1c3-48e5-b25d-7f37e03aa421 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:12.409186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5c0039e6-e1c3-48e5-b25d-7f37e03aa421 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:12.417077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5c0039e6-e1c3-48e5-b25d-7f37e03aa421 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.147935 Jul 27 20:37:12.417636 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1489/2988] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:12 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:13.093777 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-917dd329-6388-42eb-9a47-8db54d6f6089 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:13.094395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-917dd329-6388-42eb-9a47-8db54d6f6089 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:13.100940 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-917dd329-6388-42eb-9a47-8db54d6f6089 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:13.101420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-917dd329-6388-42eb-9a47-8db54d6f6089 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:13.102180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-917dd329-6388-42eb-9a47-8db54d6f6089 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:13.102617 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-917dd329-6388-42eb-9a47-8db54d6f6089 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:13.161860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-917dd329-6388-42eb-9a47-8db54d6f6089 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:13.172328 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-917dd329-6388-42eb-9a47-8db54d6f6089 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.082466 Jul 27 20:37:13.173819 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1500/2989] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:13 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:13.245135 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a9694dc2-64fd-4b64-88f6-48d063d3a271 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:13.245754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a9694dc2-64fd-4b64-88f6-48d063d3a271 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:13.252422 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a9694dc2-64fd-4b64-88f6-48d063d3a271 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:13.252870 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a9694dc2-64fd-4b64-88f6-48d063d3a271 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:13.253657 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a9694dc2-64fd-4b64-88f6-48d063d3a271 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:13.254095 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a9694dc2-64fd-4b64-88f6-48d063d3a271 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:13.315970 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a9694dc2-64fd-4b64-88f6-48d063d3a271 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:13.323808 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a9694dc2-64fd-4b64-88f6-48d063d3a271 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082612 Jul 27 20:37:13.324381 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1490/2990] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:13 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:13.438580 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d7eaf0e3-dcea-4ffd-a0a9-b4a46beb6f76 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:13.439218 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d7eaf0e3-dcea-4ffd-a0a9-b4a46beb6f76 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:13.445308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d7eaf0e3-dcea-4ffd-a0a9-b4a46beb6f76 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:13.445755 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d7eaf0e3-dcea-4ffd-a0a9-b4a46beb6f76 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:13.446505 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d7eaf0e3-dcea-4ffd-a0a9-b4a46beb6f76 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:13.446942 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d7eaf0e3-dcea-4ffd-a0a9-b4a46beb6f76 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:13.575228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d7eaf0e3-dcea-4ffd-a0a9-b4a46beb6f76 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:13.584059 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d7eaf0e3-dcea-4ffd-a0a9-b4a46beb6f76 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.149412 Jul 27 20:37:13.584617 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1501/2991] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:13 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:14.194233 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c8351914-3f8d-4e94-b93b-7594257cc381 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:14.194874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c8351914-3f8d-4e94-b93b-7594257cc381 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:14.200939 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c8351914-3f8d-4e94-b93b-7594257cc381 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:14.201418 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c8351914-3f8d-4e94-b93b-7594257cc381 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:14.202180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c8351914-3f8d-4e94-b93b-7594257cc381 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:14.202648 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c8351914-3f8d-4e94-b93b-7594257cc381 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:14.263195 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c8351914-3f8d-4e94-b93b-7594257cc381 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:14.271777 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c8351914-3f8d-4e94-b93b-7594257cc381 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.081435 Jul 27 20:37:14.272342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1491/2992] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:14 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:14.345978 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a109f341-9987-430e-854c-2a8c6ec17ce3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:14.346524 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a109f341-9987-430e-854c-2a8c6ec17ce3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:14.353212 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a109f341-9987-430e-854c-2a8c6ec17ce3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:14.353671 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a109f341-9987-430e-854c-2a8c6ec17ce3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:14.354482 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a109f341-9987-430e-854c-2a8c6ec17ce3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:14.354923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a109f341-9987-430e-854c-2a8c6ec17ce3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:14.417645 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a109f341-9987-430e-854c-2a8c6ec17ce3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:14.425598 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a109f341-9987-430e-854c-2a8c6ec17ce3 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084348 Jul 27 20:37:14.426165 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1502/2993] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:14 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:14.605386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f101998c-0161-4958-9b69-58a8eebb774a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:14.605914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f101998c-0161-4958-9b69-58a8eebb774a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:14.612030 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f101998c-0161-4958-9b69-58a8eebb774a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:14.612474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f101998c-0161-4958-9b69-58a8eebb774a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:14.613254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f101998c-0161-4958-9b69-58a8eebb774a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:14.613687 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f101998c-0161-4958-9b69-58a8eebb774a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:14.746051 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f101998c-0161-4958-9b69-58a8eebb774a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:14.754555 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f101998c-0161-4958-9b69-58a8eebb774a tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.153300 Jul 27 20:37:14.755121 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1492/2994] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:14 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:15.294849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-18dcba0c-49ca-41dd-9250-86113824aa42 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:15.295473 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-18dcba0c-49ca-41dd-9250-86113824aa42 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:15.302240 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-18dcba0c-49ca-41dd-9250-86113824aa42 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:15.302701 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-18dcba0c-49ca-41dd-9250-86113824aa42 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:15.303478 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-18dcba0c-49ca-41dd-9250-86113824aa42 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:15.303923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-18dcba0c-49ca-41dd-9250-86113824aa42 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:15.364200 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-18dcba0c-49ca-41dd-9250-86113824aa42 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:15.372045 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-18dcba0c-49ca-41dd-9250-86113824aa42 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.081089 Jul 27 20:37:15.372602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1503/2995] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:15 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:15.447137 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0fb461e7-8ce2-4c74-8c9e-0599699239d6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:15.447747 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0fb461e7-8ce2-4c74-8c9e-0599699239d6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:15.455039 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0fb461e7-8ce2-4c74-8c9e-0599699239d6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:15.455486 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0fb461e7-8ce2-4c74-8c9e-0599699239d6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:15.456260 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0fb461e7-8ce2-4c74-8c9e-0599699239d6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:15.456698 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0fb461e7-8ce2-4c74-8c9e-0599699239d6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:15.475218 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:37:15.521705 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0fb461e7-8ce2-4c74-8c9e-0599699239d6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:15.529849 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0fb461e7-8ce2-4c74-8c9e-0599699239d6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.086476 Jul 27 20:37:15.530409 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1493/2996] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:15 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:15.774299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c0d2f291-4695-4893-b101-57a447e1dd06 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:15.774912 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c0d2f291-4695-4893-b101-57a447e1dd06 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:15.781014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c0d2f291-4695-4893-b101-57a447e1dd06 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:15.781469 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c0d2f291-4695-4893-b101-57a447e1dd06 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:15.782827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c0d2f291-4695-4893-b101-57a447e1dd06 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:15.783267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c0d2f291-4695-4893-b101-57a447e1dd06 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:16.162424 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c0d2f291-4695-4893-b101-57a447e1dd06 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:16.170387 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c0d2f291-4695-4893-b101-57a447e1dd06 tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.399924 Jul 27 20:37:16.170953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1504/2997] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:15 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:16.393630 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-50e6ced7-bf2c-4404-b7b3-f9e189180c47 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:16.394253 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-50e6ced7-bf2c-4404-b7b3-f9e189180c47 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:16.400479 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-50e6ced7-bf2c-4404-b7b3-f9e189180c47 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:16.400938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-50e6ced7-bf2c-4404-b7b3-f9e189180c47 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:16.401730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-50e6ced7-bf2c-4404-b7b3-f9e189180c47 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:16.402170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-50e6ced7-bf2c-4404-b7b3-f9e189180c47 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:16.464533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-50e6ced7-bf2c-4404-b7b3-f9e189180c47 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:16.473137 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-50e6ced7-bf2c-4404-b7b3-f9e189180c47 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.083932 Jul 27 20:37:16.473702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1494/2998] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:16 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:16.551132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-34a734d4-7ab7-4ed6-a9c0-306da399f3d0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:16.551757 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-34a734d4-7ab7-4ed6-a9c0-306da399f3d0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:16.558215 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-34a734d4-7ab7-4ed6-a9c0-306da399f3d0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:16.558668 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-34a734d4-7ab7-4ed6-a9c0-306da399f3d0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:16.559437 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-34a734d4-7ab7-4ed6-a9c0-306da399f3d0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:16.559878 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-34a734d4-7ab7-4ed6-a9c0-306da399f3d0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:16.620801 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-34a734d4-7ab7-4ed6-a9c0-306da399f3d0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:16.629336 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-34a734d4-7ab7-4ed6-a9c0-306da399f3d0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082077 Jul 27 20:37:16.629895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1505/2999] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:16 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:17.192247 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e42469c7-c2b2-4117-816e-69863393554e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:17.192852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e42469c7-c2b2-4117-816e-69863393554e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] [instance: e1fe489c-2f01-4942-ad86-cf5193eaac25] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:17.198834 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e42469c7-c2b2-4117-816e-69863393554e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:17.199278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e42469c7-c2b2-4117-816e-69863393554e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:17.200051 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e42469c7-c2b2-4117-816e-69863393554e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:17.200479 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e42469c7-c2b2-4117-816e-69863393554e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:17.331398 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e42469c7-c2b2-4117-816e-69863393554e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cc7b5ba908541cf929eaf10ba24e465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5acfaf1104da41f8ba35ddbebb79b506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:17.339281 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e42469c7-c2b2-4117-816e-69863393554e tempest-VolumesSnapshotTestJSON-804812837 tempest-VolumesSnapshotTestJSON-804812837-project] 10.222.0.65 "GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25" status: 200 len: 1559 microversion: 2.1 time: 0.151518 Jul 27 20:37:17.339841 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1495/3000] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:17 2022] GET /compute/v2.1/servers/e1fe489c-2f01-4942-ad86-cf5193eaac25 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:17.493247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d3f62abd-2be5-4907-806f-803d0c96b8f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:17.493869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d3f62abd-2be5-4907-806f-803d0c96b8f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] [instance: 8a92495d-74f4-4470-b9a4-919eb729c2a7] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:17.499969 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d3f62abd-2be5-4907-806f-803d0c96b8f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:17.500425 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d3f62abd-2be5-4907-806f-803d0c96b8f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:17.501982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d3f62abd-2be5-4907-806f-803d0c96b8f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:17.502429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d3f62abd-2be5-4907-806f-803d0c96b8f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:17.561462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d3f62abd-2be5-4907-806f-803d0c96b8f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fa85a53bfbe4ef5a36c01031f9016aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d888dcf554944adae3e03bc1c24c52b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:17.569961 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d3f62abd-2be5-4907-806f-803d0c96b8f1 tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7" status: 200 len: 1390 microversion: 2.1 time: 0.080757 Jul 27 20:37:17.570535 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1506/3001] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:17 2022] GET /compute/v2.1/servers/8a92495d-74f4-4470-b9a4-919eb729c2a7 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:17.590742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bf548598-56b5-4471-b937-95d02e2d85be tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] Calling method '.version_select at 0x7fc7f38f23a0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:17.612529 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bf548598-56b5-4471-b937-95d02e2d85be tempest-TestMinimumBasicScenario-1138539075 tempest-TestMinimumBasicScenario-1138539075-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1468549466" status: 202 len: 0 microversion: 2.1 time: 0.025632 Jul 27 20:37:17.613116 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1496/3002] 10.222.0.65 () {58 vars in 1272 bytes} [Wed Jul 27 20:37:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1468549466 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:37:17.650886 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-20564d86-cd94-42bc-85c1-1a024a030e13 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:17.651500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-20564d86-cd94-42bc-85c1-1a024a030e13 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:17.657859 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-20564d86-cd94-42bc-85c1-1a024a030e13 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:17.658289 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-20564d86-cd94-42bc-85c1-1a024a030e13 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:17.659060 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-20564d86-cd94-42bc-85c1-1a024a030e13 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:17.659501 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-20564d86-cd94-42bc-85c1-1a024a030e13 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:17.721671 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-20564d86-cd94-42bc-85c1-1a024a030e13 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:17.725481 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:37:17.731026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-20564d86-cd94-42bc-85c1-1a024a030e13 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083832 Jul 27 20:37:17.731758 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1507/3003] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:17 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:18.320156 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0cf93cb8-01a2-44b4-896c-388a72e2f5c6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:18.320782 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0cf93cb8-01a2-44b4-896c-388a72e2f5c6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:18.327094 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0cf93cb8-01a2-44b4-896c-388a72e2f5c6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:18.327547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0cf93cb8-01a2-44b4-896c-388a72e2f5c6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:18.328576 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0cf93cb8-01a2-44b4-896c-388a72e2f5c6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:18.329311 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0cf93cb8-01a2-44b4-896c-388a72e2f5c6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:18.356328 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0cf93cb8-01a2-44b4-896c-388a72e2f5c6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:37:18.442439 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0cf93cb8-01a2-44b4-896c-388a72e2f5c6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 204 len: 0 microversion: 2.20 time: 0.125818 Jul 27 20:37:18.443180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1497/3004] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Jul 27 20:37:18 2022] DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 20:37:18.451691 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ab3d6379-6d0b-4146-b2cf-e7864fab7cd8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:18.452498 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ab3d6379-6d0b-4146-b2cf-e7864fab7cd8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:18.453450 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c4e154c3-b087-48d8-a225-81612039388c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:18.454224 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c4e154c3-b087-48d8-a225-81612039388c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:18.459730 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ab3d6379-6d0b-4146-b2cf-e7864fab7cd8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:18.460209 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ab3d6379-6d0b-4146-b2cf-e7864fab7cd8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:18.461000 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ab3d6379-6d0b-4146-b2cf-e7864fab7cd8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:18.461631 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ab3d6379-6d0b-4146-b2cf-e7864fab7cd8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:18.464335 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c4e154c3-b087-48d8-a225-81612039388c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:18.464798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c4e154c3-b087-48d8-a225-81612039388c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:18.465605 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c4e154c3-b087-48d8-a225-81612039388c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:18.466045 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c4e154c3-b087-48d8-a225-81612039388c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:18.499545 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c4e154c3-b087-48d8-a225-81612039388c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:37:18.611042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c4e154c3-b087-48d8-a225-81612039388c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 204 len: 0 microversion: 2.1 time: 0.161695 Jul 27 20:37:18.615331 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1498/3005] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 20:37:18 2022] DELETE /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 27 20:37:18.624087 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-01f0c4d9-4e9f-4ad2-8e5e-5d5faff43648 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:18.625082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-01f0c4d9-4e9f-4ad2-8e5e-5d5faff43648 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:18.631472 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-01f0c4d9-4e9f-4ad2-8e5e-5d5faff43648 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:18.632163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-01f0c4d9-4e9f-4ad2-8e5e-5d5faff43648 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:18.633621 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-01f0c4d9-4e9f-4ad2-8e5e-5d5faff43648 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:18.634122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-01f0c4d9-4e9f-4ad2-8e5e-5d5faff43648 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:18.645399 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ab3d6379-6d0b-4146-b2cf-e7864fab7cd8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:18.654595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ab3d6379-6d0b-4146-b2cf-e7864fab7cd8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:18.656485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ab3d6379-6d0b-4146-b2cf-e7864fab7cd8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:18.658591 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ab3d6379-6d0b-4146-b2cf-e7864fab7cd8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.211220 Jul 27 20:37:18.659584 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1508/3006] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:18 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:37:18.753212 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-70a5323e-29e8-4485-ad84-2ff77dc1c649 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:18.753754 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-70a5323e-29e8-4485-ad84-2ff77dc1c649 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:18.759800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-70a5323e-29e8-4485-ad84-2ff77dc1c649 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:18.760261 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-70a5323e-29e8-4485-ad84-2ff77dc1c649 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:18.763480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-70a5323e-29e8-4485-ad84-2ff77dc1c649 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:18.763480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-70a5323e-29e8-4485-ad84-2ff77dc1c649 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:18.825255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-70a5323e-29e8-4485-ad84-2ff77dc1c649 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:18.834745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-70a5323e-29e8-4485-ad84-2ff77dc1c649 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085881 Jul 27 20:37:18.835319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1509/3007] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:18 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:18.866921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-01f0c4d9-4e9f-4ad2-8e5e-5d5faff43648 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:18.874934 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-01f0c4d9-4e9f-4ad2-8e5e-5d5faff43648 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.255103 Jul 27 20:37:18.875489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1499/3008] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:18 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:19.684491 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-87601c4c-bfec-4ad3-99a4-f07e47f92ea5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:19.685170 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-87601c4c-bfec-4ad3-99a4-f07e47f92ea5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:19.692815 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-87601c4c-bfec-4ad3-99a4-f07e47f92ea5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:19.693600 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-87601c4c-bfec-4ad3-99a4-f07e47f92ea5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:19.694737 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-87601c4c-bfec-4ad3-99a4-f07e47f92ea5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:19.695357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-87601c4c-bfec-4ad3-99a4-f07e47f92ea5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:19.843009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-87601c4c-bfec-4ad3-99a4-f07e47f92ea5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:19.851636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-87601c4c-bfec-4ad3-99a4-f07e47f92ea5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:19.853181 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-87601c4c-bfec-4ad3-99a4-f07e47f92ea5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:19.854359 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-87601c4c-bfec-4ad3-99a4-f07e47f92ea5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.174438 Jul 27 20:37:19.854914 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1510/3009] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:19 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:37:19.855831 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d2847616-323b-4f38-a7ca-a50750fe92fd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:19.857191 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d2847616-323b-4f38-a7ca-a50750fe92fd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:19.863828 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2847616-323b-4f38-a7ca-a50750fe92fd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:19.864274 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2847616-323b-4f38-a7ca-a50750fe92fd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:19.865430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2847616-323b-4f38-a7ca-a50750fe92fd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:19.865874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2847616-323b-4f38-a7ca-a50750fe92fd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:19.898087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-49dd8362-f4b5-493b-a16b-20eff423401f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:19.898975 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-49dd8362-f4b5-493b-a16b-20eff423401f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:19.905519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-49dd8362-f4b5-493b-a16b-20eff423401f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:19.906131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-49dd8362-f4b5-493b-a16b-20eff423401f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:19.906978 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-49dd8362-f4b5-493b-a16b-20eff423401f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:19.907427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-49dd8362-f4b5-493b-a16b-20eff423401f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:19.937381 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d2847616-323b-4f38-a7ca-a50750fe92fd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:19.946654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d2847616-323b-4f38-a7ca-a50750fe92fd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.094750 Jul 27 20:37:19.947579 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1500/3010] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:19 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:20.037984 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-49dd8362-f4b5-493b-a16b-20eff423401f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:20.045852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-49dd8362-f4b5-493b-a16b-20eff423401f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151691 Jul 27 20:37:20.046424 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1511/3011] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:19 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:20.881420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3f5a1922-efe5-489c-8ec8-9a774bd1a970 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:20.884345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3f5a1922-efe5-489c-8ec8-9a774bd1a970 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:20.893846 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3f5a1922-efe5-489c-8ec8-9a774bd1a970 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:20.894384 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3f5a1922-efe5-489c-8ec8-9a774bd1a970 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:20.895243 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3f5a1922-efe5-489c-8ec8-9a774bd1a970 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:20.895743 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3f5a1922-efe5-489c-8ec8-9a774bd1a970 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:20.968684 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-617a7f8c-fa24-487d-a558-307d070a4784 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:20.969466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-617a7f8c-fa24-487d-a558-307d070a4784 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:20.976130 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-617a7f8c-fa24-487d-a558-307d070a4784 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:20.976580 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-617a7f8c-fa24-487d-a558-307d070a4784 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:20.977375 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-617a7f8c-fa24-487d-a558-307d070a4784 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:20.977812 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-617a7f8c-fa24-487d-a558-307d070a4784 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:21.042242 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-617a7f8c-fa24-487d-a558-307d070a4784 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:21.050768 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-617a7f8c-fa24-487d-a558-307d070a4784 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.086017 Jul 27 20:37:21.051336 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1512/3012] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:20 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:21.067145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8b7c4bc8-c2d1-409a-b01e-0c7607608d0d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:21.067757 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8b7c4bc8-c2d1-409a-b01e-0c7607608d0d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:21.074260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8b7c4bc8-c2d1-409a-b01e-0c7607608d0d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:21.074720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8b7c4bc8-c2d1-409a-b01e-0c7607608d0d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:21.075492 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8b7c4bc8-c2d1-409a-b01e-0c7607608d0d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:21.075932 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8b7c4bc8-c2d1-409a-b01e-0c7607608d0d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:21.210274 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3f5a1922-efe5-489c-8ec8-9a774bd1a970 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:21.212722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8b7c4bc8-c2d1-409a-b01e-0c7607608d0d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:21.226066 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3f5a1922-efe5-489c-8ec8-9a774bd1a970 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:21.233085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8b7c4bc8-c2d1-409a-b01e-0c7607608d0d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.169029 Jul 27 20:37:21.233657 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3f5a1922-efe5-489c-8ec8-9a774bd1a970 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:21.233917 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1513/3013] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:21 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:21.237000 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3f5a1922-efe5-489c-8ec8-9a774bd1a970 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.362013 Jul 27 20:37:21.238288 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1501/3014] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:20 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:37:22.072259 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ebb03fe6-02e6-4f7f-879a-8b9782f24e0a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:22.072891 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ebb03fe6-02e6-4f7f-879a-8b9782f24e0a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:22.081870 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ebb03fe6-02e6-4f7f-879a-8b9782f24e0a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:22.082334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ebb03fe6-02e6-4f7f-879a-8b9782f24e0a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:22.083140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ebb03fe6-02e6-4f7f-879a-8b9782f24e0a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:22.083586 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ebb03fe6-02e6-4f7f-879a-8b9782f24e0a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:22.159398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ebb03fe6-02e6-4f7f-879a-8b9782f24e0a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:22.167507 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ebb03fe6-02e6-4f7f-879a-8b9782f24e0a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.099594 Jul 27 20:37:22.168210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1514/3015] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:22 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:22.254890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-47c3291c-464a-4ec8-8c73-e46d06b14e3e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:22.255646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-47c3291c-464a-4ec8-8c73-e46d06b14e3e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:22.260396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7779cfaa-885d-4233-bf1a-3c462538968f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:22.261308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7779cfaa-885d-4233-bf1a-3c462538968f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:22.262407 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-47c3291c-464a-4ec8-8c73-e46d06b14e3e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:22.262928 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-47c3291c-464a-4ec8-8c73-e46d06b14e3e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:22.263766 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-47c3291c-464a-4ec8-8c73-e46d06b14e3e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:22.264425 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-47c3291c-464a-4ec8-8c73-e46d06b14e3e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:22.267682 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7779cfaa-885d-4233-bf1a-3c462538968f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:22.268141 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7779cfaa-885d-4233-bf1a-3c462538968f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:22.269095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7779cfaa-885d-4233-bf1a-3c462538968f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:22.269543 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7779cfaa-885d-4233-bf1a-3c462538968f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:22.421276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7779cfaa-885d-4233-bf1a-3c462538968f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:22.433153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7779cfaa-885d-4233-bf1a-3c462538968f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:22.435525 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7779cfaa-885d-4233-bf1a-3c462538968f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:22.437038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7779cfaa-885d-4233-bf1a-3c462538968f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.180694 Jul 27 20:37:22.440350 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1515/3016] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:22 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:37:22.670356 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-47c3291c-464a-4ec8-8c73-e46d06b14e3e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:22.678371 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-47c3291c-464a-4ec8-8c73-e46d06b14e3e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.428430 Jul 27 20:37:22.678947 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1502/3017] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:22 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:23.188871 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0826d31a-be8f-47c4-878e-b10c2bd03fea tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:23.189637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0826d31a-be8f-47c4-878e-b10c2bd03fea tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:23.196262 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0826d31a-be8f-47c4-878e-b10c2bd03fea tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:23.196721 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0826d31a-be8f-47c4-878e-b10c2bd03fea tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:23.197531 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0826d31a-be8f-47c4-878e-b10c2bd03fea tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:23.197970 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0826d31a-be8f-47c4-878e-b10c2bd03fea tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:23.267002 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0826d31a-be8f-47c4-878e-b10c2bd03fea tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:23.275281 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0826d31a-be8f-47c4-878e-b10c2bd03fea tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.090601 Jul 27 20:37:23.275841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1516/3018] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:23 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:23.464451 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-34b1f254-9aa4-4f32-9f98-c34a073eeefe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:23.465151 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-34b1f254-9aa4-4f32-9f98-c34a073eeefe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:23.472240 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-34b1f254-9aa4-4f32-9f98-c34a073eeefe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:23.472769 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-34b1f254-9aa4-4f32-9f98-c34a073eeefe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:23.473628 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-34b1f254-9aa4-4f32-9f98-c34a073eeefe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:23.474119 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-34b1f254-9aa4-4f32-9f98-c34a073eeefe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:23.704143 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7bc7a882-f7d7-443d-b16a-da81caf7834a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:23.705237 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7bc7a882-f7d7-443d-b16a-da81caf7834a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:23.712121 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7bc7a882-f7d7-443d-b16a-da81caf7834a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:23.712588 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7bc7a882-f7d7-443d-b16a-da81caf7834a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:23.713386 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7bc7a882-f7d7-443d-b16a-da81caf7834a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:23.713832 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7bc7a882-f7d7-443d-b16a-da81caf7834a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:23.851424 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7bc7a882-f7d7-443d-b16a-da81caf7834a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:23.859657 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7bc7a882-f7d7-443d-b16a-da81caf7834a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.159877 Jul 27 20:37:23.866589 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1517/3019] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:23 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:23.881286 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-34b1f254-9aa4-4f32-9f98-c34a073eeefe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:23.889808 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-34b1f254-9aa4-4f32-9f98-c34a073eeefe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:23.892170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-34b1f254-9aa4-4f32-9f98-c34a073eeefe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:23.893340 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-34b1f254-9aa4-4f32-9f98-c34a073eeefe tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.433534 Jul 27 20:37:23.894095 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1503/3020] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:23 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:37:24.297920 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5c4a7876-28fe-4f85-83f2-5d6b46557cdb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:24.299512 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5c4a7876-28fe-4f85-83f2-5d6b46557cdb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:24.306707 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5c4a7876-28fe-4f85-83f2-5d6b46557cdb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:24.307185 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5c4a7876-28fe-4f85-83f2-5d6b46557cdb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:24.308239 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5c4a7876-28fe-4f85-83f2-5d6b46557cdb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:24.308958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5c4a7876-28fe-4f85-83f2-5d6b46557cdb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:24.383216 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5c4a7876-28fe-4f85-83f2-5d6b46557cdb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:24.391095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5c4a7876-28fe-4f85-83f2-5d6b46557cdb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.097901 Jul 27 20:37:24.392019 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1518/3021] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:24 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:24.883809 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-049031fa-69f3-4a61-be93-1a80c3c7825c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:24.884540 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-049031fa-69f3-4a61-be93-1a80c3c7825c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:24.892759 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-049031fa-69f3-4a61-be93-1a80c3c7825c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:24.893261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-049031fa-69f3-4a61-be93-1a80c3c7825c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:24.894031 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-049031fa-69f3-4a61-be93-1a80c3c7825c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:24.894470 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-049031fa-69f3-4a61-be93-1a80c3c7825c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:24.918814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9892c579-6050-4eda-b2fa-c99a84e96927 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:24.920554 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9892c579-6050-4eda-b2fa-c99a84e96927 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:24.930405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9892c579-6050-4eda-b2fa-c99a84e96927 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:24.931872 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9892c579-6050-4eda-b2fa-c99a84e96927 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:24.932764 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9892c579-6050-4eda-b2fa-c99a84e96927 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:24.933895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9892c579-6050-4eda-b2fa-c99a84e96927 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:25.119694 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9892c579-6050-4eda-b2fa-c99a84e96927 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:25.130952 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9892c579-6050-4eda-b2fa-c99a84e96927 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:25.132555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9892c579-6050-4eda-b2fa-c99a84e96927 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:25.133771 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9892c579-6050-4eda-b2fa-c99a84e96927 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.220871 Jul 27 20:37:25.134671 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1519/3022] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:24 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:37:25.164081 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-049031fa-69f3-4a61-be93-1a80c3c7825c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:25.174004 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-049031fa-69f3-4a61-be93-1a80c3c7825c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.294397 Jul 27 20:37:25.174841 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1504/3023] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:24 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:25.418611 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0db72595-bb50-4d7c-b3f1-f114b53f0e68 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:25.419836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0db72595-bb50-4d7c-b3f1-f114b53f0e68 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:25.427674 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0db72595-bb50-4d7c-b3f1-f114b53f0e68 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:25.428568 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0db72595-bb50-4d7c-b3f1-f114b53f0e68 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:25.429994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0db72595-bb50-4d7c-b3f1-f114b53f0e68 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:25.430810 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0db72595-bb50-4d7c-b3f1-f114b53f0e68 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:25.499543 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0db72595-bb50-4d7c-b3f1-f114b53f0e68 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:25.509211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0db72595-bb50-4d7c-b3f1-f114b53f0e68 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.096274 Jul 27 20:37:25.509853 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1520/3024] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:25 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:26.158509 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6ab33704-0f6d-42d4-831a-a78da1a65cd7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:26.159108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6ab33704-0f6d-42d4-831a-a78da1a65cd7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:26.165749 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ab33704-0f6d-42d4-831a-a78da1a65cd7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:26.166209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ab33704-0f6d-42d4-831a-a78da1a65cd7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:26.166978 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ab33704-0f6d-42d4-831a-a78da1a65cd7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:26.167417 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ab33704-0f6d-42d4-831a-a78da1a65cd7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:26.195499 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9e5f979e-ae9e-485d-98a9-cbdda2b76f69 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:26.196116 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9e5f979e-ae9e-485d-98a9-cbdda2b76f69 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:26.202602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9e5f979e-ae9e-485d-98a9-cbdda2b76f69 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:26.203334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9e5f979e-ae9e-485d-98a9-cbdda2b76f69 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:26.204640 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9e5f979e-ae9e-485d-98a9-cbdda2b76f69 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:26.205177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9e5f979e-ae9e-485d-98a9-cbdda2b76f69 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:26.338801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6ab33704-0f6d-42d4-831a-a78da1a65cd7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:26.339630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9e5f979e-ae9e-485d-98a9-cbdda2b76f69 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:26.348324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6ab33704-0f6d-42d4-831a-a78da1a65cd7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:26.349561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9e5f979e-ae9e-485d-98a9-cbdda2b76f69 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.158542 Jul 27 20:37:26.350003 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6ab33704-0f6d-42d4-831a-a78da1a65cd7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:26.350290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1521/3025] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:26 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:26.363879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6ab33704-0f6d-42d4-831a-a78da1a65cd7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.209833 Jul 27 20:37:26.364567 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1505/3026] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:26 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:37:26.529912 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e4a4bef7-bda8-4425-817e-675563d51e9b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:26.530531 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e4a4bef7-bda8-4425-817e-675563d51e9b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:26.537703 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4a4bef7-bda8-4425-817e-675563d51e9b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:26.538178 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4a4bef7-bda8-4425-817e-675563d51e9b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:26.538921 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4a4bef7-bda8-4425-817e-675563d51e9b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:26.539360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4a4bef7-bda8-4425-817e-675563d51e9b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:26.602989 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e4a4bef7-bda8-4425-817e-675563d51e9b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:26.612875 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e4a4bef7-bda8-4425-817e-675563d51e9b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.086713 Jul 27 20:37:26.624996 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1522/3027] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:26 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:27.371932 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f66d24b4-1879-4396-bd07-1984edd74ce9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:27.372459 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f66d24b4-1879-4396-bd07-1984edd74ce9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:27.379567 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f66d24b4-1879-4396-bd07-1984edd74ce9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:27.380024 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f66d24b4-1879-4396-bd07-1984edd74ce9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:27.380783 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f66d24b4-1879-4396-bd07-1984edd74ce9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:27.382640 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f66d24b4-1879-4396-bd07-1984edd74ce9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:27.387672 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fdb74165-fe77-4339-9b66-2622a402b937 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:27.388324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fdb74165-fe77-4339-9b66-2622a402b937 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:27.395412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fdb74165-fe77-4339-9b66-2622a402b937 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:27.395871 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fdb74165-fe77-4339-9b66-2622a402b937 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:27.396644 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fdb74165-fe77-4339-9b66-2622a402b937 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:27.397117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fdb74165-fe77-4339-9b66-2622a402b937 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:27.515631 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f66d24b4-1879-4396-bd07-1984edd74ce9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:27.524925 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f66d24b4-1879-4396-bd07-1984edd74ce9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.156824 Jul 27 20:37:27.525614 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1506/3028] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:27 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:27.535508 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fdb74165-fe77-4339-9b66-2622a402b937 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:27.544393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fdb74165-fe77-4339-9b66-2622a402b937 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:27.545946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fdb74165-fe77-4339-9b66-2622a402b937 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:27.547143 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fdb74165-fe77-4339-9b66-2622a402b937 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.163466 Jul 27 20:37:27.547711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1523/3029] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:27 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:37:27.634835 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-05447d2c-fa15-4a4b-9863-1ac532e7d656 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:27.635483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-05447d2c-fa15-4a4b-9863-1ac532e7d656 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:27.642043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05447d2c-fa15-4a4b-9863-1ac532e7d656 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:27.642486 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05447d2c-fa15-4a4b-9863-1ac532e7d656 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:27.643245 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05447d2c-fa15-4a4b-9863-1ac532e7d656 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:27.643687 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05447d2c-fa15-4a4b-9863-1ac532e7d656 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:27.704252 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-05447d2c-fa15-4a4b-9863-1ac532e7d656 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:27.707725 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:37:27.713055 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-05447d2c-fa15-4a4b-9863-1ac532e7d656 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082034 Jul 27 20:37:27.713615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1507/3030] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:27 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:28.546930 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-795dec0e-787c-48e0-a7bc-a66fc332b079 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:28.548259 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-795dec0e-787c-48e0-a7bc-a66fc332b079 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:28.554837 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-795dec0e-787c-48e0-a7bc-a66fc332b079 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:28.555292 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-795dec0e-787c-48e0-a7bc-a66fc332b079 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:28.556056 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-795dec0e-787c-48e0-a7bc-a66fc332b079 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:28.556502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-795dec0e-787c-48e0-a7bc-a66fc332b079 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:28.570792 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-95ea3836-9c4d-462b-8c81-68507f4f706d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:28.571459 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-95ea3836-9c4d-462b-8c81-68507f4f706d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:28.576402 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:37:28.578974 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95ea3836-9c4d-462b-8c81-68507f4f706d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:28.579436 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95ea3836-9c4d-462b-8c81-68507f4f706d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:28.580187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95ea3836-9c4d-462b-8c81-68507f4f706d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:28.580620 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95ea3836-9c4d-462b-8c81-68507f4f706d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:28.688474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-795dec0e-787c-48e0-a7bc-a66fc332b079 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:28.696625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-795dec0e-787c-48e0-a7bc-a66fc332b079 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153533 Jul 27 20:37:28.697227 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1524/3031] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:28 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:28.716076 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-95ea3836-9c4d-462b-8c81-68507f4f706d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:28.727430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-95ea3836-9c4d-462b-8c81-68507f4f706d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:28.729519 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-95ea3836-9c4d-462b-8c81-68507f4f706d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:28.730711 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-95ea3836-9c4d-462b-8c81-68507f4f706d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.164336 Jul 27 20:37:28.731261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1508/3032] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:28 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:37:28.734594 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a7840b8d-c834-496b-839c-e7f95e915247 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:28.736139 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a7840b8d-c834-496b-839c-e7f95e915247 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:28.742326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a7840b8d-c834-496b-839c-e7f95e915247 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:28.742751 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a7840b8d-c834-496b-839c-e7f95e915247 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:28.743515 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a7840b8d-c834-496b-839c-e7f95e915247 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:28.743956 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a7840b8d-c834-496b-839c-e7f95e915247 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:28.806848 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a7840b8d-c834-496b-839c-e7f95e915247 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:28.814861 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a7840b8d-c834-496b-839c-e7f95e915247 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084391 Jul 27 20:37:28.815421 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1525/3033] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:28 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:29.717848 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0b875860-8600-404f-8491-6a9b7c23b9c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:29.718459 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0b875860-8600-404f-8491-6a9b7c23b9c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:29.724889 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b875860-8600-404f-8491-6a9b7c23b9c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:29.725367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b875860-8600-404f-8491-6a9b7c23b9c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:29.726136 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b875860-8600-404f-8491-6a9b7c23b9c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:29.726577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b875860-8600-404f-8491-6a9b7c23b9c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:29.755169 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7e2a6c25-c353-4b8a-a728-0913c082e1cf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:29.755790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7e2a6c25-c353-4b8a-a728-0913c082e1cf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:29.762588 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7e2a6c25-c353-4b8a-a728-0913c082e1cf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:29.763038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7e2a6c25-c353-4b8a-a728-0913c082e1cf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:29.763809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7e2a6c25-c353-4b8a-a728-0913c082e1cf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:29.764249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7e2a6c25-c353-4b8a-a728-0913c082e1cf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:29.856657 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0b875860-8600-404f-8491-6a9b7c23b9c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:29.865237 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0b875860-8600-404f-8491-6a9b7c23b9c5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151206 Jul 27 20:37:29.865795 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1509/3034] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:29 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:29.870394 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-87b005c1-79be-4276-9855-08a3b178cdb7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:29.870991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-87b005c1-79be-4276-9855-08a3b178cdb7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:29.877505 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87b005c1-79be-4276-9855-08a3b178cdb7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:29.877959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87b005c1-79be-4276-9855-08a3b178cdb7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:29.878711 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87b005c1-79be-4276-9855-08a3b178cdb7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:29.879326 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87b005c1-79be-4276-9855-08a3b178cdb7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:29.899866 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7e2a6c25-c353-4b8a-a728-0913c082e1cf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:29.908544 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7e2a6c25-c353-4b8a-a728-0913c082e1cf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:29.910072 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7e2a6c25-c353-4b8a-a728-0913c082e1cf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:29.911242 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7e2a6c25-c353-4b8a-a728-0913c082e1cf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.160605 Jul 27 20:37:29.911797 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1526/3035] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:29 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:37:29.943734 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-87b005c1-79be-4276-9855-08a3b178cdb7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:29.951599 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-87b005c1-79be-4276-9855-08a3b178cdb7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084715 Jul 27 20:37:29.952174 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1510/3036] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:29 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:30.887575 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cc6f5991-33bd-47ed-b381-b1ca385e1190 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:30.888196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cc6f5991-33bd-47ed-b381-b1ca385e1190 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:30.895505 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc6f5991-33bd-47ed-b381-b1ca385e1190 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:30.895956 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc6f5991-33bd-47ed-b381-b1ca385e1190 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:30.896724 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc6f5991-33bd-47ed-b381-b1ca385e1190 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:30.897203 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc6f5991-33bd-47ed-b381-b1ca385e1190 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:30.934807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b16e70f6-c53f-4670-baeb-459845e4469f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:30.935448 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b16e70f6-c53f-4670-baeb-459845e4469f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:30.942433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b16e70f6-c53f-4670-baeb-459845e4469f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:30.942880 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b16e70f6-c53f-4670-baeb-459845e4469f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:30.943640 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b16e70f6-c53f-4670-baeb-459845e4469f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:30.944072 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b16e70f6-c53f-4670-baeb-459845e4469f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:31.026747 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cc6f5991-33bd-47ed-b381-b1ca385e1190 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:31.035341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cc6f5991-33bd-47ed-b381-b1ca385e1190 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151592 Jul 27 20:37:31.036014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1527/3037] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:30 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:31.041184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a0112c4b-dc84-42b5-aac2-19f53cc19bbe tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:31.041184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a0112c4b-dc84-42b5-aac2-19f53cc19bbe tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:31.047601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a0112c4b-dc84-42b5-aac2-19f53cc19bbe tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:31.048231 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a0112c4b-dc84-42b5-aac2-19f53cc19bbe tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:31.049387 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a0112c4b-dc84-42b5-aac2-19f53cc19bbe tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:31.049839 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a0112c4b-dc84-42b5-aac2-19f53cc19bbe tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:31.075430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b16e70f6-c53f-4670-baeb-459845e4469f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:31.084923 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b16e70f6-c53f-4670-baeb-459845e4469f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:31.086440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b16e70f6-c53f-4670-baeb-459845e4469f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:31.087612 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b16e70f6-c53f-4670-baeb-459845e4469f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156633 Jul 27 20:37:31.088170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1511/3038] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:30 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:37:31.117366 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a0112c4b-dc84-42b5-aac2-19f53cc19bbe tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:31.125290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a0112c4b-dc84-42b5-aac2-19f53cc19bbe tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.088223 Jul 27 20:37:31.126420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1528/3039] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:31 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:32.057322 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f8dfb15a-d96f-41c9-930f-c27f8d3cd5e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:32.057863 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f8dfb15a-d96f-41c9-930f-c27f8d3cd5e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:32.064879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8dfb15a-d96f-41c9-930f-c27f8d3cd5e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:32.065357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8dfb15a-d96f-41c9-930f-c27f8d3cd5e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:32.066132 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8dfb15a-d96f-41c9-930f-c27f8d3cd5e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:32.066578 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8dfb15a-d96f-41c9-930f-c27f8d3cd5e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:32.111386 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bb95bbbc-d2f5-42e6-955a-7805d4caba33 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:32.111999 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bb95bbbc-d2f5-42e6-955a-7805d4caba33 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:32.118481 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb95bbbc-d2f5-42e6-955a-7805d4caba33 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:32.118924 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb95bbbc-d2f5-42e6-955a-7805d4caba33 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:32.119681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb95bbbc-d2f5-42e6-955a-7805d4caba33 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:32.120115 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb95bbbc-d2f5-42e6-955a-7805d4caba33 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:32.205047 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f8dfb15a-d96f-41c9-930f-c27f8d3cd5e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:32.213221 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f8dfb15a-d96f-41c9-930f-c27f8d3cd5e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.159768 Jul 27 20:37:32.213980 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1512/3040] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:32 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:32.218479 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bebc87fa-0367-4c52-b055-34f479eed714 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:32.219204 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bebc87fa-0367-4c52-b055-34f479eed714 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:32.225606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bebc87fa-0367-4c52-b055-34f479eed714 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:32.226133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bebc87fa-0367-4c52-b055-34f479eed714 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:32.226972 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bebc87fa-0367-4c52-b055-34f479eed714 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:32.227482 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bebc87fa-0367-4c52-b055-34f479eed714 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:32.254022 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bb95bbbc-d2f5-42e6-955a-7805d4caba33 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:32.262383 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bb95bbbc-d2f5-42e6-955a-7805d4caba33 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:32.263866 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bb95bbbc-d2f5-42e6-955a-7805d4caba33 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:32.265060 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bb95bbbc-d2f5-42e6-955a-7805d4caba33 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.158283 Jul 27 20:37:32.265617 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1529/3041] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:32 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:37:32.292884 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bebc87fa-0367-4c52-b055-34f479eed714 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:32.301036 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bebc87fa-0367-4c52-b055-34f479eed714 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085992 Jul 27 20:37:32.301599 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1513/3042] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:32 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:33.235756 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-613caa7c-a212-4d37-b898-94dcb27000a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:33.236401 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-613caa7c-a212-4d37-b898-94dcb27000a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:33.238261 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=88 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:37:33.243846 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-613caa7c-a212-4d37-b898-94dcb27000a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:33.244294 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-613caa7c-a212-4d37-b898-94dcb27000a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:33.245081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-613caa7c-a212-4d37-b898-94dcb27000a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:33.245521 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-613caa7c-a212-4d37-b898-94dcb27000a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:33.288780 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-aa5358cd-741b-470c-9fe6-93fcfabf47a2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:33.289422 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-aa5358cd-741b-470c-9fe6-93fcfabf47a2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:33.291686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:37:33.297317 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa5358cd-741b-470c-9fe6-93fcfabf47a2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:33.298307 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa5358cd-741b-470c-9fe6-93fcfabf47a2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:33.299062 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa5358cd-741b-470c-9fe6-93fcfabf47a2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:33.299495 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa5358cd-741b-470c-9fe6-93fcfabf47a2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:33.375333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-613caa7c-a212-4d37-b898-94dcb27000a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:33.383582 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-613caa7c-a212-4d37-b898-94dcb27000a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152424 Jul 27 20:37:33.384385 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1530/3043] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:33 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:33.388643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cfa394a5-df72-4803-8c0a-cb638636a649 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:33.389277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cfa394a5-df72-4803-8c0a-cb638636a649 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:33.395625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cfa394a5-df72-4803-8c0a-cb638636a649 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:33.396087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cfa394a5-df72-4803-8c0a-cb638636a649 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:33.396857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cfa394a5-df72-4803-8c0a-cb638636a649 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:33.397326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cfa394a5-df72-4803-8c0a-cb638636a649 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:33.436622 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aa5358cd-741b-470c-9fe6-93fcfabf47a2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:33.445454 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aa5358cd-741b-470c-9fe6-93fcfabf47a2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:33.446993 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aa5358cd-741b-470c-9fe6-93fcfabf47a2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:33.448194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-aa5358cd-741b-470c-9fe6-93fcfabf47a2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.163325 Jul 27 20:37:33.448747 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1514/3044] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:33 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:37:33.462199 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cfa394a5-df72-4803-8c0a-cb638636a649 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:33.470761 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cfa394a5-df72-4803-8c0a-cb638636a649 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085660 Jul 27 20:37:33.471319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1531/3045] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:33 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:34.405106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-206773cf-88ff-4d91-8c04-0fa23b63ed88 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:34.405732 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-206773cf-88ff-4d91-8c04-0fa23b63ed88 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:34.412862 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-206773cf-88ff-4d91-8c04-0fa23b63ed88 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:34.413354 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-206773cf-88ff-4d91-8c04-0fa23b63ed88 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:34.414121 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-206773cf-88ff-4d91-8c04-0fa23b63ed88 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:34.414564 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-206773cf-88ff-4d91-8c04-0fa23b63ed88 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:34.472737 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e4ad49e0-2486-4a67-a635-89c487ca86f0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:34.473532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e4ad49e0-2486-4a67-a635-89c487ca86f0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:34.480083 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4ad49e0-2486-4a67-a635-89c487ca86f0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:34.480535 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4ad49e0-2486-4a67-a635-89c487ca86f0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:34.481325 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4ad49e0-2486-4a67-a635-89c487ca86f0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:34.481765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4ad49e0-2486-4a67-a635-89c487ca86f0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:34.546299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-206773cf-88ff-4d91-8c04-0fa23b63ed88 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:34.554299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-206773cf-88ff-4d91-8c04-0fa23b63ed88 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153273 Jul 27 20:37:34.554870 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1515/3046] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:34 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:34.559735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b449f825-650a-4bec-8630-242c8a533e27 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:34.560115 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b449f825-650a-4bec-8630-242c8a533e27 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:34.566394 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b449f825-650a-4bec-8630-242c8a533e27 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:34.566847 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b449f825-650a-4bec-8630-242c8a533e27 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:34.567605 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b449f825-650a-4bec-8630-242c8a533e27 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:34.568043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b449f825-650a-4bec-8630-242c8a533e27 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:34.613546 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e4ad49e0-2486-4a67-a635-89c487ca86f0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:34.622008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e4ad49e0-2486-4a67-a635-89c487ca86f0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:34.623520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e4ad49e0-2486-4a67-a635-89c487ca86f0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:34.624729 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e4ad49e0-2486-4a67-a635-89c487ca86f0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156621 Jul 27 20:37:34.625866 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1532/3047] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:34 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:37:34.634844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b449f825-650a-4bec-8630-242c8a533e27 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:34.643436 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b449f825-650a-4bec-8630-242c8a533e27 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.087629 Jul 27 20:37:34.643988 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1516/3048] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:34 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:35.575708 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-26b2ec05-ce5a-44fd-9f6c-f2f8bba3e198 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:35.576319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-26b2ec05-ce5a-44fd-9f6c-f2f8bba3e198 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:35.583128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-26b2ec05-ce5a-44fd-9f6c-f2f8bba3e198 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:35.583583 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-26b2ec05-ce5a-44fd-9f6c-f2f8bba3e198 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:35.584334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-26b2ec05-ce5a-44fd-9f6c-f2f8bba3e198 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:35.584772 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-26b2ec05-ce5a-44fd-9f6c-f2f8bba3e198 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:35.651513 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-89e8365c-4c41-4c4b-aa70-fc895746ecf8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:35.652139 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-89e8365c-4c41-4c4b-aa70-fc895746ecf8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:35.660155 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-89e8365c-4c41-4c4b-aa70-fc895746ecf8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:35.660607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-89e8365c-4c41-4c4b-aa70-fc895746ecf8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:35.661865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-89e8365c-4c41-4c4b-aa70-fc895746ecf8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:35.661865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-89e8365c-4c41-4c4b-aa70-fc895746ecf8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:35.718709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-26b2ec05-ce5a-44fd-9f6c-f2f8bba3e198 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:35.727250 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-26b2ec05-ce5a-44fd-9f6c-f2f8bba3e198 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.155455 Jul 27 20:37:35.727821 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1533/3049] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:35 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:35.733457 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d7738835-6d1b-4506-acf1-9ad4ca638cd0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:35.734264 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d7738835-6d1b-4506-acf1-9ad4ca638cd0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:35.741399 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d7738835-6d1b-4506-acf1-9ad4ca638cd0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:35.741873 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d7738835-6d1b-4506-acf1-9ad4ca638cd0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:35.742747 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d7738835-6d1b-4506-acf1-9ad4ca638cd0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:35.743264 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d7738835-6d1b-4506-acf1-9ad4ca638cd0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:35.802969 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-89e8365c-4c41-4c4b-aa70-fc895746ecf8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:35.809351 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d7738835-6d1b-4506-acf1-9ad4ca638cd0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:35.811675 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-89e8365c-4c41-4c4b-aa70-fc895746ecf8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:35.813372 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-89e8365c-4c41-4c4b-aa70-fc895746ecf8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:35.814528 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-89e8365c-4c41-4c4b-aa70-fc895746ecf8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.166921 Jul 27 20:37:35.815078 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1517/3050] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:35 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:37:35.817350 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d7738835-6d1b-4506-acf1-9ad4ca638cd0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.087500 Jul 27 20:37:35.817911 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1534/3051] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:35 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:36.751064 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ee9e9bef-4f55-49ce-9424-f525cf2bd84f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:36.751701 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ee9e9bef-4f55-49ce-9424-f525cf2bd84f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:36.758215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee9e9bef-4f55-49ce-9424-f525cf2bd84f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:36.758671 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee9e9bef-4f55-49ce-9424-f525cf2bd84f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:36.759441 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee9e9bef-4f55-49ce-9424-f525cf2bd84f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:36.759880 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee9e9bef-4f55-49ce-9424-f525cf2bd84f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:36.838402 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5b48c8d6-6602-46f1-85b5-707945fa1180 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:36.839024 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5b48c8d6-6602-46f1-85b5-707945fa1180 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:36.846068 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5b48c8d6-6602-46f1-85b5-707945fa1180 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:36.846525 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5b48c8d6-6602-46f1-85b5-707945fa1180 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:36.847302 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5b48c8d6-6602-46f1-85b5-707945fa1180 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:36.847745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5b48c8d6-6602-46f1-85b5-707945fa1180 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:36.886419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ee9e9bef-4f55-49ce-9424-f525cf2bd84f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:36.895079 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ee9e9bef-4f55-49ce-9424-f525cf2bd84f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148650 Jul 27 20:37:36.895854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1518/3052] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:36 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:36.900358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-38fa3b02-ada2-43c7-9665-761d8722bd1b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:36.900984 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-38fa3b02-ada2-43c7-9665-761d8722bd1b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:36.909360 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-38fa3b02-ada2-43c7-9665-761d8722bd1b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:36.909823 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-38fa3b02-ada2-43c7-9665-761d8722bd1b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:36.910602 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-38fa3b02-ada2-43c7-9665-761d8722bd1b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:36.911044 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-38fa3b02-ada2-43c7-9665-761d8722bd1b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:36.925395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5b48c8d6-6602-46f1-85b5-707945fa1180 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:36.933375 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5b48c8d6-6602-46f1-85b5-707945fa1180 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.098788 Jul 27 20:37:36.934214 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1535/3053] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:36 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:37.044019 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-38fa3b02-ada2-43c7-9665-761d8722bd1b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:37.053177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-38fa3b02-ada2-43c7-9665-761d8722bd1b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:37.054679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-38fa3b02-ada2-43c7-9665-761d8722bd1b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:37.055845 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-38fa3b02-ada2-43c7-9665-761d8722bd1b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.159194 Jul 27 20:37:37.056402 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1519/3054] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:36 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:37:37.917444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6ab0767b-af89-4cc3-86a8-c2af17b9e4cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:37.918119 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6ab0767b-af89-4cc3-86a8-c2af17b9e4cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:37.925434 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ab0767b-af89-4cc3-86a8-c2af17b9e4cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:37.925892 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ab0767b-af89-4cc3-86a8-c2af17b9e4cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:37.926666 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ab0767b-af89-4cc3-86a8-c2af17b9e4cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:37.927109 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ab0767b-af89-4cc3-86a8-c2af17b9e4cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:37.955294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-52a3de54-fe8e-4c91-b889-eb7083569f28 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:37.956038 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-52a3de54-fe8e-4c91-b889-eb7083569f28 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:37.962532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-52a3de54-fe8e-4c91-b889-eb7083569f28 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:37.962975 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-52a3de54-fe8e-4c91-b889-eb7083569f28 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:37.963734 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-52a3de54-fe8e-4c91-b889-eb7083569f28 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:37.964170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-52a3de54-fe8e-4c91-b889-eb7083569f28 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:38.027039 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-52a3de54-fe8e-4c91-b889-eb7083569f28 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:38.035400 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-52a3de54-fe8e-4c91-b889-eb7083569f28 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084221 Jul 27 20:37:38.036286 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1520/3055] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:37 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:38.059780 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6ab0767b-af89-4cc3-86a8-c2af17b9e4cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:38.067783 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6ab0767b-af89-4cc3-86a8-c2af17b9e4cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.154508 Jul 27 20:37:38.068360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1536/3056] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:37 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:38.080195 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-19fbd2ec-bab4-4534-a39d-5cf409e1bd75 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:38.080810 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-19fbd2ec-bab4-4534-a39d-5cf409e1bd75 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:38.086935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19fbd2ec-bab4-4534-a39d-5cf409e1bd75 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:38.087415 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19fbd2ec-bab4-4534-a39d-5cf409e1bd75 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:38.088178 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19fbd2ec-bab4-4534-a39d-5cf409e1bd75 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:38.088617 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19fbd2ec-bab4-4534-a39d-5cf409e1bd75 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:38.215826 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-19fbd2ec-bab4-4534-a39d-5cf409e1bd75 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:38.224697 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-19fbd2ec-bab4-4534-a39d-5cf409e1bd75 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:38.226215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-19fbd2ec-bab4-4534-a39d-5cf409e1bd75 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:38.227369 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-19fbd2ec-bab4-4534-a39d-5cf409e1bd75 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152127 Jul 27 20:37:38.227920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1521/3057] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:38 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:37:39.056160 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-08b84d2f-b893-480d-bec5-3df8b9edbfce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:39.056777 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-08b84d2f-b893-480d-bec5-3df8b9edbfce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:39.063945 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-08b84d2f-b893-480d-bec5-3df8b9edbfce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:39.064401 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-08b84d2f-b893-480d-bec5-3df8b9edbfce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:39.065196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-08b84d2f-b893-480d-bec5-3df8b9edbfce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:39.065644 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-08b84d2f-b893-480d-bec5-3df8b9edbfce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:39.090138 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0cb37832-e45c-47fc-a858-5b69557444e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:39.090773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0cb37832-e45c-47fc-a858-5b69557444e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:39.098198 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0cb37832-e45c-47fc-a858-5b69557444e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:39.098643 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0cb37832-e45c-47fc-a858-5b69557444e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:39.099397 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0cb37832-e45c-47fc-a858-5b69557444e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:39.099827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0cb37832-e45c-47fc-a858-5b69557444e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:39.133211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-08b84d2f-b893-480d-bec5-3df8b9edbfce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:39.141377 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-08b84d2f-b893-480d-bec5-3df8b9edbfce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.089037 Jul 27 20:37:39.141956 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1537/3058] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:39 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:39.238967 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0cb37832-e45c-47fc-a858-5b69557444e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:39.251045 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7b7bab81-2d18-4403-88b7-9793e280973f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:39.251877 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0cb37832-e45c-47fc-a858-5b69557444e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.164187 Jul 27 20:37:39.252018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7b7bab81-2d18-4403-88b7-9793e280973f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:39.252462 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1522/3059] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:39 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:39.258092 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7b7bab81-2d18-4403-88b7-9793e280973f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:39.258547 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7b7bab81-2d18-4403-88b7-9793e280973f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:39.259319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7b7bab81-2d18-4403-88b7-9793e280973f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:39.259764 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7b7bab81-2d18-4403-88b7-9793e280973f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:39.388799 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7b7bab81-2d18-4403-88b7-9793e280973f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:39.397138 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7b7bab81-2d18-4403-88b7-9793e280973f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:39.398634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7b7bab81-2d18-4403-88b7-9793e280973f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:39.399781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7b7bab81-2d18-4403-88b7-9793e280973f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153274 Jul 27 20:37:39.400335 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1538/3060] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:39 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:37:40.162795 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-05dc2da1-fad1-4046-83be-066dbe64d3aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:40.163421 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-05dc2da1-fad1-4046-83be-066dbe64d3aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:40.169892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05dc2da1-fad1-4046-83be-066dbe64d3aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:40.170341 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05dc2da1-fad1-4046-83be-066dbe64d3aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:40.171098 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05dc2da1-fad1-4046-83be-066dbe64d3aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:40.171531 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05dc2da1-fad1-4046-83be-066dbe64d3aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:40.261405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-05dc2da1-fad1-4046-83be-066dbe64d3aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:40.271290 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-05dc2da1-fad1-4046-83be-066dbe64d3aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.112326 Jul 27 20:37:40.272073 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1523/3061] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:40 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:40.273565 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ea476fa5-8dbf-4d14-ac94-95ca226e12b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:40.274279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ea476fa5-8dbf-4d14-ac94-95ca226e12b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:40.287799 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ea476fa5-8dbf-4d14-ac94-95ca226e12b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:40.288272 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ea476fa5-8dbf-4d14-ac94-95ca226e12b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:40.289088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ea476fa5-8dbf-4d14-ac94-95ca226e12b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:40.289536 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ea476fa5-8dbf-4d14-ac94-95ca226e12b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:40.423820 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d4ae7811-1065-41db-9521-1b1edaabef8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:40.424421 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d4ae7811-1065-41db-9521-1b1edaabef8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:40.426896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ea476fa5-8dbf-4d14-ac94-95ca226e12b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:40.430606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4ae7811-1065-41db-9521-1b1edaabef8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:40.431135 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4ae7811-1065-41db-9521-1b1edaabef8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:40.431955 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4ae7811-1065-41db-9521-1b1edaabef8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:40.432454 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4ae7811-1065-41db-9521-1b1edaabef8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:40.434890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ea476fa5-8dbf-4d14-ac94-95ca226e12b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.165527 Jul 27 20:37:40.435468 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1539/3062] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:40 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:40.450500 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:37:40.564005 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d4ae7811-1065-41db-9521-1b1edaabef8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:40.572347 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d4ae7811-1065-41db-9521-1b1edaabef8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:40.573878 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d4ae7811-1065-41db-9521-1b1edaabef8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:40.575042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d4ae7811-1065-41db-9521-1b1edaabef8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155199 Jul 27 20:37:40.575593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1524/3063] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:40 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:37:41.308397 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-44bdc6aa-8319-4271-aef1-786f4a9826cd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:41.309045 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-44bdc6aa-8319-4271-aef1-786f4a9826cd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:41.316598 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-44bdc6aa-8319-4271-aef1-786f4a9826cd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:41.317086 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-44bdc6aa-8319-4271-aef1-786f4a9826cd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:41.317858 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-44bdc6aa-8319-4271-aef1-786f4a9826cd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:41.318302 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-44bdc6aa-8319-4271-aef1-786f4a9826cd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:41.380541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-44bdc6aa-8319-4271-aef1-786f4a9826cd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:41.388451 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-44bdc6aa-8319-4271-aef1-786f4a9826cd tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083980 Jul 27 20:37:41.389035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1540/3064] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:41 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:41.456855 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-eef08e61-0539-4819-9c0d-73717e83ca0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:41.457503 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-eef08e61-0539-4819-9c0d-73717e83ca0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:41.464106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eef08e61-0539-4819-9c0d-73717e83ca0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:41.464567 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eef08e61-0539-4819-9c0d-73717e83ca0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:41.465367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eef08e61-0539-4819-9c0d-73717e83ca0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:41.465807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eef08e61-0539-4819-9c0d-73717e83ca0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:41.591960 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eef08e61-0539-4819-9c0d-73717e83ca0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:41.599913 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2fc6bac7-15a9-44f1-8a52-bdf1e435675b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:41.600530 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2fc6bac7-15a9-44f1-8a52-bdf1e435675b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:41.600659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-eef08e61-0539-4819-9c0d-73717e83ca0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148235 Jul 27 20:37:41.601226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1525/3065] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:41 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:41.606516 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2fc6bac7-15a9-44f1-8a52-bdf1e435675b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:41.606973 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2fc6bac7-15a9-44f1-8a52-bdf1e435675b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:41.607738 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2fc6bac7-15a9-44f1-8a52-bdf1e435675b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:41.608181 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2fc6bac7-15a9-44f1-8a52-bdf1e435675b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:41.613123 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:37:41.742452 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2fc6bac7-15a9-44f1-8a52-bdf1e435675b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:41.750945 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2fc6bac7-15a9-44f1-8a52-bdf1e435675b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:41.752441 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2fc6bac7-15a9-44f1-8a52-bdf1e435675b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:41.753626 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2fc6bac7-15a9-44f1-8a52-bdf1e435675b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157543 Jul 27 20:37:41.754178 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1541/3066] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:41 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:37:42.409763 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7347d51e-95aa-413a-a5c7-6095fb6ebe5e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:42.410396 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7347d51e-95aa-413a-a5c7-6095fb6ebe5e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:42.419180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7347d51e-95aa-413a-a5c7-6095fb6ebe5e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:42.419616 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7347d51e-95aa-413a-a5c7-6095fb6ebe5e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:42.420426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7347d51e-95aa-413a-a5c7-6095fb6ebe5e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:42.420948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7347d51e-95aa-413a-a5c7-6095fb6ebe5e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:42.483208 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7347d51e-95aa-413a-a5c7-6095fb6ebe5e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:42.492630 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7347d51e-95aa-413a-a5c7-6095fb6ebe5e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.087065 Jul 27 20:37:42.493237 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1526/3067] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:42 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:42.623243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-faf71705-e820-432a-ba91-03b6b6da3ed7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:42.623859 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-faf71705-e820-432a-ba91-03b6b6da3ed7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:42.631006 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-faf71705-e820-432a-ba91-03b6b6da3ed7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:42.631454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-faf71705-e820-432a-ba91-03b6b6da3ed7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:42.632243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-faf71705-e820-432a-ba91-03b6b6da3ed7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:42.632679 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-faf71705-e820-432a-ba91-03b6b6da3ed7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:42.761324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-faf71705-e820-432a-ba91-03b6b6da3ed7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:42.770882 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-faf71705-e820-432a-ba91-03b6b6da3ed7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151380 Jul 27 20:37:42.771512 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1542/3068] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:42 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:42.777893 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e30e9c9a-9ba5-4c48-b5c8-8c780fc34ce6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:42.778592 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e30e9c9a-9ba5-4c48-b5c8-8c780fc34ce6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:42.785101 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e30e9c9a-9ba5-4c48-b5c8-8c780fc34ce6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:42.785553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e30e9c9a-9ba5-4c48-b5c8-8c780fc34ce6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:42.786319 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e30e9c9a-9ba5-4c48-b5c8-8c780fc34ce6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:42.786758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e30e9c9a-9ba5-4c48-b5c8-8c780fc34ce6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:42.917446 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e30e9c9a-9ba5-4c48-b5c8-8c780fc34ce6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:42.926375 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e30e9c9a-9ba5-4c48-b5c8-8c780fc34ce6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:42.927853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e30e9c9a-9ba5-4c48-b5c8-8c780fc34ce6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:42.929021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e30e9c9a-9ba5-4c48-b5c8-8c780fc34ce6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.154971 Jul 27 20:37:42.929570 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1527/3069] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:42 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:37:43.514339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-dcb3ec09-e8e5-4516-8362-e1433864a4f8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:43.514950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-dcb3ec09-e8e5-4516-8362-e1433864a4f8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:43.521113 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dcb3ec09-e8e5-4516-8362-e1433864a4f8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:43.521562 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dcb3ec09-e8e5-4516-8362-e1433864a4f8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:43.522343 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dcb3ec09-e8e5-4516-8362-e1433864a4f8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:43.522776 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dcb3ec09-e8e5-4516-8362-e1433864a4f8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:43.588486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-dcb3ec09-e8e5-4516-8362-e1433864a4f8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:43.596411 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-dcb3ec09-e8e5-4516-8362-e1433864a4f8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085907 Jul 27 20:37:43.596985 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1543/3070] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:43 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:43.792048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0edea5c8-6aed-4960-ad33-9bc270ca4062 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:43.792670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0edea5c8-6aed-4960-ad33-9bc270ca4062 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:43.799748 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0edea5c8-6aed-4960-ad33-9bc270ca4062 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:43.800203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0edea5c8-6aed-4960-ad33-9bc270ca4062 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:43.800992 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0edea5c8-6aed-4960-ad33-9bc270ca4062 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:43.801430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0edea5c8-6aed-4960-ad33-9bc270ca4062 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:43.931207 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0edea5c8-6aed-4960-ad33-9bc270ca4062 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:43.940294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0edea5c8-6aed-4960-ad33-9bc270ca4062 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151995 Jul 27 20:37:43.940881 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1528/3071] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:43 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:43.952337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-69349a2a-fe14-4b88-921a-92254552fbf0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:43.953324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-69349a2a-fe14-4b88-921a-92254552fbf0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:43.960267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69349a2a-fe14-4b88-921a-92254552fbf0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:43.960720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69349a2a-fe14-4b88-921a-92254552fbf0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:43.961517 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69349a2a-fe14-4b88-921a-92254552fbf0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:43.961957 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69349a2a-fe14-4b88-921a-92254552fbf0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:44.107175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-69349a2a-fe14-4b88-921a-92254552fbf0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:44.115895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-69349a2a-fe14-4b88-921a-92254552fbf0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:44.117445 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-69349a2a-fe14-4b88-921a-92254552fbf0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:44.118605 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-69349a2a-fe14-4b88-921a-92254552fbf0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.170876 Jul 27 20:37:44.119163 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1544/3072] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:43 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:37:44.616760 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3b0b3217-e95b-4d7e-bc31-83b6ba84eef1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:44.617406 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3b0b3217-e95b-4d7e-bc31-83b6ba84eef1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:44.623443 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b0b3217-e95b-4d7e-bc31-83b6ba84eef1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:44.623896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b0b3217-e95b-4d7e-bc31-83b6ba84eef1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:44.624662 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b0b3217-e95b-4d7e-bc31-83b6ba84eef1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:44.625145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b0b3217-e95b-4d7e-bc31-83b6ba84eef1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:44.685970 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3b0b3217-e95b-4d7e-bc31-83b6ba84eef1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:44.694037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3b0b3217-e95b-4d7e-bc31-83b6ba84eef1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081228 Jul 27 20:37:44.694592 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1529/3073] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:44 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:44.961476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3982436c-53a4-4afc-a55b-fbe95c54b60d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:44.962031 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3982436c-53a4-4afc-a55b-fbe95c54b60d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:44.968441 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3982436c-53a4-4afc-a55b-fbe95c54b60d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:44.970115 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3982436c-53a4-4afc-a55b-fbe95c54b60d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:44.971257 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3982436c-53a4-4afc-a55b-fbe95c54b60d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:44.971925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3982436c-53a4-4afc-a55b-fbe95c54b60d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:45.098784 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3982436c-53a4-4afc-a55b-fbe95c54b60d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:45.106746 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3982436c-53a4-4afc-a55b-fbe95c54b60d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149194 Jul 27 20:37:45.107303 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1545/3074] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:44 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:45.142480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4c8529c6-65fc-44b8-9581-7857d0a59da5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:45.143086 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4c8529c6-65fc-44b8-9581-7857d0a59da5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:45.149623 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c8529c6-65fc-44b8-9581-7857d0a59da5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:45.150071 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c8529c6-65fc-44b8-9581-7857d0a59da5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:45.150859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c8529c6-65fc-44b8-9581-7857d0a59da5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:45.151296 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c8529c6-65fc-44b8-9581-7857d0a59da5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:45.283815 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4c8529c6-65fc-44b8-9581-7857d0a59da5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:45.292098 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4c8529c6-65fc-44b8-9581-7857d0a59da5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:45.293667 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4c8529c6-65fc-44b8-9581-7857d0a59da5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:45.294829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4c8529c6-65fc-44b8-9581-7857d0a59da5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156778 Jul 27 20:37:45.295384 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1530/3075] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:45 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:37:45.714884 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b7b5bd0a-f982-4917-8735-b2e976aaf913 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:45.715500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b7b5bd0a-f982-4917-8735-b2e976aaf913 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:45.721763 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b7b5bd0a-f982-4917-8735-b2e976aaf913 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:45.722222 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b7b5bd0a-f982-4917-8735-b2e976aaf913 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:45.722994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b7b5bd0a-f982-4917-8735-b2e976aaf913 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:45.723439 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b7b5bd0a-f982-4917-8735-b2e976aaf913 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:45.789117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b7b5bd0a-f982-4917-8735-b2e976aaf913 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:45.798176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b7b5bd0a-f982-4917-8735-b2e976aaf913 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.087200 Jul 27 20:37:45.798734 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1546/3076] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:45 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:46.127658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-864158a2-8e00-4681-817a-7bb2022ba1fd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:46.128272 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-864158a2-8e00-4681-817a-7bb2022ba1fd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:46.134999 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-864158a2-8e00-4681-817a-7bb2022ba1fd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:46.135444 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-864158a2-8e00-4681-817a-7bb2022ba1fd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:46.136196 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-864158a2-8e00-4681-817a-7bb2022ba1fd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:46.136627 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-864158a2-8e00-4681-817a-7bb2022ba1fd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:46.264118 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-864158a2-8e00-4681-817a-7bb2022ba1fd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:46.272533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-864158a2-8e00-4681-817a-7bb2022ba1fd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148783 Jul 27 20:37:46.273115 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1531/3077] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:46 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:46.317929 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2630fc37-1698-42da-a449-fdfc036fcd58 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:46.318548 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2630fc37-1698-42da-a449-fdfc036fcd58 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:46.324919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2630fc37-1698-42da-a449-fdfc036fcd58 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:46.325405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2630fc37-1698-42da-a449-fdfc036fcd58 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:46.326220 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2630fc37-1698-42da-a449-fdfc036fcd58 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:46.326618 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2630fc37-1698-42da-a449-fdfc036fcd58 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:46.454509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2630fc37-1698-42da-a449-fdfc036fcd58 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:46.462907 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2630fc37-1698-42da-a449-fdfc036fcd58 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:46.464422 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2630fc37-1698-42da-a449-fdfc036fcd58 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:46.465628 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2630fc37-1698-42da-a449-fdfc036fcd58 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.151706 Jul 27 20:37:46.466193 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1547/3078] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:46 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:37:46.819502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f1077888-46c9-471e-b4ed-ddca8419564e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:46.820104 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f1077888-46c9-471e-b4ed-ddca8419564e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:46.826295 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1077888-46c9-471e-b4ed-ddca8419564e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:46.826765 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1077888-46c9-471e-b4ed-ddca8419564e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:46.827513 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1077888-46c9-471e-b4ed-ddca8419564e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:46.828938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1077888-46c9-471e-b4ed-ddca8419564e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:46.888445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f1077888-46c9-471e-b4ed-ddca8419564e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:46.896862 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f1077888-46c9-471e-b4ed-ddca8419564e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081197 Jul 27 20:37:46.897465 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1532/3079] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:46 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:47.294652 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-447587fd-524a-475d-a093-6aa990f2a21d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:47.295277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-447587fd-524a-475d-a093-6aa990f2a21d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:47.302064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-447587fd-524a-475d-a093-6aa990f2a21d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:47.302524 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-447587fd-524a-475d-a093-6aa990f2a21d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:47.303291 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-447587fd-524a-475d-a093-6aa990f2a21d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:47.303733 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-447587fd-524a-475d-a093-6aa990f2a21d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:47.431669 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-447587fd-524a-475d-a093-6aa990f2a21d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:47.439899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-447587fd-524a-475d-a093-6aa990f2a21d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149130 Jul 27 20:37:47.440467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1548/3080] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:47 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:47.490269 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0b514d76-fb56-43e0-bf1e-9a77d4469a95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:47.490873 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0b514d76-fb56-43e0-bf1e-9a77d4469a95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:47.496918 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b514d76-fb56-43e0-bf1e-9a77d4469a95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:47.497392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b514d76-fb56-43e0-bf1e-9a77d4469a95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:47.498174 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b514d76-fb56-43e0-bf1e-9a77d4469a95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:47.498607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b514d76-fb56-43e0-bf1e-9a77d4469a95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:47.630385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0b514d76-fb56-43e0-bf1e-9a77d4469a95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:47.638583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0b514d76-fb56-43e0-bf1e-9a77d4469a95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:47.640070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0b514d76-fb56-43e0-bf1e-9a77d4469a95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:47.641962 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0b514d76-fb56-43e0-bf1e-9a77d4469a95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155451 Jul 27 20:37:47.642525 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1533/3081] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:47 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:37:47.918031 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-dc2c6eb0-c6d4-4900-836e-5bb3e243a768 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:47.918655 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-dc2c6eb0-c6d4-4900-836e-5bb3e243a768 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:47.925510 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc2c6eb0-c6d4-4900-836e-5bb3e243a768 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:47.925962 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc2c6eb0-c6d4-4900-836e-5bb3e243a768 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:47.926731 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc2c6eb0-c6d4-4900-836e-5bb3e243a768 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:47.927173 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc2c6eb0-c6d4-4900-836e-5bb3e243a768 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:47.991549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-dc2c6eb0-c6d4-4900-836e-5bb3e243a768 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:47.999426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-dc2c6eb0-c6d4-4900-836e-5bb3e243a768 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085313 Jul 27 20:37:48.000121 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1549/3082] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:47 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:48.461258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2b6d5ad3-f1c1-440e-8c51-dd02fabb6b91 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:48.461872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2b6d5ad3-f1c1-440e-8c51-dd02fabb6b91 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:48.467891 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b6d5ad3-f1c1-440e-8c51-dd02fabb6b91 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:48.468338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b6d5ad3-f1c1-440e-8c51-dd02fabb6b91 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:48.469627 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b6d5ad3-f1c1-440e-8c51-dd02fabb6b91 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:48.470210 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b6d5ad3-f1c1-440e-8c51-dd02fabb6b91 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:48.599164 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2b6d5ad3-f1c1-440e-8c51-dd02fabb6b91 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:48.607076 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2b6d5ad3-f1c1-440e-8c51-dd02fabb6b91 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149760 Jul 27 20:37:48.607637 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1534/3083] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:48 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:48.665285 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1c7424fd-a5d8-466f-b636-636e86d56672 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:48.666001 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1c7424fd-a5d8-466f-b636-636e86d56672 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:48.672544 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1c7424fd-a5d8-466f-b636-636e86d56672 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:48.673035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1c7424fd-a5d8-466f-b636-636e86d56672 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:48.673808 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1c7424fd-a5d8-466f-b636-636e86d56672 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:48.674255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1c7424fd-a5d8-466f-b636-636e86d56672 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:48.803888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1c7424fd-a5d8-466f-b636-636e86d56672 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:48.812254 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1c7424fd-a5d8-466f-b636-636e86d56672 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:48.813834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1c7424fd-a5d8-466f-b636-636e86d56672 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:48.815810 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1c7424fd-a5d8-466f-b636-636e86d56672 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.154353 Jul 27 20:37:48.817417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1550/3084] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:48 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:37:49.020531 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ed438aa0-0d8f-431e-a278-41e6ea08bcab tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:49.021837 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ed438aa0-0d8f-431e-a278-41e6ea08bcab tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:49.027877 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed438aa0-0d8f-431e-a278-41e6ea08bcab tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:49.028329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed438aa0-0d8f-431e-a278-41e6ea08bcab tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:49.029114 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed438aa0-0d8f-431e-a278-41e6ea08bcab tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:49.029552 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed438aa0-0d8f-431e-a278-41e6ea08bcab tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:49.097872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ed438aa0-0d8f-431e-a278-41e6ea08bcab tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:49.106030 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ed438aa0-0d8f-431e-a278-41e6ea08bcab tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.089432 Jul 27 20:37:49.106583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1535/3085] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:49 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:49.628879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d91eea81-4258-417c-8d1f-b6ebba031c37 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:49.629535 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d91eea81-4258-417c-8d1f-b6ebba031c37 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:49.635638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d91eea81-4258-417c-8d1f-b6ebba031c37 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:49.636101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d91eea81-4258-417c-8d1f-b6ebba031c37 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:49.636846 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d91eea81-4258-417c-8d1f-b6ebba031c37 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:49.637304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d91eea81-4258-417c-8d1f-b6ebba031c37 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:49.768512 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d91eea81-4258-417c-8d1f-b6ebba031c37 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:49.776476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d91eea81-4258-417c-8d1f-b6ebba031c37 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152038 Jul 27 20:37:49.777011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1551/3086] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:49 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:49.843387 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-32f1f605-23bf-41b8-959b-0768f0aa7862 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:49.844000 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-32f1f605-23bf-41b8-959b-0768f0aa7862 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:49.850420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-32f1f605-23bf-41b8-959b-0768f0aa7862 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:49.850868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-32f1f605-23bf-41b8-959b-0768f0aa7862 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:49.851625 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-32f1f605-23bf-41b8-959b-0768f0aa7862 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:49.852067 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-32f1f605-23bf-41b8-959b-0768f0aa7862 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:49.980496 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-32f1f605-23bf-41b8-959b-0768f0aa7862 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:49.989369 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-32f1f605-23bf-41b8-959b-0768f0aa7862 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:49.990867 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-32f1f605-23bf-41b8-959b-0768f0aa7862 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:49.992027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-32f1f605-23bf-41b8-959b-0768f0aa7862 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152573 Jul 27 20:37:49.992584 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1536/3087] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:49 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:37:50.127986 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-87cf3260-4090-4c98-b9b6-3e65bebacb9d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:50.128609 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-87cf3260-4090-4c98-b9b6-3e65bebacb9d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:50.134579 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-87cf3260-4090-4c98-b9b6-3e65bebacb9d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:50.135039 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-87cf3260-4090-4c98-b9b6-3e65bebacb9d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:50.135809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-87cf3260-4090-4c98-b9b6-3e65bebacb9d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:50.136252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-87cf3260-4090-4c98-b9b6-3e65bebacb9d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:50.200531 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-87cf3260-4090-4c98-b9b6-3e65bebacb9d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:50.208897 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-87cf3260-4090-4c98-b9b6-3e65bebacb9d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085454 Jul 27 20:37:50.209487 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1552/3088] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:50 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:50.797641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fca44f8f-7dd3-4211-9af9-32eb3bbf1b2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:50.798921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fca44f8f-7dd3-4211-9af9-32eb3bbf1b2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:50.804993 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fca44f8f-7dd3-4211-9af9-32eb3bbf1b2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:50.805455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fca44f8f-7dd3-4211-9af9-32eb3bbf1b2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:50.806219 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fca44f8f-7dd3-4211-9af9-32eb3bbf1b2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:50.806660 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fca44f8f-7dd3-4211-9af9-32eb3bbf1b2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:50.935310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fca44f8f-7dd3-4211-9af9-32eb3bbf1b2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:50.944070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fca44f8f-7dd3-4211-9af9-32eb3bbf1b2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150337 Jul 27 20:37:50.944638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1537/3089] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:50 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:51.015649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e31a2a10-c2a8-4876-a5f7-dbfecb1cdbe7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:51.016271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e31a2a10-c2a8-4876-a5f7-dbfecb1cdbe7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:51.023494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e31a2a10-c2a8-4876-a5f7-dbfecb1cdbe7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:51.023953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e31a2a10-c2a8-4876-a5f7-dbfecb1cdbe7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:51.024719 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e31a2a10-c2a8-4876-a5f7-dbfecb1cdbe7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:51.025195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e31a2a10-c2a8-4876-a5f7-dbfecb1cdbe7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:51.153561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e31a2a10-c2a8-4876-a5f7-dbfecb1cdbe7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:51.162510 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e31a2a10-c2a8-4876-a5f7-dbfecb1cdbe7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:51.164055 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e31a2a10-c2a8-4876-a5f7-dbfecb1cdbe7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:51.165224 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e31a2a10-c2a8-4876-a5f7-dbfecb1cdbe7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153502 Jul 27 20:37:51.165780 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1553/3090] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:51 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:37:51.229349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-19c3c573-3128-4275-9bca-f1e73dc843dc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:51.229966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-19c3c573-3128-4275-9bca-f1e73dc843dc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:51.236499 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19c3c573-3128-4275-9bca-f1e73dc843dc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:51.236950 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19c3c573-3128-4275-9bca-f1e73dc843dc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:51.237736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19c3c573-3128-4275-9bca-f1e73dc843dc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:51.238180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19c3c573-3128-4275-9bca-f1e73dc843dc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:51.301406 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-19c3c573-3128-4275-9bca-f1e73dc843dc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:51.309244 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-19c3c573-3128-4275-9bca-f1e73dc843dc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083644 Jul 27 20:37:51.309806 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1538/3091] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:51 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:51.966114 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cb1f6cfb-42dc-477a-a8fa-48bd70ec7672 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:51.966658 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cb1f6cfb-42dc-477a-a8fa-48bd70ec7672 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:51.973827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb1f6cfb-42dc-477a-a8fa-48bd70ec7672 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:51.974283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb1f6cfb-42dc-477a-a8fa-48bd70ec7672 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:51.975052 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb1f6cfb-42dc-477a-a8fa-48bd70ec7672 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:51.975492 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb1f6cfb-42dc-477a-a8fa-48bd70ec7672 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:52.102857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cb1f6cfb-42dc-477a-a8fa-48bd70ec7672 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:52.111475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cb1f6cfb-42dc-477a-a8fa-48bd70ec7672 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148710 Jul 27 20:37:52.112241 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1554/3092] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:51 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:52.189154 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3a3ca455-ab7e-463d-8467-6781be1ae0aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:52.189808 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3a3ca455-ab7e-463d-8467-6781be1ae0aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:52.196284 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3a3ca455-ab7e-463d-8467-6781be1ae0aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:52.196725 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3a3ca455-ab7e-463d-8467-6781be1ae0aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:52.197494 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3a3ca455-ab7e-463d-8467-6781be1ae0aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:52.197925 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3a3ca455-ab7e-463d-8467-6781be1ae0aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:52.328618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3a3ca455-ab7e-463d-8467-6781be1ae0aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:52.330858 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-54d38929-4a3e-42db-a8c1-22fa69a8b7a5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:52.331473 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-54d38929-4a3e-42db-a8c1-22fa69a8b7a5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:52.337844 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-54d38929-4a3e-42db-a8c1-22fa69a8b7a5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:52.338299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-54d38929-4a3e-42db-a8c1-22fa69a8b7a5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:52.338746 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3a3ca455-ab7e-463d-8467-6781be1ae0aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:52.339074 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-54d38929-4a3e-42db-a8c1-22fa69a8b7a5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:52.339513 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-54d38929-4a3e-42db-a8c1-22fa69a8b7a5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:52.340266 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3a3ca455-ab7e-463d-8467-6781be1ae0aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:52.341436 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3a3ca455-ab7e-463d-8467-6781be1ae0aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156234 Jul 27 20:37:52.343037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1539/3093] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:52 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:37:52.405709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-54d38929-4a3e-42db-a8c1-22fa69a8b7a5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:52.413958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-54d38929-4a3e-42db-a8c1-22fa69a8b7a5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.087693 Jul 27 20:37:52.414523 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1555/3094] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:52 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:53.133142 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-edab3892-9561-4db9-8bff-8b0332310bc4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:53.133818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-edab3892-9561-4db9-8bff-8b0332310bc4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:53.139920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-edab3892-9561-4db9-8bff-8b0332310bc4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:53.140368 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-edab3892-9561-4db9-8bff-8b0332310bc4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:53.141153 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-edab3892-9561-4db9-8bff-8b0332310bc4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:53.141595 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-edab3892-9561-4db9-8bff-8b0332310bc4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:53.269867 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-edab3892-9561-4db9-8bff-8b0332310bc4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:53.277729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-edab3892-9561-4db9-8bff-8b0332310bc4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148449 Jul 27 20:37:53.278299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1540/3095] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:53 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:53.367159 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fe40264b-788f-4c2b-b730-bd46afb3e6d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:53.367695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fe40264b-788f-4c2b-b730-bd46afb3e6d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:53.374191 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fe40264b-788f-4c2b-b730-bd46afb3e6d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:53.374638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fe40264b-788f-4c2b-b730-bd46afb3e6d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:53.375393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fe40264b-788f-4c2b-b730-bd46afb3e6d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:53.375833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fe40264b-788f-4c2b-b730-bd46afb3e6d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:53.435242 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-202ecee4-67d6-418c-92f6-5b3358bd7431 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:53.435852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-202ecee4-67d6-418c-92f6-5b3358bd7431 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:53.441833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-202ecee4-67d6-418c-92f6-5b3358bd7431 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:53.442285 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-202ecee4-67d6-418c-92f6-5b3358bd7431 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:53.443048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-202ecee4-67d6-418c-92f6-5b3358bd7431 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:53.443517 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-202ecee4-67d6-418c-92f6-5b3358bd7431 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:53.448629 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:37:53.508532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fe40264b-788f-4c2b-b730-bd46afb3e6d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:53.510616 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-202ecee4-67d6-418c-92f6-5b3358bd7431 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:53.517927 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fe40264b-788f-4c2b-b730-bd46afb3e6d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:53.518761 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-202ecee4-67d6-418c-92f6-5b3358bd7431 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.087370 Jul 27 20:37:53.520998 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fe40264b-788f-4c2b-b730-bd46afb3e6d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:53.521159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1541/3096] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:53 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:53.521267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fe40264b-788f-4c2b-b730-bd46afb3e6d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157469 Jul 27 20:37:53.524325 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1556/3097] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:53 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:37:54.299646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-39bb768c-3e8a-4361-aff3-79a0bd78e306 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:54.300249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-39bb768c-3e8a-4361-aff3-79a0bd78e306 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:54.306779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39bb768c-3e8a-4361-aff3-79a0bd78e306 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:54.307224 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39bb768c-3e8a-4361-aff3-79a0bd78e306 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:54.307970 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39bb768c-3e8a-4361-aff3-79a0bd78e306 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:54.308396 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39bb768c-3e8a-4361-aff3-79a0bd78e306 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:54.437387 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-39bb768c-3e8a-4361-aff3-79a0bd78e306 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:54.445213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-39bb768c-3e8a-4361-aff3-79a0bd78e306 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150229 Jul 27 20:37:54.445779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1542/3098] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:54 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:54.539476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-312bf05b-3975-4a75-ba25-788d1987e728 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:54.540094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-312bf05b-3975-4a75-ba25-788d1987e728 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:54.543319 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5f812019-86aa-4fcc-ab18-3a9ffee64dfa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:54.543923 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5f812019-86aa-4fcc-ab18-3a9ffee64dfa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:54.546668 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-312bf05b-3975-4a75-ba25-788d1987e728 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:54.547133 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-312bf05b-3975-4a75-ba25-788d1987e728 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:54.547905 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-312bf05b-3975-4a75-ba25-788d1987e728 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:54.548362 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-312bf05b-3975-4a75-ba25-788d1987e728 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:54.549957 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5f812019-86aa-4fcc-ab18-3a9ffee64dfa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:54.550400 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5f812019-86aa-4fcc-ab18-3a9ffee64dfa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:54.551151 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5f812019-86aa-4fcc-ab18-3a9ffee64dfa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:54.551579 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5f812019-86aa-4fcc-ab18-3a9ffee64dfa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:54.614154 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-312bf05b-3975-4a75-ba25-788d1987e728 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:54.617574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:37:54.623149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-312bf05b-3975-4a75-ba25-788d1987e728 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.087484 Jul 27 20:37:54.623954 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1557/3099] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:54 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:54.680099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5f812019-86aa-4fcc-ab18-3a9ffee64dfa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:54.688471 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5f812019-86aa-4fcc-ab18-3a9ffee64dfa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:54.690451 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5f812019-86aa-4fcc-ab18-3a9ffee64dfa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:54.691614 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5f812019-86aa-4fcc-ab18-3a9ffee64dfa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152016 Jul 27 20:37:54.692173 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1543/3100] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:54 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:37:55.467497 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a2bca5e9-4569-4881-b39c-2bcab7c5703e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:55.468107 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a2bca5e9-4569-4881-b39c-2bcab7c5703e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:55.475033 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a2bca5e9-4569-4881-b39c-2bcab7c5703e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:55.475494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a2bca5e9-4569-4881-b39c-2bcab7c5703e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:55.476260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a2bca5e9-4569-4881-b39c-2bcab7c5703e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:55.476709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a2bca5e9-4569-4881-b39c-2bcab7c5703e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:55.609109 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a2bca5e9-4569-4881-b39c-2bcab7c5703e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:55.617052 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a2bca5e9-4569-4881-b39c-2bcab7c5703e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153461 Jul 27 20:37:55.617619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1558/3101] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:55 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:55.646179 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6713cbbc-3c4d-4b8e-ac09-66f43efeca1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:55.646841 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6713cbbc-3c4d-4b8e-ac09-66f43efeca1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:55.653577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6713cbbc-3c4d-4b8e-ac09-66f43efeca1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:55.654032 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6713cbbc-3c4d-4b8e-ac09-66f43efeca1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:55.654833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6713cbbc-3c4d-4b8e-ac09-66f43efeca1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:55.655276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6713cbbc-3c4d-4b8e-ac09-66f43efeca1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:55.715772 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cebbd6b8-c9e0-480f-b45e-442fc65d63da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:55.716441 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cebbd6b8-c9e0-480f-b45e-442fc65d63da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:55.720720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6713cbbc-3c4d-4b8e-ac09-66f43efeca1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:55.723320 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cebbd6b8-c9e0-480f-b45e-442fc65d63da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:55.723775 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cebbd6b8-c9e0-480f-b45e-442fc65d63da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:55.724548 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cebbd6b8-c9e0-480f-b45e-442fc65d63da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:55.725003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cebbd6b8-c9e0-480f-b45e-442fc65d63da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:55.729198 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6713cbbc-3c4d-4b8e-ac09-66f43efeca1a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.089416 Jul 27 20:37:55.729771 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1544/3102] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:55 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:55.853590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cebbd6b8-c9e0-480f-b45e-442fc65d63da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:55.865142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cebbd6b8-c9e0-480f-b45e-442fc65d63da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:55.867135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cebbd6b8-c9e0-480f-b45e-442fc65d63da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:55.868316 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cebbd6b8-c9e0-480f-b45e-442fc65d63da tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156502 Jul 27 20:37:55.868890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1559/3103] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:55 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:37:56.638723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-54b70550-40b4-4136-b009-afe308924240 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:56.639350 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-54b70550-40b4-4136-b009-afe308924240 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:56.646114 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-54b70550-40b4-4136-b009-afe308924240 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:56.646565 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-54b70550-40b4-4136-b009-afe308924240 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:56.647332 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-54b70550-40b4-4136-b009-afe308924240 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:56.647773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-54b70550-40b4-4136-b009-afe308924240 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:56.750567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3495325c-2c3f-486d-bcea-e467bec1fd57 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:56.752082 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3495325c-2c3f-486d-bcea-e467bec1fd57 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:56.758571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3495325c-2c3f-486d-bcea-e467bec1fd57 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:56.759097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3495325c-2c3f-486d-bcea-e467bec1fd57 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:56.759861 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3495325c-2c3f-486d-bcea-e467bec1fd57 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:56.760297 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3495325c-2c3f-486d-bcea-e467bec1fd57 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:56.776227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-54b70550-40b4-4136-b009-afe308924240 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:56.784138 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-54b70550-40b4-4136-b009-afe308924240 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149354 Jul 27 20:37:56.784705 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1545/3104] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:56 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:56.821951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3495325c-2c3f-486d-bcea-e467bec1fd57 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:56.830593 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3495325c-2c3f-486d-bcea-e467bec1fd57 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083938 Jul 27 20:37:56.831150 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1560/3105] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:56 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:56.893956 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-45030388-3e39-4d10-948d-fcc99b7e00c1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:56.894499 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-45030388-3e39-4d10-948d-fcc99b7e00c1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:56.900417 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-45030388-3e39-4d10-948d-fcc99b7e00c1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:56.900865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-45030388-3e39-4d10-948d-fcc99b7e00c1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:56.901659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-45030388-3e39-4d10-948d-fcc99b7e00c1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:56.902100 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-45030388-3e39-4d10-948d-fcc99b7e00c1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:57.036367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-45030388-3e39-4d10-948d-fcc99b7e00c1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:57.044814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-45030388-3e39-4d10-948d-fcc99b7e00c1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:57.046349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-45030388-3e39-4d10-948d-fcc99b7e00c1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:57.047524 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-45030388-3e39-4d10-948d-fcc99b7e00c1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.158167 Jul 27 20:37:57.048301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1546/3106] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:56 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:37:57.806253 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3f2b1198-bf07-4547-8ca6-26f17dd50c4a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:57.806911 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3f2b1198-bf07-4547-8ca6-26f17dd50c4a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:57.814224 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3f2b1198-bf07-4547-8ca6-26f17dd50c4a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:57.814845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3f2b1198-bf07-4547-8ca6-26f17dd50c4a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:57.815625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3f2b1198-bf07-4547-8ca6-26f17dd50c4a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:57.816074 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3f2b1198-bf07-4547-8ca6-26f17dd50c4a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:57.851712 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c0e6cb2d-8e74-487d-a7e9-ff1d3740ee3a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:57.852330 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c0e6cb2d-8e74-487d-a7e9-ff1d3740ee3a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:57.858898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c0e6cb2d-8e74-487d-a7e9-ff1d3740ee3a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:57.859353 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c0e6cb2d-8e74-487d-a7e9-ff1d3740ee3a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:57.860129 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c0e6cb2d-8e74-487d-a7e9-ff1d3740ee3a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:57.861160 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c0e6cb2d-8e74-487d-a7e9-ff1d3740ee3a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:57.926969 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c0e6cb2d-8e74-487d-a7e9-ff1d3740ee3a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:57.935019 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c0e6cb2d-8e74-487d-a7e9-ff1d3740ee3a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.087058 Jul 27 20:37:57.935592 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1547/3107] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:57 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:57.947968 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3f2b1198-bf07-4547-8ca6-26f17dd50c4a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:57.956681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3f2b1198-bf07-4547-8ca6-26f17dd50c4a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.154240 Jul 27 20:37:57.957280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1561/3108] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:57 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:58.070773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-61911712-eff9-40f2-af90-000ff13261f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:58.071376 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-61911712-eff9-40f2-af90-000ff13261f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:58.077568 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-61911712-eff9-40f2-af90-000ff13261f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:58.078317 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-61911712-eff9-40f2-af90-000ff13261f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:58.079084 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-61911712-eff9-40f2-af90-000ff13261f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:58.079510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-61911712-eff9-40f2-af90-000ff13261f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:58.206923 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-61911712-eff9-40f2-af90-000ff13261f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:58.215212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-61911712-eff9-40f2-af90-000ff13261f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:58.216701 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-61911712-eff9-40f2-af90-000ff13261f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:58.217888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-61911712-eff9-40f2-af90-000ff13261f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.151286 Jul 27 20:37:58.218449 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1548/3109] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:58 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:37:58.956455 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3a2b5782-2dd7-4199-b2fb-f1ff0ed3d7cf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:58.957091 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3a2b5782-2dd7-4199-b2fb-f1ff0ed3d7cf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:58.963692 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3a2b5782-2dd7-4199-b2fb-f1ff0ed3d7cf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:58.964147 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3a2b5782-2dd7-4199-b2fb-f1ff0ed3d7cf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:58.964914 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3a2b5782-2dd7-4199-b2fb-f1ff0ed3d7cf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:58.965405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3a2b5782-2dd7-4199-b2fb-f1ff0ed3d7cf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:58.978195 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8bdac127-1255-461c-9479-0dbdc0e7e0e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:58.978802 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8bdac127-1255-461c-9479-0dbdc0e7e0e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:58.985961 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8bdac127-1255-461c-9479-0dbdc0e7e0e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:58.986649 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8bdac127-1255-461c-9479-0dbdc0e7e0e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:58.987601 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8bdac127-1255-461c-9479-0dbdc0e7e0e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:58.988033 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8bdac127-1255-461c-9479-0dbdc0e7e0e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:59.028794 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3a2b5782-2dd7-4199-b2fb-f1ff0ed3d7cf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:59.037315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3a2b5782-2dd7-4199-b2fb-f1ff0ed3d7cf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085492 Jul 27 20:37:59.048783 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1562/3110] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:58 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:37:59.124102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8bdac127-1255-461c-9479-0dbdc0e7e0e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:59.132633 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8bdac127-1255-461c-9479-0dbdc0e7e0e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.158263 Jul 27 20:37:59.133241 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1549/3111] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:37:58 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:37:59.242393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9e74f9be-e9b5-45a2-b455-47d10ba3e75d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:37:59.242934 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9e74f9be-e9b5-45a2-b455-47d10ba3e75d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:37:59.248899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9e74f9be-e9b5-45a2-b455-47d10ba3e75d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:59.249378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9e74f9be-e9b5-45a2-b455-47d10ba3e75d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:59.250132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9e74f9be-e9b5-45a2-b455-47d10ba3e75d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:37:59.250569 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9e74f9be-e9b5-45a2-b455-47d10ba3e75d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:37:59.377319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9e74f9be-e9b5-45a2-b455-47d10ba3e75d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:59.385620 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9e74f9be-e9b5-45a2-b455-47d10ba3e75d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:59.387159 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9e74f9be-e9b5-45a2-b455-47d10ba3e75d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:37:59.388323 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9e74f9be-e9b5-45a2-b455-47d10ba3e75d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.149894 Jul 27 20:37:59.388884 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1563/3112] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:37:59 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:00.059743 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-64dd5609-9d23-4711-90c1-f7831222e3ff tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:00.060298 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-64dd5609-9d23-4711-90c1-f7831222e3ff tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:00.067712 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-64dd5609-9d23-4711-90c1-f7831222e3ff tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:00.068162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-64dd5609-9d23-4711-90c1-f7831222e3ff tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:00.068926 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-64dd5609-9d23-4711-90c1-f7831222e3ff tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:00.069388 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-64dd5609-9d23-4711-90c1-f7831222e3ff tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:00.136177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-64dd5609-9d23-4711-90c1-f7831222e3ff tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:00.144179 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-64dd5609-9d23-4711-90c1-f7831222e3ff tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.088391 Jul 27 20:38:00.144740 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1550/3113] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:00 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:00.153959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-88558e3e-c66a-46e7-a210-af804eeaf265 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:00.154726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-88558e3e-c66a-46e7-a210-af804eeaf265 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:00.162054 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88558e3e-c66a-46e7-a210-af804eeaf265 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:00.162848 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88558e3e-c66a-46e7-a210-af804eeaf265 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:00.163268 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88558e3e-c66a-46e7-a210-af804eeaf265 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:00.163717 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88558e3e-c66a-46e7-a210-af804eeaf265 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:00.294431 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-88558e3e-c66a-46e7-a210-af804eeaf265 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:00.303050 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-88558e3e-c66a-46e7-a210-af804eeaf265 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152945 Jul 27 20:38:00.303640 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1564/3114] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:00 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:00.411887 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-30fdfd9f-5797-4cc2-9179-387e14186417 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:00.412503 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-30fdfd9f-5797-4cc2-9179-387e14186417 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:00.418506 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30fdfd9f-5797-4cc2-9179-387e14186417 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:00.418964 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30fdfd9f-5797-4cc2-9179-387e14186417 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:00.419727 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30fdfd9f-5797-4cc2-9179-387e14186417 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:00.420169 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30fdfd9f-5797-4cc2-9179-387e14186417 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:00.549565 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-30fdfd9f-5797-4cc2-9179-387e14186417 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:00.557869 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-30fdfd9f-5797-4cc2-9179-387e14186417 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:00.559383 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-30fdfd9f-5797-4cc2-9179-387e14186417 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:00.560547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-30fdfd9f-5797-4cc2-9179-387e14186417 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153165 Jul 27 20:38:00.561136 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1551/3115] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:00 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:01.164861 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c1ee79d4-6559-4ac6-b585-4828e6b3ed61 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:01.165500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c1ee79d4-6559-4ac6-b585-4828e6b3ed61 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:01.171936 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c1ee79d4-6559-4ac6-b585-4828e6b3ed61 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:01.172389 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c1ee79d4-6559-4ac6-b585-4828e6b3ed61 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:01.173923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c1ee79d4-6559-4ac6-b585-4828e6b3ed61 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:01.174388 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c1ee79d4-6559-4ac6-b585-4828e6b3ed61 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:01.235073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c1ee79d4-6559-4ac6-b585-4828e6b3ed61 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:01.242930 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c1ee79d4-6559-4ac6-b585-4828e6b3ed61 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082051 Jul 27 20:38:01.243502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1565/3116] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:01 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:01.324108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ea4d175c-93cf-49de-b56e-599a8efe4910 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:01.324761 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ea4d175c-93cf-49de-b56e-599a8efe4910 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:01.332100 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ea4d175c-93cf-49de-b56e-599a8efe4910 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:01.332496 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ea4d175c-93cf-49de-b56e-599a8efe4910 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:01.333297 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ea4d175c-93cf-49de-b56e-599a8efe4910 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:01.333740 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ea4d175c-93cf-49de-b56e-599a8efe4910 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:01.459962 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ea4d175c-93cf-49de-b56e-599a8efe4910 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:01.468083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ea4d175c-93cf-49de-b56e-599a8efe4910 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.147875 Jul 27 20:38:01.468647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1552/3117] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:01 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:01.584576 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-dc01d388-b52d-4088-b58b-c0bebbb332b7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:01.585153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-dc01d388-b52d-4088-b58b-c0bebbb332b7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:01.591318 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc01d388-b52d-4088-b58b-c0bebbb332b7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:01.591798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc01d388-b52d-4088-b58b-c0bebbb332b7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:01.592553 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc01d388-b52d-4088-b58b-c0bebbb332b7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:01.593010 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc01d388-b52d-4088-b58b-c0bebbb332b7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:01.722407 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-dc01d388-b52d-4088-b58b-c0bebbb332b7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:01.730778 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-dc01d388-b52d-4088-b58b-c0bebbb332b7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:01.732325 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-dc01d388-b52d-4088-b58b-c0bebbb332b7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:01.733525 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-dc01d388-b52d-4088-b58b-c0bebbb332b7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152936 Jul 27 20:38:01.734090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1566/3118] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:01 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:02.264001 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e4011562-f388-4846-a6d4-24b2d3fc9e50 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:02.264627 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e4011562-f388-4846-a6d4-24b2d3fc9e50 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:02.270732 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4011562-f388-4846-a6d4-24b2d3fc9e50 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:02.271186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4011562-f388-4846-a6d4-24b2d3fc9e50 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:02.271957 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4011562-f388-4846-a6d4-24b2d3fc9e50 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:02.272396 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4011562-f388-4846-a6d4-24b2d3fc9e50 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:02.335798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e4011562-f388-4846-a6d4-24b2d3fc9e50 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:02.343701 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e4011562-f388-4846-a6d4-24b2d3fc9e50 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083826 Jul 27 20:38:02.344267 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1553/3119] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:02 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:02.490089 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-756b2ed0-f779-472c-b47c-a14963c9d792 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:02.490727 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-756b2ed0-f779-472c-b47c-a14963c9d792 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:02.496839 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-756b2ed0-f779-472c-b47c-a14963c9d792 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:02.497318 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-756b2ed0-f779-472c-b47c-a14963c9d792 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:02.498072 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-756b2ed0-f779-472c-b47c-a14963c9d792 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:02.498503 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-756b2ed0-f779-472c-b47c-a14963c9d792 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:02.629243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-756b2ed0-f779-472c-b47c-a14963c9d792 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:02.639166 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-756b2ed0-f779-472c-b47c-a14963c9d792 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153316 Jul 27 20:38:02.640007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1567/3120] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:02 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:02.757593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-406d3079-5d20-424a-99d9-50cafa5b56d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:02.758213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-406d3079-5d20-424a-99d9-50cafa5b56d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:02.767948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-406d3079-5d20-424a-99d9-50cafa5b56d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:02.768404 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-406d3079-5d20-424a-99d9-50cafa5b56d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:02.769328 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-406d3079-5d20-424a-99d9-50cafa5b56d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:02.769778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-406d3079-5d20-424a-99d9-50cafa5b56d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:02.932471 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-406d3079-5d20-424a-99d9-50cafa5b56d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:02.942266 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-406d3079-5d20-424a-99d9-50cafa5b56d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:02.943770 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-406d3079-5d20-424a-99d9-50cafa5b56d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:02.948296 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-406d3079-5d20-424a-99d9-50cafa5b56d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.191286 Jul 27 20:38:02.948885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1554/3121] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:02 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:38:03.365460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-16495d21-9a67-42fb-b05c-207184795126 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:03.366001 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-16495d21-9a67-42fb-b05c-207184795126 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:03.369394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=76 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:03.375199 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-16495d21-9a67-42fb-b05c-207184795126 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:03.376411 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-16495d21-9a67-42fb-b05c-207184795126 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:03.377218 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-16495d21-9a67-42fb-b05c-207184795126 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:03.377666 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-16495d21-9a67-42fb-b05c-207184795126 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:03.449678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-16495d21-9a67-42fb-b05c-207184795126 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:03.463460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-16495d21-9a67-42fb-b05c-207184795126 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.101505 Jul 27 20:38:03.464307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1568/3122] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:03 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:03.661674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dd768234-5e47-44ac-ac60-3f0732b30c73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:03.662282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dd768234-5e47-44ac-ac60-3f0732b30c73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:03.664729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=82 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:03.670285 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd768234-5e47-44ac-ac60-3f0732b30c73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:03.670735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd768234-5e47-44ac-ac60-3f0732b30c73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:03.671487 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd768234-5e47-44ac-ac60-3f0732b30c73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:03.671915 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd768234-5e47-44ac-ac60-3f0732b30c73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:03.800621 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dd768234-5e47-44ac-ac60-3f0732b30c73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:03.808479 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dd768234-5e47-44ac-ac60-3f0732b30c73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151437 Jul 27 20:38:03.809064 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1555/3123] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:03 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:03.974541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5453ac30-fd5e-451d-84b4-871b189dcc9a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:03.975096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5453ac30-fd5e-451d-84b4-871b189dcc9a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:03.981609 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5453ac30-fd5e-451d-84b4-871b189dcc9a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:03.982061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5453ac30-fd5e-451d-84b4-871b189dcc9a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:03.982824 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5453ac30-fd5e-451d-84b4-871b189dcc9a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:03.983265 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5453ac30-fd5e-451d-84b4-871b189dcc9a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:04.114589 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5453ac30-fd5e-451d-84b4-871b189dcc9a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:04.122946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5453ac30-fd5e-451d-84b4-871b189dcc9a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:04.124447 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5453ac30-fd5e-451d-84b4-871b189dcc9a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:04.125637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5453ac30-fd5e-451d-84b4-871b189dcc9a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155065 Jul 27 20:38:04.126240 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1569/3124] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:03 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:38:04.487165 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e863e2b1-7c40-4905-ad49-ce89a3364ed2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:04.487781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e863e2b1-7c40-4905-ad49-ce89a3364ed2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:04.493911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e863e2b1-7c40-4905-ad49-ce89a3364ed2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:04.494363 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e863e2b1-7c40-4905-ad49-ce89a3364ed2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:04.495124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e863e2b1-7c40-4905-ad49-ce89a3364ed2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:04.495565 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e863e2b1-7c40-4905-ad49-ce89a3364ed2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:04.558722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e863e2b1-7c40-4905-ad49-ce89a3364ed2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:04.567411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e863e2b1-7c40-4905-ad49-ce89a3364ed2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084192 Jul 27 20:38:04.567973 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1556/3125] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:04 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:04.831206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-dc4981ab-8929-4a43-b8d9-a371624ed929 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:04.831728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-dc4981ab-8929-4a43-b8d9-a371624ed929 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:04.837786 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc4981ab-8929-4a43-b8d9-a371624ed929 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:04.838232 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc4981ab-8929-4a43-b8d9-a371624ed929 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:04.838984 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc4981ab-8929-4a43-b8d9-a371624ed929 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:04.839421 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc4981ab-8929-4a43-b8d9-a371624ed929 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:04.967488 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-dc4981ab-8929-4a43-b8d9-a371624ed929 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:04.975673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-dc4981ab-8929-4a43-b8d9-a371624ed929 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149488 Jul 27 20:38:04.976254 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1570/3126] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:04 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:05.149102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a9f70726-a7d4-4f69-9e74-754884656f2e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:05.149710 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a9f70726-a7d4-4f69-9e74-754884656f2e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:05.156042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a9f70726-a7d4-4f69-9e74-754884656f2e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:05.156485 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a9f70726-a7d4-4f69-9e74-754884656f2e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:05.160528 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a9f70726-a7d4-4f69-9e74-754884656f2e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:05.160528 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a9f70726-a7d4-4f69-9e74-754884656f2e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:05.514965 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a9f70726-a7d4-4f69-9e74-754884656f2e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:05.518981 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:05.525241 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a9f70726-a7d4-4f69-9e74-754884656f2e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:05.526729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a9f70726-a7d4-4f69-9e74-754884656f2e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:05.527878 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a9f70726-a7d4-4f69-9e74-754884656f2e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.382786 Jul 27 20:38:05.528424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1557/3127] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:05 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:05.588950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4b56b0ab-f1a5-408e-a800-4f8deab92a5c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:05.589597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4b56b0ab-f1a5-408e-a800-4f8deab92a5c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:05.596021 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4b56b0ab-f1a5-408e-a800-4f8deab92a5c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:05.596487 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4b56b0ab-f1a5-408e-a800-4f8deab92a5c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:05.597280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4b56b0ab-f1a5-408e-a800-4f8deab92a5c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:05.597727 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4b56b0ab-f1a5-408e-a800-4f8deab92a5c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:05.659797 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4b56b0ab-f1a5-408e-a800-4f8deab92a5c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:05.667730 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4b56b0ab-f1a5-408e-a800-4f8deab92a5c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082598 Jul 27 20:38:05.668294 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1571/3128] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:05 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:05.997070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-aabcef70-91e5-4fca-b582-7a9b78384837 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:05.997689 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-aabcef70-91e5-4fca-b582-7a9b78384837 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:06.004576 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aabcef70-91e5-4fca-b582-7a9b78384837 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:06.005058 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aabcef70-91e5-4fca-b582-7a9b78384837 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:06.005824 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aabcef70-91e5-4fca-b582-7a9b78384837 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:06.006262 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aabcef70-91e5-4fca-b582-7a9b78384837 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:06.138002 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aabcef70-91e5-4fca-b582-7a9b78384837 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:06.146035 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-aabcef70-91e5-4fca-b582-7a9b78384837 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152892 Jul 27 20:38:06.146602 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1558/3129] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:05 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:06.551830 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-86b934da-9d9e-469e-b5f8-34f8675f9529 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:06.552424 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-86b934da-9d9e-469e-b5f8-34f8675f9529 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:06.558473 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-86b934da-9d9e-469e-b5f8-34f8675f9529 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:06.558924 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-86b934da-9d9e-469e-b5f8-34f8675f9529 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:06.559685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-86b934da-9d9e-469e-b5f8-34f8675f9529 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:06.560127 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-86b934da-9d9e-469e-b5f8-34f8675f9529 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:06.688023 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a8b41c99-a4d6-4bb9-bf5f-9026d32e024e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:06.689032 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a8b41c99-a4d6-4bb9-bf5f-9026d32e024e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:06.691374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-86b934da-9d9e-469e-b5f8-34f8675f9529 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:06.695500 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a8b41c99-a4d6-4bb9-bf5f-9026d32e024e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:06.695950 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a8b41c99-a4d6-4bb9-bf5f-9026d32e024e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:06.696754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a8b41c99-a4d6-4bb9-bf5f-9026d32e024e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:06.697225 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a8b41c99-a4d6-4bb9-bf5f-9026d32e024e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:06.699948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-86b934da-9d9e-469e-b5f8-34f8675f9529 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:06.701486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-86b934da-9d9e-469e-b5f8-34f8675f9529 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:06.702662 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-86b934da-9d9e-469e-b5f8-34f8675f9529 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155028 Jul 27 20:38:06.703493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1572/3130] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:06 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:06.761516 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a8b41c99-a4d6-4bb9-bf5f-9026d32e024e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:06.769965 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a8b41c99-a4d6-4bb9-bf5f-9026d32e024e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085816 Jul 27 20:38:06.770525 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1559/3131] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:06 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:07.167588 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-afcf920d-2bcb-44d4-8220-f6cca1d72de6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:07.168209 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-afcf920d-2bcb-44d4-8220-f6cca1d72de6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:07.174788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-afcf920d-2bcb-44d4-8220-f6cca1d72de6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:07.175239 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-afcf920d-2bcb-44d4-8220-f6cca1d72de6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:07.176039 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-afcf920d-2bcb-44d4-8220-f6cca1d72de6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:07.176479 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-afcf920d-2bcb-44d4-8220-f6cca1d72de6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:07.304014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-afcf920d-2bcb-44d4-8220-f6cca1d72de6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:07.312123 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-afcf920d-2bcb-44d4-8220-f6cca1d72de6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148445 Jul 27 20:38:07.312694 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1573/3132] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:07 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:07.727602 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ef2c28bb-5d25-498c-afec-b53689676c1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:07.728209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ef2c28bb-5d25-498c-afec-b53689676c1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:07.735143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef2c28bb-5d25-498c-afec-b53689676c1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:07.735844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef2c28bb-5d25-498c-afec-b53689676c1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:07.736705 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef2c28bb-5d25-498c-afec-b53689676c1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:07.737165 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef2c28bb-5d25-498c-afec-b53689676c1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:07.790446 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b710f436-0509-43c2-a107-f77dbf8f61d9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:07.791064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b710f436-0509-43c2-a107-f77dbf8f61d9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:07.797868 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b710f436-0509-43c2-a107-f77dbf8f61d9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:07.798326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b710f436-0509-43c2-a107-f77dbf8f61d9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:07.799142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b710f436-0509-43c2-a107-f77dbf8f61d9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:07.799589 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b710f436-0509-43c2-a107-f77dbf8f61d9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:07.818517 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:07.863622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b710f436-0509-43c2-a107-f77dbf8f61d9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:07.866197 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ef2c28bb-5d25-498c-afec-b53689676c1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:07.871579 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b710f436-0509-43c2-a107-f77dbf8f61d9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084942 Jul 27 20:38:07.872157 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1574/3133] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:07 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:07.874557 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ef2c28bb-5d25-498c-afec-b53689676c1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:07.876896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ef2c28bb-5d25-498c-afec-b53689676c1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:07.878128 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ef2c28bb-5d25-498c-afec-b53689676c1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.154350 Jul 27 20:38:07.878678 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1560/3134] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:07 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:08.334250 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b6045731-c79d-46dc-b1af-52257b131c9e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:08.334831 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b6045731-c79d-46dc-b1af-52257b131c9e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:08.341097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b6045731-c79d-46dc-b1af-52257b131c9e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:08.341561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b6045731-c79d-46dc-b1af-52257b131c9e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:08.342322 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b6045731-c79d-46dc-b1af-52257b131c9e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:08.342763 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b6045731-c79d-46dc-b1af-52257b131c9e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:08.474026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b6045731-c79d-46dc-b1af-52257b131c9e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:08.481766 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b6045731-c79d-46dc-b1af-52257b131c9e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151490 Jul 27 20:38:08.482322 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1575/3135] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:08 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:08.892832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1ced6a0a-de4c-4177-aa8e-106ebb60a4b6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:08.893475 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1ced6a0a-de4c-4177-aa8e-106ebb60a4b6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:08.900173 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1ced6a0a-de4c-4177-aa8e-106ebb60a4b6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:08.900627 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1ced6a0a-de4c-4177-aa8e-106ebb60a4b6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:08.901432 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1ced6a0a-de4c-4177-aa8e-106ebb60a4b6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:08.901870 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1ced6a0a-de4c-4177-aa8e-106ebb60a4b6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:08.901992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-647c5bc4-90fb-4ec1-9501-9050e1f0d9bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:08.902549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-647c5bc4-90fb-4ec1-9501-9050e1f0d9bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:08.909587 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-647c5bc4-90fb-4ec1-9501-9050e1f0d9bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:08.910032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-647c5bc4-90fb-4ec1-9501-9050e1f0d9bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:08.910787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-647c5bc4-90fb-4ec1-9501-9050e1f0d9bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:08.911225 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-647c5bc4-90fb-4ec1-9501-9050e1f0d9bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:08.968001 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1ced6a0a-de4c-4177-aa8e-106ebb60a4b6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:08.976686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1ced6a0a-de4c-4177-aa8e-106ebb60a4b6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.088316 Jul 27 20:38:08.977348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1561/3136] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:08 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:09.041834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-647c5bc4-90fb-4ec1-9501-9050e1f0d9bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:09.050892 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-647c5bc4-90fb-4ec1-9501-9050e1f0d9bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:09.052389 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-647c5bc4-90fb-4ec1-9501-9050e1f0d9bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:09.053600 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-647c5bc4-90fb-4ec1-9501-9050e1f0d9bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155584 Jul 27 20:38:09.054156 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1576/3137] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:08 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:38:09.504270 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-12ec1a5e-5cdf-448c-b9de-b279840cf590 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:09.504882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-12ec1a5e-5cdf-448c-b9de-b279840cf590 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:09.510882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12ec1a5e-5cdf-448c-b9de-b279840cf590 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:09.511327 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12ec1a5e-5cdf-448c-b9de-b279840cf590 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:09.512082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12ec1a5e-5cdf-448c-b9de-b279840cf590 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:09.512519 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12ec1a5e-5cdf-448c-b9de-b279840cf590 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:09.641132 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-12ec1a5e-5cdf-448c-b9de-b279840cf590 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:09.649188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-12ec1a5e-5cdf-448c-b9de-b279840cf590 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149580 Jul 27 20:38:09.649749 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1562/3138] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:09 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:09.997703 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-29900368-6e61-4173-beab-d7cad22238b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:09.998319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-29900368-6e61-4173-beab-d7cad22238b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:10.005143 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-29900368-6e61-4173-beab-d7cad22238b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:10.005622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-29900368-6e61-4173-beab-d7cad22238b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:10.006385 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-29900368-6e61-4173-beab-d7cad22238b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:10.006825 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-29900368-6e61-4173-beab-d7cad22238b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:10.067659 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-29900368-6e61-4173-beab-d7cad22238b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:10.075808 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-29900368-6e61-4173-beab-d7cad22238b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081942 Jul 27 20:38:10.076710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1577/3139] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:09 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:10.077417 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-33f1c4eb-3f61-4977-9a41-d078762e5c3f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:10.078279 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-33f1c4eb-3f61-4977-9a41-d078762e5c3f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:10.085078 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33f1c4eb-3f61-4977-9a41-d078762e5c3f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:10.085523 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33f1c4eb-3f61-4977-9a41-d078762e5c3f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:10.086279 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33f1c4eb-3f61-4977-9a41-d078762e5c3f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:10.086710 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33f1c4eb-3f61-4977-9a41-d078762e5c3f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:10.215082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-33f1c4eb-3f61-4977-9a41-d078762e5c3f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:10.224046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-33f1c4eb-3f61-4977-9a41-d078762e5c3f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:10.225560 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-33f1c4eb-3f61-4977-9a41-d078762e5c3f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:10.226739 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-33f1c4eb-3f61-4977-9a41-d078762e5c3f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153148 Jul 27 20:38:10.227287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1563/3140] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:10 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:38:10.670392 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4a10b5a9-2cb2-437a-be79-b766ccf5cb5f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:10.671009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4a10b5a9-2cb2-437a-be79-b766ccf5cb5f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:10.677227 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4a10b5a9-2cb2-437a-be79-b766ccf5cb5f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:10.677672 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4a10b5a9-2cb2-437a-be79-b766ccf5cb5f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:10.678490 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4a10b5a9-2cb2-437a-be79-b766ccf5cb5f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:10.678924 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4a10b5a9-2cb2-437a-be79-b766ccf5cb5f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:10.807930 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4a10b5a9-2cb2-437a-be79-b766ccf5cb5f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:10.816580 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4a10b5a9-2cb2-437a-be79-b766ccf5cb5f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149972 Jul 27 20:38:10.817184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1578/3141] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:10 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:11.096890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-21125bf5-8016-47ed-bc7d-a8528a2aa7ce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:11.097530 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-21125bf5-8016-47ed-bc7d-a8528a2aa7ce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:11.103973 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21125bf5-8016-47ed-bc7d-a8528a2aa7ce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:11.104425 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21125bf5-8016-47ed-bc7d-a8528a2aa7ce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:11.105219 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21125bf5-8016-47ed-bc7d-a8528a2aa7ce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:11.105655 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21125bf5-8016-47ed-bc7d-a8528a2aa7ce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:11.166425 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-21125bf5-8016-47ed-bc7d-a8528a2aa7ce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:11.174902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-21125bf5-8016-47ed-bc7d-a8528a2aa7ce tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082317 Jul 27 20:38:11.175458 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1564/3142] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:11 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:11.249742 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b19f3dda-45c7-40a2-991f-3ef7757cc87b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:11.250357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b19f3dda-45c7-40a2-991f-3ef7757cc87b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:11.257477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b19f3dda-45c7-40a2-991f-3ef7757cc87b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:11.257928 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b19f3dda-45c7-40a2-991f-3ef7757cc87b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:11.258687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b19f3dda-45c7-40a2-991f-3ef7757cc87b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:11.259125 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b19f3dda-45c7-40a2-991f-3ef7757cc87b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:11.384991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b19f3dda-45c7-40a2-991f-3ef7757cc87b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:11.393324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b19f3dda-45c7-40a2-991f-3ef7757cc87b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:11.394842 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b19f3dda-45c7-40a2-991f-3ef7757cc87b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:11.396005 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b19f3dda-45c7-40a2-991f-3ef7757cc87b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.150166 Jul 27 20:38:11.396572 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1579/3143] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:11 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:11.837981 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f617795b-9f4f-466f-a2e5-4f4aca1e4da5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:11.838597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f617795b-9f4f-466f-a2e5-4f4aca1e4da5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:11.845234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f617795b-9f4f-466f-a2e5-4f4aca1e4da5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:11.845689 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f617795b-9f4f-466f-a2e5-4f4aca1e4da5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:11.846447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f617795b-9f4f-466f-a2e5-4f4aca1e4da5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:11.846885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f617795b-9f4f-466f-a2e5-4f4aca1e4da5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:11.982312 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f617795b-9f4f-466f-a2e5-4f4aca1e4da5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:11.990349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f617795b-9f4f-466f-a2e5-4f4aca1e4da5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.156268 Jul 27 20:38:11.990911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1565/3144] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:11 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:12.197584 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-571fff22-1fa2-45aa-8c82-3274f58193d1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:12.198200 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-571fff22-1fa2-45aa-8c82-3274f58193d1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:12.205268 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-571fff22-1fa2-45aa-8c82-3274f58193d1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:12.205722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-571fff22-1fa2-45aa-8c82-3274f58193d1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:12.206487 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-571fff22-1fa2-45aa-8c82-3274f58193d1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:12.206930 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-571fff22-1fa2-45aa-8c82-3274f58193d1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:12.270046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-571fff22-1fa2-45aa-8c82-3274f58193d1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:12.280023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-571fff22-1fa2-45aa-8c82-3274f58193d1 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.086316 Jul 27 20:38:12.280592 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1580/3145] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:12 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:12.418821 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-16918dc0-03e1-4de2-93d7-766fb9b10cdc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:12.419426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-16918dc0-03e1-4de2-93d7-766fb9b10cdc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:12.425938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16918dc0-03e1-4de2-93d7-766fb9b10cdc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:12.426385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16918dc0-03e1-4de2-93d7-766fb9b10cdc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:12.427137 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16918dc0-03e1-4de2-93d7-766fb9b10cdc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:12.427563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16918dc0-03e1-4de2-93d7-766fb9b10cdc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:12.555736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-16918dc0-03e1-4de2-93d7-766fb9b10cdc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:12.564895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-16918dc0-03e1-4de2-93d7-766fb9b10cdc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:12.566436 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-16918dc0-03e1-4de2-93d7-766fb9b10cdc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:12.567597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-16918dc0-03e1-4de2-93d7-766fb9b10cdc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152700 Jul 27 20:38:12.568159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1566/3146] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:12 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:13.011602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1cf3fc21-08c3-4747-b1d9-945441b2478a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:13.012210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1cf3fc21-08c3-4747-b1d9-945441b2478a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:13.018668 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1cf3fc21-08c3-4747-b1d9-945441b2478a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:13.019121 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1cf3fc21-08c3-4747-b1d9-945441b2478a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:13.019925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1cf3fc21-08c3-4747-b1d9-945441b2478a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:13.020367 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1cf3fc21-08c3-4747-b1d9-945441b2478a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:13.151965 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1cf3fc21-08c3-4747-b1d9-945441b2478a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:13.160480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1cf3fc21-08c3-4747-b1d9-945441b2478a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152747 Jul 27 20:38:13.161063 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1581/3147] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:13 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:13.301719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-39ffff48-e0a6-4eed-8e9d-7788f51103df tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:13.302251 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-39ffff48-e0a6-4eed-8e9d-7788f51103df tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:13.308278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39ffff48-e0a6-4eed-8e9d-7788f51103df tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:13.308734 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39ffff48-e0a6-4eed-8e9d-7788f51103df tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:13.309537 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39ffff48-e0a6-4eed-8e9d-7788f51103df tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:13.309977 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39ffff48-e0a6-4eed-8e9d-7788f51103df tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:13.373677 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-39ffff48-e0a6-4eed-8e9d-7788f51103df tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:13.381704 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-39ffff48-e0a6-4eed-8e9d-7788f51103df tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084068 Jul 27 20:38:13.382269 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1567/3148] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:13 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:13.591090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5a10df53-a741-4025-a325-b32129008271 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:13.591663 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5a10df53-a741-4025-a325-b32129008271 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:13.599252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5a10df53-a741-4025-a325-b32129008271 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:13.599749 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5a10df53-a741-4025-a325-b32129008271 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:13.600548 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5a10df53-a741-4025-a325-b32129008271 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:13.601037 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5a10df53-a741-4025-a325-b32129008271 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:13.734628 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5a10df53-a741-4025-a325-b32129008271 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:13.743005 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5a10df53-a741-4025-a325-b32129008271 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:13.744516 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5a10df53-a741-4025-a325-b32129008271 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:13.745710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5a10df53-a741-4025-a325-b32129008271 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.158781 Jul 27 20:38:13.746274 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1582/3149] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:13 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:14.182178 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-69732f94-7bdc-4c75-a139-3eac84353f03 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:14.182793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-69732f94-7bdc-4c75-a139-3eac84353f03 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:14.190286 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-69732f94-7bdc-4c75-a139-3eac84353f03 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:14.190738 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-69732f94-7bdc-4c75-a139-3eac84353f03 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:14.191497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-69732f94-7bdc-4c75-a139-3eac84353f03 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:14.191935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-69732f94-7bdc-4c75-a139-3eac84353f03 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:14.320116 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-69732f94-7bdc-4c75-a139-3eac84353f03 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:14.328255 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-69732f94-7bdc-4c75-a139-3eac84353f03 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149625 Jul 27 20:38:14.328812 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1568/3150] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:14 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:14.402805 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3391cc85-ee9b-4c09-9a0d-80da0fe6c947 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:14.403412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3391cc85-ee9b-4c09-9a0d-80da0fe6c947 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:14.409996 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3391cc85-ee9b-4c09-9a0d-80da0fe6c947 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:14.410441 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3391cc85-ee9b-4c09-9a0d-80da0fe6c947 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:14.411193 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3391cc85-ee9b-4c09-9a0d-80da0fe6c947 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:14.411629 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3391cc85-ee9b-4c09-9a0d-80da0fe6c947 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:14.477558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3391cc85-ee9b-4c09-9a0d-80da0fe6c947 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:14.486164 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3391cc85-ee9b-4c09-9a0d-80da0fe6c947 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.087280 Jul 27 20:38:14.486736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1583/3151] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:14 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:14.770266 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b6b80af8-7d5a-43e2-a7d7-b94e39975b2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:14.770910 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b6b80af8-7d5a-43e2-a7d7-b94e39975b2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:14.777048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6b80af8-7d5a-43e2-a7d7-b94e39975b2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:14.777503 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6b80af8-7d5a-43e2-a7d7-b94e39975b2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:14.778268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6b80af8-7d5a-43e2-a7d7-b94e39975b2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:14.778717 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6b80af8-7d5a-43e2-a7d7-b94e39975b2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:14.909676 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b6b80af8-7d5a-43e2-a7d7-b94e39975b2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:14.918002 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b6b80af8-7d5a-43e2-a7d7-b94e39975b2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:14.919515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b6b80af8-7d5a-43e2-a7d7-b94e39975b2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:14.920683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b6b80af8-7d5a-43e2-a7d7-b94e39975b2b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.154919 Jul 27 20:38:14.921274 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1569/3152] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:14 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:15.349831 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-97c924f3-1798-4710-86d7-bdaf19526008 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:15.350387 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-97c924f3-1798-4710-86d7-bdaf19526008 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:15.356805 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-97c924f3-1798-4710-86d7-bdaf19526008 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:15.357291 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-97c924f3-1798-4710-86d7-bdaf19526008 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:15.358060 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-97c924f3-1798-4710-86d7-bdaf19526008 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:15.358503 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-97c924f3-1798-4710-86d7-bdaf19526008 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:15.486889 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-97c924f3-1798-4710-86d7-bdaf19526008 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:15.494873 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-97c924f3-1798-4710-86d7-bdaf19526008 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149042 Jul 27 20:38:15.495439 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1584/3153] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:15 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:15.506789 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3678e2b6-5890-44d1-a0a7-189e7d831375 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:15.507406 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3678e2b6-5890-44d1-a0a7-189e7d831375 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:15.513879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3678e2b6-5890-44d1-a0a7-189e7d831375 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:15.514333 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3678e2b6-5890-44d1-a0a7-189e7d831375 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:15.515091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3678e2b6-5890-44d1-a0a7-189e7d831375 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:15.515539 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3678e2b6-5890-44d1-a0a7-189e7d831375 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:15.582192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3678e2b6-5890-44d1-a0a7-189e7d831375 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:15.590069 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3678e2b6-5890-44d1-a0a7-189e7d831375 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.087161 Jul 27 20:38:15.590631 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1570/3154] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:15 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:15.944991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4f71ff4c-837d-4fe4-bc9b-d90b71dcdcd4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:15.945607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4f71ff4c-837d-4fe4-bc9b-d90b71dcdcd4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:15.951723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4f71ff4c-837d-4fe4-bc9b-d90b71dcdcd4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:15.952116 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4f71ff4c-837d-4fe4-bc9b-d90b71dcdcd4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:15.953158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4f71ff4c-837d-4fe4-bc9b-d90b71dcdcd4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:15.953596 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4f71ff4c-837d-4fe4-bc9b-d90b71dcdcd4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:16.080201 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4f71ff4c-837d-4fe4-bc9b-d90b71dcdcd4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:16.088588 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4f71ff4c-837d-4fe4-bc9b-d90b71dcdcd4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:16.090133 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4f71ff4c-837d-4fe4-bc9b-d90b71dcdcd4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:16.091306 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4f71ff4c-837d-4fe4-bc9b-d90b71dcdcd4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.150293 Jul 27 20:38:16.091869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1585/3155] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:15 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:16.516987 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2c50b517-be2a-495b-9a5b-42c69bd9d3bc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:16.517606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2c50b517-be2a-495b-9a5b-42c69bd9d3bc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:16.524348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c50b517-be2a-495b-9a5b-42c69bd9d3bc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:16.524801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c50b517-be2a-495b-9a5b-42c69bd9d3bc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:16.525722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c50b517-be2a-495b-9a5b-42c69bd9d3bc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:16.526166 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c50b517-be2a-495b-9a5b-42c69bd9d3bc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:16.611019 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e1a8bb07-f974-434b-8372-0cb5a11b2123 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:16.611675 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e1a8bb07-f974-434b-8372-0cb5a11b2123 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:16.618360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1a8bb07-f974-434b-8372-0cb5a11b2123 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:16.618818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1a8bb07-f974-434b-8372-0cb5a11b2123 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:16.619592 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1a8bb07-f974-434b-8372-0cb5a11b2123 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:16.620040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1a8bb07-f974-434b-8372-0cb5a11b2123 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:16.657057 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2c50b517-be2a-495b-9a5b-42c69bd9d3bc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:16.665373 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2c50b517-be2a-495b-9a5b-42c69bd9d3bc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152793 Jul 27 20:38:16.665993 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1571/3156] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:16 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:16.685297 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e1a8bb07-f974-434b-8372-0cb5a11b2123 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:16.693879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e1a8bb07-f974-434b-8372-0cb5a11b2123 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.086997 Jul 27 20:38:16.694451 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1586/3157] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:16 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:17.115583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b84379f0-0c88-45fb-8472-ae81252cded6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:17.116319 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b84379f0-0c88-45fb-8472-ae81252cded6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:17.124086 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b84379f0-0c88-45fb-8472-ae81252cded6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:17.124582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b84379f0-0c88-45fb-8472-ae81252cded6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:17.126793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b84379f0-0c88-45fb-8472-ae81252cded6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:17.127305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b84379f0-0c88-45fb-8472-ae81252cded6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:17.254843 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b84379f0-0c88-45fb-8472-ae81252cded6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:17.263053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b84379f0-0c88-45fb-8472-ae81252cded6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:17.264534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b84379f0-0c88-45fb-8472-ae81252cded6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:17.265703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b84379f0-0c88-45fb-8472-ae81252cded6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.154040 Jul 27 20:38:17.266320 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1572/3158] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:17 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:17.686459 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bfef58a2-a87c-48a1-a5de-4f111c07e3e5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:17.687072 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bfef58a2-a87c-48a1-a5de-4f111c07e3e5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:17.693656 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bfef58a2-a87c-48a1-a5de-4f111c07e3e5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:17.694111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bfef58a2-a87c-48a1-a5de-4f111c07e3e5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:17.694868 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bfef58a2-a87c-48a1-a5de-4f111c07e3e5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:17.695307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bfef58a2-a87c-48a1-a5de-4f111c07e3e5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:17.715440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-599ee6bd-acaf-4b90-8c63-920be29a6d62 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:17.716055 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-599ee6bd-acaf-4b90-8c63-920be29a6d62 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:17.722778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-599ee6bd-acaf-4b90-8c63-920be29a6d62 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:17.726689 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-599ee6bd-acaf-4b90-8c63-920be29a6d62 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:17.727462 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-599ee6bd-acaf-4b90-8c63-920be29a6d62 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:17.727918 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-599ee6bd-acaf-4b90-8c63-920be29a6d62 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:17.795087 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-599ee6bd-acaf-4b90-8c63-920be29a6d62 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:17.803159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-599ee6bd-acaf-4b90-8c63-920be29a6d62 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.091783 Jul 27 20:38:17.803738 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1573/3159] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:17 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:17.830772 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bfef58a2-a87c-48a1-a5de-4f111c07e3e5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:17.838746 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bfef58a2-a87c-48a1-a5de-4f111c07e3e5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.156166 Jul 27 20:38:17.839302 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1587/3160] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:17 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:18.288899 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-600ba6ff-dca3-44c9-8967-23baa412186f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:18.289535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-600ba6ff-dca3-44c9-8967-23baa412186f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:18.295561 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-600ba6ff-dca3-44c9-8967-23baa412186f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:18.296012 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-600ba6ff-dca3-44c9-8967-23baa412186f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:18.296772 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-600ba6ff-dca3-44c9-8967-23baa412186f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:18.297241 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-600ba6ff-dca3-44c9-8967-23baa412186f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:18.315476 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:18.427169 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-600ba6ff-dca3-44c9-8967-23baa412186f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:18.435393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-600ba6ff-dca3-44c9-8967-23baa412186f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:18.436880 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-600ba6ff-dca3-44c9-8967-23baa412186f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:18.438632 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-600ba6ff-dca3-44c9-8967-23baa412186f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153100 Jul 27 20:38:18.439295 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1574/3161] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:18 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:18.823724 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e70cc97a-ba82-4e2c-b886-77640fcab3f4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:18.824344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e70cc97a-ba82-4e2c-b886-77640fcab3f4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:18.831304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e70cc97a-ba82-4e2c-b886-77640fcab3f4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:18.831763 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e70cc97a-ba82-4e2c-b886-77640fcab3f4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:18.832652 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e70cc97a-ba82-4e2c-b886-77640fcab3f4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:18.833180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e70cc97a-ba82-4e2c-b886-77640fcab3f4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:18.861900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-40541266-b4d6-4ba7-8ebb-8614f85f3020 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:18.862506 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-40541266-b4d6-4ba7-8ebb-8614f85f3020 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:18.869019 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-40541266-b4d6-4ba7-8ebb-8614f85f3020 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:18.869468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-40541266-b4d6-4ba7-8ebb-8614f85f3020 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:18.870233 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-40541266-b4d6-4ba7-8ebb-8614f85f3020 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:18.870668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-40541266-b4d6-4ba7-8ebb-8614f85f3020 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:18.894577 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e70cc97a-ba82-4e2c-b886-77640fcab3f4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:18.902598 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e70cc97a-ba82-4e2c-b886-77640fcab3f4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082761 Jul 27 20:38:18.903172 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1588/3162] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:18 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:19.004629 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-40541266-b4d6-4ba7-8ebb-8614f85f3020 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:19.012456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-40541266-b4d6-4ba7-8ebb-8614f85f3020 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.155093 Jul 27 20:38:19.013029 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1575/3163] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:18 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:19.462863 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-db9bb8dd-4718-443d-9ea1-c326dea96d92 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:19.463481 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-db9bb8dd-4718-443d-9ea1-c326dea96d92 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:19.470278 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-db9bb8dd-4718-443d-9ea1-c326dea96d92 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:19.470733 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-db9bb8dd-4718-443d-9ea1-c326dea96d92 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:19.471495 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-db9bb8dd-4718-443d-9ea1-c326dea96d92 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:19.471939 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-db9bb8dd-4718-443d-9ea1-c326dea96d92 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:19.600421 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-db9bb8dd-4718-443d-9ea1-c326dea96d92 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:19.608709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-db9bb8dd-4718-443d-9ea1-c326dea96d92 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:19.610840 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-db9bb8dd-4718-443d-9ea1-c326dea96d92 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:19.612024 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-db9bb8dd-4718-443d-9ea1-c326dea96d92 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153209 Jul 27 20:38:19.612578 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1589/3164] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:19 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:19.926858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-04564ae8-af10-4dbe-9676-073953e60b34 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:19.927462 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-04564ae8-af10-4dbe-9676-073953e60b34 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:19.934464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04564ae8-af10-4dbe-9676-073953e60b34 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:19.934899 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04564ae8-af10-4dbe-9676-073953e60b34 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:19.935647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04564ae8-af10-4dbe-9676-073953e60b34 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:19.936076 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04564ae8-af10-4dbe-9676-073953e60b34 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:20.002500 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-04564ae8-af10-4dbe-9676-073953e60b34 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:20.010393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-04564ae8-af10-4dbe-9676-073953e60b34 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.088127 Jul 27 20:38:20.010953 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1576/3165] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:19 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:20.034390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-016c6e7b-feef-4cab-95bd-009f0dae4fb7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:20.035038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-016c6e7b-feef-4cab-95bd-009f0dae4fb7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:20.041566 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-016c6e7b-feef-4cab-95bd-009f0dae4fb7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:20.042026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-016c6e7b-feef-4cab-95bd-009f0dae4fb7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:20.042802 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-016c6e7b-feef-4cab-95bd-009f0dae4fb7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:20.043246 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-016c6e7b-feef-4cab-95bd-009f0dae4fb7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:20.173619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-016c6e7b-feef-4cab-95bd-009f0dae4fb7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:20.181494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-016c6e7b-feef-4cab-95bd-009f0dae4fb7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151688 Jul 27 20:38:20.182071 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1590/3166] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:20 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:20.635303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0e02e53d-18a2-4c37-9dcb-7cada7f4eb09 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:20.635923 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0e02e53d-18a2-4c37-9dcb-7cada7f4eb09 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:20.642049 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e02e53d-18a2-4c37-9dcb-7cada7f4eb09 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:20.642526 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e02e53d-18a2-4c37-9dcb-7cada7f4eb09 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:20.643294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e02e53d-18a2-4c37-9dcb-7cada7f4eb09 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:20.643733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e02e53d-18a2-4c37-9dcb-7cada7f4eb09 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:20.777287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0e02e53d-18a2-4c37-9dcb-7cada7f4eb09 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:20.786265 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0e02e53d-18a2-4c37-9dcb-7cada7f4eb09 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:20.787767 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0e02e53d-18a2-4c37-9dcb-7cada7f4eb09 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:20.788937 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0e02e53d-18a2-4c37-9dcb-7cada7f4eb09 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157663 Jul 27 20:38:20.789520 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1577/3167] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:20 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:21.032530 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5683d95e-ad92-4914-94b9-4df578a82e94 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:21.033096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5683d95e-ad92-4914-94b9-4df578a82e94 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:21.039663 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5683d95e-ad92-4914-94b9-4df578a82e94 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:21.040238 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5683d95e-ad92-4914-94b9-4df578a82e94 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:21.040867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5683d95e-ad92-4914-94b9-4df578a82e94 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:21.041337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5683d95e-ad92-4914-94b9-4df578a82e94 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:21.045307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:21.104284 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5683d95e-ad92-4914-94b9-4df578a82e94 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:21.112923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5683d95e-ad92-4914-94b9-4df578a82e94 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084949 Jul 27 20:38:21.113510 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1591/3168] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:21 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:21.203338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-87c59359-3ac6-4df2-abfe-6043e7dd5082 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:21.204057 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-87c59359-3ac6-4df2-abfe-6043e7dd5082 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:21.210559 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87c59359-3ac6-4df2-abfe-6043e7dd5082 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:21.211008 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87c59359-3ac6-4df2-abfe-6043e7dd5082 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:21.211762 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87c59359-3ac6-4df2-abfe-6043e7dd5082 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:21.212199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87c59359-3ac6-4df2-abfe-6043e7dd5082 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:21.341045 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-87c59359-3ac6-4df2-abfe-6043e7dd5082 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:21.349446 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-87c59359-3ac6-4df2-abfe-6043e7dd5082 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150188 Jul 27 20:38:21.350004 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1578/3169] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:21 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:21.813350 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a03d4e39-0220-4bf3-b6f7-d440cf94d26a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:21.814448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a03d4e39-0220-4bf3-b6f7-d440cf94d26a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:21.820951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a03d4e39-0220-4bf3-b6f7-d440cf94d26a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:21.821421 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a03d4e39-0220-4bf3-b6f7-d440cf94d26a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:21.822180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a03d4e39-0220-4bf3-b6f7-d440cf94d26a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:21.822619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a03d4e39-0220-4bf3-b6f7-d440cf94d26a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:21.953113 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a03d4e39-0220-4bf3-b6f7-d440cf94d26a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:21.962240 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a03d4e39-0220-4bf3-b6f7-d440cf94d26a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:21.963737 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a03d4e39-0220-4bf3-b6f7-d440cf94d26a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:21.964901 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a03d4e39-0220-4bf3-b6f7-d440cf94d26a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156083 Jul 27 20:38:21.965483 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1592/3170] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:21 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:22.133919 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a0ac8db9-f7e7-480b-b561-a56b8f35639e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:22.134579 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a0ac8db9-f7e7-480b-b561-a56b8f35639e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:22.140548 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0ac8db9-f7e7-480b-b561-a56b8f35639e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:22.141018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0ac8db9-f7e7-480b-b561-a56b8f35639e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:22.141774 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0ac8db9-f7e7-480b-b561-a56b8f35639e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:22.142210 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0ac8db9-f7e7-480b-b561-a56b8f35639e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:22.206515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a0ac8db9-f7e7-480b-b561-a56b8f35639e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:22.215046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a0ac8db9-f7e7-480b-b561-a56b8f35639e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084880 Jul 27 20:38:22.215610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1579/3171] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:22 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:22.370292 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1468fe16-135b-4624-b162-0c2f4fc69c63 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:22.370908 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1468fe16-135b-4624-b162-0c2f4fc69c63 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:22.377516 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1468fe16-135b-4624-b162-0c2f4fc69c63 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:22.377965 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1468fe16-135b-4624-b162-0c2f4fc69c63 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:22.378750 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1468fe16-135b-4624-b162-0c2f4fc69c63 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:22.379189 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1468fe16-135b-4624-b162-0c2f4fc69c63 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:22.506455 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1468fe16-135b-4624-b162-0c2f4fc69c63 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:22.514484 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1468fe16-135b-4624-b162-0c2f4fc69c63 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148076 Jul 27 20:38:22.515044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1593/3172] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:22 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:22.990578 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bce3e79f-615f-4142-8d4e-1440c7ad1cc5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:22.991194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bce3e79f-615f-4142-8d4e-1440c7ad1cc5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:22.997235 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bce3e79f-615f-4142-8d4e-1440c7ad1cc5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:22.997692 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bce3e79f-615f-4142-8d4e-1440c7ad1cc5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:22.998477 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bce3e79f-615f-4142-8d4e-1440c7ad1cc5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:22.998925 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bce3e79f-615f-4142-8d4e-1440c7ad1cc5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:23.130003 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bce3e79f-615f-4142-8d4e-1440c7ad1cc5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:23.138365 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bce3e79f-615f-4142-8d4e-1440c7ad1cc5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:23.139890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bce3e79f-615f-4142-8d4e-1440c7ad1cc5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:23.141090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bce3e79f-615f-4142-8d4e-1440c7ad1cc5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156862 Jul 27 20:38:23.141686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1580/3173] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:22 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:23.236953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a59b6ea2-01df-4eb6-ab2e-96ccd94d90b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:23.237583 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a59b6ea2-01df-4eb6-ab2e-96ccd94d90b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:23.243686 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a59b6ea2-01df-4eb6-ab2e-96ccd94d90b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:23.244079 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a59b6ea2-01df-4eb6-ab2e-96ccd94d90b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:23.244839 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a59b6ea2-01df-4eb6-ab2e-96ccd94d90b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:23.245310 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a59b6ea2-01df-4eb6-ab2e-96ccd94d90b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:23.305062 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a59b6ea2-01df-4eb6-ab2e-96ccd94d90b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:23.312855 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a59b6ea2-01df-4eb6-ab2e-96ccd94d90b2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.080425 Jul 27 20:38:23.314091 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1594/3174] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:23 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:23.536164 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6d7d48c2-bf7d-4db6-885e-502b243f85d9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:23.536812 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6d7d48c2-bf7d-4db6-885e-502b243f85d9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:23.543244 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6d7d48c2-bf7d-4db6-885e-502b243f85d9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:23.543684 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6d7d48c2-bf7d-4db6-885e-502b243f85d9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:23.544434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6d7d48c2-bf7d-4db6-885e-502b243f85d9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:23.544952 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6d7d48c2-bf7d-4db6-885e-502b243f85d9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:23.672648 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6d7d48c2-bf7d-4db6-885e-502b243f85d9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:23.681094 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6d7d48c2-bf7d-4db6-885e-502b243f85d9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149373 Jul 27 20:38:23.681656 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1581/3175] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:23 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:24.164518 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-45a4a0d7-45a5-4c95-8a07-0286d0c3c1d9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:24.165165 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-45a4a0d7-45a5-4c95-8a07-0286d0c3c1d9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:24.171779 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-45a4a0d7-45a5-4c95-8a07-0286d0c3c1d9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:24.172236 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-45a4a0d7-45a5-4c95-8a07-0286d0c3c1d9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:24.173069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-45a4a0d7-45a5-4c95-8a07-0286d0c3c1d9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:24.173665 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-45a4a0d7-45a5-4c95-8a07-0286d0c3c1d9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:24.302931 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-45a4a0d7-45a5-4c95-8a07-0286d0c3c1d9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:24.311429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-45a4a0d7-45a5-4c95-8a07-0286d0c3c1d9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:24.312946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-45a4a0d7-45a5-4c95-8a07-0286d0c3c1d9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:24.314985 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-45a4a0d7-45a5-4c95-8a07-0286d0c3c1d9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.154353 Jul 27 20:38:24.315551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1595/3176] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:24 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:24.334302 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-607e3060-f381-48e7-a00f-356b0fa09cc7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:24.334854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-607e3060-f381-48e7-a00f-356b0fa09cc7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:24.340990 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-607e3060-f381-48e7-a00f-356b0fa09cc7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:24.341490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-607e3060-f381-48e7-a00f-356b0fa09cc7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:24.342313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-607e3060-f381-48e7-a00f-356b0fa09cc7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:24.342748 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-607e3060-f381-48e7-a00f-356b0fa09cc7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:24.406960 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-607e3060-f381-48e7-a00f-356b0fa09cc7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:24.415232 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-607e3060-f381-48e7-a00f-356b0fa09cc7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084777 Jul 27 20:38:24.415792 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1582/3177] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:24 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:24.702381 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-32af05a4-5257-4141-a91c-a97630e9d21c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:24.703253 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-32af05a4-5257-4141-a91c-a97630e9d21c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:24.709296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-32af05a4-5257-4141-a91c-a97630e9d21c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:24.709744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-32af05a4-5257-4141-a91c-a97630e9d21c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:24.710492 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-32af05a4-5257-4141-a91c-a97630e9d21c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:24.710935 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-32af05a4-5257-4141-a91c-a97630e9d21c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:24.837863 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-32af05a4-5257-4141-a91c-a97630e9d21c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:24.846171 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-32af05a4-5257-4141-a91c-a97630e9d21c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.147374 Jul 27 20:38:24.846735 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1596/3178] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:24 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:25.339496 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bfd0f882-f3ce-471c-a2a6-6eedf887c1f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:25.340027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bfd0f882-f3ce-471c-a2a6-6eedf887c1f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:25.347095 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfd0f882-f3ce-471c-a2a6-6eedf887c1f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:25.347535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfd0f882-f3ce-471c-a2a6-6eedf887c1f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:25.348285 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfd0f882-f3ce-471c-a2a6-6eedf887c1f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:25.348723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfd0f882-f3ce-471c-a2a6-6eedf887c1f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:25.435449 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d76eb3d5-63f7-49e8-a645-500fb4664181 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:25.436067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d76eb3d5-63f7-49e8-a645-500fb4664181 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:25.443211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d76eb3d5-63f7-49e8-a645-500fb4664181 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:25.443663 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d76eb3d5-63f7-49e8-a645-500fb4664181 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:25.444434 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d76eb3d5-63f7-49e8-a645-500fb4664181 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:25.444877 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d76eb3d5-63f7-49e8-a645-500fb4664181 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:25.479894 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bfd0f882-f3ce-471c-a2a6-6eedf887c1f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:25.488668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bfd0f882-f3ce-471c-a2a6-6eedf887c1f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:25.490275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bfd0f882-f3ce-471c-a2a6-6eedf887c1f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:25.491447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bfd0f882-f3ce-471c-a2a6-6eedf887c1f1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155946 Jul 27 20:38:25.492001 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1583/3179] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:25 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:25.507668 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d76eb3d5-63f7-49e8-a645-500fb4664181 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:25.515678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d76eb3d5-63f7-49e8-a645-500fb4664181 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084016 Jul 27 20:38:25.516232 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1597/3180] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:25 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:25.867012 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ba8ced15-d6af-4c30-9ba0-c379b260b4d6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:25.867614 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ba8ced15-d6af-4c30-9ba0-c379b260b4d6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:25.873614 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba8ced15-d6af-4c30-9ba0-c379b260b4d6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:25.874063 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba8ced15-d6af-4c30-9ba0-c379b260b4d6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:25.874815 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba8ced15-d6af-4c30-9ba0-c379b260b4d6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:25.875244 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba8ced15-d6af-4c30-9ba0-c379b260b4d6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:26.007053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ba8ced15-d6af-4c30-9ba0-c379b260b4d6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:26.014818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ba8ced15-d6af-4c30-9ba0-c379b260b4d6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151648 Jul 27 20:38:26.015406 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1584/3181] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:25 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:26.515516 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-88f6c302-9506-4560-86ca-22cd03496118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:26.516131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-88f6c302-9506-4560-86ca-22cd03496118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:26.522717 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88f6c302-9506-4560-86ca-22cd03496118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:26.523171 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88f6c302-9506-4560-86ca-22cd03496118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:26.523933 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88f6c302-9506-4560-86ca-22cd03496118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:26.524380 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88f6c302-9506-4560-86ca-22cd03496118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:26.537248 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-55605879-f4c3-40b8-8d50-57308fd1c1ef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:26.537865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-55605879-f4c3-40b8-8d50-57308fd1c1ef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:26.544323 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55605879-f4c3-40b8-8d50-57308fd1c1ef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:26.544779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55605879-f4c3-40b8-8d50-57308fd1c1ef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:26.545585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55605879-f4c3-40b8-8d50-57308fd1c1ef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:26.546030 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55605879-f4c3-40b8-8d50-57308fd1c1ef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:26.612754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-55605879-f4c3-40b8-8d50-57308fd1c1ef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:26.621458 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-55605879-f4c3-40b8-8d50-57308fd1c1ef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.088654 Jul 27 20:38:26.622026 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1585/3182] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:26 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:26.659671 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-88f6c302-9506-4560-86ca-22cd03496118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:26.668080 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-88f6c302-9506-4560-86ca-22cd03496118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:26.669641 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-88f6c302-9506-4560-86ca-22cd03496118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:26.670972 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-88f6c302-9506-4560-86ca-22cd03496118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.159274 Jul 27 20:38:26.671535 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1598/3183] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:26 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:27.036462 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2dacb2eb-fdf3-4119-b29f-f8b86442c631 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:27.037132 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2dacb2eb-fdf3-4119-b29f-f8b86442c631 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:27.043088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2dacb2eb-fdf3-4119-b29f-f8b86442c631 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:27.043536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2dacb2eb-fdf3-4119-b29f-f8b86442c631 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:27.044284 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2dacb2eb-fdf3-4119-b29f-f8b86442c631 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:27.044715 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2dacb2eb-fdf3-4119-b29f-f8b86442c631 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:27.175675 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2dacb2eb-fdf3-4119-b29f-f8b86442c631 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:27.183516 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2dacb2eb-fdf3-4119-b29f-f8b86442c631 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151411 Jul 27 20:38:27.184077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1586/3184] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:27 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:27.301000 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:38:27.301182 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:38:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:38:27.642824 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-174c27b6-1493-427c-94bc-250b21e0f822 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:27.643644 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-174c27b6-1493-427c-94bc-250b21e0f822 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:27.650054 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-174c27b6-1493-427c-94bc-250b21e0f822 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:27.650511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-174c27b6-1493-427c-94bc-250b21e0f822 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:27.651390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-174c27b6-1493-427c-94bc-250b21e0f822 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:27.651842 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-174c27b6-1493-427c-94bc-250b21e0f822 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:27.695988 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5e1319f0-62d2-4e7a-91ec-db3b10e1412a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:27.696694 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5e1319f0-62d2-4e7a-91ec-db3b10e1412a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:27.703560 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e1319f0-62d2-4e7a-91ec-db3b10e1412a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:27.704001 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e1319f0-62d2-4e7a-91ec-db3b10e1412a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:27.705264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e1319f0-62d2-4e7a-91ec-db3b10e1412a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:27.705706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e1319f0-62d2-4e7a-91ec-db3b10e1412a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:27.715456 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-174c27b6-1493-427c-94bc-250b21e0f822 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:27.724617 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-174c27b6-1493-427c-94bc-250b21e0f822 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.086121 Jul 27 20:38:27.725216 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1599/3185] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:27 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:27.839478 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5e1319f0-62d2-4e7a-91ec-db3b10e1412a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:27.848318 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5e1319f0-62d2-4e7a-91ec-db3b10e1412a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:27.849872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5e1319f0-62d2-4e7a-91ec-db3b10e1412a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:27.851043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5e1319f0-62d2-4e7a-91ec-db3b10e1412a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.159230 Jul 27 20:38:27.851602 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1587/3186] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:27 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:38:28.205394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bee87927-4d01-4c4e-9b38-20f7830d6bcd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:28.206009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bee87927-4d01-4c4e-9b38-20f7830d6bcd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:28.212028 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bee87927-4d01-4c4e-9b38-20f7830d6bcd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:28.212621 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bee87927-4d01-4c4e-9b38-20f7830d6bcd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:28.214063 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bee87927-4d01-4c4e-9b38-20f7830d6bcd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:28.214063 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bee87927-4d01-4c4e-9b38-20f7830d6bcd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:28.347590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bee87927-4d01-4c4e-9b38-20f7830d6bcd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:28.355553 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bee87927-4d01-4c4e-9b38-20f7830d6bcd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.154441 Jul 27 20:38:28.356120 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1600/3187] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:28 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:28.746150 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-df1c63cc-7477-4c9d-b14e-443ba5b22ed2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:28.746902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-df1c63cc-7477-4c9d-b14e-443ba5b22ed2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:28.753656 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-df1c63cc-7477-4c9d-b14e-443ba5b22ed2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:28.754106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-df1c63cc-7477-4c9d-b14e-443ba5b22ed2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:28.754879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-df1c63cc-7477-4c9d-b14e-443ba5b22ed2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:28.755303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-df1c63cc-7477-4c9d-b14e-443ba5b22ed2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:28.820480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-df1c63cc-7477-4c9d-b14e-443ba5b22ed2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:28.828633 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-df1c63cc-7477-4c9d-b14e-443ba5b22ed2 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.086461 Jul 27 20:38:28.829237 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1588/3188] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:28 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:28.874214 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c79d3948-9e08-4d49-b758-a7b5936bbef5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:28.874824 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c79d3948-9e08-4d49-b758-a7b5936bbef5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:28.881293 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c79d3948-9e08-4d49-b758-a7b5936bbef5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:28.881739 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c79d3948-9e08-4d49-b758-a7b5936bbef5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:28.882502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c79d3948-9e08-4d49-b758-a7b5936bbef5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:28.882923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c79d3948-9e08-4d49-b758-a7b5936bbef5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:29.014852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c79d3948-9e08-4d49-b758-a7b5936bbef5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:29.024027 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c79d3948-9e08-4d49-b758-a7b5936bbef5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:29.025574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c79d3948-9e08-4d49-b758-a7b5936bbef5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:29.026848 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c79d3948-9e08-4d49-b758-a7b5936bbef5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156359 Jul 27 20:38:29.027407 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1601/3189] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:28 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:29.378166 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e43947c7-5432-4ef8-83e0-113003e5cf79 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:29.378698 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e43947c7-5432-4ef8-83e0-113003e5cf79 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:29.384736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e43947c7-5432-4ef8-83e0-113003e5cf79 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:29.385296 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e43947c7-5432-4ef8-83e0-113003e5cf79 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:29.386066 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e43947c7-5432-4ef8-83e0-113003e5cf79 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:29.386508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e43947c7-5432-4ef8-83e0-113003e5cf79 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:29.516749 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e43947c7-5432-4ef8-83e0-113003e5cf79 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:29.525244 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e43947c7-5432-4ef8-83e0-113003e5cf79 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151549 Jul 27 20:38:29.525796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1589/3190] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:29 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:29.849399 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-52ef0dc2-6c8b-4291-9a03-251e90fdbd70 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:29.850010 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-52ef0dc2-6c8b-4291-9a03-251e90fdbd70 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:29.856076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-52ef0dc2-6c8b-4291-9a03-251e90fdbd70 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:29.856529 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-52ef0dc2-6c8b-4291-9a03-251e90fdbd70 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:29.857319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-52ef0dc2-6c8b-4291-9a03-251e90fdbd70 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:29.857763 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-52ef0dc2-6c8b-4291-9a03-251e90fdbd70 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:29.918956 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-52ef0dc2-6c8b-4291-9a03-251e90fdbd70 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:29.927484 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-52ef0dc2-6c8b-4291-9a03-251e90fdbd70 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082491 Jul 27 20:38:29.928053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1602/3191] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:29 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:30.051839 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-775fe450-aa5e-4300-bf3e-e82f41ecf435 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:30.052375 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-775fe450-aa5e-4300-bf3e-e82f41ecf435 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:30.059168 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-775fe450-aa5e-4300-bf3e-e82f41ecf435 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:30.059621 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-775fe450-aa5e-4300-bf3e-e82f41ecf435 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:30.060393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-775fe450-aa5e-4300-bf3e-e82f41ecf435 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:30.060829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-775fe450-aa5e-4300-bf3e-e82f41ecf435 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:30.190305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-775fe450-aa5e-4300-bf3e-e82f41ecf435 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:30.198660 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-775fe450-aa5e-4300-bf3e-e82f41ecf435 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:30.200132 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-775fe450-aa5e-4300-bf3e-e82f41ecf435 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:30.201300 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-775fe450-aa5e-4300-bf3e-e82f41ecf435 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.154037 Jul 27 20:38:30.201853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1590/3192] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:30 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:30.546341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a088ded0-1537-4b34-9668-6009144082d8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:30.546985 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a088ded0-1537-4b34-9668-6009144082d8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:30.553468 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a088ded0-1537-4b34-9668-6009144082d8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:30.553927 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a088ded0-1537-4b34-9668-6009144082d8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:30.554697 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a088ded0-1537-4b34-9668-6009144082d8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:30.555141 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a088ded0-1537-4b34-9668-6009144082d8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:30.694082 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a088ded0-1537-4b34-9668-6009144082d8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:30.702144 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a088ded0-1537-4b34-9668-6009144082d8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.159630 Jul 27 20:38:30.702718 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1603/3193] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:30 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:30.950278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6faa298c-5a35-46f8-9574-85575b7ea01d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:30.950892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6faa298c-5a35-46f8-9574-85575b7ea01d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:30.958284 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6faa298c-5a35-46f8-9574-85575b7ea01d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:30.958738 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6faa298c-5a35-46f8-9574-85575b7ea01d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:30.959497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6faa298c-5a35-46f8-9574-85575b7ea01d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:30.959933 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6faa298c-5a35-46f8-9574-85575b7ea01d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:30.963966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:31.029433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6faa298c-5a35-46f8-9574-85575b7ea01d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:31.040116 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6faa298c-5a35-46f8-9574-85575b7ea01d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.095303 Jul 27 20:38:31.040691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1591/3194] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:30 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:31.225331 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-15ca8e94-788b-4bf3-9a40-7c8699667c1d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:31.225863 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-15ca8e94-788b-4bf3-9a40-7c8699667c1d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:31.232360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-15ca8e94-788b-4bf3-9a40-7c8699667c1d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:31.232809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-15ca8e94-788b-4bf3-9a40-7c8699667c1d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:31.233627 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-15ca8e94-788b-4bf3-9a40-7c8699667c1d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:31.234065 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-15ca8e94-788b-4bf3-9a40-7c8699667c1d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:31.363870 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-15ca8e94-788b-4bf3-9a40-7c8699667c1d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:31.372424 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-15ca8e94-788b-4bf3-9a40-7c8699667c1d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:31.373957 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-15ca8e94-788b-4bf3-9a40-7c8699667c1d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:31.375117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-15ca8e94-788b-4bf3-9a40-7c8699667c1d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153872 Jul 27 20:38:31.375681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1604/3195] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:31 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:31.724064 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7895bbd0-87ad-444d-b3bf-d266651501e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:31.724682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7895bbd0-87ad-444d-b3bf-d266651501e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:31.731246 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7895bbd0-87ad-444d-b3bf-d266651501e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:31.731690 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7895bbd0-87ad-444d-b3bf-d266651501e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:31.732445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7895bbd0-87ad-444d-b3bf-d266651501e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:31.732877 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7895bbd0-87ad-444d-b3bf-d266651501e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:31.862162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7895bbd0-87ad-444d-b3bf-d266651501e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:31.870167 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7895bbd0-87ad-444d-b3bf-d266651501e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150449 Jul 27 20:38:31.870726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1592/3196] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:31 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:32.061083 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9ac277fe-3d78-4fc5-a945-86541e403d4c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:32.061640 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9ac277fe-3d78-4fc5-a945-86541e403d4c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:32.067872 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ac277fe-3d78-4fc5-a945-86541e403d4c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:32.068320 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ac277fe-3d78-4fc5-a945-86541e403d4c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:32.069119 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ac277fe-3d78-4fc5-a945-86541e403d4c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:32.069563 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ac277fe-3d78-4fc5-a945-86541e403d4c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:32.132541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9ac277fe-3d78-4fc5-a945-86541e403d4c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:32.140506 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9ac277fe-3d78-4fc5-a945-86541e403d4c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083495 Jul 27 20:38:32.141104 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1605/3197] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:32 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:32.399485 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-142de47e-d8e2-4b0e-83e9-6d18b5a985d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:32.400120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-142de47e-d8e2-4b0e-83e9-6d18b5a985d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:32.406121 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-142de47e-d8e2-4b0e-83e9-6d18b5a985d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:32.406569 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-142de47e-d8e2-4b0e-83e9-6d18b5a985d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:32.407326 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-142de47e-d8e2-4b0e-83e9-6d18b5a985d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:32.407764 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-142de47e-d8e2-4b0e-83e9-6d18b5a985d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:32.535894 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-142de47e-d8e2-4b0e-83e9-6d18b5a985d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:32.544319 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-142de47e-d8e2-4b0e-83e9-6d18b5a985d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:32.545851 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-142de47e-d8e2-4b0e-83e9-6d18b5a985d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:32.547004 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-142de47e-d8e2-4b0e-83e9-6d18b5a985d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.151381 Jul 27 20:38:32.547563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1593/3198] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:32 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:38:32.891749 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b06a05cf-6257-4a36-aecc-8d1aa44c5ee6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:32.892423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b06a05cf-6257-4a36-aecc-8d1aa44c5ee6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:32.898601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b06a05cf-6257-4a36-aecc-8d1aa44c5ee6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:32.899061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b06a05cf-6257-4a36-aecc-8d1aa44c5ee6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:32.899831 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b06a05cf-6257-4a36-aecc-8d1aa44c5ee6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:32.900274 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b06a05cf-6257-4a36-aecc-8d1aa44c5ee6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:33.035302 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b06a05cf-6257-4a36-aecc-8d1aa44c5ee6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:33.043346 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b06a05cf-6257-4a36-aecc-8d1aa44c5ee6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.155436 Jul 27 20:38:33.043915 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1606/3199] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:32 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:33.162912 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b54a94a8-5133-418f-a86b-a94644670de5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:33.163465 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b54a94a8-5133-418f-a86b-a94644670de5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:33.170112 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b54a94a8-5133-418f-a86b-a94644670de5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:33.170562 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b54a94a8-5133-418f-a86b-a94644670de5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:33.171328 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b54a94a8-5133-418f-a86b-a94644670de5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:33.171766 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b54a94a8-5133-418f-a86b-a94644670de5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:33.238744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b54a94a8-5133-418f-a86b-a94644670de5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:33.246945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b54a94a8-5133-418f-a86b-a94644670de5 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.088187 Jul 27 20:38:33.247500 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1594/3200] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:33 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:33.570798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8ad8baa5-2783-47e7-a08e-1198460a64d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:33.571326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8ad8baa5-2783-47e7-a08e-1198460a64d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:33.573339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=78 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:33.578987 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8ad8baa5-2783-47e7-a08e-1198460a64d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:33.579447 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8ad8baa5-2783-47e7-a08e-1198460a64d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:33.580720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8ad8baa5-2783-47e7-a08e-1198460a64d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:33.581196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8ad8baa5-2783-47e7-a08e-1198460a64d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:33.708802 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8ad8baa5-2783-47e7-a08e-1198460a64d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:33.712397 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:33.718044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8ad8baa5-2783-47e7-a08e-1198460a64d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:33.719556 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8ad8baa5-2783-47e7-a08e-1198460a64d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:33.721709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8ad8baa5-2783-47e7-a08e-1198460a64d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.154067 Jul 27 20:38:33.722269 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1607/3201] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:33 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:34.065645 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c4287e6f-66a6-4b78-863c-3b08dfbfc73f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:34.066255 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c4287e6f-66a6-4b78-863c-3b08dfbfc73f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:34.068097 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=80 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:34.073869 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c4287e6f-66a6-4b78-863c-3b08dfbfc73f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:34.074324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c4287e6f-66a6-4b78-863c-3b08dfbfc73f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:34.075100 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c4287e6f-66a6-4b78-863c-3b08dfbfc73f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:34.075542 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c4287e6f-66a6-4b78-863c-3b08dfbfc73f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:34.207022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c4287e6f-66a6-4b78-863c-3b08dfbfc73f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:34.215012 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c4287e6f-66a6-4b78-863c-3b08dfbfc73f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153767 Jul 27 20:38:34.215585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1595/3202] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:34 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:34.267681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d32842b9-4b35-4f59-bed4-73a8b8e50265 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:34.268296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d32842b9-4b35-4f59-bed4-73a8b8e50265 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:34.274806 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d32842b9-4b35-4f59-bed4-73a8b8e50265 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:34.275260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d32842b9-4b35-4f59-bed4-73a8b8e50265 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:34.276021 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d32842b9-4b35-4f59-bed4-73a8b8e50265 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:34.276462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d32842b9-4b35-4f59-bed4-73a8b8e50265 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:34.336954 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d32842b9-4b35-4f59-bed4-73a8b8e50265 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:34.344898 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d32842b9-4b35-4f59-bed4-73a8b8e50265 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081357 Jul 27 20:38:34.345542 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1608/3203] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:34 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:34.744596 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e0065636-a8a7-4c29-ae05-3553c88a1b98 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:34.745300 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e0065636-a8a7-4c29-ae05-3553c88a1b98 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:34.751801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0065636-a8a7-4c29-ae05-3553c88a1b98 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:34.752431 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0065636-a8a7-4c29-ae05-3553c88a1b98 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:34.753236 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0065636-a8a7-4c29-ae05-3553c88a1b98 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:34.753679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0065636-a8a7-4c29-ae05-3553c88a1b98 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:34.884782 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e0065636-a8a7-4c29-ae05-3553c88a1b98 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:34.894017 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e0065636-a8a7-4c29-ae05-3553c88a1b98 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:34.895513 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e0065636-a8a7-4c29-ae05-3553c88a1b98 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:34.896677 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e0065636-a8a7-4c29-ae05-3553c88a1b98 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156074 Jul 27 20:38:34.897254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1596/3204] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:34 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:38:35.237100 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0b1ddcf0-4581-4680-b808-38e6e11c9797 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:35.237722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0b1ddcf0-4581-4680-b808-38e6e11c9797 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:35.243932 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b1ddcf0-4581-4680-b808-38e6e11c9797 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:35.244396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b1ddcf0-4581-4680-b808-38e6e11c9797 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:35.245195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b1ddcf0-4581-4680-b808-38e6e11c9797 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:35.245644 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b1ddcf0-4581-4680-b808-38e6e11c9797 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:35.365645 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ff1a7c27-21c3-480b-9263-f51b55365be6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:35.366257 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ff1a7c27-21c3-480b-9263-f51b55365be6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:35.373057 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff1a7c27-21c3-480b-9263-f51b55365be6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:35.373515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff1a7c27-21c3-480b-9263-f51b55365be6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:35.374295 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff1a7c27-21c3-480b-9263-f51b55365be6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:35.374734 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff1a7c27-21c3-480b-9263-f51b55365be6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:35.375032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0b1ddcf0-4581-4680-b808-38e6e11c9797 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:35.383825 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0b1ddcf0-4581-4680-b808-38e6e11c9797 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151228 Jul 27 20:38:35.384398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1609/3205] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:35 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:35.441524 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ff1a7c27-21c3-480b-9263-f51b55365be6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:35.449554 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ff1a7c27-21c3-480b-9263-f51b55365be6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.087838 Jul 27 20:38:35.450114 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1597/3206] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:35 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:35.919965 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-311ee765-fc8d-497a-9aed-6e4944634989 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:35.920602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-311ee765-fc8d-497a-9aed-6e4944634989 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:35.928009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-311ee765-fc8d-497a-9aed-6e4944634989 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:35.928462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-311ee765-fc8d-497a-9aed-6e4944634989 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:35.929273 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-311ee765-fc8d-497a-9aed-6e4944634989 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:35.929718 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-311ee765-fc8d-497a-9aed-6e4944634989 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:36.058148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-311ee765-fc8d-497a-9aed-6e4944634989 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:36.070402 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-311ee765-fc8d-497a-9aed-6e4944634989 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:36.072021 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-311ee765-fc8d-497a-9aed-6e4944634989 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:36.074255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-311ee765-fc8d-497a-9aed-6e4944634989 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157870 Jul 27 20:38:36.075290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1610/3207] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:35 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:36.404821 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-98225367-0ac2-48bf-b6ef-4af3325e045e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:36.405441 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-98225367-0ac2-48bf-b6ef-4af3325e045e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:36.411980 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-98225367-0ac2-48bf-b6ef-4af3325e045e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:36.412423 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-98225367-0ac2-48bf-b6ef-4af3325e045e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:36.413211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-98225367-0ac2-48bf-b6ef-4af3325e045e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:36.413646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-98225367-0ac2-48bf-b6ef-4af3325e045e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:36.471074 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bb0bfb68-5b00-470c-8f40-9f6e2ed550c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:36.471674 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bb0bfb68-5b00-470c-8f40-9f6e2ed550c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:36.478397 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb0bfb68-5b00-470c-8f40-9f6e2ed550c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:36.478845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb0bfb68-5b00-470c-8f40-9f6e2ed550c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:36.479615 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb0bfb68-5b00-470c-8f40-9f6e2ed550c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:36.480058 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb0bfb68-5b00-470c-8f40-9f6e2ed550c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:36.541739 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bb0bfb68-5b00-470c-8f40-9f6e2ed550c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:36.547672 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-98225367-0ac2-48bf-b6ef-4af3325e045e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:36.551197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bb0bfb68-5b00-470c-8f40-9f6e2ed550c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083915 Jul 27 20:38:36.551788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1611/3208] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:36 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:36.557872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-98225367-0ac2-48bf-b6ef-4af3325e045e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.156770 Jul 27 20:38:36.558450 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1598/3209] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:36 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:37.099076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-722e854d-6d27-42b2-891d-a081aac51667 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:37.099697 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-722e854d-6d27-42b2-891d-a081aac51667 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:37.105798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-722e854d-6d27-42b2-891d-a081aac51667 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:37.106252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-722e854d-6d27-42b2-891d-a081aac51667 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:37.107021 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-722e854d-6d27-42b2-891d-a081aac51667 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:37.107465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-722e854d-6d27-42b2-891d-a081aac51667 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:37.238647 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-722e854d-6d27-42b2-891d-a081aac51667 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:37.247104 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-722e854d-6d27-42b2-891d-a081aac51667 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:37.248598 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-722e854d-6d27-42b2-891d-a081aac51667 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:37.249796 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-722e854d-6d27-42b2-891d-a081aac51667 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.154730 Jul 27 20:38:37.250361 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1612/3210] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:37 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:37.572391 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-86bd1bbe-288d-4afa-b9ff-bfc556b67874 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:37.573017 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-86bd1bbe-288d-4afa-b9ff-bfc556b67874 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:37.579837 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86bd1bbe-288d-4afa-b9ff-bfc556b67874 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:37.580288 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86bd1bbe-288d-4afa-b9ff-bfc556b67874 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:37.580522 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-68efe21a-97ef-4387-9067-35a98eca8a5c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:37.581094 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86bd1bbe-288d-4afa-b9ff-bfc556b67874 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:37.581239 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-68efe21a-97ef-4387-9067-35a98eca8a5c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:37.581537 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86bd1bbe-288d-4afa-b9ff-bfc556b67874 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:37.587847 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-68efe21a-97ef-4387-9067-35a98eca8a5c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:37.588286 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-68efe21a-97ef-4387-9067-35a98eca8a5c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:37.589101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-68efe21a-97ef-4387-9067-35a98eca8a5c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:37.589547 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-68efe21a-97ef-4387-9067-35a98eca8a5c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:37.651776 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-86bd1bbe-288d-4afa-b9ff-bfc556b67874 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:37.660700 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-86bd1bbe-288d-4afa-b9ff-bfc556b67874 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.092371 Jul 27 20:38:37.661534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1599/3211] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:37 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:37.724374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-68efe21a-97ef-4387-9067-35a98eca8a5c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:37.732423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-68efe21a-97ef-4387-9067-35a98eca8a5c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.155942 Jul 27 20:38:37.733216 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1613/3212] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:37 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:38.274371 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ee34cb0e-4c08-4d86-acf7-76c384207fe5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:38.274900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ee34cb0e-4c08-4d86-acf7-76c384207fe5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:38.281174 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee34cb0e-4c08-4d86-acf7-76c384207fe5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:38.281634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee34cb0e-4c08-4d86-acf7-76c384207fe5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:38.282441 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee34cb0e-4c08-4d86-acf7-76c384207fe5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:38.282880 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee34cb0e-4c08-4d86-acf7-76c384207fe5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:38.414802 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ee34cb0e-4c08-4d86-acf7-76c384207fe5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:38.423008 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ee34cb0e-4c08-4d86-acf7-76c384207fe5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:38.424476 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ee34cb0e-4c08-4d86-acf7-76c384207fe5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:38.425782 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ee34cb0e-4c08-4d86-acf7-76c384207fe5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155475 Jul 27 20:38:38.426340 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1600/3213] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:38 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:38.681892 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b0453bf2-88db-4b90-ba0e-30c3ca01ec66 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:38.682516 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b0453bf2-88db-4b90-ba0e-30c3ca01ec66 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:38.689022 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b0453bf2-88db-4b90-ba0e-30c3ca01ec66 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:38.689483 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b0453bf2-88db-4b90-ba0e-30c3ca01ec66 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:38.690319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b0453bf2-88db-4b90-ba0e-30c3ca01ec66 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:38.691374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b0453bf2-88db-4b90-ba0e-30c3ca01ec66 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:38.755023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b0453bf2-88db-4b90-ba0e-30c3ca01ec66 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:38.756352 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e2619940-21e6-4ee2-80e6-d0b2844d7564 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:38.756998 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e2619940-21e6-4ee2-80e6-d0b2844d7564 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:38.763476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b0453bf2-88db-4b90-ba0e-30c3ca01ec66 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085439 Jul 27 20:38:38.763706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2619940-21e6-4ee2-80e6-d0b2844d7564 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:38.764044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1614/3214] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:38 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:38.764183 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2619940-21e6-4ee2-80e6-d0b2844d7564 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:38.764900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2619940-21e6-4ee2-80e6-d0b2844d7564 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:38.765379 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2619940-21e6-4ee2-80e6-d0b2844d7564 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:38.893517 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e2619940-21e6-4ee2-80e6-d0b2844d7564 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:38.901458 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e2619940-21e6-4ee2-80e6-d0b2844d7564 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149703 Jul 27 20:38:38.902029 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1601/3215] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:38 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:39.449675 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-03c384d1-8e42-4531-9932-441acabc2134 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:39.450322 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-03c384d1-8e42-4531-9932-441acabc2134 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:39.457032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-03c384d1-8e42-4531-9932-441acabc2134 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:39.457484 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-03c384d1-8e42-4531-9932-441acabc2134 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:39.458244 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-03c384d1-8e42-4531-9932-441acabc2134 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:39.458685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-03c384d1-8e42-4531-9932-441acabc2134 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:39.586350 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-03c384d1-8e42-4531-9932-441acabc2134 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:39.594660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-03c384d1-8e42-4531-9932-441acabc2134 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:39.596163 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-03c384d1-8e42-4531-9932-441acabc2134 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:39.598516 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-03c384d1-8e42-4531-9932-441acabc2134 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152560 Jul 27 20:38:39.599361 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1615/3216] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:39 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:39.784573 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f65d918b-14ce-456e-8b62-8c8ec8f8c57d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:39.785206 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f65d918b-14ce-456e-8b62-8c8ec8f8c57d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:39.791830 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f65d918b-14ce-456e-8b62-8c8ec8f8c57d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:39.792268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f65d918b-14ce-456e-8b62-8c8ec8f8c57d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:39.793046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f65d918b-14ce-456e-8b62-8c8ec8f8c57d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:39.793476 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f65d918b-14ce-456e-8b62-8c8ec8f8c57d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:39.854469 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f65d918b-14ce-456e-8b62-8c8ec8f8c57d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:39.862623 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f65d918b-14ce-456e-8b62-8c8ec8f8c57d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082006 Jul 27 20:38:39.863181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1602/3217] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:39 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:39.922389 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d9c040da-22e8-433c-9874-569db3ddd9e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:39.923039 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d9c040da-22e8-433c-9874-569db3ddd9e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:39.929903 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d9c040da-22e8-433c-9874-569db3ddd9e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:39.930363 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d9c040da-22e8-433c-9874-569db3ddd9e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:39.931131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d9c040da-22e8-433c-9874-569db3ddd9e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:39.931605 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d9c040da-22e8-433c-9874-569db3ddd9e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:40.056772 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d9c040da-22e8-433c-9874-569db3ddd9e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:40.064779 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d9c040da-22e8-433c-9874-569db3ddd9e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.146184 Jul 27 20:38:40.065967 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1616/3218] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:39 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:40.622534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f661cb7e-5d13-48a3-8a5b-b124455e8a9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:40.623140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f661cb7e-5d13-48a3-8a5b-b124455e8a9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:40.629895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f661cb7e-5d13-48a3-8a5b-b124455e8a9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:40.630343 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f661cb7e-5d13-48a3-8a5b-b124455e8a9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:40.631100 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f661cb7e-5d13-48a3-8a5b-b124455e8a9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:40.631532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f661cb7e-5d13-48a3-8a5b-b124455e8a9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:40.764312 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f661cb7e-5d13-48a3-8a5b-b124455e8a9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:40.773317 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f661cb7e-5d13-48a3-8a5b-b124455e8a9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:40.774797 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f661cb7e-5d13-48a3-8a5b-b124455e8a9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:40.775938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f661cb7e-5d13-48a3-8a5b-b124455e8a9b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157287 Jul 27 20:38:40.776492 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1603/3219] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:40 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:40.883882 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0e14bf8d-00b1-48b6-ab2c-fb74881bd3bb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:40.884441 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0e14bf8d-00b1-48b6-ab2c-fb74881bd3bb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:40.890501 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e14bf8d-00b1-48b6-ab2c-fb74881bd3bb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:40.890965 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e14bf8d-00b1-48b6-ab2c-fb74881bd3bb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:40.891727 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e14bf8d-00b1-48b6-ab2c-fb74881bd3bb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:40.892172 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e14bf8d-00b1-48b6-ab2c-fb74881bd3bb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:40.957096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0e14bf8d-00b1-48b6-ab2c-fb74881bd3bb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:40.965090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0e14bf8d-00b1-48b6-ab2c-fb74881bd3bb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085155 Jul 27 20:38:40.965650 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1617/3220] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:40 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:41.087127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-acb2e6ac-4016-48ef-869c-7058d2c0704e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:41.087744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-acb2e6ac-4016-48ef-869c-7058d2c0704e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:41.094510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-acb2e6ac-4016-48ef-869c-7058d2c0704e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:41.094963 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-acb2e6ac-4016-48ef-869c-7058d2c0704e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:41.095735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-acb2e6ac-4016-48ef-869c-7058d2c0704e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:41.096179 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-acb2e6ac-4016-48ef-869c-7058d2c0704e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:41.226167 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-acb2e6ac-4016-48ef-869c-7058d2c0704e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:41.234182 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-acb2e6ac-4016-48ef-869c-7058d2c0704e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150981 Jul 27 20:38:41.234745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1604/3221] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:41 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:41.798992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a9b56aec-8fb9-4903-9dd2-b389a97b90bc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:41.799614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a9b56aec-8fb9-4903-9dd2-b389a97b90bc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:41.805885 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a9b56aec-8fb9-4903-9dd2-b389a97b90bc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:41.806337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a9b56aec-8fb9-4903-9dd2-b389a97b90bc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:41.807096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a9b56aec-8fb9-4903-9dd2-b389a97b90bc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:41.807537 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a9b56aec-8fb9-4903-9dd2-b389a97b90bc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:41.933509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a9b56aec-8fb9-4903-9dd2-b389a97b90bc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:41.941792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a9b56aec-8fb9-4903-9dd2-b389a97b90bc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:41.943310 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a9b56aec-8fb9-4903-9dd2-b389a97b90bc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:41.944467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a9b56aec-8fb9-4903-9dd2-b389a97b90bc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.149397 Jul 27 20:38:41.945041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1618/3222] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:41 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:41.985703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c7e8ca09-6ceb-4f36-a0f6-394ecb12a924 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:41.986240 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c7e8ca09-6ceb-4f36-a0f6-394ecb12a924 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:41.992414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c7e8ca09-6ceb-4f36-a0f6-394ecb12a924 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:41.992868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c7e8ca09-6ceb-4f36-a0f6-394ecb12a924 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:41.993657 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c7e8ca09-6ceb-4f36-a0f6-394ecb12a924 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:41.994093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c7e8ca09-6ceb-4f36-a0f6-394ecb12a924 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:42.054342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c7e8ca09-6ceb-4f36-a0f6-394ecb12a924 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:42.062179 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c7e8ca09-6ceb-4f36-a0f6-394ecb12a924 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.080323 Jul 27 20:38:42.062746 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1605/3223] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:41 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:42.256401 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-41fca93b-cb75-40d4-ba70-64db86612368 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:42.256945 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-41fca93b-cb75-40d4-ba70-64db86612368 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:42.263189 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41fca93b-cb75-40d4-ba70-64db86612368 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:42.263645 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41fca93b-cb75-40d4-ba70-64db86612368 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:42.264412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41fca93b-cb75-40d4-ba70-64db86612368 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:42.264854 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41fca93b-cb75-40d4-ba70-64db86612368 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:42.390745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-41fca93b-cb75-40d4-ba70-64db86612368 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:42.399266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-41fca93b-cb75-40d4-ba70-64db86612368 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.147349 Jul 27 20:38:42.399825 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1619/3224] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:42 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:42.968053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-179ec683-7c67-40cf-964d-591c8c95dcc7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:42.968641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-179ec683-7c67-40cf-964d-591c8c95dcc7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:42.975737 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-179ec683-7c67-40cf-964d-591c8c95dcc7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:42.976184 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-179ec683-7c67-40cf-964d-591c8c95dcc7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:42.976942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-179ec683-7c67-40cf-964d-591c8c95dcc7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:42.977405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-179ec683-7c67-40cf-964d-591c8c95dcc7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:43.084095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5392442d-e900-446b-9dc8-f98e8806dfa0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:43.084707 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5392442d-e900-446b-9dc8-f98e8806dfa0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:43.091289 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5392442d-e900-446b-9dc8-f98e8806dfa0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:43.091736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5392442d-e900-446b-9dc8-f98e8806dfa0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:43.092507 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5392442d-e900-446b-9dc8-f98e8806dfa0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:43.092943 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5392442d-e900-446b-9dc8-f98e8806dfa0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:43.121027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-179ec683-7c67-40cf-964d-591c8c95dcc7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:43.130173 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-179ec683-7c67-40cf-964d-591c8c95dcc7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:43.131678 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-179ec683-7c67-40cf-964d-591c8c95dcc7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:43.132852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-179ec683-7c67-40cf-964d-591c8c95dcc7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.168800 Jul 27 20:38:43.133445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1606/3225] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:42 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:43.161872 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5392442d-e900-446b-9dc8-f98e8806dfa0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:43.169661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5392442d-e900-446b-9dc8-f98e8806dfa0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.089729 Jul 27 20:38:43.170220 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1620/3226] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:43 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:43.419590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dcf12fbc-6f67-4b26-9b5d-8f92fb777705 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:43.420193 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dcf12fbc-6f67-4b26-9b5d-8f92fb777705 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:43.427581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dcf12fbc-6f67-4b26-9b5d-8f92fb777705 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:43.428025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dcf12fbc-6f67-4b26-9b5d-8f92fb777705 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:43.428780 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dcf12fbc-6f67-4b26-9b5d-8f92fb777705 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:43.429234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dcf12fbc-6f67-4b26-9b5d-8f92fb777705 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:43.566814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dcf12fbc-6f67-4b26-9b5d-8f92fb777705 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:43.570191 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:43.575662 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dcf12fbc-6f67-4b26-9b5d-8f92fb777705 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.159914 Jul 27 20:38:43.576229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1607/3227] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:43 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:44.156553 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3536fa21-1cc5-43cd-8a52-8e9badebbbe5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:44.157188 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3536fa21-1cc5-43cd-8a52-8e9badebbbe5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:44.163969 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3536fa21-1cc5-43cd-8a52-8e9badebbbe5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:44.164415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3536fa21-1cc5-43cd-8a52-8e9badebbbe5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:44.165196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3536fa21-1cc5-43cd-8a52-8e9badebbbe5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:44.165642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3536fa21-1cc5-43cd-8a52-8e9badebbbe5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:44.192127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9a470914-e026-44c3-bca7-aa5b836c1582 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:44.192740 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9a470914-e026-44c3-bca7-aa5b836c1582 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:44.199358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a470914-e026-44c3-bca7-aa5b836c1582 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:44.199807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a470914-e026-44c3-bca7-aa5b836c1582 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:44.200577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a470914-e026-44c3-bca7-aa5b836c1582 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:44.201039 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a470914-e026-44c3-bca7-aa5b836c1582 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:44.262799 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9a470914-e026-44c3-bca7-aa5b836c1582 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:44.270896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9a470914-e026-44c3-bca7-aa5b836c1582 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083118 Jul 27 20:38:44.271599 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1608/3228] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:44 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:44.295901 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3536fa21-1cc5-43cd-8a52-8e9badebbbe5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:44.305433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3536fa21-1cc5-43cd-8a52-8e9badebbbe5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:44.306935 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3536fa21-1cc5-43cd-8a52-8e9badebbbe5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:44.308087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3536fa21-1cc5-43cd-8a52-8e9badebbbe5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155400 Jul 27 20:38:44.308639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1621/3229] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:44 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:44.598056 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-62be5fcc-0ef7-49af-8051-a33955c41291 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:44.598672 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-62be5fcc-0ef7-49af-8051-a33955c41291 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:44.604665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-62be5fcc-0ef7-49af-8051-a33955c41291 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:44.605176 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-62be5fcc-0ef7-49af-8051-a33955c41291 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:44.605944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-62be5fcc-0ef7-49af-8051-a33955c41291 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:44.606383 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-62be5fcc-0ef7-49af-8051-a33955c41291 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:44.736763 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-62be5fcc-0ef7-49af-8051-a33955c41291 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:44.744884 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-62be5fcc-0ef7-49af-8051-a33955c41291 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151318 Jul 27 20:38:44.745483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1609/3230] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:44 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:45.292195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3fb74046-9b83-485b-9605-12c5881235bf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:45.292844 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3fb74046-9b83-485b-9605-12c5881235bf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:45.299413 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3fb74046-9b83-485b-9605-12c5881235bf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:45.299866 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3fb74046-9b83-485b-9605-12c5881235bf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:45.300630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3fb74046-9b83-485b-9605-12c5881235bf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:45.301115 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3fb74046-9b83-485b-9605-12c5881235bf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:45.332630 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4e8567be-7ec5-4952-b40f-4fffb63290af tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:45.333210 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4e8567be-7ec5-4952-b40f-4fffb63290af tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:45.339790 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e8567be-7ec5-4952-b40f-4fffb63290af tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:45.340247 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e8567be-7ec5-4952-b40f-4fffb63290af tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:45.341031 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e8567be-7ec5-4952-b40f-4fffb63290af tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:45.341468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e8567be-7ec5-4952-b40f-4fffb63290af tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:45.363442 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3fb74046-9b83-485b-9605-12c5881235bf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:45.371314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3fb74046-9b83-485b-9605-12c5881235bf tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083074 Jul 27 20:38:45.371886 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1622/3231] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:45 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:45.471001 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4e8567be-7ec5-4952-b40f-4fffb63290af tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:45.479918 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4e8567be-7ec5-4952-b40f-4fffb63290af tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:45.481429 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4e8567be-7ec5-4952-b40f-4fffb63290af tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:45.482575 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4e8567be-7ec5-4952-b40f-4fffb63290af tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.154833 Jul 27 20:38:45.483122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1610/3232] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:45 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:38:45.766415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b040fc81-548c-465f-aa8d-c57633801d2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:45.767059 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b040fc81-548c-465f-aa8d-c57633801d2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:45.773731 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b040fc81-548c-465f-aa8d-c57633801d2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:45.774186 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b040fc81-548c-465f-aa8d-c57633801d2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:45.774948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b040fc81-548c-465f-aa8d-c57633801d2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:45.775392 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b040fc81-548c-465f-aa8d-c57633801d2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:45.904446 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b040fc81-548c-465f-aa8d-c57633801d2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:45.912697 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b040fc81-548c-465f-aa8d-c57633801d2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150148 Jul 27 20:38:45.913391 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1623/3233] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:45 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:46.391620 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-67a6e254-0d9d-47ff-85b0-e5ba2014696a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:46.392233 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-67a6e254-0d9d-47ff-85b0-e5ba2014696a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:46.399475 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-67a6e254-0d9d-47ff-85b0-e5ba2014696a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:46.399928 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-67a6e254-0d9d-47ff-85b0-e5ba2014696a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:46.400690 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-67a6e254-0d9d-47ff-85b0-e5ba2014696a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:46.401166 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-67a6e254-0d9d-47ff-85b0-e5ba2014696a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:46.466390 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-67a6e254-0d9d-47ff-85b0-e5ba2014696a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:46.474972 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-67a6e254-0d9d-47ff-85b0-e5ba2014696a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.087230 Jul 27 20:38:46.475533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1611/3234] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:46 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:46.506218 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-16341230-68e6-4791-b517-15e19387b5ad tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:46.506832 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-16341230-68e6-4791-b517-15e19387b5ad tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:46.513293 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-16341230-68e6-4791-b517-15e19387b5ad tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:46.513744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-16341230-68e6-4791-b517-15e19387b5ad tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:46.514501 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-16341230-68e6-4791-b517-15e19387b5ad tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:46.514940 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-16341230-68e6-4791-b517-15e19387b5ad tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:46.534265 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:46.646481 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-16341230-68e6-4791-b517-15e19387b5ad tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:46.654825 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-16341230-68e6-4791-b517-15e19387b5ad tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:46.656329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-16341230-68e6-4791-b517-15e19387b5ad tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:46.657531 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-16341230-68e6-4791-b517-15e19387b5ad tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155741 Jul 27 20:38:46.658092 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1624/3235] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:46 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:46.934159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-332c8a8d-e745-423d-b35f-fd3d10b7f77a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:46.934695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-332c8a8d-e745-423d-b35f-fd3d10b7f77a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:46.941375 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-332c8a8d-e745-423d-b35f-fd3d10b7f77a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:46.941829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-332c8a8d-e745-423d-b35f-fd3d10b7f77a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:46.942599 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-332c8a8d-e745-423d-b35f-fd3d10b7f77a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:46.943038 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-332c8a8d-e745-423d-b35f-fd3d10b7f77a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:47.070473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-332c8a8d-e745-423d-b35f-fd3d10b7f77a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:47.078800 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-332c8a8d-e745-423d-b35f-fd3d10b7f77a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148537 Jul 27 20:38:47.079374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1612/3236] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:46 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:47.495613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7599e7bb-c6d9-435c-bf40-3f481ce15fe8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:47.496237 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7599e7bb-c6d9-435c-bf40-3f481ce15fe8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:47.502280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7599e7bb-c6d9-435c-bf40-3f481ce15fe8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:47.502744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7599e7bb-c6d9-435c-bf40-3f481ce15fe8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:47.503660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7599e7bb-c6d9-435c-bf40-3f481ce15fe8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:47.504108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7599e7bb-c6d9-435c-bf40-3f481ce15fe8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:47.564861 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7599e7bb-c6d9-435c-bf40-3f481ce15fe8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:47.572795 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7599e7bb-c6d9-435c-bf40-3f481ce15fe8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081042 Jul 27 20:38:47.573386 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1625/3237] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:47 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:47.680474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d8fa0911-ede9-4b47-89bf-e79cf9de1329 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:47.681108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d8fa0911-ede9-4b47-89bf-e79cf9de1329 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:47.687408 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8fa0911-ede9-4b47-89bf-e79cf9de1329 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:47.687855 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8fa0911-ede9-4b47-89bf-e79cf9de1329 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:47.688601 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8fa0911-ede9-4b47-89bf-e79cf9de1329 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:47.689065 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8fa0911-ede9-4b47-89bf-e79cf9de1329 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:47.818326 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d8fa0911-ede9-4b47-89bf-e79cf9de1329 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:47.826732 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d8fa0911-ede9-4b47-89bf-e79cf9de1329 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:47.828482 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d8fa0911-ede9-4b47-89bf-e79cf9de1329 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:47.829671 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d8fa0911-ede9-4b47-89bf-e79cf9de1329 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153112 Jul 27 20:38:47.830230 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1613/3238] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:47 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:48.102869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-241b7e1a-c037-4163-bf04-419da0fcd478 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:48.103491 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-241b7e1a-c037-4163-bf04-419da0fcd478 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:48.109563 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-241b7e1a-c037-4163-bf04-419da0fcd478 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:48.110023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-241b7e1a-c037-4163-bf04-419da0fcd478 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:48.110792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-241b7e1a-c037-4163-bf04-419da0fcd478 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:48.111239 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-241b7e1a-c037-4163-bf04-419da0fcd478 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:48.239977 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-241b7e1a-c037-4163-bf04-419da0fcd478 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:48.247826 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-241b7e1a-c037-4163-bf04-419da0fcd478 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148818 Jul 27 20:38:48.248396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1626/3239] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:48 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:48.593829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8bd3d590-21eb-4adf-9f1b-f5486994f141 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:48.594431 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8bd3d590-21eb-4adf-9f1b-f5486994f141 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:48.601069 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8bd3d590-21eb-4adf-9f1b-f5486994f141 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:48.601515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8bd3d590-21eb-4adf-9f1b-f5486994f141 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:48.602263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8bd3d590-21eb-4adf-9f1b-f5486994f141 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:48.602695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8bd3d590-21eb-4adf-9f1b-f5486994f141 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:48.665959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8bd3d590-21eb-4adf-9f1b-f5486994f141 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:48.673918 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8bd3d590-21eb-4adf-9f1b-f5486994f141 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083884 Jul 27 20:38:48.674521 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1614/3240] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:48 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:48.853281 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f60f75af-0b80-4dbd-b329-7cfdbb3ba74c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:48.853823 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f60f75af-0b80-4dbd-b329-7cfdbb3ba74c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:48.860247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f60f75af-0b80-4dbd-b329-7cfdbb3ba74c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:48.860702 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f60f75af-0b80-4dbd-b329-7cfdbb3ba74c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:48.861501 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f60f75af-0b80-4dbd-b329-7cfdbb3ba74c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:48.861980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f60f75af-0b80-4dbd-b329-7cfdbb3ba74c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:48.988309 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f60f75af-0b80-4dbd-b329-7cfdbb3ba74c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:48.996898 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f60f75af-0b80-4dbd-b329-7cfdbb3ba74c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:48.998466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f60f75af-0b80-4dbd-b329-7cfdbb3ba74c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:48.999667 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f60f75af-0b80-4dbd-b329-7cfdbb3ba74c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.150470 Jul 27 20:38:49.000230 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1627/3241] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:48 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:49.269786 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-99a3180d-8b1d-445d-ab01-77aa76183d4d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:49.270402 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-99a3180d-8b1d-445d-ab01-77aa76183d4d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:49.276980 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99a3180d-8b1d-445d-ab01-77aa76183d4d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:49.277430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99a3180d-8b1d-445d-ab01-77aa76183d4d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:49.278184 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99a3180d-8b1d-445d-ab01-77aa76183d4d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:49.278618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99a3180d-8b1d-445d-ab01-77aa76183d4d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:49.406453 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-99a3180d-8b1d-445d-ab01-77aa76183d4d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:49.415272 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-99a3180d-8b1d-445d-ab01-77aa76183d4d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149970 Jul 27 20:38:49.415836 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1615/3242] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:49 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:49.695295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-19d6c802-da04-4c8a-9645-d67c779d1b8b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:49.695911 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-19d6c802-da04-4c8a-9645-d67c779d1b8b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:49.701988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19d6c802-da04-4c8a-9645-d67c779d1b8b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:49.702436 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19d6c802-da04-4c8a-9645-d67c779d1b8b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:49.703444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19d6c802-da04-4c8a-9645-d67c779d1b8b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:49.703883 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19d6c802-da04-4c8a-9645-d67c779d1b8b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:49.766435 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-19d6c802-da04-4c8a-9645-d67c779d1b8b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:49.775491 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-19d6c802-da04-4c8a-9645-d67c779d1b8b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083976 Jul 27 20:38:49.776061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1628/3243] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:49 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:50.023664 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-102315f5-38f3-4e5c-9afe-ae37b3b59b8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:50.024198 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-102315f5-38f3-4e5c-9afe-ae37b3b59b8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:50.030311 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-102315f5-38f3-4e5c-9afe-ae37b3b59b8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:50.030762 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-102315f5-38f3-4e5c-9afe-ae37b3b59b8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:50.031521 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-102315f5-38f3-4e5c-9afe-ae37b3b59b8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:50.031962 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-102315f5-38f3-4e5c-9afe-ae37b3b59b8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:50.161003 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-102315f5-38f3-4e5c-9afe-ae37b3b59b8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:50.169388 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-102315f5-38f3-4e5c-9afe-ae37b3b59b8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:50.170847 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-102315f5-38f3-4e5c-9afe-ae37b3b59b8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:50.171984 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-102315f5-38f3-4e5c-9afe-ae37b3b59b8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152347 Jul 27 20:38:50.172537 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1616/3244] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:50 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:50.437050 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6ed176bc-befc-42da-a9f6-a4dc84d98212 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:50.437667 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6ed176bc-befc-42da-a9f6-a4dc84d98212 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:50.444189 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ed176bc-befc-42da-a9f6-a4dc84d98212 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:50.444638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ed176bc-befc-42da-a9f6-a4dc84d98212 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:50.445420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ed176bc-befc-42da-a9f6-a4dc84d98212 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:50.445854 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6ed176bc-befc-42da-a9f6-a4dc84d98212 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:50.576008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6ed176bc-befc-42da-a9f6-a4dc84d98212 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:50.584449 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6ed176bc-befc-42da-a9f6-a4dc84d98212 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151268 Jul 27 20:38:50.585035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1629/3245] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:50 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:50.795650 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-77dd2962-8aae-4e8c-88ac-9f1ea96db2e4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:50.796196 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-77dd2962-8aae-4e8c-88ac-9f1ea96db2e4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:50.802834 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-77dd2962-8aae-4e8c-88ac-9f1ea96db2e4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:50.803293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-77dd2962-8aae-4e8c-88ac-9f1ea96db2e4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:50.804056 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-77dd2962-8aae-4e8c-88ac-9f1ea96db2e4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:50.804494 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-77dd2962-8aae-4e8c-88ac-9f1ea96db2e4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:50.868552 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-77dd2962-8aae-4e8c-88ac-9f1ea96db2e4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:50.876393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-77dd2962-8aae-4e8c-88ac-9f1ea96db2e4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084661 Jul 27 20:38:50.876953 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1617/3246] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:50 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:51.196123 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-91dd8103-a6db-46d9-b170-4b1336db4ab5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:51.196727 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-91dd8103-a6db-46d9-b170-4b1336db4ab5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:51.202710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-91dd8103-a6db-46d9-b170-4b1336db4ab5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:51.203408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-91dd8103-a6db-46d9-b170-4b1336db4ab5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:51.204156 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-91dd8103-a6db-46d9-b170-4b1336db4ab5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:51.204589 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-91dd8103-a6db-46d9-b170-4b1336db4ab5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:51.333062 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-91dd8103-a6db-46d9-b170-4b1336db4ab5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:51.341306 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-91dd8103-a6db-46d9-b170-4b1336db4ab5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:51.342806 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-91dd8103-a6db-46d9-b170-4b1336db4ab5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:51.343951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-91dd8103-a6db-46d9-b170-4b1336db4ab5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.151728 Jul 27 20:38:51.344495 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1630/3247] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:51 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:51.605790 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-10467717-5050-46d7-90e0-0e8d04632176 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:51.606962 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-10467717-5050-46d7-90e0-0e8d04632176 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:51.613951 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10467717-5050-46d7-90e0-0e8d04632176 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:51.614401 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10467717-5050-46d7-90e0-0e8d04632176 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:51.615168 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10467717-5050-46d7-90e0-0e8d04632176 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:51.615604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10467717-5050-46d7-90e0-0e8d04632176 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:51.744224 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-10467717-5050-46d7-90e0-0e8d04632176 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:51.752116 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-10467717-5050-46d7-90e0-0e8d04632176 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150243 Jul 27 20:38:51.753462 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1618/3248] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:51 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:51.896982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-70a93a54-60b4-4a56-aab5-447c98896709 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:51.897602 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-70a93a54-60b4-4a56-aab5-447c98896709 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:51.904100 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-70a93a54-60b4-4a56-aab5-447c98896709 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:51.904553 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-70a93a54-60b4-4a56-aab5-447c98896709 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:51.905352 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-70a93a54-60b4-4a56-aab5-447c98896709 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:51.905792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-70a93a54-60b4-4a56-aab5-447c98896709 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:51.966478 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-70a93a54-60b4-4a56-aab5-447c98896709 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:51.975335 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-70a93a54-60b4-4a56-aab5-447c98896709 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082296 Jul 27 20:38:51.975900 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1631/3249] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:51 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:52.366728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2c5cc156-79e0-4b8a-83c0-5a501d2b62fa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:52.367328 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2c5cc156-79e0-4b8a-83c0-5a501d2b62fa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:52.373720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c5cc156-79e0-4b8a-83c0-5a501d2b62fa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:52.374163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c5cc156-79e0-4b8a-83c0-5a501d2b62fa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:52.374908 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c5cc156-79e0-4b8a-83c0-5a501d2b62fa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:52.375337 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c5cc156-79e0-4b8a-83c0-5a501d2b62fa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:52.504512 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2c5cc156-79e0-4b8a-83c0-5a501d2b62fa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:52.512719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2c5cc156-79e0-4b8a-83c0-5a501d2b62fa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:52.514233 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2c5cc156-79e0-4b8a-83c0-5a501d2b62fa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:52.515406 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2c5cc156-79e0-4b8a-83c0-5a501d2b62fa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152654 Jul 27 20:38:52.515950 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1619/3250] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:52 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:38:52.774127 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9ddccf11-b622-4ce2-b71d-168e1b13b6ff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:52.774748 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9ddccf11-b622-4ce2-b71d-168e1b13b6ff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:52.780771 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ddccf11-b622-4ce2-b71d-168e1b13b6ff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:52.781260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ddccf11-b622-4ce2-b71d-168e1b13b6ff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:52.782030 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ddccf11-b622-4ce2-b71d-168e1b13b6ff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:52.782471 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ddccf11-b622-4ce2-b71d-168e1b13b6ff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:52.912351 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9ddccf11-b622-4ce2-b71d-168e1b13b6ff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:52.920261 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9ddccf11-b622-4ce2-b71d-168e1b13b6ff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150049 Jul 27 20:38:52.920818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1632/3251] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:52 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:52.996724 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7c5de4d3-42fb-4983-a3fa-9f1c21643b3b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:52.997365 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7c5de4d3-42fb-4983-a3fa-9f1c21643b3b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:53.003678 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c5de4d3-42fb-4983-a3fa-9f1c21643b3b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:53.004126 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c5de4d3-42fb-4983-a3fa-9f1c21643b3b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:53.004882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c5de4d3-42fb-4983-a3fa-9f1c21643b3b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:53.005365 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c5de4d3-42fb-4983-a3fa-9f1c21643b3b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:53.068913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7c5de4d3-42fb-4983-a3fa-9f1c21643b3b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:53.076902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7c5de4d3-42fb-4983-a3fa-9f1c21643b3b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083994 Jul 27 20:38:53.077495 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1620/3252] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:52 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:53.539480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-db0a6ed0-0fbf-4f5b-b81d-c44075d63f57 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:53.540097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-db0a6ed0-0fbf-4f5b-b81d-c44075d63f57 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:53.546066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-db0a6ed0-0fbf-4f5b-b81d-c44075d63f57 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:53.546522 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-db0a6ed0-0fbf-4f5b-b81d-c44075d63f57 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:53.547282 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-db0a6ed0-0fbf-4f5b-b81d-c44075d63f57 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:53.547721 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-db0a6ed0-0fbf-4f5b-b81d-c44075d63f57 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:53.673170 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-db0a6ed0-0fbf-4f5b-b81d-c44075d63f57 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:53.682222 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-db0a6ed0-0fbf-4f5b-b81d-c44075d63f57 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:53.683788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-db0a6ed0-0fbf-4f5b-b81d-c44075d63f57 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:53.684956 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-db0a6ed0-0fbf-4f5b-b81d-c44075d63f57 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.149405 Jul 27 20:38:53.685539 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1633/3253] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:53 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:53.942063 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d40220ae-e32f-49a9-bf43-f24f1ead6655 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:53.942679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d40220ae-e32f-49a9-bf43-f24f1ead6655 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:53.949225 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d40220ae-e32f-49a9-bf43-f24f1ead6655 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:53.949680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d40220ae-e32f-49a9-bf43-f24f1ead6655 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:53.950445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d40220ae-e32f-49a9-bf43-f24f1ead6655 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:53.950886 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d40220ae-e32f-49a9-bf43-f24f1ead6655 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:54.079386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d40220ae-e32f-49a9-bf43-f24f1ead6655 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:54.088085 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d40220ae-e32f-49a9-bf43-f24f1ead6655 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150506 Jul 27 20:38:54.088657 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1621/3254] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:53 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:54.099288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9e331797-85a2-4b3e-a889-2be7635e99a6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:54.099902 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9e331797-85a2-4b3e-a889-2be7635e99a6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:54.106302 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9e331797-85a2-4b3e-a889-2be7635e99a6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:54.106755 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9e331797-85a2-4b3e-a889-2be7635e99a6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:54.107513 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9e331797-85a2-4b3e-a889-2be7635e99a6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:54.107951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9e331797-85a2-4b3e-a889-2be7635e99a6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:54.171689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9e331797-85a2-4b3e-a889-2be7635e99a6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:54.179749 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9e331797-85a2-4b3e-a889-2be7635e99a6 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084817 Jul 27 20:38:54.180307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1634/3255] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:54 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:54.709527 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1378790d-b482-4c05-aee6-700812d25e10 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:54.710126 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1378790d-b482-4c05-aee6-700812d25e10 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:54.716145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1378790d-b482-4c05-aee6-700812d25e10 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:54.716586 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1378790d-b482-4c05-aee6-700812d25e10 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:54.717366 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1378790d-b482-4c05-aee6-700812d25e10 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:54.717966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1378790d-b482-4c05-aee6-700812d25e10 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:54.845258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1378790d-b482-4c05-aee6-700812d25e10 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:54.854050 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1378790d-b482-4c05-aee6-700812d25e10 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:54.855507 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1378790d-b482-4c05-aee6-700812d25e10 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:54.856651 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1378790d-b482-4c05-aee6-700812d25e10 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.151369 Jul 27 20:38:54.857240 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1622/3256] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:54 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:55.109503 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cc7f7761-316b-4131-bd3c-4fee401535ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:55.110179 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cc7f7761-316b-4131-bd3c-4fee401535ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:55.118007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc7f7761-316b-4131-bd3c-4fee401535ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:55.118451 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc7f7761-316b-4131-bd3c-4fee401535ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:55.119214 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc7f7761-316b-4131-bd3c-4fee401535ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:55.119651 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc7f7761-316b-4131-bd3c-4fee401535ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:55.201629 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-71e57ce6-c406-49eb-84c1-0663da298823 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:55.202241 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-71e57ce6-c406-49eb-84c1-0663da298823 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:55.209752 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71e57ce6-c406-49eb-84c1-0663da298823 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:55.210203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71e57ce6-c406-49eb-84c1-0663da298823 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:55.210970 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71e57ce6-c406-49eb-84c1-0663da298823 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:55.211404 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71e57ce6-c406-49eb-84c1-0663da298823 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:55.247192 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cc7f7761-316b-4131-bd3c-4fee401535ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:55.255643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cc7f7761-316b-4131-bd3c-4fee401535ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150013 Jul 27 20:38:55.256234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1635/3257] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:55 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:55.278961 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-71e57ce6-c406-49eb-84c1-0663da298823 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:55.288067 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-71e57ce6-c406-49eb-84c1-0663da298823 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.090338 Jul 27 20:38:55.288636 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1623/3258] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:55 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:55.880471 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-70577876-af34-417a-bff4-b4519f5d6260 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:55.881119 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-70577876-af34-417a-bff4-b4519f5d6260 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:55.887109 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-70577876-af34-417a-bff4-b4519f5d6260 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:55.887557 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-70577876-af34-417a-bff4-b4519f5d6260 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:55.888309 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-70577876-af34-417a-bff4-b4519f5d6260 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:55.888745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-70577876-af34-417a-bff4-b4519f5d6260 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:56.014905 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-70577876-af34-417a-bff4-b4519f5d6260 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:56.023684 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-70577876-af34-417a-bff4-b4519f5d6260 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:56.025236 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-70577876-af34-417a-bff4-b4519f5d6260 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:56.026397 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-70577876-af34-417a-bff4-b4519f5d6260 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.150495 Jul 27 20:38:56.026957 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1636/3259] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:55 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:56.277909 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9aa22f2f-6d19-4c47-9b33-1b949286e8f6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:56.278470 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9aa22f2f-6d19-4c47-9b33-1b949286e8f6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:56.285668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9aa22f2f-6d19-4c47-9b33-1b949286e8f6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:56.286117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9aa22f2f-6d19-4c47-9b33-1b949286e8f6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:56.286876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9aa22f2f-6d19-4c47-9b33-1b949286e8f6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:56.287313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9aa22f2f-6d19-4c47-9b33-1b949286e8f6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:56.312048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:56.316792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-46f3a85f-6378-45a3-a1b1-690c6184b539 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:56.317452 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-46f3a85f-6378-45a3-a1b1-690c6184b539 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:56.324002 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46f3a85f-6378-45a3-a1b1-690c6184b539 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:56.324457 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46f3a85f-6378-45a3-a1b1-690c6184b539 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:56.325260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46f3a85f-6378-45a3-a1b1-690c6184b539 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:56.325736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-46f3a85f-6378-45a3-a1b1-690c6184b539 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:56.391728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-46f3a85f-6378-45a3-a1b1-690c6184b539 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:56.399755 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-46f3a85f-6378-45a3-a1b1-690c6184b539 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.090223 Jul 27 20:38:56.400329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1637/3260] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:56 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:56.425248 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9aa22f2f-6d19-4c47-9b33-1b949286e8f6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:56.433161 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9aa22f2f-6d19-4c47-9b33-1b949286e8f6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.159108 Jul 27 20:38:56.433747 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1624/3261] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:56 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:57.051064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2a72c8ac-325d-4f4f-81a0-58caec496222 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:57.051671 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2a72c8ac-325d-4f4f-81a0-58caec496222 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:57.057722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2a72c8ac-325d-4f4f-81a0-58caec496222 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:57.058187 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2a72c8ac-325d-4f4f-81a0-58caec496222 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:57.058933 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2a72c8ac-325d-4f4f-81a0-58caec496222 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:57.059365 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2a72c8ac-325d-4f4f-81a0-58caec496222 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:57.191979 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2a72c8ac-325d-4f4f-81a0-58caec496222 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:57.200598 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2a72c8ac-325d-4f4f-81a0-58caec496222 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:57.202177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2a72c8ac-325d-4f4f-81a0-58caec496222 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:57.203621 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2a72c8ac-325d-4f4f-81a0-58caec496222 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156799 Jul 27 20:38:57.204197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1638/3262] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:57 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:57.420217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6c233f4a-cd3b-4423-a0a4-478e85e0adf9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:57.420834 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6c233f4a-cd3b-4423-a0a4-478e85e0adf9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:57.427817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c233f4a-cd3b-4423-a0a4-478e85e0adf9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:57.428263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c233f4a-cd3b-4423-a0a4-478e85e0adf9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:57.429046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c233f4a-cd3b-4423-a0a4-478e85e0adf9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:57.429484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c233f4a-cd3b-4423-a0a4-478e85e0adf9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:57.455060 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3401219e-334b-42fb-be50-b67094509034 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:57.456493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3401219e-334b-42fb-be50-b67094509034 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:57.463409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3401219e-334b-42fb-be50-b67094509034 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:57.463865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3401219e-334b-42fb-be50-b67094509034 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:57.464643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3401219e-334b-42fb-be50-b67094509034 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:57.465262 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3401219e-334b-42fb-be50-b67094509034 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:57.491188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6c233f4a-cd3b-4423-a0a4-478e85e0adf9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:57.499140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6c233f4a-cd3b-4423-a0a4-478e85e0adf9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082763 Jul 27 20:38:57.499744 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1625/3263] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:57 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:57.593480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3401219e-334b-42fb-be50-b67094509034 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:57.601985 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3401219e-334b-42fb-be50-b67094509034 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150999 Jul 27 20:38:57.602555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1639/3264] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:57 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:38:58.227979 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-57501ad2-dd46-4385-bca5-bfa9b2784cdf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:58.228573 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-57501ad2-dd46-4385-bca5-bfa9b2784cdf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:58.234547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57501ad2-dd46-4385-bca5-bfa9b2784cdf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:58.234989 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57501ad2-dd46-4385-bca5-bfa9b2784cdf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:58.235736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57501ad2-dd46-4385-bca5-bfa9b2784cdf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:58.236166 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57501ad2-dd46-4385-bca5-bfa9b2784cdf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:58.366565 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-57501ad2-dd46-4385-bca5-bfa9b2784cdf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:58.374745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-57501ad2-dd46-4385-bca5-bfa9b2784cdf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:58.376239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-57501ad2-dd46-4385-bca5-bfa9b2784cdf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:58.377574 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-57501ad2-dd46-4385-bca5-bfa9b2784cdf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153503 Jul 27 20:38:58.378218 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1626/3265] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:58 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:58.520636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-03f00a70-49e6-44f7-843d-be95ef793d66 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:58.521289 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-03f00a70-49e6-44f7-843d-be95ef793d66 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:58.527771 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-03f00a70-49e6-44f7-843d-be95ef793d66 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:58.528226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-03f00a70-49e6-44f7-843d-be95ef793d66 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:58.529048 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-03f00a70-49e6-44f7-843d-be95ef793d66 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:58.529490 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-03f00a70-49e6-44f7-843d-be95ef793d66 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:58.597234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-03f00a70-49e6-44f7-843d-be95ef793d66 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:58.605151 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-03f00a70-49e6-44f7-843d-be95ef793d66 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.088999 Jul 27 20:38:58.605705 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1640/3266] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:58 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:58.623336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6a48e0d6-366b-480c-9f6e-2370fa29dd34 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:58.623885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6a48e0d6-366b-480c-9f6e-2370fa29dd34 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:58.631026 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6a48e0d6-366b-480c-9f6e-2370fa29dd34 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:58.631475 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6a48e0d6-366b-480c-9f6e-2370fa29dd34 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:58.632238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6a48e0d6-366b-480c-9f6e-2370fa29dd34 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:58.632683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6a48e0d6-366b-480c-9f6e-2370fa29dd34 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:58.760944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6a48e0d6-366b-480c-9f6e-2370fa29dd34 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:58.769569 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6a48e0d6-366b-480c-9f6e-2370fa29dd34 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150141 Jul 27 20:38:58.770138 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1627/3267] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:58 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:59.401948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-947a63c9-0dd6-477a-9b50-f67c651f7204 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:59.402561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-947a63c9-0dd6-477a-9b50-f67c651f7204 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:59.408559 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-947a63c9-0dd6-477a-9b50-f67c651f7204 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:59.409034 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-947a63c9-0dd6-477a-9b50-f67c651f7204 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:59.409798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-947a63c9-0dd6-477a-9b50-f67c651f7204 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:59.410227 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-947a63c9-0dd6-477a-9b50-f67c651f7204 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:59.414160 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:38:59.536140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-947a63c9-0dd6-477a-9b50-f67c651f7204 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:59.544380 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-947a63c9-0dd6-477a-9b50-f67c651f7204 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:59.545907 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-947a63c9-0dd6-477a-9b50-f67c651f7204 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:59.547047 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-947a63c9-0dd6-477a-9b50-f67c651f7204 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.149003 Jul 27 20:38:59.547596 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1641/3268] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:38:59 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:38:59.626179 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1b189897-1f6c-4c91-b9b7-3d31975d012f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:59.626805 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1b189897-1f6c-4c91-b9b7-3d31975d012f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:59.633918 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b189897-1f6c-4c91-b9b7-3d31975d012f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:59.634371 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b189897-1f6c-4c91-b9b7-3d31975d012f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:59.635138 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b189897-1f6c-4c91-b9b7-3d31975d012f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:59.635576 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b189897-1f6c-4c91-b9b7-3d31975d012f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:59.695944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1b189897-1f6c-4c91-b9b7-3d31975d012f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:59.704404 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1b189897-1f6c-4c91-b9b7-3d31975d012f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.081998 Jul 27 20:38:59.704993 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1628/3269] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:59 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:38:59.790005 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-25b6e92a-68cd-4ae3-ac9d-db820f32879b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:38:59.790622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-25b6e92a-68cd-4ae3-ac9d-db820f32879b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:38:59.796572 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-25b6e92a-68cd-4ae3-ac9d-db820f32879b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:59.797044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-25b6e92a-68cd-4ae3-ac9d-db820f32879b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:59.797825 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-25b6e92a-68cd-4ae3-ac9d-db820f32879b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:38:59.798268 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-25b6e92a-68cd-4ae3-ac9d-db820f32879b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:38:59.923898 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-25b6e92a-68cd-4ae3-ac9d-db820f32879b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:38:59.932210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-25b6e92a-68cd-4ae3-ac9d-db820f32879b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.146226 Jul 27 20:38:59.932767 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1642/3270] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:38:59 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:00.571499 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c3a97a68-bd5e-45d5-a2b9-2fdab0abf086 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:00.572102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c3a97a68-bd5e-45d5-a2b9-2fdab0abf086 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:00.578361 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3a97a68-bd5e-45d5-a2b9-2fdab0abf086 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:00.578802 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3a97a68-bd5e-45d5-a2b9-2fdab0abf086 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:00.579553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3a97a68-bd5e-45d5-a2b9-2fdab0abf086 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:00.579981 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3a97a68-bd5e-45d5-a2b9-2fdab0abf086 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:00.712064 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c3a97a68-bd5e-45d5-a2b9-2fdab0abf086 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:00.720506 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c3a97a68-bd5e-45d5-a2b9-2fdab0abf086 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:00.722795 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c3a97a68-bd5e-45d5-a2b9-2fdab0abf086 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:00.724001 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c3a97a68-bd5e-45d5-a2b9-2fdab0abf086 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156393 Jul 27 20:39:00.724558 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1629/3271] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:00 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:00.725996 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-00b89078-207d-49af-9342-ce97eec80691 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:00.726646 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-00b89078-207d-49af-9342-ce97eec80691 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:00.733085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00b89078-207d-49af-9342-ce97eec80691 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:00.733540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00b89078-207d-49af-9342-ce97eec80691 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:00.734304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00b89078-207d-49af-9342-ce97eec80691 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:00.734743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-00b89078-207d-49af-9342-ce97eec80691 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:00.798768 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-00b89078-207d-49af-9342-ce97eec80691 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:00.806852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-00b89078-207d-49af-9342-ce97eec80691 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.085533 Jul 27 20:39:00.807426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1643/3272] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:00 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:00.954237 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7f1e7a83-475a-4f0a-a60e-c7ae53230a71 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:00.954848 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7f1e7a83-475a-4f0a-a60e-c7ae53230a71 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:00.961937 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7f1e7a83-475a-4f0a-a60e-c7ae53230a71 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:00.962392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7f1e7a83-475a-4f0a-a60e-c7ae53230a71 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:00.963153 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7f1e7a83-475a-4f0a-a60e-c7ae53230a71 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:00.963594 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7f1e7a83-475a-4f0a-a60e-c7ae53230a71 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:01.093324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7f1e7a83-475a-4f0a-a60e-c7ae53230a71 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:01.102037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7f1e7a83-475a-4f0a-a60e-c7ae53230a71 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151864 Jul 27 20:39:01.102596 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1630/3273] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:00 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:01.747895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e495f799-182c-4bfb-8abc-d0df63419571 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:01.748513 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e495f799-182c-4bfb-8abc-d0df63419571 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:01.755591 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e495f799-182c-4bfb-8abc-d0df63419571 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:01.756267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e495f799-182c-4bfb-8abc-d0df63419571 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:01.757412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e495f799-182c-4bfb-8abc-d0df63419571 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:01.757859 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e495f799-182c-4bfb-8abc-d0df63419571 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:01.827690 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-262b1595-d69c-4ae4-a5ed-52dc592070cb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:01.828704 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-262b1595-d69c-4ae4-a5ed-52dc592070cb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:01.835305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-262b1595-d69c-4ae4-a5ed-52dc592070cb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:01.835635 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-262b1595-d69c-4ae4-a5ed-52dc592070cb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:01.836524 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-262b1595-d69c-4ae4-a5ed-52dc592070cb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:01.836833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-262b1595-d69c-4ae4-a5ed-52dc592070cb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:01.887865 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e495f799-182c-4bfb-8abc-d0df63419571 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:01.897164 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e495f799-182c-4bfb-8abc-d0df63419571 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:01.898402 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e495f799-182c-4bfb-8abc-d0df63419571 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:01.899177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-262b1595-d69c-4ae4-a5ed-52dc592070cb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:01.899578 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e495f799-182c-4bfb-8abc-d0df63419571 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155657 Jul 27 20:39:01.900142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1644/3274] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:01 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:01.906954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-262b1595-d69c-4ae4-a5ed-52dc592070cb tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083179 Jul 27 20:39:01.907500 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1631/3275] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:01 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:02.123620 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-19b566cd-c28a-4388-92a7-715eaa3098fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:02.124238 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-19b566cd-c28a-4388-92a7-715eaa3098fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:02.130425 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19b566cd-c28a-4388-92a7-715eaa3098fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:02.130876 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19b566cd-c28a-4388-92a7-715eaa3098fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:02.131633 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19b566cd-c28a-4388-92a7-715eaa3098fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:02.132071 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-19b566cd-c28a-4388-92a7-715eaa3098fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:02.259198 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-19b566cd-c28a-4388-92a7-715eaa3098fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:02.267003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-19b566cd-c28a-4388-92a7-715eaa3098fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.147239 Jul 27 20:39:02.267567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1645/3276] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:02 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:02.923372 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-06d8661a-d7b3-4ab3-9e04-19e05d7c71b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:02.923980 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-06d8661a-d7b3-4ab3-9e04-19e05d7c71b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:02.928728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-aad34539-c5e8-43dc-badd-2da4077b2cb9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:02.929380 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-aad34539-c5e8-43dc-badd-2da4077b2cb9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:02.931067 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-06d8661a-d7b3-4ab3-9e04-19e05d7c71b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:02.931510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-06d8661a-d7b3-4ab3-9e04-19e05d7c71b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:02.932270 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-06d8661a-d7b3-4ab3-9e04-19e05d7c71b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:02.932703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-06d8661a-d7b3-4ab3-9e04-19e05d7c71b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:02.935505 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aad34539-c5e8-43dc-badd-2da4077b2cb9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:02.935959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aad34539-c5e8-43dc-badd-2da4077b2cb9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:02.936735 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aad34539-c5e8-43dc-badd-2da4077b2cb9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:02.937204 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aad34539-c5e8-43dc-badd-2da4077b2cb9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:03.004581 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-aad34539-c5e8-43dc-badd-2da4077b2cb9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:03.012804 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-aad34539-c5e8-43dc-badd-2da4077b2cb9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.088996 Jul 27 20:39:03.013406 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1646/3277] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:02 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:03.067310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-06d8661a-d7b3-4ab3-9e04-19e05d7c71b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:03.075889 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-06d8661a-d7b3-4ab3-9e04-19e05d7c71b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:03.077424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-06d8661a-d7b3-4ab3-9e04-19e05d7c71b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:03.078863 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-06d8661a-d7b3-4ab3-9e04-19e05d7c71b0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.159460 Jul 27 20:39:03.079439 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1632/3278] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:02 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:03.289232 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-63c37b8d-bec6-4b32-bd60-460246d723fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:03.289845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-63c37b8d-bec6-4b32-bd60-460246d723fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:03.295751 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63c37b8d-bec6-4b32-bd60-460246d723fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:03.296209 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63c37b8d-bec6-4b32-bd60-460246d723fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:03.296991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63c37b8d-bec6-4b32-bd60-460246d723fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:03.297434 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63c37b8d-bec6-4b32-bd60-460246d723fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:03.424443 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-63c37b8d-bec6-4b32-bd60-460246d723fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:03.432344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-63c37b8d-bec6-4b32-bd60-460246d723fb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.147034 Jul 27 20:39:03.432907 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1647/3279] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:03 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:04.034978 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1aceea36-2bb7-40b4-aafc-bc06ce3a5d19 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:04.035803 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1aceea36-2bb7-40b4-aafc-bc06ce3a5d19 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:04.042767 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1aceea36-2bb7-40b4-aafc-bc06ce3a5d19 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:04.043250 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1aceea36-2bb7-40b4-aafc-bc06ce3a5d19 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:04.044016 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1aceea36-2bb7-40b4-aafc-bc06ce3a5d19 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:04.044455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1aceea36-2bb7-40b4-aafc-bc06ce3a5d19 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:04.105375 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a89970e3-8f6d-4137-9a29-9b69157841de tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:04.106501 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a89970e3-8f6d-4137-9a29-9b69157841de tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:04.109973 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=82 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:39:04.115904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1aceea36-2bb7-40b4-aafc-bc06ce3a5d19 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:04.118121 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a89970e3-8f6d-4137-9a29-9b69157841de tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:04.118580 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a89970e3-8f6d-4137-9a29-9b69157841de tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:04.119395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a89970e3-8f6d-4137-9a29-9b69157841de tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:04.120035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a89970e3-8f6d-4137-9a29-9b69157841de tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:04.125960 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1aceea36-2bb7-40b4-aafc-bc06ce3a5d19 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.095167 Jul 27 20:39:04.126548 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1633/3280] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:04 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:04.267805 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a89970e3-8f6d-4137-9a29-9b69157841de tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:04.277027 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a89970e3-8f6d-4137-9a29-9b69157841de tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:04.279761 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a89970e3-8f6d-4137-9a29-9b69157841de tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:04.280987 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a89970e3-8f6d-4137-9a29-9b69157841de tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.181460 Jul 27 20:39:04.281587 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1648/3281] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:04 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:39:04.453915 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-04b75203-0096-4a79-b428-2f3b9e34432a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:04.454532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-04b75203-0096-4a79-b428-2f3b9e34432a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:04.456334 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=78 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:39:04.462473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04b75203-0096-4a79-b428-2f3b9e34432a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:04.462928 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04b75203-0096-4a79-b428-2f3b9e34432a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:04.463729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04b75203-0096-4a79-b428-2f3b9e34432a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:04.464171 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04b75203-0096-4a79-b428-2f3b9e34432a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:04.594677 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-04b75203-0096-4a79-b428-2f3b9e34432a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:04.602721 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-04b75203-0096-4a79-b428-2f3b9e34432a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152976 Jul 27 20:39:04.603293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1634/3282] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:04 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:05.147872 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a0d341ea-4bc5-4160-a7c6-402a3795908b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:05.148832 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a0d341ea-4bc5-4160-a7c6-402a3795908b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:05.156717 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a0d341ea-4bc5-4160-a7c6-402a3795908b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:05.157203 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a0d341ea-4bc5-4160-a7c6-402a3795908b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:05.157973 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a0d341ea-4bc5-4160-a7c6-402a3795908b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:05.158418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a0d341ea-4bc5-4160-a7c6-402a3795908b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:05.224686 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a0d341ea-4bc5-4160-a7c6-402a3795908b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:05.232676 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a0d341ea-4bc5-4160-a7c6-402a3795908b tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.089700 Jul 27 20:39:05.233274 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1649/3283] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:05 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:05.306281 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b2b5bdfb-fec5-4c8e-91ec-92b8fd7bd4ca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:05.306823 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b2b5bdfb-fec5-4c8e-91ec-92b8fd7bd4ca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:05.313295 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b2b5bdfb-fec5-4c8e-91ec-92b8fd7bd4ca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:05.313746 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b2b5bdfb-fec5-4c8e-91ec-92b8fd7bd4ca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:05.314503 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b2b5bdfb-fec5-4c8e-91ec-92b8fd7bd4ca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:05.314940 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b2b5bdfb-fec5-4c8e-91ec-92b8fd7bd4ca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:05.440508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b2b5bdfb-fec5-4c8e-91ec-92b8fd7bd4ca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:05.448841 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b2b5bdfb-fec5-4c8e-91ec-92b8fd7bd4ca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:05.450364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b2b5bdfb-fec5-4c8e-91ec-92b8fd7bd4ca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:05.451518 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b2b5bdfb-fec5-4c8e-91ec-92b8fd7bd4ca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.149225 Jul 27 20:39:05.452076 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1635/3284] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:05 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:05.623737 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-11ae5a81-5cd4-43f9-aeed-3c6780daafa7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:05.624251 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-11ae5a81-5cd4-43f9-aeed-3c6780daafa7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:05.630384 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-11ae5a81-5cd4-43f9-aeed-3c6780daafa7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:05.630832 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-11ae5a81-5cd4-43f9-aeed-3c6780daafa7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:05.631637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-11ae5a81-5cd4-43f9-aeed-3c6780daafa7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:05.632078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-11ae5a81-5cd4-43f9-aeed-3c6780daafa7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:05.760109 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-11ae5a81-5cd4-43f9-aeed-3c6780daafa7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:05.768043 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-11ae5a81-5cd4-43f9-aeed-3c6780daafa7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148314 Jul 27 20:39:05.768603 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1650/3285] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:05 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:06.254962 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-75b8a46e-8012-4d4a-afa0-748773a41e9d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:06.255561 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-75b8a46e-8012-4d4a-afa0-748773a41e9d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:06.261565 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-75b8a46e-8012-4d4a-afa0-748773a41e9d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:06.262008 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-75b8a46e-8012-4d4a-afa0-748773a41e9d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:06.262757 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-75b8a46e-8012-4d4a-afa0-748773a41e9d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:06.263187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-75b8a46e-8012-4d4a-afa0-748773a41e9d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:06.322611 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-75b8a46e-8012-4d4a-afa0-748773a41e9d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:06.330667 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-75b8a46e-8012-4d4a-afa0-748773a41e9d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.079966 Jul 27 20:39:06.331164 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1636/3286] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:06 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:06.474966 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6e481b04-cf6d-4e6e-b896-38e456d66545 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:06.475582 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6e481b04-cf6d-4e6e-b896-38e456d66545 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:06.482148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6e481b04-cf6d-4e6e-b896-38e456d66545 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:06.482596 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6e481b04-cf6d-4e6e-b896-38e456d66545 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:06.483346 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6e481b04-cf6d-4e6e-b896-38e456d66545 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:06.483781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6e481b04-cf6d-4e6e-b896-38e456d66545 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:06.610048 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6e481b04-cf6d-4e6e-b896-38e456d66545 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:06.619033 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6e481b04-cf6d-4e6e-b896-38e456d66545 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:06.620551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6e481b04-cf6d-4e6e-b896-38e456d66545 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:06.621745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6e481b04-cf6d-4e6e-b896-38e456d66545 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.150793 Jul 27 20:39:06.622303 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1651/3287] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:06 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:06.790137 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6906209f-af86-4136-aa3d-b30bb8ed075d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:06.790771 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6906209f-af86-4136-aa3d-b30bb8ed075d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:06.796758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6906209f-af86-4136-aa3d-b30bb8ed075d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:06.797238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6906209f-af86-4136-aa3d-b30bb8ed075d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:06.797986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6906209f-af86-4136-aa3d-b30bb8ed075d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:06.798415 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6906209f-af86-4136-aa3d-b30bb8ed075d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:06.930390 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6906209f-af86-4136-aa3d-b30bb8ed075d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:06.938263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6906209f-af86-4136-aa3d-b30bb8ed075d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151971 Jul 27 20:39:06.938830 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1637/3288] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:06 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:07.352304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e55b6291-890b-4d91-b142-411754d2963a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:07.352923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e55b6291-890b-4d91-b142-411754d2963a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:07.358970 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e55b6291-890b-4d91-b142-411754d2963a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:07.359428 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e55b6291-890b-4d91-b142-411754d2963a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:07.360195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e55b6291-890b-4d91-b142-411754d2963a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:07.360644 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e55b6291-890b-4d91-b142-411754d2963a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:07.423560 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e55b6291-890b-4d91-b142-411754d2963a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:07.431631 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e55b6291-890b-4d91-b142-411754d2963a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083226 Jul 27 20:39:07.432198 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1652/3289] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:07 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:07.646367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c2949be5-56b4-4863-b05f-c341ca25d598 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:07.647029 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c2949be5-56b4-4863-b05f-c341ca25d598 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:07.653568 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2949be5-56b4-4863-b05f-c341ca25d598 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:07.654021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2949be5-56b4-4863-b05f-c341ca25d598 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:07.654786 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2949be5-56b4-4863-b05f-c341ca25d598 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:07.655240 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2949be5-56b4-4863-b05f-c341ca25d598 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:07.790283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c2949be5-56b4-4863-b05f-c341ca25d598 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:07.798510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c2949be5-56b4-4863-b05f-c341ca25d598 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:07.799988 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c2949be5-56b4-4863-b05f-c341ca25d598 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:07.801740 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c2949be5-56b4-4863-b05f-c341ca25d598 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.160139 Jul 27 20:39:07.802291 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1638/3290] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:07 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:07.960197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9612ef1e-0eec-4850-b53d-20d1aed739d2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:07.960807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9612ef1e-0eec-4850-b53d-20d1aed739d2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:07.967227 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9612ef1e-0eec-4850-b53d-20d1aed739d2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:07.967704 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9612ef1e-0eec-4850-b53d-20d1aed739d2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:07.968459 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9612ef1e-0eec-4850-b53d-20d1aed739d2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:07.968893 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9612ef1e-0eec-4850-b53d-20d1aed739d2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:08.342102 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9612ef1e-0eec-4850-b53d-20d1aed739d2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:08.352396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9612ef1e-0eec-4850-b53d-20d1aed739d2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.396265 Jul 27 20:39:08.353148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1653/3291] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:07 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:08.451578 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-902e4947-62fc-42e5-9f8a-9adb2ed7489f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:08.452186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-902e4947-62fc-42e5-9f8a-9adb2ed7489f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:08.459056 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-902e4947-62fc-42e5-9f8a-9adb2ed7489f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:08.459509 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-902e4947-62fc-42e5-9f8a-9adb2ed7489f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:08.460269 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-902e4947-62fc-42e5-9f8a-9adb2ed7489f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:08.460706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-902e4947-62fc-42e5-9f8a-9adb2ed7489f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:08.520495 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-902e4947-62fc-42e5-9f8a-9adb2ed7489f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:08.528356 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-902e4947-62fc-42e5-9f8a-9adb2ed7489f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.080649 Jul 27 20:39:08.528922 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1639/3292] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:08 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:08.824812 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cf4465b3-4a22-4303-9fd3-c56ef7683618 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:08.825447 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cf4465b3-4a22-4303-9fd3-c56ef7683618 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:08.831838 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf4465b3-4a22-4303-9fd3-c56ef7683618 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:08.832291 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf4465b3-4a22-4303-9fd3-c56ef7683618 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:08.833086 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf4465b3-4a22-4303-9fd3-c56ef7683618 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:08.833526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf4465b3-4a22-4303-9fd3-c56ef7683618 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:08.961135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cf4465b3-4a22-4303-9fd3-c56ef7683618 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:08.969860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cf4465b3-4a22-4303-9fd3-c56ef7683618 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:08.971361 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cf4465b3-4a22-4303-9fd3-c56ef7683618 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:08.973090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cf4465b3-4a22-4303-9fd3-c56ef7683618 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152125 Jul 27 20:39:08.973645 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1654/3293] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:08 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:09.375835 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fdddc1e9-02ed-4050-be92-6b211c681583 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:09.376393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fdddc1e9-02ed-4050-be92-6b211c681583 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:09.383833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fdddc1e9-02ed-4050-be92-6b211c681583 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:09.384281 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fdddc1e9-02ed-4050-be92-6b211c681583 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:09.385074 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fdddc1e9-02ed-4050-be92-6b211c681583 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:09.385517 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fdddc1e9-02ed-4050-be92-6b211c681583 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:09.515021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fdddc1e9-02ed-4050-be92-6b211c681583 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:09.522963 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fdddc1e9-02ed-4050-be92-6b211c681583 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151066 Jul 27 20:39:09.523530 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1640/3294] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:09 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:09.549073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-85858831-6161-4cf2-8da4-ac835c1fa84e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:09.549692 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-85858831-6161-4cf2-8da4-ac835c1fa84e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:09.556374 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-85858831-6161-4cf2-8da4-ac835c1fa84e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:09.556826 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-85858831-6161-4cf2-8da4-ac835c1fa84e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:09.557628 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-85858831-6161-4cf2-8da4-ac835c1fa84e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:09.558066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-85858831-6161-4cf2-8da4-ac835c1fa84e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:09.620477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-85858831-6161-4cf2-8da4-ac835c1fa84e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:09.628949 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-85858831-6161-4cf2-8da4-ac835c1fa84e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083064 Jul 27 20:39:09.629475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1655/3295] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:09 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:09.996861 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8e77821b-ea2d-4174-b4f5-6562ab58cb52 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:09.997501 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8e77821b-ea2d-4174-b4f5-6562ab58cb52 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:10.003630 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e77821b-ea2d-4174-b4f5-6562ab58cb52 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:10.004075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e77821b-ea2d-4174-b4f5-6562ab58cb52 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:10.004832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e77821b-ea2d-4174-b4f5-6562ab58cb52 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:10.005299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e77821b-ea2d-4174-b4f5-6562ab58cb52 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:10.009219 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:39:10.133995 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8e77821b-ea2d-4174-b4f5-6562ab58cb52 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:10.142401 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8e77821b-ea2d-4174-b4f5-6562ab58cb52 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:10.144498 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8e77821b-ea2d-4174-b4f5-6562ab58cb52 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:10.145797 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8e77821b-ea2d-4174-b4f5-6562ab58cb52 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152846 Jul 27 20:39:10.146367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1641/3296] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:09 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:10.544078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c18d2e16-e3c4-4350-9226-c5c4f2aa881c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:10.544697 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c18d2e16-e3c4-4350-9226-c5c4f2aa881c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:10.551778 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c18d2e16-e3c4-4350-9226-c5c4f2aa881c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:10.552236 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c18d2e16-e3c4-4350-9226-c5c4f2aa881c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:10.553029 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c18d2e16-e3c4-4350-9226-c5c4f2aa881c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:10.553476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c18d2e16-e3c4-4350-9226-c5c4f2aa881c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:10.649849 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-273546b8-17b6-4ef8-a663-e0e847ac40ab tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:10.650453 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-273546b8-17b6-4ef8-a663-e0e847ac40ab tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:10.656886 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-273546b8-17b6-4ef8-a663-e0e847ac40ab tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:10.657374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-273546b8-17b6-4ef8-a663-e0e847ac40ab tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:10.658132 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-273546b8-17b6-4ef8-a663-e0e847ac40ab tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:10.658563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-273546b8-17b6-4ef8-a663-e0e847ac40ab tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:10.686480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c18d2e16-e3c4-4350-9226-c5c4f2aa881c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:10.695623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c18d2e16-e3c4-4350-9226-c5c4f2aa881c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.155327 Jul 27 20:39:10.696216 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1656/3297] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:10 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:10.721654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-273546b8-17b6-4ef8-a663-e0e847ac40ab tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:10.729565 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-273546b8-17b6-4ef8-a663-e0e847ac40ab tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083530 Jul 27 20:39:10.730123 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1642/3298] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:10 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:11.169820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9dc00aa2-e9ac-492d-9b1f-6b216a3f5f88 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:11.170468 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9dc00aa2-e9ac-492d-9b1f-6b216a3f5f88 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:11.177185 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9dc00aa2-e9ac-492d-9b1f-6b216a3f5f88 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:11.177646 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9dc00aa2-e9ac-492d-9b1f-6b216a3f5f88 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:11.178417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9dc00aa2-e9ac-492d-9b1f-6b216a3f5f88 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:11.178863 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9dc00aa2-e9ac-492d-9b1f-6b216a3f5f88 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:11.308819 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9dc00aa2-e9ac-492d-9b1f-6b216a3f5f88 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:11.312188 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:39:11.318184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9dc00aa2-e9ac-492d-9b1f-6b216a3f5f88 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:11.319682 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9dc00aa2-e9ac-492d-9b1f-6b216a3f5f88 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:11.320833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9dc00aa2-e9ac-492d-9b1f-6b216a3f5f88 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.154983 Jul 27 20:39:11.321417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1657/3299] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:11 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:11.717860 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-86a5b725-3b52-45a5-b107-dce9cdcb3d3c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:11.718554 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-86a5b725-3b52-45a5-b107-dce9cdcb3d3c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:11.725572 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86a5b725-3b52-45a5-b107-dce9cdcb3d3c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:11.726025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86a5b725-3b52-45a5-b107-dce9cdcb3d3c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:11.726787 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86a5b725-3b52-45a5-b107-dce9cdcb3d3c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:11.727223 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86a5b725-3b52-45a5-b107-dce9cdcb3d3c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:11.750347 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-999d2223-a536-4bd2-8bd9-ecb42abd5805 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:11.750956 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-999d2223-a536-4bd2-8bd9-ecb42abd5805 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:11.758169 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-999d2223-a536-4bd2-8bd9-ecb42abd5805 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:11.758616 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-999d2223-a536-4bd2-8bd9-ecb42abd5805 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:11.759376 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-999d2223-a536-4bd2-8bd9-ecb42abd5805 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:11.759810 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-999d2223-a536-4bd2-8bd9-ecb42abd5805 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:11.821615 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-999d2223-a536-4bd2-8bd9-ecb42abd5805 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:11.829845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-999d2223-a536-4bd2-8bd9-ecb42abd5805 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.083498 Jul 27 20:39:11.830409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1658/3300] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:11 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:11.862093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-86a5b725-3b52-45a5-b107-dce9cdcb3d3c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:11.870073 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-86a5b725-3b52-45a5-b107-dce9cdcb3d3c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.156078 Jul 27 20:39:11.870634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1643/3301] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:11 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:12.344843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-02ecd0ae-fb3a-4b33-a18a-202cc4e17c2d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:12.345409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-02ecd0ae-fb3a-4b33-a18a-202cc4e17c2d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:12.351667 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-02ecd0ae-fb3a-4b33-a18a-202cc4e17c2d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:12.352126 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-02ecd0ae-fb3a-4b33-a18a-202cc4e17c2d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:12.352891 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-02ecd0ae-fb3a-4b33-a18a-202cc4e17c2d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:12.353362 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-02ecd0ae-fb3a-4b33-a18a-202cc4e17c2d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:12.477498 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-02ecd0ae-fb3a-4b33-a18a-202cc4e17c2d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:12.485920 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-02ecd0ae-fb3a-4b33-a18a-202cc4e17c2d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:12.487925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-02ecd0ae-fb3a-4b33-a18a-202cc4e17c2d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:12.489109 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-02ecd0ae-fb3a-4b33-a18a-202cc4e17c2d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.148579 Jul 27 20:39:12.489660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1659/3302] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:12 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:12.851164 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-10cdd296-e30d-4107-9cbc-e6d3e4730b89 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:12.851780 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-10cdd296-e30d-4107-9cbc-e6d3e4730b89 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:12.858332 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10cdd296-e30d-4107-9cbc-e6d3e4730b89 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:12.858787 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10cdd296-e30d-4107-9cbc-e6d3e4730b89 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:12.859548 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10cdd296-e30d-4107-9cbc-e6d3e4730b89 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:12.860013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10cdd296-e30d-4107-9cbc-e6d3e4730b89 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:12.891249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5bdbe854-90c3-44b1-a3a3-75e97e255b53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:12.891969 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5bdbe854-90c3-44b1-a3a3-75e97e255b53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:12.898805 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5bdbe854-90c3-44b1-a3a3-75e97e255b53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:12.899257 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5bdbe854-90c3-44b1-a3a3-75e97e255b53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:12.900026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5bdbe854-90c3-44b1-a3a3-75e97e255b53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:12.900707 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5bdbe854-90c3-44b1-a3a3-75e97e255b53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:12.922419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-10cdd296-e30d-4107-9cbc-e6d3e4730b89 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:12.931119 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-10cdd296-e30d-4107-9cbc-e6d3e4730b89 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084533 Jul 27 20:39:12.931686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1644/3303] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:12 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:13.032849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5bdbe854-90c3-44b1-a3a3-75e97e255b53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:13.041347 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5bdbe854-90c3-44b1-a3a3-75e97e255b53 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153894 Jul 27 20:39:13.041907 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1660/3304] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:12 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:13.512941 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9e25a03d-79ff-4098-ba75-8e641871c464 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:13.513579 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9e25a03d-79ff-4098-ba75-8e641871c464 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:13.519599 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9e25a03d-79ff-4098-ba75-8e641871c464 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:13.520046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9e25a03d-79ff-4098-ba75-8e641871c464 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:13.520807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9e25a03d-79ff-4098-ba75-8e641871c464 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:13.521273 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9e25a03d-79ff-4098-ba75-8e641871c464 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:13.650670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9e25a03d-79ff-4098-ba75-8e641871c464 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:13.659116 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9e25a03d-79ff-4098-ba75-8e641871c464 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:13.661323 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9e25a03d-79ff-4098-ba75-8e641871c464 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:13.662489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9e25a03d-79ff-4098-ba75-8e641871c464 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153457 Jul 27 20:39:13.663046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1645/3305] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:13 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:13.951233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3c9bb60e-52a4-4f23-bdc9-00e14830e754 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:13.951854 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3c9bb60e-52a4-4f23-bdc9-00e14830e754 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:13.959478 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c9bb60e-52a4-4f23-bdc9-00e14830e754 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:13.959933 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c9bb60e-52a4-4f23-bdc9-00e14830e754 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:13.960707 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c9bb60e-52a4-4f23-bdc9-00e14830e754 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:13.961184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c9bb60e-52a4-4f23-bdc9-00e14830e754 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:14.026692 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3c9bb60e-52a4-4f23-bdc9-00e14830e754 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:14.034809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3c9bb60e-52a4-4f23-bdc9-00e14830e754 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.087407 Jul 27 20:39:14.036181 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1661/3306] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:13 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:14.062579 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4559b40e-21e9-466c-b971-dc28998fb21b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:14.063204 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4559b40e-21e9-466c-b971-dc28998fb21b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:14.069564 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4559b40e-21e9-466c-b971-dc28998fb21b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:14.070010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4559b40e-21e9-466c-b971-dc28998fb21b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:14.070768 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4559b40e-21e9-466c-b971-dc28998fb21b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:14.071199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4559b40e-21e9-466c-b971-dc28998fb21b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:14.208378 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4559b40e-21e9-466c-b971-dc28998fb21b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:14.216463 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4559b40e-21e9-466c-b971-dc28998fb21b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.157630 Jul 27 20:39:14.217055 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1646/3307] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:14 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:14.686838 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2b16a6e2-c1d5-4e59-bc71-ca818cbc1c33 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:14.687448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2b16a6e2-c1d5-4e59-bc71-ca818cbc1c33 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:14.694203 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2b16a6e2-c1d5-4e59-bc71-ca818cbc1c33 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:14.694650 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2b16a6e2-c1d5-4e59-bc71-ca818cbc1c33 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:14.695402 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2b16a6e2-c1d5-4e59-bc71-ca818cbc1c33 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:14.695835 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2b16a6e2-c1d5-4e59-bc71-ca818cbc1c33 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:14.822857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2b16a6e2-c1d5-4e59-bc71-ca818cbc1c33 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:14.831383 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2b16a6e2-c1d5-4e59-bc71-ca818cbc1c33 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:14.833196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2b16a6e2-c1d5-4e59-bc71-ca818cbc1c33 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:14.834350 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2b16a6e2-c1d5-4e59-bc71-ca818cbc1c33 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.151421 Jul 27 20:39:14.834907 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1662/3308] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:14 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:15.056873 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9a280406-0c13-45d9-b88d-836e942666e4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:15.057446 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9a280406-0c13-45d9-b88d-836e942666e4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:15.063532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a280406-0c13-45d9-b88d-836e942666e4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:15.064093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a280406-0c13-45d9-b88d-836e942666e4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:15.064726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a280406-0c13-45d9-b88d-836e942666e4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:15.065191 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a280406-0c13-45d9-b88d-836e942666e4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:15.127653 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9a280406-0c13-45d9-b88d-836e942666e4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:15.135617 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9a280406-0c13-45d9-b88d-836e942666e4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082697 Jul 27 20:39:15.136188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1647/3309] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:15 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:15.239126 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-38916847-f155-4241-bfb7-8c84795a8c54 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:15.239760 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-38916847-f155-4241-bfb7-8c84795a8c54 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:15.247953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-38916847-f155-4241-bfb7-8c84795a8c54 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:15.248411 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-38916847-f155-4241-bfb7-8c84795a8c54 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:15.249218 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-38916847-f155-4241-bfb7-8c84795a8c54 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:15.249664 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-38916847-f155-4241-bfb7-8c84795a8c54 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:15.379637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-38916847-f155-4241-bfb7-8c84795a8c54 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:15.387612 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-38916847-f155-4241-bfb7-8c84795a8c54 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152982 Jul 27 20:39:15.388181 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1663/3310] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:15 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:15.857453 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2267a38a-203b-4d75-9e26-a230ffddd138 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:15.858090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2267a38a-203b-4d75-9e26-a230ffddd138 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:15.864229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2267a38a-203b-4d75-9e26-a230ffddd138 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:15.864690 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2267a38a-203b-4d75-9e26-a230ffddd138 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:15.865480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2267a38a-203b-4d75-9e26-a230ffddd138 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:15.865922 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2267a38a-203b-4d75-9e26-a230ffddd138 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:15.995505 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2267a38a-203b-4d75-9e26-a230ffddd138 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:16.004748 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2267a38a-203b-4d75-9e26-a230ffddd138 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:16.007408 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2267a38a-203b-4d75-9e26-a230ffddd138 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:16.008818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2267a38a-203b-4d75-9e26-a230ffddd138 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155254 Jul 27 20:39:16.009399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1648/3311] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:15 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:16.156306 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e123423a-06f9-4021-98b7-7aeaf1bdeb72 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:16.156952 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e123423a-06f9-4021-98b7-7aeaf1bdeb72 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:16.164175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e123423a-06f9-4021-98b7-7aeaf1bdeb72 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:16.164628 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e123423a-06f9-4021-98b7-7aeaf1bdeb72 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:16.165420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e123423a-06f9-4021-98b7-7aeaf1bdeb72 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:16.165860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e123423a-06f9-4021-98b7-7aeaf1bdeb72 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:16.225872 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e123423a-06f9-4021-98b7-7aeaf1bdeb72 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:16.235343 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e123423a-06f9-4021-98b7-7aeaf1bdeb72 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.082943 Jul 27 20:39:16.235908 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1664/3312] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:16 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:16.408946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5504b1c2-043f-4e2a-a920-414c345e4109 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:16.409606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5504b1c2-043f-4e2a-a920-414c345e4109 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:16.416178 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5504b1c2-043f-4e2a-a920-414c345e4109 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:16.416619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5504b1c2-043f-4e2a-a920-414c345e4109 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:16.417402 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5504b1c2-043f-4e2a-a920-414c345e4109 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:16.417832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5504b1c2-043f-4e2a-a920-414c345e4109 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:16.546138 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5504b1c2-043f-4e2a-a920-414c345e4109 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:16.554821 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5504b1c2-043f-4e2a-a920-414c345e4109 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149661 Jul 27 20:39:16.555392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1649/3313] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:16 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:17.031919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-73d6b92a-c17f-4e19-a420-c6ed8a6560c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:17.032571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-73d6b92a-c17f-4e19-a420-c6ed8a6560c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:17.039852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-73d6b92a-c17f-4e19-a420-c6ed8a6560c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:17.040308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-73d6b92a-c17f-4e19-a420-c6ed8a6560c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:17.041108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-73d6b92a-c17f-4e19-a420-c6ed8a6560c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:17.041560 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-73d6b92a-c17f-4e19-a420-c6ed8a6560c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:17.172102 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-73d6b92a-c17f-4e19-a420-c6ed8a6560c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:17.181581 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-73d6b92a-c17f-4e19-a420-c6ed8a6560c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:17.183087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-73d6b92a-c17f-4e19-a420-c6ed8a6560c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:17.184247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-73d6b92a-c17f-4e19-a420-c6ed8a6560c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156222 Jul 27 20:39:17.184842 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1665/3314] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:17 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:17.258320 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-859ea229-a4a1-4558-adcd-0fcd5634d64c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:17.258930 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-859ea229-a4a1-4558-adcd-0fcd5634d64c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:17.265862 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-859ea229-a4a1-4558-adcd-0fcd5634d64c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:17.266311 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-859ea229-a4a1-4558-adcd-0fcd5634d64c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:17.267068 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-859ea229-a4a1-4558-adcd-0fcd5634d64c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:17.267503 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-859ea229-a4a1-4558-adcd-0fcd5634d64c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:17.329134 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-859ea229-a4a1-4558-adcd-0fcd5634d64c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:17.337733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-859ea229-a4a1-4558-adcd-0fcd5634d64c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.084623 Jul 27 20:39:17.338298 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1650/3315] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:17 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:17.575615 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6e8f3394-f0cb-4459-95f0-0ca7df2e36ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:17.576230 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6e8f3394-f0cb-4459-95f0-0ca7df2e36ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:17.583639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6e8f3394-f0cb-4459-95f0-0ca7df2e36ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:17.584042 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6e8f3394-f0cb-4459-95f0-0ca7df2e36ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:17.584802 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6e8f3394-f0cb-4459-95f0-0ca7df2e36ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:17.585273 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6e8f3394-f0cb-4459-95f0-0ca7df2e36ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:17.716764 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6e8f3394-f0cb-4459-95f0-0ca7df2e36ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:17.724799 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6e8f3394-f0cb-4459-95f0-0ca7df2e36ad tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153038 Jul 27 20:39:17.725392 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1666/3316] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:17 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:18.208627 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1b86d9fe-2f0d-4454-94fb-5ba42e67c1a8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:18.209290 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1b86d9fe-2f0d-4454-94fb-5ba42e67c1a8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:18.215332 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b86d9fe-2f0d-4454-94fb-5ba42e67c1a8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:18.215783 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b86d9fe-2f0d-4454-94fb-5ba42e67c1a8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:18.216551 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b86d9fe-2f0d-4454-94fb-5ba42e67c1a8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:18.217009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b86d9fe-2f0d-4454-94fb-5ba42e67c1a8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:18.347030 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1b86d9fe-2f0d-4454-94fb-5ba42e67c1a8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:18.356723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1b86d9fe-2f0d-4454-94fb-5ba42e67c1a8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:18.357714 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-215fda72-850e-42c5-8261-90553302467f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:18.358337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-215fda72-850e-42c5-8261-90553302467f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:18.359048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1b86d9fe-2f0d-4454-94fb-5ba42e67c1a8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:18.360356 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1b86d9fe-2f0d-4454-94fb-5ba42e67c1a8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155756 Jul 27 20:39:18.361338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1651/3317] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:18 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:18.376793 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-215fda72-850e-42c5-8261-90553302467f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:18.380548 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-215fda72-850e-42c5-8261-90553302467f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:18.381385 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-215fda72-850e-42c5-8261-90553302467f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:18.381843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-215fda72-850e-42c5-8261-90553302467f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:18.448412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-215fda72-850e-42c5-8261-90553302467f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:18.457563 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-215fda72-850e-42c5-8261-90553302467f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 200 len: 1368 microversion: 2.1 time: 0.102900 Jul 27 20:39:18.469036 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1667/3318] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:18 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:18.479610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-51eab9af-872f-4308-8518-fc555064f9d4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '.version_select at 0x7fc7eae7cb80>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:18.498563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-51eab9af-872f-4308-8518-fc555064f9d4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-760039290" status: 202 len: 0 microversion: 2.1 time: 0.022759 Jul 27 20:39:18.499167 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1652/3319] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Jul 27 20:39:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-760039290 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:39:18.747339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f6ce1b34-0e0b-45be-9943-c0460ea7c62e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:18.747951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f6ce1b34-0e0b-45be-9943-c0460ea7c62e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:18.754353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f6ce1b34-0e0b-45be-9943-c0460ea7c62e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:18.754796 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f6ce1b34-0e0b-45be-9943-c0460ea7c62e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:18.755552 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f6ce1b34-0e0b-45be-9943-c0460ea7c62e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:18.755988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f6ce1b34-0e0b-45be-9943-c0460ea7c62e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:18.885120 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f6ce1b34-0e0b-45be-9943-c0460ea7c62e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:18.893421 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f6ce1b34-0e0b-45be-9943-c0460ea7c62e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150531 Jul 27 20:39:18.893988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1668/3320] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:18 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:19.239070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cf85350c-f133-4dfa-8367-93340117a010 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Action: 'create', calling method: .version_select at 0x7fc7eaf79160>, body: {"keypair": {"name": "tempest-keypair-1427936615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEoGpp0JiF7LeowA0Vu0B4JmjH1ISH76TPL8lXmY5n3ag/0DmOtLcV/ktn+gKtmSzPl11Jov7cn5gzMYr3K+yltwm9nfjx1iTHxCIJgrViWt0kwkRhbslK+coUz90JYKA=="}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:39:19.254990 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-cf85350c-f133-4dfa-8367-93340117a010 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Getting quotas for project 8d9a9e3a2b0e4918950cfd454aab9fbb. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:39:19.259710 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-cf85350c-f133-4dfa-8367-93340117a010 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Getting quotas for user ea3c5c3007e04391b5b108473da62787 and project 8d9a9e3a2b0e4918950cfd454aab9fbb. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:39:19.282399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cf85350c-f133-4dfa-8367-93340117a010 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047780 Jul 27 20:39:19.283268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1653/3321] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Jul 27 20:39:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:39:19.388877 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-18856977-9327-4ed3-bdd2-2286a0fea312 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:19.389764 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-18856977-9327-4ed3-bdd2-2286a0fea312 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:19.397279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-18856977-9327-4ed3-bdd2-2286a0fea312 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:19.397854 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-18856977-9327-4ed3-bdd2-2286a0fea312 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:19.398720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-18856977-9327-4ed3-bdd2-2286a0fea312 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:19.399151 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-18856977-9327-4ed3-bdd2-2286a0fea312 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:19.543349 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-18856977-9327-4ed3-bdd2-2286a0fea312 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:19.553891 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-18856977-9327-4ed3-bdd2-2286a0fea312 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:19.555500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-18856977-9327-4ed3-bdd2-2286a0fea312 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:19.557009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-18856977-9327-4ed3-bdd2-2286a0fea312 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.172606 Jul 27 20:39:19.557807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1669/3322] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:19 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:19.916500 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2f2116cc-f6ca-403a-b95c-5c8d0db1c7f2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:19.917146 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2f2116cc-f6ca-403a-b95c-5c8d0db1c7f2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:19.924722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2f2116cc-f6ca-403a-b95c-5c8d0db1c7f2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:19.925205 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2f2116cc-f6ca-403a-b95c-5c8d0db1c7f2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:19.926278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2f2116cc-f6ca-403a-b95c-5c8d0db1c7f2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:19.926928 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2f2116cc-f6ca-403a-b95c-5c8d0db1c7f2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:20.061913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2f2116cc-f6ca-403a-b95c-5c8d0db1c7f2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:20.069999 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2f2116cc-f6ca-403a-b95c-5c8d0db1c7f2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.157452 Jul 27 20:39:20.070956 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1654/3323] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:19 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:20.550762 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b43d24a7-5f6b-45fe-9c4c-85be7b8f50ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-93232975", "imageRef": "fb689bea-534a-4aac-bec3-8f55591dba58", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "33e63fd4-dc98-4fa3-abec-4f896450c787"}], "security_groups": [{"name": "tempest-securitygroup--1098477146"}], "key_name": "tempest-keypair-1427936615", "user_data": "}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:39:20.581605 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6784d0c4-0bee-4524-ad07-db131cd07b1e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:20.582865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6784d0c4-0bee-4524-ad07-db131cd07b1e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:20.588951 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6784d0c4-0bee-4524-ad07-db131cd07b1e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:20.589428 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6784d0c4-0bee-4524-ad07-db131cd07b1e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:20.590342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6784d0c4-0bee-4524-ad07-db131cd07b1e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:20.590612 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6784d0c4-0bee-4524-ad07-db131cd07b1e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:20.659933 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.network.neutron [None req-b43d24a7-5f6b-45fe-9c4c-85be7b8f50ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] validate_networks() for [('33e63fd4-dc98-4fa3-abec-4f896450c787', None, None, None, None, None)] {{(pid=117876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:39:20.727457 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6784d0c4-0bee-4524-ad07-db131cd07b1e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:20.735853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6784d0c4-0bee-4524-ad07-db131cd07b1e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:20.737375 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6784d0c4-0bee-4524-ad07-db131cd07b1e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:20.739169 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6784d0c4-0bee-4524-ad07-db131cd07b1e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.161534 Jul 27 20:39:20.739891 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1655/3324] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:20 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:39:21.095601 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8645109e-852a-4d9d-9035-57f6985ba616 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:21.096209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8645109e-852a-4d9d-9035-57f6985ba616 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:21.103183 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8645109e-852a-4d9d-9035-57f6985ba616 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:21.103631 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8645109e-852a-4d9d-9035-57f6985ba616 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:21.104398 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8645109e-852a-4d9d-9035-57f6985ba616 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:21.104835 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8645109e-852a-4d9d-9035-57f6985ba616 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:21.144456 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-b43d24a7-5f6b-45fe-9c4c-85be7b8f50ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Flavor limits 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:39:21.145679 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-b43d24a7-5f6b-45fe-9c4c-85be7b8f50ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Image limits 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:39:21.146309 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-b43d24a7-5f6b-45fe-9c4c-85be7b8f50ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Flavor pref 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:39:21.146729 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-b43d24a7-5f6b-45fe-9c4c-85be7b8f50ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Image pref 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:39:21.147148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-b43d24a7-5f6b-45fe-9c4c-85be7b8f50ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:39:21.156101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b43d24a7-5f6b-45fe-9c4c-85be7b8f50ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:21.156551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b43d24a7-5f6b-45fe-9c4c-85be7b8f50ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:21.157378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b43d24a7-5f6b-45fe-9c4c-85be7b8f50ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:21.157827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b43d24a7-5f6b-45fe-9c4c-85be7b8f50ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:21.175034 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-b43d24a7-5f6b-45fe-9c4c-85be7b8f50ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Getting quotas for project 8d9a9e3a2b0e4918950cfd454aab9fbb. Resources: {'cores', 'instances', 'ram'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:39:21.179642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-b43d24a7-5f6b-45fe-9c4c-85be7b8f50ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Getting quotas for user ea3c5c3007e04391b5b108473da62787 and project 8d9a9e3a2b0e4918950cfd454aab9fbb. Resources: {'cores', 'instances', 'ram'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:39:21.191061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b43d24a7-5f6b-45fe-9c4c-85be7b8f50ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Going to run 1 instances... {{(pid=117876) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:39:21.194368 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b43d24a7-5f6b-45fe-9c4c-85be7b8f50ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb689bea-534a-4aac-bec3-8f55591dba58',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:39:21.236788 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8645109e-852a-4d9d-9035-57f6985ba616 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:21.244517 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b43d24a7-5f6b-45fe-9c4c-85be7b8f50ae tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.697915 Jul 27 20:39:21.250852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8645109e-852a-4d9d-9035-57f6985ba616 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153569 Jul 27 20:39:21.251027 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1670/3325] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Jul 27 20:39:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:39:21.251146 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1656/3326] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:21 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:21.263146 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-453cf803-c7d0-4551-87ac-093349fbc3b8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:21.263762 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-453cf803-c7d0-4551-87ac-093349fbc3b8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:21.319003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-453cf803-c7d0-4551-87ac-093349fbc3b8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:21.326809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-453cf803-c7d0-4551-87ac-093349fbc3b8 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734" status: 200 len: 1236 microversion: 2.1 time: 0.068665 Jul 27 20:39:21.327597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1671/3327] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:21 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734 => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:21.763723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0e3331b0-5a63-4e76-a01c-cd87e686d711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:21.764444 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0e3331b0-5a63-4e76-a01c-cd87e686d711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:21.770579 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e3331b0-5a63-4e76-a01c-cd87e686d711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:21.771128 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e3331b0-5a63-4e76-a01c-cd87e686d711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:21.771999 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e3331b0-5a63-4e76-a01c-cd87e686d711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:21.772502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e3331b0-5a63-4e76-a01c-cd87e686d711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:21.906394 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0e3331b0-5a63-4e76-a01c-cd87e686d711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:21.916108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0e3331b0-5a63-4e76-a01c-cd87e686d711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:21.917636 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0e3331b0-5a63-4e76-a01c-cd87e686d711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:21.918803 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0e3331b0-5a63-4e76-a01c-cd87e686d711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.159211 Jul 27 20:39:21.919360 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1657/3328] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:21 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:22.267674 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c3540116-d4ec-49e0-b623-caf95d222319 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:22.268456 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c3540116-d4ec-49e0-b623-caf95d222319 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:22.278409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c3540116-d4ec-49e0-b623-caf95d222319 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:22.278906 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c3540116-d4ec-49e0-b623-caf95d222319 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:22.279794 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c3540116-d4ec-49e0-b623-caf95d222319 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:22.280279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c3540116-d4ec-49e0-b623-caf95d222319 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:22.349575 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d438cae8-5b8a-4620-8d48-6b99c0c1e7e4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:22.350213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d438cae8-5b8a-4620-8d48-6b99c0c1e7e4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:22.362366 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d438cae8-5b8a-4620-8d48-6b99c0c1e7e4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:22.362850 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d438cae8-5b8a-4620-8d48-6b99c0c1e7e4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:22.364184 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d438cae8-5b8a-4620-8d48-6b99c0c1e7e4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:22.364639 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d438cae8-5b8a-4620-8d48-6b99c0c1e7e4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:22.468654 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c3540116-d4ec-49e0-b623-caf95d222319 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:22.473313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d438cae8-5b8a-4620-8d48-6b99c0c1e7e4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:22.480314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c3540116-d4ec-49e0-b623-caf95d222319 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.215863 Jul 27 20:39:22.480441 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1672/3329] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:22 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:22.483049 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d438cae8-5b8a-4620-8d48-6b99c0c1e7e4 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734" status: 200 len: 1306 microversion: 2.1 time: 0.138590 Jul 27 20:39:22.484039 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1658/3330] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:22 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734 => generated 1306 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:22.943449 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5cf4a828-3f98-4aca-87fe-f373f143d793 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:22.943985 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5cf4a828-3f98-4aca-87fe-f373f143d793 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:22.950120 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5cf4a828-3f98-4aca-87fe-f373f143d793 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:22.950732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5cf4a828-3f98-4aca-87fe-f373f143d793 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:22.951503 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5cf4a828-3f98-4aca-87fe-f373f143d793 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:22.951946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5cf4a828-3f98-4aca-87fe-f373f143d793 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:23.091468 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5cf4a828-3f98-4aca-87fe-f373f143d793 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:23.101173 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5cf4a828-3f98-4aca-87fe-f373f143d793 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:23.102776 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5cf4a828-3f98-4aca-87fe-f373f143d793 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:23.104032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5cf4a828-3f98-4aca-87fe-f373f143d793 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.165349 Jul 27 20:39:23.104831 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1673/3331] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:22 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:23.501620 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-57a8448e-3ca6-410f-a113-b5f50186df44 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:23.502395 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-57a8448e-3ca6-410f-a113-b5f50186df44 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:23.504005 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-baca4700-8da2-4677-88fa-472a1c8b1481 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:23.505151 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-baca4700-8da2-4677-88fa-472a1c8b1481 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:23.508994 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57a8448e-3ca6-410f-a113-b5f50186df44 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:23.509452 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57a8448e-3ca6-410f-a113-b5f50186df44 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:23.510290 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57a8448e-3ca6-410f-a113-b5f50186df44 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:23.510666 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57a8448e-3ca6-410f-a113-b5f50186df44 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:23.512547 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-baca4700-8da2-4677-88fa-472a1c8b1481 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:23.513160 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-baca4700-8da2-4677-88fa-472a1c8b1481 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:23.513937 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-baca4700-8da2-4677-88fa-472a1c8b1481 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:23.514383 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-baca4700-8da2-4677-88fa-472a1c8b1481 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:23.648338 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-baca4700-8da2-4677-88fa-472a1c8b1481 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:23.655409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-baca4700-8da2-4677-88fa-472a1c8b1481 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734" status: 200 len: 1362 microversion: 2.1 time: 0.155459 Jul 27 20:39:23.656300 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1674/3332] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:23 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:23.748938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-57a8448e-3ca6-410f-a113-b5f50186df44 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:23.752339 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:39:23.759610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-57a8448e-3ca6-410f-a113-b5f50186df44 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.261806 Jul 27 20:39:23.760189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1659/3333] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:23 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:24.129083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-91c1ac02-ac72-4c8e-87d7-9a10c66f987e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:24.129949 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-91c1ac02-ac72-4c8e-87d7-9a10c66f987e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:24.136833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-91c1ac02-ac72-4c8e-87d7-9a10c66f987e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:24.137732 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-91c1ac02-ac72-4c8e-87d7-9a10c66f987e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:24.138787 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-91c1ac02-ac72-4c8e-87d7-9a10c66f987e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:24.139563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-91c1ac02-ac72-4c8e-87d7-9a10c66f987e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:24.226600 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-f9a8c78b-1e1e-491b-91c2-d891dfa8a5a0 req-a76c9712-ee19-410e-984d-0172f0451f68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b9db8a2-db32-4e01-9dbe-6e767e8b9734", "tag": "939f80b9-ff52-4cba-9679-35b5650c5b6d"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:39:24.236874 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-f9a8c78b-1e1e-491b-91c2-d891dfa8a5a0 req-a76c9712-ee19-410e-984d-0172f0451f68 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:24.237355 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-f9a8c78b-1e1e-491b-91c2-d891dfa8a5a0 req-a76c9712-ee19-410e-984d-0172f0451f68 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:24.249682 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-f9a8c78b-1e1e-491b-91c2-d891dfa8a5a0 req-a76c9712-ee19-410e-984d-0172f0451f68 service nova] Creating event network-changed:939f80b9-ff52-4cba-9679-35b5650c5b6d for instance 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 on hv-cinder-79987 Jul 27 20:39:24.255381 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-f9a8c78b-1e1e-491b-91c2-d891dfa8a5a0 req-a76c9712-ee19-410e-984d-0172f0451f68 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179342 Jul 27 20:39:24.256302 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1675/3334] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:39:24.363462 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-91c1ac02-ac72-4c8e-87d7-9a10c66f987e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:24.372107 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-91c1ac02-ac72-4c8e-87d7-9a10c66f987e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:24.373461 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-91c1ac02-ac72-4c8e-87d7-9a10c66f987e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:24.374820 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-91c1ac02-ac72-4c8e-87d7-9a10c66f987e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.250258 Jul 27 20:39:24.376500 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1660/3335] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:24 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:24.678744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d8ec8d30-7da6-4ef7-8b4e-ca4da9f7365d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:24.679455 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d8ec8d30-7da6-4ef7-8b4e-ca4da9f7365d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:24.686177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d8ec8d30-7da6-4ef7-8b4e-ca4da9f7365d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:24.686644 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d8ec8d30-7da6-4ef7-8b4e-ca4da9f7365d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:24.687414 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d8ec8d30-7da6-4ef7-8b4e-ca4da9f7365d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:24.687960 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d8ec8d30-7da6-4ef7-8b4e-ca4da9f7365d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:24.783441 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-547de6c1-8715-4d76-bba1-b2444620c30b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:24.784062 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-547de6c1-8715-4d76-bba1-b2444620c30b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:24.791354 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-547de6c1-8715-4d76-bba1-b2444620c30b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:24.791804 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-547de6c1-8715-4d76-bba1-b2444620c30b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:24.792571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-547de6c1-8715-4d76-bba1-b2444620c30b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:24.793027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-547de6c1-8715-4d76-bba1-b2444620c30b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:24.819969 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d8ec8d30-7da6-4ef7-8b4e-ca4da9f7365d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:24.823492 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:39:24.828617 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d8ec8d30-7da6-4ef7-8b4e-ca4da9f7365d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734" status: 200 len: 1362 microversion: 2.1 time: 0.154706 Jul 27 20:39:24.829224 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1676/3336] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:24 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:24.927941 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-547de6c1-8715-4d76-bba1-b2444620c30b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:24.935820 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-547de6c1-8715-4d76-bba1-b2444620c30b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.156407 Jul 27 20:39:24.936381 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1661/3337] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:24 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:25.398892 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-484d44f6-f8df-4ff7-a3a8-296fbf179ea6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:25.399498 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-484d44f6-f8df-4ff7-a3a8-296fbf179ea6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:25.405687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-484d44f6-f8df-4ff7-a3a8-296fbf179ea6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:25.406135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-484d44f6-f8df-4ff7-a3a8-296fbf179ea6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:25.406887 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-484d44f6-f8df-4ff7-a3a8-296fbf179ea6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:25.407321 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-484d44f6-f8df-4ff7-a3a8-296fbf179ea6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:25.532990 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-484d44f6-f8df-4ff7-a3a8-296fbf179ea6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:25.541867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-484d44f6-f8df-4ff7-a3a8-296fbf179ea6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:25.543357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-484d44f6-f8df-4ff7-a3a8-296fbf179ea6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:25.544508 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-484d44f6-f8df-4ff7-a3a8-296fbf179ea6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.149532 Jul 27 20:39:25.545087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1677/3338] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:25 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:25.849393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bbe2aa35-cde0-4413-8c65-d2b5fadfaa64 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:25.850003 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bbe2aa35-cde0-4413-8c65-d2b5fadfaa64 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:25.856482 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bbe2aa35-cde0-4413-8c65-d2b5fadfaa64 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:25.856933 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bbe2aa35-cde0-4413-8c65-d2b5fadfaa64 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:25.857723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bbe2aa35-cde0-4413-8c65-d2b5fadfaa64 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:25.858156 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bbe2aa35-cde0-4413-8c65-d2b5fadfaa64 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:25.957405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8c2e051a-addd-40d1-83c9-941a2df8dcd6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:25.958019 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8c2e051a-addd-40d1-83c9-941a2df8dcd6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:25.964478 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8c2e051a-addd-40d1-83c9-941a2df8dcd6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:25.964925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8c2e051a-addd-40d1-83c9-941a2df8dcd6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:25.965723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8c2e051a-addd-40d1-83c9-941a2df8dcd6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:25.966160 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8c2e051a-addd-40d1-83c9-941a2df8dcd6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:25.986539 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bbe2aa35-cde0-4413-8c65-d2b5fadfaa64 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:25.994199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bbe2aa35-cde0-4413-8c65-d2b5fadfaa64 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734" status: 200 len: 1362 microversion: 2.1 time: 0.149159 Jul 27 20:39:25.994702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1662/3339] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:25 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:26.101485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8c2e051a-addd-40d1-83c9-941a2df8dcd6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:26.110243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8c2e051a-addd-40d1-83c9-941a2df8dcd6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.157318 Jul 27 20:39:26.110834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1678/3340] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:25 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:26.568983 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dadca38c-f08c-4d7e-97e5-19e52038d57c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:26.569606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dadca38c-f08c-4d7e-97e5-19e52038d57c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:26.575689 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dadca38c-f08c-4d7e-97e5-19e52038d57c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:26.576134 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dadca38c-f08c-4d7e-97e5-19e52038d57c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:26.576885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dadca38c-f08c-4d7e-97e5-19e52038d57c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:26.577345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dadca38c-f08c-4d7e-97e5-19e52038d57c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:26.708603 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dadca38c-f08c-4d7e-97e5-19e52038d57c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:26.716936 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dadca38c-f08c-4d7e-97e5-19e52038d57c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:26.718465 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dadca38c-f08c-4d7e-97e5-19e52038d57c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:26.719620 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dadca38c-f08c-4d7e-97e5-19e52038d57c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155183 Jul 27 20:39:26.720186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1663/3341] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:26 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:27.015321 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-21935a55-79bf-4fa7-8567-eebeb6f15e00 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:27.015912 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-21935a55-79bf-4fa7-8567-eebeb6f15e00 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:27.023668 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-21935a55-79bf-4fa7-8567-eebeb6f15e00 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:27.024114 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-21935a55-79bf-4fa7-8567-eebeb6f15e00 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:27.024880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-21935a55-79bf-4fa7-8567-eebeb6f15e00 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:27.025342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-21935a55-79bf-4fa7-8567-eebeb6f15e00 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:27.130781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-df3e3955-5894-4d14-af5b-614cc8c04ee4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:27.131344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-df3e3955-5894-4d14-af5b-614cc8c04ee4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:27.138852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-df3e3955-5894-4d14-af5b-614cc8c04ee4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:27.139694 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-df3e3955-5894-4d14-af5b-614cc8c04ee4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:27.140791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-df3e3955-5894-4d14-af5b-614cc8c04ee4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:27.141547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-df3e3955-5894-4d14-af5b-614cc8c04ee4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:27.163775 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-21935a55-79bf-4fa7-8567-eebeb6f15e00 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:27.171852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-21935a55-79bf-4fa7-8567-eebeb6f15e00 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734" status: 200 len: 1362 microversion: 2.1 time: 0.160495 Jul 27 20:39:27.172585 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1679/3342] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:27 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:27.297614 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-df3e3955-5894-4d14-af5b-614cc8c04ee4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:27.306972 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-df3e3955-5894-4d14-af5b-614cc8c04ee4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.180428 Jul 27 20:39:27.307535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1664/3343] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:27 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:27.743637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-29dd5aa7-e940-4c37-b34e-a6c4ce54b5c4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:27.744406 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-29dd5aa7-e940-4c37-b34e-a6c4ce54b5c4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:27.750520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-29dd5aa7-e940-4c37-b34e-a6c4ce54b5c4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:27.751000 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-29dd5aa7-e940-4c37-b34e-a6c4ce54b5c4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:27.751759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-29dd5aa7-e940-4c37-b34e-a6c4ce54b5c4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:27.752191 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-29dd5aa7-e940-4c37-b34e-a6c4ce54b5c4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:27.884940 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-29dd5aa7-e940-4c37-b34e-a6c4ce54b5c4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:27.893299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-29dd5aa7-e940-4c37-b34e-a6c4ce54b5c4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:27.894791 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-29dd5aa7-e940-4c37-b34e-a6c4ce54b5c4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:27.895943 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-29dd5aa7-e940-4c37-b34e-a6c4ce54b5c4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157129 Jul 27 20:39:27.896663 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1680/3344] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:27 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:28.192620 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8dccc1c8-4cea-405b-8e39-e4d0747dc4aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:28.193344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8dccc1c8-4cea-405b-8e39-e4d0747dc4aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:28.199715 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8dccc1c8-4cea-405b-8e39-e4d0747dc4aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:28.200157 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8dccc1c8-4cea-405b-8e39-e4d0747dc4aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:28.200906 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8dccc1c8-4cea-405b-8e39-e4d0747dc4aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:28.201363 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8dccc1c8-4cea-405b-8e39-e4d0747dc4aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:28.328406 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8dccc1c8-4cea-405b-8e39-e4d0747dc4aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:28.328623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-08de8e7e-dc8b-4f19-a42b-d2cc59a4b3f0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:28.329266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-08de8e7e-dc8b-4f19-a42b-d2cc59a4b3f0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:28.336489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-08de8e7e-dc8b-4f19-a42b-d2cc59a4b3f0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:28.336748 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8dccc1c8-4cea-405b-8e39-e4d0747dc4aa tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734" status: 200 len: 1362 microversion: 2.1 time: 0.147995 Jul 27 20:39:28.336989 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-08de8e7e-dc8b-4f19-a42b-d2cc59a4b3f0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:28.337482 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1665/3345] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:28 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:28.337768 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-08de8e7e-dc8b-4f19-a42b-d2cc59a4b3f0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:28.338213 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-08de8e7e-dc8b-4f19-a42b-d2cc59a4b3f0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:28.471450 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-08de8e7e-dc8b-4f19-a42b-d2cc59a4b3f0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:28.479559 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-08de8e7e-dc8b-4f19-a42b-d2cc59a4b3f0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.155073 Jul 27 20:39:28.480140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1681/3346] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:28 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:28.919277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-97f0d436-4e56-4f45-aa7d-1cd54bf3918c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:28.919945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-97f0d436-4e56-4f45-aa7d-1cd54bf3918c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:28.926111 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97f0d436-4e56-4f45-aa7d-1cd54bf3918c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:28.926562 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97f0d436-4e56-4f45-aa7d-1cd54bf3918c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:28.927319 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97f0d436-4e56-4f45-aa7d-1cd54bf3918c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:28.928535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97f0d436-4e56-4f45-aa7d-1cd54bf3918c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:29.061191 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-97f0d436-4e56-4f45-aa7d-1cd54bf3918c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:29.070347 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-97f0d436-4e56-4f45-aa7d-1cd54bf3918c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:29.071844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-97f0d436-4e56-4f45-aa7d-1cd54bf3918c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:29.073066 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-97f0d436-4e56-4f45-aa7d-1cd54bf3918c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157671 Jul 27 20:39:29.073844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1666/3347] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:28 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:29.358029 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8ac7347f-637c-4843-b2a6-2d89f881133e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:29.358597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8ac7347f-637c-4843-b2a6-2d89f881133e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:29.366797 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8ac7347f-637c-4843-b2a6-2d89f881133e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:29.367410 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8ac7347f-637c-4843-b2a6-2d89f881133e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:29.368786 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8ac7347f-637c-4843-b2a6-2d89f881133e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:29.369637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8ac7347f-637c-4843-b2a6-2d89f881133e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:29.499475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8ac7347f-637c-4843-b2a6-2d89f881133e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:29.501950 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-eb13bd5b-ed52-4f74-b845-cbb73b16c7ca tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:29.503083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-eb13bd5b-ed52-4f74-b845-cbb73b16c7ca tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:29.505248 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=4 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:39:29.507657 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8ac7347f-637c-4843-b2a6-2d89f881133e tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734" status: 200 len: 1362 microversion: 2.1 time: 0.153553 Jul 27 20:39:29.508234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1682/3348] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:29 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:29.511534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eb13bd5b-ed52-4f74-b845-cbb73b16c7ca tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:29.511984 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eb13bd5b-ed52-4f74-b845-cbb73b16c7ca tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:29.512756 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eb13bd5b-ed52-4f74-b845-cbb73b16c7ca tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:29.513483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eb13bd5b-ed52-4f74-b845-cbb73b16c7ca tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:29.645256 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eb13bd5b-ed52-4f74-b845-cbb73b16c7ca tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:29.653338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-eb13bd5b-ed52-4f74-b845-cbb73b16c7ca tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.155242 Jul 27 20:39:29.653911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1667/3349] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:29 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:30.097127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-28758f39-76d9-41ae-8015-bcebdc3b2f6d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:30.097841 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-28758f39-76d9-41ae-8015-bcebdc3b2f6d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:30.104009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28758f39-76d9-41ae-8015-bcebdc3b2f6d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:30.104476 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28758f39-76d9-41ae-8015-bcebdc3b2f6d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:30.105175 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28758f39-76d9-41ae-8015-bcebdc3b2f6d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:30.105735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28758f39-76d9-41ae-8015-bcebdc3b2f6d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:30.141324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-f41a1936-075c-4f44-b445-2abec4b74ad0 req-22616465-1938-498d-b10c-9480b845b6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b9db8a2-db32-4e01-9dbe-6e767e8b9734", "name": "network-vif-plugged", "status": "completed", "tag": "939f80b9-ff52-4cba-9679-35b5650c5b6d"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:39:30.158236 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-f41a1936-075c-4f44-b445-2abec4b74ad0 req-22616465-1938-498d-b10c-9480b845b6c4 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:30.158928 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-f41a1936-075c-4f44-b445-2abec4b74ad0 req-22616465-1938-498d-b10c-9480b845b6c4 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:30.170045 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-f41a1936-075c-4f44-b445-2abec4b74ad0 req-22616465-1938-498d-b10c-9480b845b6c4 service nova] Creating event network-vif-plugged:939f80b9-ff52-4cba-9679-35b5650c5b6d for instance 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 on hv-cinder-79987 Jul 27 20:39:30.175095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-f41a1936-075c-4f44-b445-2abec4b74ad0 req-22616465-1938-498d-b10c-9480b845b6c4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100531 Jul 27 20:39:30.175688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1683/3350] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:39:30.242126 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-28758f39-76d9-41ae-8015-bcebdc3b2f6d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:30.250730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-28758f39-76d9-41ae-8015-bcebdc3b2f6d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:30.252364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-28758f39-76d9-41ae-8015-bcebdc3b2f6d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:30.253634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-28758f39-76d9-41ae-8015-bcebdc3b2f6d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.161029 Jul 27 20:39:30.254296 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1668/3351] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:30 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:30.530048 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1016e0c7-e451-4378-b185-e44c72e45730 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:30.530444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1016e0c7-e451-4378-b185-e44c72e45730 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:30.536463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1016e0c7-e451-4378-b185-e44c72e45730 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:30.537614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1016e0c7-e451-4378-b185-e44c72e45730 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:30.538400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1016e0c7-e451-4378-b185-e44c72e45730 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:30.538847 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1016e0c7-e451-4378-b185-e44c72e45730 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:30.672026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1016e0c7-e451-4378-b185-e44c72e45730 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:30.674639 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-079fab66-5228-40e7-9578-ea11d789ea09 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:30.675243 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-079fab66-5228-40e7-9578-ea11d789ea09 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:30.679618 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1016e0c7-e451-4378-b185-e44c72e45730 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734" status: 200 len: 1362 microversion: 2.1 time: 0.154666 Jul 27 20:39:30.680195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1684/3352] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:30 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:30.681737 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-079fab66-5228-40e7-9578-ea11d789ea09 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:30.682182 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-079fab66-5228-40e7-9578-ea11d789ea09 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:30.682938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-079fab66-5228-40e7-9578-ea11d789ea09 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:30.683373 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-079fab66-5228-40e7-9578-ea11d789ea09 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:30.811918 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-079fab66-5228-40e7-9578-ea11d789ea09 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:30.820351 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-079fab66-5228-40e7-9578-ea11d789ea09 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149491 Jul 27 20:39:30.820908 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1669/3353] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:30 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:31.277783 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f8373a69-420d-4a61-a403-13017a1ab5a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:31.278435 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f8373a69-420d-4a61-a403-13017a1ab5a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:31.280378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=2 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:39:31.286079 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f8373a69-420d-4a61-a403-13017a1ab5a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:31.286535 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f8373a69-420d-4a61-a403-13017a1ab5a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:31.287302 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f8373a69-420d-4a61-a403-13017a1ab5a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:31.287744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f8373a69-420d-4a61-a403-13017a1ab5a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:31.323864 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=8 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:39:31.424360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f8373a69-420d-4a61-a403-13017a1ab5a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:31.433681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f8373a69-420d-4a61-a403-13017a1ab5a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:31.435315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f8373a69-420d-4a61-a403-13017a1ab5a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:31.436471 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f8373a69-420d-4a61-a403-13017a1ab5a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.162714 Jul 27 20:39:31.437046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1685/3354] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:31 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:31.705078 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2d84adf0-588c-4bcc-83d1-f2772c4395ef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:31.705696 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2d84adf0-588c-4bcc-83d1-f2772c4395ef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:31.712260 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d84adf0-588c-4bcc-83d1-f2772c4395ef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:31.712706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d84adf0-588c-4bcc-83d1-f2772c4395ef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:31.713495 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d84adf0-588c-4bcc-83d1-f2772c4395ef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:31.713927 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d84adf0-588c-4bcc-83d1-f2772c4395ef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:31.841304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c03b3cec-2aec-4e54-a7ce-8116c46ae4fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:31.841928 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c03b3cec-2aec-4e54-a7ce-8116c46ae4fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:31.847848 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2d84adf0-588c-4bcc-83d1-f2772c4395ef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:31.848309 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c03b3cec-2aec-4e54-a7ce-8116c46ae4fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:31.848762 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c03b3cec-2aec-4e54-a7ce-8116c46ae4fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:31.850266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c03b3cec-2aec-4e54-a7ce-8116c46ae4fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:31.850697 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c03b3cec-2aec-4e54-a7ce-8116c46ae4fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:31.855820 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2d84adf0-588c-4bcc-83d1-f2772c4395ef tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734" status: 200 len: 1362 microversion: 2.1 time: 0.155057 Jul 27 20:39:31.856384 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1670/3355] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:31 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:31.982101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c03b3cec-2aec-4e54-a7ce-8116c46ae4fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:31.990162 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c03b3cec-2aec-4e54-a7ce-8116c46ae4fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152768 Jul 27 20:39:31.990726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1686/3356] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:31 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:32.460568 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-669e53ac-b007-4185-8218-e4efe5337513 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:32.461193 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-669e53ac-b007-4185-8218-e4efe5337513 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:32.467607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-669e53ac-b007-4185-8218-e4efe5337513 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:32.468067 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-669e53ac-b007-4185-8218-e4efe5337513 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:32.468844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-669e53ac-b007-4185-8218-e4efe5337513 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:32.469319 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-669e53ac-b007-4185-8218-e4efe5337513 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:32.601081 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-669e53ac-b007-4185-8218-e4efe5337513 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:32.609390 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-669e53ac-b007-4185-8218-e4efe5337513 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:32.610895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-669e53ac-b007-4185-8218-e4efe5337513 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:32.612053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-669e53ac-b007-4185-8218-e4efe5337513 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156133 Jul 27 20:39:32.612616 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1671/3357] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:32 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:32.876820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5baa000f-8c5a-4d17-af22-c4b31b8e5f28 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:32.877386 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5baa000f-8c5a-4d17-af22-c4b31b8e5f28 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:32.884249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5baa000f-8c5a-4d17-af22-c4b31b8e5f28 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:32.884700 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5baa000f-8c5a-4d17-af22-c4b31b8e5f28 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:32.885493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5baa000f-8c5a-4d17-af22-c4b31b8e5f28 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:32.885928 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5baa000f-8c5a-4d17-af22-c4b31b8e5f28 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:33.011416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cb7dcf45-6f9e-49e3-bc26-a666cec0ac6d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:33.012141 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cb7dcf45-6f9e-49e3-bc26-a666cec0ac6d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:33.018869 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cb7dcf45-6f9e-49e3-bc26-a666cec0ac6d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:33.019319 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cb7dcf45-6f9e-49e3-bc26-a666cec0ac6d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:33.019541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5baa000f-8c5a-4d17-af22-c4b31b8e5f28 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:33.020077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cb7dcf45-6f9e-49e3-bc26-a666cec0ac6d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:33.020514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cb7dcf45-6f9e-49e3-bc26-a666cec0ac6d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:33.027149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5baa000f-8c5a-4d17-af22-c4b31b8e5f28 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734" status: 200 len: 1548 microversion: 2.1 time: 0.154119 Jul 27 20:39:33.027733 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1687/3358] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:32 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:33.047895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ee8ba33a-36df-4d96-8700-2a98ae5a61c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:33.048393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ee8ba33a-36df-4d96-8700-2a98ae5a61c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:33.055153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ee8ba33a-36df-4d96-8700-2a98ae5a61c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:33.055588 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ee8ba33a-36df-4d96-8700-2a98ae5a61c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:33.056355 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ee8ba33a-36df-4d96-8700-2a98ae5a61c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:33.056791 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ee8ba33a-36df-4d96-8700-2a98ae5a61c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:33.134659 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ee8ba33a-36df-4d96-8700-2a98ae5a61c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090441 Jul 27 20:39:33.135255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1688/3359] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Jul 27 20:39:33 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:39:33.158351 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cb7dcf45-6f9e-49e3-bc26-a666cec0ac6d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:33.166901 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cb7dcf45-6f9e-49e3-bc26-a666cec0ac6d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.159759 Jul 27 20:39:33.167476 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1672/3360] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:33 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:39:33.637584 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cf90edfd-4829-4034-bdba-93f6001d80f3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:33.638202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cf90edfd-4829-4034-bdba-93f6001d80f3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:33.640078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:39:33.645487 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf90edfd-4829-4034-bdba-93f6001d80f3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:33.645946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf90edfd-4829-4034-bdba-93f6001d80f3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:33.647446 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf90edfd-4829-4034-bdba-93f6001d80f3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:33.647894 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf90edfd-4829-4034-bdba-93f6001d80f3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:33.870464 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cf90edfd-4829-4034-bdba-93f6001d80f3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:33.878968 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cf90edfd-4829-4034-bdba-93f6001d80f3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:33.881016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cf90edfd-4829-4034-bdba-93f6001d80f3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:33.882236 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cf90edfd-4829-4034-bdba-93f6001d80f3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.248629 Jul 27 20:39:33.882809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1689/3361] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:33 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:34.188430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-dfc0a1c8-ef92-4c3b-8453-a40e7c39697d req-c60fc017-a3fc-4fab-855e-265a9cba1aad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b9db8a2-db32-4e01-9dbe-6e767e8b9734", "tag": "939f80b9-ff52-4cba-9679-35b5650c5b6d"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:39:34.189667 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b4122273-5c06-4f70-8778-6981b8b479a6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:34.190476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b4122273-5c06-4f70-8778-6981b8b479a6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:34.197393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4122273-5c06-4f70-8778-6981b8b479a6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:34.197847 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4122273-5c06-4f70-8778-6981b8b479a6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:34.198625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4122273-5c06-4f70-8778-6981b8b479a6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:34.199064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b4122273-5c06-4f70-8778-6981b8b479a6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:34.199686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-dfc0a1c8-ef92-4c3b-8453-a40e7c39697d req-c60fc017-a3fc-4fab-855e-265a9cba1aad service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:34.200249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-dfc0a1c8-ef92-4c3b-8453-a40e7c39697d req-c60fc017-a3fc-4fab-855e-265a9cba1aad service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:34.214668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-dfc0a1c8-ef92-4c3b-8453-a40e7c39697d req-c60fc017-a3fc-4fab-855e-265a9cba1aad service nova] Creating event network-changed:939f80b9-ff52-4cba-9679-35b5650c5b6d for instance 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 on hv-cinder-79987 Jul 27 20:39:34.219157 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR oslo.messaging._drivers.impl_rabbit [req-dfc0a1c8-ef92-4c3b-8453-a40e7c39697d req-c60fc017-a3fc-4fab-855e-265a9cba1aad service nova] [bb09c108-9350-46bd-b31d-9a819fec7994] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 27 20:39:34.331361 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b4122273-5c06-4f70-8778-6981b8b479a6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:34.339991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b4122273-5c06-4f70-8778-6981b8b479a6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.154045 Jul 27 20:39:34.340567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1690/3362] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:34 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:34.906472 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-543a65ad-1158-4299-ab71-3d5de19faebf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:34.907113 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-543a65ad-1158-4299-ab71-3d5de19faebf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:34.914233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-543a65ad-1158-4299-ab71-3d5de19faebf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:34.914689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-543a65ad-1158-4299-ab71-3d5de19faebf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:34.915466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-543a65ad-1158-4299-ab71-3d5de19faebf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:34.915906 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-543a65ad-1158-4299-ab71-3d5de19faebf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:35.047277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-543a65ad-1158-4299-ab71-3d5de19faebf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:35.056077 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-543a65ad-1158-4299-ab71-3d5de19faebf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:35.057645 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-543a65ad-1158-4299-ab71-3d5de19faebf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:35.058817 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-543a65ad-1158-4299-ab71-3d5de19faebf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156375 Jul 27 20:39:35.059377 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1691/3363] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:34 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:39:35.226412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [req-dfc0a1c8-ef92-4c3b-8453-a40e7c39697d req-c60fc017-a3fc-4fab-855e-265a9cba1aad service nova] [bb09c108-9350-46bd-b31d-9a819fec7994] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 39866. Jul 27 20:39:35.230089 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-dfc0a1c8-ef92-4c3b-8453-a40e7c39697d req-c60fc017-a3fc-4fab-855e-265a9cba1aad service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.102848 Jul 27 20:39:35.230688 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1673/3364] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:39:35.361769 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f202bb80-b383-4a26-b6c1-496911b26f57 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:35.362492 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f202bb80-b383-4a26-b6c1-496911b26f57 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:35.369275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f202bb80-b383-4a26-b6c1-496911b26f57 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:35.369737 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f202bb80-b383-4a26-b6c1-496911b26f57 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:35.370519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f202bb80-b383-4a26-b6c1-496911b26f57 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:35.370963 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f202bb80-b383-4a26-b6c1-496911b26f57 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:35.503591 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f202bb80-b383-4a26-b6c1-496911b26f57 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:35.512445 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f202bb80-b383-4a26-b6c1-496911b26f57 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.154513 Jul 27 20:39:35.513073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1692/3365] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:35 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:36.083468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-55d39bd4-c8c1-4615-ab10-53d1f41d278e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:36.084987 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-55d39bd4-c8c1-4615-ab10-53d1f41d278e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:36.086905 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:39:36.093603 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55d39bd4-c8c1-4615-ab10-53d1f41d278e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:36.094062 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55d39bd4-c8c1-4615-ab10-53d1f41d278e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:36.094843 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55d39bd4-c8c1-4615-ab10-53d1f41d278e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:36.095290 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55d39bd4-c8c1-4615-ab10-53d1f41d278e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:36.231519 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-55d39bd4-c8c1-4615-ab10-53d1f41d278e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:36.239858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-55d39bd4-c8c1-4615-ab10-53d1f41d278e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:36.241428 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-55d39bd4-c8c1-4615-ab10-53d1f41d278e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:36.242581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-55d39bd4-c8c1-4615-ab10-53d1f41d278e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.163451 Jul 27 20:39:36.243130 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1674/3366] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:36 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:36.534199 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2865b923-6f85-4f65-b5dc-75639f7235a7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:36.534849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2865b923-6f85-4f65-b5dc-75639f7235a7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:36.541549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2865b923-6f85-4f65-b5dc-75639f7235a7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:36.542009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2865b923-6f85-4f65-b5dc-75639f7235a7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:36.542776 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2865b923-6f85-4f65-b5dc-75639f7235a7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:36.543222 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2865b923-6f85-4f65-b5dc-75639f7235a7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:36.668858 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2865b923-6f85-4f65-b5dc-75639f7235a7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:36.676795 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2865b923-6f85-4f65-b5dc-75639f7235a7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.146503 Jul 27 20:39:36.678076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1693/3367] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:36 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:37.266270 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-335e4457-101c-404f-bc93-ac58ae980088 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:37.266874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-335e4457-101c-404f-bc93-ac58ae980088 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:37.274051 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-335e4457-101c-404f-bc93-ac58ae980088 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:37.274503 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-335e4457-101c-404f-bc93-ac58ae980088 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:37.275271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-335e4457-101c-404f-bc93-ac58ae980088 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:37.275707 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-335e4457-101c-404f-bc93-ac58ae980088 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:37.407542 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-335e4457-101c-404f-bc93-ac58ae980088 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:37.416526 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-335e4457-101c-404f-bc93-ac58ae980088 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:37.418044 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-335e4457-101c-404f-bc93-ac58ae980088 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:37.419197 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-335e4457-101c-404f-bc93-ac58ae980088 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156872 Jul 27 20:39:37.419750 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1675/3368] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:37 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:37.699200 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e5eafbeb-d700-4c64-b5e5-cf3e55efade6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:37.699810 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e5eafbeb-d700-4c64-b5e5-cf3e55efade6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:37.706567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e5eafbeb-d700-4c64-b5e5-cf3e55efade6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:37.707011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e5eafbeb-d700-4c64-b5e5-cf3e55efade6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:37.707762 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e5eafbeb-d700-4c64-b5e5-cf3e55efade6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:37.708201 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e5eafbeb-d700-4c64-b5e5-cf3e55efade6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:37.726244 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:39:37.840212 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e5eafbeb-d700-4c64-b5e5-cf3e55efade6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:37.848400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e5eafbeb-d700-4c64-b5e5-cf3e55efade6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153079 Jul 27 20:39:37.848979 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1694/3369] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:37 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:38.443479 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-39481823-b70a-4d47-b46b-f9ac69bdd118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:38.444130 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-39481823-b70a-4d47-b46b-f9ac69bdd118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:38.450629 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39481823-b70a-4d47-b46b-f9ac69bdd118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:38.451077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39481823-b70a-4d47-b46b-f9ac69bdd118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:38.451836 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39481823-b70a-4d47-b46b-f9ac69bdd118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:38.452276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39481823-b70a-4d47-b46b-f9ac69bdd118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:38.579093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-39481823-b70a-4d47-b46b-f9ac69bdd118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:38.593232 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-39481823-b70a-4d47-b46b-f9ac69bdd118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:38.594742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-39481823-b70a-4d47-b46b-f9ac69bdd118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:38.595901 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-39481823-b70a-4d47-b46b-f9ac69bdd118 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156547 Jul 27 20:39:38.596466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1676/3370] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:38 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:38.869318 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-16c76ff2-a97c-4975-8d51-53482a308bc1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:38.869875 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-16c76ff2-a97c-4975-8d51-53482a308bc1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:38.876327 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-16c76ff2-a97c-4975-8d51-53482a308bc1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:38.876781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-16c76ff2-a97c-4975-8d51-53482a308bc1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:38.877573 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-16c76ff2-a97c-4975-8d51-53482a308bc1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:38.878020 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-16c76ff2-a97c-4975-8d51-53482a308bc1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:39.009985 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-16c76ff2-a97c-4975-8d51-53482a308bc1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:39.019029 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-16c76ff2-a97c-4975-8d51-53482a308bc1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153727 Jul 27 20:39:39.019605 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1695/3371] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:38 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:39.620571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dd2174dd-506a-4fe4-8058-ff33bffe357b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:39.621225 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dd2174dd-506a-4fe4-8058-ff33bffe357b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:39.627706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd2174dd-506a-4fe4-8058-ff33bffe357b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:39.628158 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd2174dd-506a-4fe4-8058-ff33bffe357b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:39.628940 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd2174dd-506a-4fe4-8058-ff33bffe357b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:39.629417 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd2174dd-506a-4fe4-8058-ff33bffe357b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:39.634020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:39:39.764724 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dd2174dd-506a-4fe4-8058-ff33bffe357b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:39.773524 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dd2174dd-506a-4fe4-8058-ff33bffe357b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:39.775095 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dd2174dd-506a-4fe4-8058-ff33bffe357b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:39.776313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dd2174dd-506a-4fe4-8058-ff33bffe357b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.159691 Jul 27 20:39:39.776879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1677/3372] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:39 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:40.041660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-13be76fc-b005-454d-9857-cd53b37e8eef tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:40.042295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-13be76fc-b005-454d-9857-cd53b37e8eef tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:40.048952 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-13be76fc-b005-454d-9857-cd53b37e8eef tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:40.049445 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-13be76fc-b005-454d-9857-cd53b37e8eef tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:40.050213 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-13be76fc-b005-454d-9857-cd53b37e8eef tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:40.050660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-13be76fc-b005-454d-9857-cd53b37e8eef tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:40.179146 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-13be76fc-b005-454d-9857-cd53b37e8eef tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:40.187071 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-13be76fc-b005-454d-9857-cd53b37e8eef tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149354 Jul 27 20:39:40.187643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1696/3373] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:40 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:40.801167 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1df47c5e-782d-4f74-b435-ba7251d8162e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:40.801785 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1df47c5e-782d-4f74-b435-ba7251d8162e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:40.808989 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1df47c5e-782d-4f74-b435-ba7251d8162e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:40.809459 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1df47c5e-782d-4f74-b435-ba7251d8162e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:40.810236 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1df47c5e-782d-4f74-b435-ba7251d8162e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:40.810675 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1df47c5e-782d-4f74-b435-ba7251d8162e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:41.008391 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1df47c5e-782d-4f74-b435-ba7251d8162e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:41.020285 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1df47c5e-782d-4f74-b435-ba7251d8162e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:41.022464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1df47c5e-782d-4f74-b435-ba7251d8162e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:41.023645 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1df47c5e-782d-4f74-b435-ba7251d8162e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.227035 Jul 27 20:39:41.024211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1678/3374] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:40 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:41.207803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c9e03559-99f9-461a-af47-f92f109b9c91 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:41.209124 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c9e03559-99f9-461a-af47-f92f109b9c91 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:41.215724 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c9e03559-99f9-461a-af47-f92f109b9c91 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:41.216180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c9e03559-99f9-461a-af47-f92f109b9c91 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:41.216936 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c9e03559-99f9-461a-af47-f92f109b9c91 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:41.217405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c9e03559-99f9-461a-af47-f92f109b9c91 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:41.350384 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c9e03559-99f9-461a-af47-f92f109b9c91 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:41.358326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c9e03559-99f9-461a-af47-f92f109b9c91 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.154388 Jul 27 20:39:41.358895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1697/3375] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:41 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:42.047555 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c2d40146-9f80-47c6-a43d-1501f38533fd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:42.048124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c2d40146-9f80-47c6-a43d-1501f38533fd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:42.055205 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2d40146-9f80-47c6-a43d-1501f38533fd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:42.055653 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2d40146-9f80-47c6-a43d-1501f38533fd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:42.056414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2d40146-9f80-47c6-a43d-1501f38533fd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:42.056851 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2d40146-9f80-47c6-a43d-1501f38533fd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:42.186383 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c2d40146-9f80-47c6-a43d-1501f38533fd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:42.195034 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c2d40146-9f80-47c6-a43d-1501f38533fd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:42.196533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c2d40146-9f80-47c6-a43d-1501f38533fd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:42.197730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c2d40146-9f80-47c6-a43d-1501f38533fd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.154226 Jul 27 20:39:42.198292 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1679/3376] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:42 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:42.379211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fba50d55-3fcb-4118-878e-497c215a6c22 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:42.379743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fba50d55-3fcb-4118-878e-497c215a6c22 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:42.386518 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fba50d55-3fcb-4118-878e-497c215a6c22 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:42.386973 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fba50d55-3fcb-4118-878e-497c215a6c22 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:42.387736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fba50d55-3fcb-4118-878e-497c215a6c22 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:42.388180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fba50d55-3fcb-4118-878e-497c215a6c22 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:42.518202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fba50d55-3fcb-4118-878e-497c215a6c22 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:42.526933 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fba50d55-3fcb-4118-878e-497c215a6c22 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151672 Jul 27 20:39:42.527514 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1698/3377] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:42 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:43.221601 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3b76683f-c0ac-4aeb-8d84-475e51066e77 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:43.222210 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3b76683f-c0ac-4aeb-8d84-475e51066e77 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:43.229327 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b76683f-c0ac-4aeb-8d84-475e51066e77 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:43.229855 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b76683f-c0ac-4aeb-8d84-475e51066e77 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:43.230646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b76683f-c0ac-4aeb-8d84-475e51066e77 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:43.231075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b76683f-c0ac-4aeb-8d84-475e51066e77 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:43.361835 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3b76683f-c0ac-4aeb-8d84-475e51066e77 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:43.370308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3b76683f-c0ac-4aeb-8d84-475e51066e77 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:43.371797 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3b76683f-c0ac-4aeb-8d84-475e51066e77 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:43.373858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3b76683f-c0ac-4aeb-8d84-475e51066e77 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156178 Jul 27 20:39:43.374608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1680/3378] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:43 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:43.549042 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cc8f5612-b793-4dd8-be71-38992f7ec2b7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:43.549659 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cc8f5612-b793-4dd8-be71-38992f7ec2b7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:43.556373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc8f5612-b793-4dd8-be71-38992f7ec2b7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:43.556824 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc8f5612-b793-4dd8-be71-38992f7ec2b7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:43.557617 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc8f5612-b793-4dd8-be71-38992f7ec2b7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:43.558059 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc8f5612-b793-4dd8-be71-38992f7ec2b7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:43.684230 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cc8f5612-b793-4dd8-be71-38992f7ec2b7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:43.692098 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cc8f5612-b793-4dd8-be71-38992f7ec2b7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.147054 Jul 27 20:39:43.693206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1699/3379] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:43 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:44.397594 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1f940ac7-989f-4054-8d4d-c80ab943dbd0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:44.398904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1f940ac7-989f-4054-8d4d-c80ab943dbd0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:44.404733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1f940ac7-989f-4054-8d4d-c80ab943dbd0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:44.405209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1f940ac7-989f-4054-8d4d-c80ab943dbd0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:44.405979 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1f940ac7-989f-4054-8d4d-c80ab943dbd0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:44.406424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1f940ac7-989f-4054-8d4d-c80ab943dbd0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:44.539515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1f940ac7-989f-4054-8d4d-c80ab943dbd0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:44.547740 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1f940ac7-989f-4054-8d4d-c80ab943dbd0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:44.549268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1f940ac7-989f-4054-8d4d-c80ab943dbd0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:44.550420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1f940ac7-989f-4054-8d4d-c80ab943dbd0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157175 Jul 27 20:39:44.550979 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1681/3380] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:44 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:44.715255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-deced44a-55d5-4704-be55-aa500fc5909c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:44.715818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-deced44a-55d5-4704-be55-aa500fc5909c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:44.722255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-deced44a-55d5-4704-be55-aa500fc5909c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:44.722700 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-deced44a-55d5-4704-be55-aa500fc5909c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:44.723460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-deced44a-55d5-4704-be55-aa500fc5909c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:44.724560 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-deced44a-55d5-4704-be55-aa500fc5909c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:44.856719 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-deced44a-55d5-4704-be55-aa500fc5909c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:44.864696 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-deced44a-55d5-4704-be55-aa500fc5909c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153275 Jul 27 20:39:44.865447 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1700/3381] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:44 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:45.574474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-11dcede7-7521-491c-adcc-a49cbe28786e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:45.575094 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-11dcede7-7521-491c-adcc-a49cbe28786e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:45.581946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11dcede7-7521-491c-adcc-a49cbe28786e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:45.582398 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11dcede7-7521-491c-adcc-a49cbe28786e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:45.583212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11dcede7-7521-491c-adcc-a49cbe28786e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:45.584316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11dcede7-7521-491c-adcc-a49cbe28786e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:45.713009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-11dcede7-7521-491c-adcc-a49cbe28786e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:45.721327 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-11dcede7-7521-491c-adcc-a49cbe28786e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:45.722804 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-11dcede7-7521-491c-adcc-a49cbe28786e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:45.724445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-11dcede7-7521-491c-adcc-a49cbe28786e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153375 Jul 27 20:39:45.725007 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1682/3382] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:45 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:45.886472 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4daf09e6-e59b-48fe-b07b-17edb6528001 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:45.887088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4daf09e6-e59b-48fe-b07b-17edb6528001 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:45.893651 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4daf09e6-e59b-48fe-b07b-17edb6528001 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:45.894110 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4daf09e6-e59b-48fe-b07b-17edb6528001 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:45.894870 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4daf09e6-e59b-48fe-b07b-17edb6528001 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:45.895311 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4daf09e6-e59b-48fe-b07b-17edb6528001 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:46.025195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4daf09e6-e59b-48fe-b07b-17edb6528001 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:46.033081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4daf09e6-e59b-48fe-b07b-17edb6528001 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150440 Jul 27 20:39:46.033654 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1701/3383] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:45 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:46.747203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-177f52b5-e5e8-4263-a24f-98abc68b2b6f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:46.747798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-177f52b5-e5e8-4263-a24f-98abc68b2b6f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:46.754346 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-177f52b5-e5e8-4263-a24f-98abc68b2b6f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:46.754795 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-177f52b5-e5e8-4263-a24f-98abc68b2b6f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:46.756282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-177f52b5-e5e8-4263-a24f-98abc68b2b6f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:46.756718 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-177f52b5-e5e8-4263-a24f-98abc68b2b6f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:46.889408 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-177f52b5-e5e8-4263-a24f-98abc68b2b6f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:46.898086 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-177f52b5-e5e8-4263-a24f-98abc68b2b6f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:46.899597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-177f52b5-e5e8-4263-a24f-98abc68b2b6f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:46.900752 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-177f52b5-e5e8-4263-a24f-98abc68b2b6f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157442 Jul 27 20:39:46.901342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1683/3384] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:46 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:47.056025 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5abf39ad-09b4-4255-ab5d-8c8754af495c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:47.056553 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5abf39ad-09b4-4255-ab5d-8c8754af495c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:47.063071 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5abf39ad-09b4-4255-ab5d-8c8754af495c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:47.063520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5abf39ad-09b4-4255-ab5d-8c8754af495c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:47.064275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5abf39ad-09b4-4255-ab5d-8c8754af495c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:47.064738 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5abf39ad-09b4-4255-ab5d-8c8754af495c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:47.196014 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5abf39ad-09b4-4255-ab5d-8c8754af495c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:47.204394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5abf39ad-09b4-4255-ab5d-8c8754af495c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152809 Jul 27 20:39:47.204992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1702/3385] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:47 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:47.923582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8c319b49-3f13-46ac-a22d-f52f3ff1fa4f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:47.924197 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8c319b49-3f13-46ac-a22d-f52f3ff1fa4f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:47.930532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c319b49-3f13-46ac-a22d-f52f3ff1fa4f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:47.930986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c319b49-3f13-46ac-a22d-f52f3ff1fa4f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:47.931747 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c319b49-3f13-46ac-a22d-f52f3ff1fa4f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:47.932189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c319b49-3f13-46ac-a22d-f52f3ff1fa4f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:48.063462 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8c319b49-3f13-46ac-a22d-f52f3ff1fa4f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:48.072448 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8c319b49-3f13-46ac-a22d-f52f3ff1fa4f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:48.073987 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8c319b49-3f13-46ac-a22d-f52f3ff1fa4f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:48.075348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8c319b49-3f13-46ac-a22d-f52f3ff1fa4f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155536 Jul 27 20:39:48.076039 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1684/3386] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:47 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:48.226408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f704c07a-ac03-4e0a-8af8-c7d07f3d35b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:48.227027 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f704c07a-ac03-4e0a-8af8-c7d07f3d35b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:48.233589 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f704c07a-ac03-4e0a-8af8-c7d07f3d35b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:48.234049 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f704c07a-ac03-4e0a-8af8-c7d07f3d35b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:48.234815 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f704c07a-ac03-4e0a-8af8-c7d07f3d35b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:48.235259 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f704c07a-ac03-4e0a-8af8-c7d07f3d35b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:48.362375 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f704c07a-ac03-4e0a-8af8-c7d07f3d35b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:48.370790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f704c07a-ac03-4e0a-8af8-c7d07f3d35b6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148320 Jul 27 20:39:48.371351 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1703/3387] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:48 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:49.099172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-96105e7e-eb3e-41a1-b58a-4edb20d2531f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:49.099778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-96105e7e-eb3e-41a1-b58a-4edb20d2531f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:49.106314 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96105e7e-eb3e-41a1-b58a-4edb20d2531f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:49.106764 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96105e7e-eb3e-41a1-b58a-4edb20d2531f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:49.107529 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96105e7e-eb3e-41a1-b58a-4edb20d2531f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:49.107968 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96105e7e-eb3e-41a1-b58a-4edb20d2531f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:49.234368 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-96105e7e-eb3e-41a1-b58a-4edb20d2531f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:49.243466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-96105e7e-eb3e-41a1-b58a-4edb20d2531f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:49.244982 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-96105e7e-eb3e-41a1-b58a-4edb20d2531f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:49.246140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-96105e7e-eb3e-41a1-b58a-4edb20d2531f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.150908 Jul 27 20:39:49.246698 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1685/3388] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:49 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:49.392440 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d6820bd7-5db9-46c9-9344-4e291940a4df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:49.393073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d6820bd7-5db9-46c9-9344-4e291940a4df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:49.399832 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d6820bd7-5db9-46c9-9344-4e291940a4df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:49.400279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d6820bd7-5db9-46c9-9344-4e291940a4df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:49.401054 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d6820bd7-5db9-46c9-9344-4e291940a4df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:49.401493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d6820bd7-5db9-46c9-9344-4e291940a4df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:49.530458 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d6820bd7-5db9-46c9-9344-4e291940a4df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:49.538903 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d6820bd7-5db9-46c9-9344-4e291940a4df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150316 Jul 27 20:39:49.539461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1704/3389] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:49 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:50.270109 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2ca72681-f140-4847-9210-6e214c288017 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:50.270726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2ca72681-f140-4847-9210-6e214c288017 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:50.277971 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ca72681-f140-4847-9210-6e214c288017 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:50.278424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ca72681-f140-4847-9210-6e214c288017 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:50.279191 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ca72681-f140-4847-9210-6e214c288017 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:50.279642 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ca72681-f140-4847-9210-6e214c288017 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:50.408136 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2ca72681-f140-4847-9210-6e214c288017 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:50.416991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2ca72681-f140-4847-9210-6e214c288017 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:50.418500 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2ca72681-f140-4847-9210-6e214c288017 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:50.419655 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2ca72681-f140-4847-9210-6e214c288017 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153505 Jul 27 20:39:50.420212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1686/3390] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:50 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:39:50.559571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-83c09c12-91a8-4d34-a5a5-a5d4c70a4b2f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:50.560179 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-83c09c12-91a8-4d34-a5a5-a5d4c70a4b2f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:50.566626 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-83c09c12-91a8-4d34-a5a5-a5d4c70a4b2f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:50.567073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-83c09c12-91a8-4d34-a5a5-a5d4c70a4b2f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:50.567827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-83c09c12-91a8-4d34-a5a5-a5d4c70a4b2f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:50.568261 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-83c09c12-91a8-4d34-a5a5-a5d4c70a4b2f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:50.694015 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-83c09c12-91a8-4d34-a5a5-a5d4c70a4b2f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:50.702665 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-83c09c12-91a8-4d34-a5a5-a5d4c70a4b2f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.146964 Jul 27 20:39:50.703677 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1705/3391] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:50 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:51.442853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-076d0f1b-2f6b-4213-a988-99dabe4738e5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:51.443455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-076d0f1b-2f6b-4213-a988-99dabe4738e5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:51.450592 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-076d0f1b-2f6b-4213-a988-99dabe4738e5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:51.451034 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-076d0f1b-2f6b-4213-a988-99dabe4738e5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:51.451783 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-076d0f1b-2f6b-4213-a988-99dabe4738e5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:51.452215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-076d0f1b-2f6b-4213-a988-99dabe4738e5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:51.580473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-076d0f1b-2f6b-4213-a988-99dabe4738e5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:51.588874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-076d0f1b-2f6b-4213-a988-99dabe4738e5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:51.590400 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-076d0f1b-2f6b-4213-a988-99dabe4738e5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:51.591563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-076d0f1b-2f6b-4213-a988-99dabe4738e5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152577 Jul 27 20:39:51.592123 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1687/3392] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:51 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:51.724058 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-40c1b1de-3322-4c74-bb67-2021c5f182bf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:51.724679 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-40c1b1de-3322-4c74-bb67-2021c5f182bf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:51.731916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-40c1b1de-3322-4c74-bb67-2021c5f182bf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:51.732370 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-40c1b1de-3322-4c74-bb67-2021c5f182bf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:51.733173 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-40c1b1de-3322-4c74-bb67-2021c5f182bf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:51.733618 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-40c1b1de-3322-4c74-bb67-2021c5f182bf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:51.864618 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-40c1b1de-3322-4c74-bb67-2021c5f182bf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:51.873224 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-40c1b1de-3322-4c74-bb67-2021c5f182bf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153077 Jul 27 20:39:51.873774 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1706/3393] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:51 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:52.617051 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-109923a4-03b9-4241-9020-77e04f3aa028 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:52.617603 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-109923a4-03b9-4241-9020-77e04f3aa028 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:52.624030 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-109923a4-03b9-4241-9020-77e04f3aa028 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:52.624483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-109923a4-03b9-4241-9020-77e04f3aa028 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:52.625284 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-109923a4-03b9-4241-9020-77e04f3aa028 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:52.625722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-109923a4-03b9-4241-9020-77e04f3aa028 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:52.756750 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-109923a4-03b9-4241-9020-77e04f3aa028 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:52.765742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-109923a4-03b9-4241-9020-77e04f3aa028 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:52.767217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-109923a4-03b9-4241-9020-77e04f3aa028 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:52.768360 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-109923a4-03b9-4241-9020-77e04f3aa028 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155317 Jul 27 20:39:52.768914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1688/3394] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:52 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:52.894609 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8fcbc442-4bc7-469a-9a02-7df1118e608e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:52.895264 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8fcbc442-4bc7-469a-9a02-7df1118e608e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:52.901959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8fcbc442-4bc7-469a-9a02-7df1118e608e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:52.902416 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8fcbc442-4bc7-469a-9a02-7df1118e608e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:52.903188 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8fcbc442-4bc7-469a-9a02-7df1118e608e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:52.903635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8fcbc442-4bc7-469a-9a02-7df1118e608e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:53.032671 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8fcbc442-4bc7-469a-9a02-7df1118e608e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:53.040634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8fcbc442-4bc7-469a-9a02-7df1118e608e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149907 Jul 27 20:39:53.041229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1707/3395] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:52 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:53.792131 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bfc23c8a-47eb-443f-9a78-976947fbfcca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:53.792732 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bfc23c8a-47eb-443f-9a78-976947fbfcca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:53.799175 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfc23c8a-47eb-443f-9a78-976947fbfcca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:53.799617 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfc23c8a-47eb-443f-9a78-976947fbfcca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:53.800360 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfc23c8a-47eb-443f-9a78-976947fbfcca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:53.800788 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfc23c8a-47eb-443f-9a78-976947fbfcca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:53.927713 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bfc23c8a-47eb-443f-9a78-976947fbfcca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:53.936445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bfc23c8a-47eb-443f-9a78-976947fbfcca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:53.937968 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bfc23c8a-47eb-443f-9a78-976947fbfcca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:53.939124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bfc23c8a-47eb-443f-9a78-976947fbfcca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.151542 Jul 27 20:39:53.939676 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1689/3396] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:53 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:54.061674 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5cab857b-911d-4386-b34f-0e956e9d8dfb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:54.062207 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5cab857b-911d-4386-b34f-0e956e9d8dfb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:54.068601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5cab857b-911d-4386-b34f-0e956e9d8dfb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:54.069083 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5cab857b-911d-4386-b34f-0e956e9d8dfb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:54.069842 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5cab857b-911d-4386-b34f-0e956e9d8dfb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:54.070279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5cab857b-911d-4386-b34f-0e956e9d8dfb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:54.201150 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5cab857b-911d-4386-b34f-0e956e9d8dfb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:54.209229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5cab857b-911d-4386-b34f-0e956e9d8dfb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151399 Jul 27 20:39:54.209792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1708/3397] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:54 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:54.963595 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-acaf4749-8a16-42f9-ad93-caaf1184017b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:54.964199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-acaf4749-8a16-42f9-ad93-caaf1184017b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:54.970939 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-acaf4749-8a16-42f9-ad93-caaf1184017b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:54.971389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-acaf4749-8a16-42f9-ad93-caaf1184017b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:54.972140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-acaf4749-8a16-42f9-ad93-caaf1184017b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:54.972569 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-acaf4749-8a16-42f9-ad93-caaf1184017b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:55.109986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-acaf4749-8a16-42f9-ad93-caaf1184017b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:55.119267 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-acaf4749-8a16-42f9-ad93-caaf1184017b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:55.120788 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-acaf4749-8a16-42f9-ad93-caaf1184017b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:55.121965 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-acaf4749-8a16-42f9-ad93-caaf1184017b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.162493 Jul 27 20:39:55.122519 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1690/3398] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:54 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:55.230499 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4b910696-9ba6-4359-9c6b-da531b835021 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:55.231178 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4b910696-9ba6-4359-9c6b-da531b835021 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:55.237795 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4b910696-9ba6-4359-9c6b-da531b835021 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:55.238249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4b910696-9ba6-4359-9c6b-da531b835021 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:55.239021 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4b910696-9ba6-4359-9c6b-da531b835021 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:55.239461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4b910696-9ba6-4359-9c6b-da531b835021 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:55.369453 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4b910696-9ba6-4359-9c6b-da531b835021 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:55.377361 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4b910696-9ba6-4359-9c6b-da531b835021 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150728 Jul 27 20:39:55.377934 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1709/3399] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:55 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:56.146090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f423c838-4b31-4172-ad37-fd0f8ee602aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:56.146700 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f423c838-4b31-4172-ad37-fd0f8ee602aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:56.154045 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f423c838-4b31-4172-ad37-fd0f8ee602aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:56.154498 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f423c838-4b31-4172-ad37-fd0f8ee602aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:56.155266 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f423c838-4b31-4172-ad37-fd0f8ee602aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:56.155707 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f423c838-4b31-4172-ad37-fd0f8ee602aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:56.280766 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f423c838-4b31-4172-ad37-fd0f8ee602aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:56.288956 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f423c838-4b31-4172-ad37-fd0f8ee602aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:56.290564 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f423c838-4b31-4172-ad37-fd0f8ee602aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:56.291709 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f423c838-4b31-4172-ad37-fd0f8ee602aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.149503 Jul 27 20:39:56.292257 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1691/3400] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:56 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:56.401570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0349bb5f-1075-46f7-b170-de5ada40821d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:56.402177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0349bb5f-1075-46f7-b170-de5ada40821d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:56.408645 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0349bb5f-1075-46f7-b170-de5ada40821d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:56.409129 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0349bb5f-1075-46f7-b170-de5ada40821d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:56.409883 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0349bb5f-1075-46f7-b170-de5ada40821d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:56.410320 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0349bb5f-1075-46f7-b170-de5ada40821d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:56.537609 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0349bb5f-1075-46f7-b170-de5ada40821d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:56.545616 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0349bb5f-1075-46f7-b170-de5ada40821d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148484 Jul 27 20:39:56.546186 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1710/3401] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:56 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:57.314954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0df4c497-5066-4efd-b840-46d4ca937b9f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:57.315565 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0df4c497-5066-4efd-b840-46d4ca937b9f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:57.322261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0df4c497-5066-4efd-b840-46d4ca937b9f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:57.322712 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0df4c497-5066-4efd-b840-46d4ca937b9f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:57.323476 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0df4c497-5066-4efd-b840-46d4ca937b9f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:57.323912 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0df4c497-5066-4efd-b840-46d4ca937b9f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:57.451714 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0df4c497-5066-4efd-b840-46d4ca937b9f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:57.460309 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0df4c497-5066-4efd-b840-46d4ca937b9f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:57.462539 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0df4c497-5066-4efd-b840-46d4ca937b9f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:57.463708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0df4c497-5066-4efd-b840-46d4ca937b9f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152744 Jul 27 20:39:57.464263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1692/3402] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:57 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:57.567051 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2f22b5f2-5396-44db-b66a-749a244d3fc8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:57.567727 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2f22b5f2-5396-44db-b66a-749a244d3fc8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:57.574754 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2f22b5f2-5396-44db-b66a-749a244d3fc8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:57.575213 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2f22b5f2-5396-44db-b66a-749a244d3fc8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:57.575982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2f22b5f2-5396-44db-b66a-749a244d3fc8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:57.576428 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2f22b5f2-5396-44db-b66a-749a244d3fc8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:57.580600 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:39:57.707176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2f22b5f2-5396-44db-b66a-749a244d3fc8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:57.715788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2f22b5f2-5396-44db-b66a-749a244d3fc8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152617 Jul 27 20:39:57.716357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1711/3403] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:57 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:58.487547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5cbf9311-353b-4253-8821-0903e08eb080 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:58.488165 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5cbf9311-353b-4253-8821-0903e08eb080 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:58.495442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5cbf9311-353b-4253-8821-0903e08eb080 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:58.495895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5cbf9311-353b-4253-8821-0903e08eb080 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:58.496660 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5cbf9311-353b-4253-8821-0903e08eb080 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:58.497155 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5cbf9311-353b-4253-8821-0903e08eb080 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:58.626889 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5cbf9311-353b-4253-8821-0903e08eb080 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:58.630275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:39:58.636241 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5cbf9311-353b-4253-8821-0903e08eb080 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:58.637814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5cbf9311-353b-4253-8821-0903e08eb080 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:58.638969 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5cbf9311-353b-4253-8821-0903e08eb080 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155343 Jul 27 20:39:58.639537 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1693/3404] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:58 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:58.736871 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-51ee6cb7-0b27-4cfd-a84d-eb8befe4ede2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:58.737527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-51ee6cb7-0b27-4cfd-a84d-eb8befe4ede2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:58.744107 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-51ee6cb7-0b27-4cfd-a84d-eb8befe4ede2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:58.744508 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-51ee6cb7-0b27-4cfd-a84d-eb8befe4ede2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:58.745305 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-51ee6cb7-0b27-4cfd-a84d-eb8befe4ede2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:58.745759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-51ee6cb7-0b27-4cfd-a84d-eb8befe4ede2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:58.875455 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-51ee6cb7-0b27-4cfd-a84d-eb8befe4ede2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:58.883433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-51ee6cb7-0b27-4cfd-a84d-eb8befe4ede2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150445 Jul 27 20:39:58.884105 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1712/3405] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:58 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:39:59.662189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-03273cc3-bef9-4e7f-9bac-2470c532a4f4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:59.662802 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-03273cc3-bef9-4e7f-9bac-2470c532a4f4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:59.669832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03273cc3-bef9-4e7f-9bac-2470c532a4f4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:59.670285 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03273cc3-bef9-4e7f-9bac-2470c532a4f4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:59.671048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03273cc3-bef9-4e7f-9bac-2470c532a4f4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:59.671491 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03273cc3-bef9-4e7f-9bac-2470c532a4f4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:59.806880 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-03273cc3-bef9-4e7f-9bac-2470c532a4f4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:59.815278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-03273cc3-bef9-4e7f-9bac-2470c532a4f4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:59.816786 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-03273cc3-bef9-4e7f-9bac-2470c532a4f4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:39:59.817986 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-03273cc3-bef9-4e7f-9bac-2470c532a4f4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.159703 Jul 27 20:39:59.818545 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1694/3406] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:39:59 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:39:59.904372 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-91c1326a-0db0-426d-8fbb-712e62c28242 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:39:59.905047 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-91c1326a-0db0-426d-8fbb-712e62c28242 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:39:59.911528 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-91c1326a-0db0-426d-8fbb-712e62c28242 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:59.912019 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-91c1326a-0db0-426d-8fbb-712e62c28242 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:39:59.912832 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-91c1326a-0db0-426d-8fbb-712e62c28242 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:39:59.913253 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-91c1326a-0db0-426d-8fbb-712e62c28242 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:00.041677 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-91c1326a-0db0-426d-8fbb-712e62c28242 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:00.050674 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-91c1326a-0db0-426d-8fbb-712e62c28242 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150210 Jul 27 20:40:00.051247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1713/3407] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:39:59 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:00.766053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:40:00.766352 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:40:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:40:00.843436 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-790189e1-1277-492e-9d24-a474275355cf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:00.844070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-790189e1-1277-492e-9d24-a474275355cf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:00.850533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-790189e1-1277-492e-9d24-a474275355cf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:00.850977 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-790189e1-1277-492e-9d24-a474275355cf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:00.851726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-790189e1-1277-492e-9d24-a474275355cf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:00.852303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-790189e1-1277-492e-9d24-a474275355cf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:01.042356 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-790189e1-1277-492e-9d24-a474275355cf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:01.050693 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-790189e1-1277-492e-9d24-a474275355cf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:01.052199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-790189e1-1277-492e-9d24-a474275355cf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:01.053391 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-790189e1-1277-492e-9d24-a474275355cf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.213754 Jul 27 20:40:01.053948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1695/3408] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:00 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:01.072081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-adc4ed89-81e0-40cf-ba44-4a4281df0033 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:01.072709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-adc4ed89-81e0-40cf-ba44-4a4281df0033 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:01.079606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-adc4ed89-81e0-40cf-ba44-4a4281df0033 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:01.080056 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-adc4ed89-81e0-40cf-ba44-4a4281df0033 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:01.080824 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-adc4ed89-81e0-40cf-ba44-4a4281df0033 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:01.081322 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-adc4ed89-81e0-40cf-ba44-4a4281df0033 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:01.214438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-adc4ed89-81e0-40cf-ba44-4a4281df0033 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:01.222451 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-adc4ed89-81e0-40cf-ba44-4a4281df0033 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.154858 Jul 27 20:40:01.223013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1714/3409] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:01 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:02.078241 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4a848b94-e154-4d96-aaeb-45a752b5c895 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:02.078856 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4a848b94-e154-4d96-aaeb-45a752b5c895 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:02.085433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a848b94-e154-4d96-aaeb-45a752b5c895 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:02.085888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a848b94-e154-4d96-aaeb-45a752b5c895 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:02.086902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a848b94-e154-4d96-aaeb-45a752b5c895 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:02.087341 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a848b94-e154-4d96-aaeb-45a752b5c895 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:02.221014 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4a848b94-e154-4d96-aaeb-45a752b5c895 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:02.230224 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4a848b94-e154-4d96-aaeb-45a752b5c895 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:02.231722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4a848b94-e154-4d96-aaeb-45a752b5c895 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:02.232875 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4a848b94-e154-4d96-aaeb-45a752b5c895 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.158785 Jul 27 20:40:02.233464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1696/3410] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:02 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:02.245433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ace7dd89-d226-4806-9e28-c15cd0a1b6c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:02.246058 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ace7dd89-d226-4806-9e28-c15cd0a1b6c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:02.252689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ace7dd89-d226-4806-9e28-c15cd0a1b6c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:02.253183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ace7dd89-d226-4806-9e28-c15cd0a1b6c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:02.254007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ace7dd89-d226-4806-9e28-c15cd0a1b6c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:02.254459 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ace7dd89-d226-4806-9e28-c15cd0a1b6c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:02.466044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ace7dd89-d226-4806-9e28-c15cd0a1b6c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:02.473849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ace7dd89-d226-4806-9e28-c15cd0a1b6c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.232990 Jul 27 20:40:02.474410 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1715/3411] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:02 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:03.257233 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c409871e-7da6-47d0-9840-0f1798ad0ef9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:03.257836 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c409871e-7da6-47d0-9840-0f1798ad0ef9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:03.265270 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c409871e-7da6-47d0-9840-0f1798ad0ef9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:03.265719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c409871e-7da6-47d0-9840-0f1798ad0ef9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:03.266485 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c409871e-7da6-47d0-9840-0f1798ad0ef9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:03.266923 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c409871e-7da6-47d0-9840-0f1798ad0ef9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:03.532113 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c409871e-7da6-47d0-9840-0f1798ad0ef9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:03.543640 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c409871e-7da6-47d0-9840-0f1798ad0ef9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:03.545173 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c409871e-7da6-47d0-9840-0f1798ad0ef9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:03.546367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c409871e-7da6-47d0-9840-0f1798ad0ef9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.293029 Jul 27 20:40:03.546927 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1697/3412] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:03 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:03.616426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-aec077ad-43fe-4ff2-93e8-1fc6867a50d5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:03.617114 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-aec077ad-43fe-4ff2-93e8-1fc6867a50d5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:03.623744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aec077ad-43fe-4ff2-93e8-1fc6867a50d5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:03.624199 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aec077ad-43fe-4ff2-93e8-1fc6867a50d5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:03.624993 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aec077ad-43fe-4ff2-93e8-1fc6867a50d5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:03.625436 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aec077ad-43fe-4ff2-93e8-1fc6867a50d5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:03.753236 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-aec077ad-43fe-4ff2-93e8-1fc6867a50d5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:03.761309 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-aec077ad-43fe-4ff2-93e8-1fc6867a50d5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.269467 Jul 27 20:40:03.761880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1716/3413] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:03 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:04.571214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-eebb1c52-9199-4bd6-8c16-26d9c6990d5f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:04.571857 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-eebb1c52-9199-4bd6-8c16-26d9c6990d5f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:04.578693 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eebb1c52-9199-4bd6-8c16-26d9c6990d5f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:04.579145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eebb1c52-9199-4bd6-8c16-26d9c6990d5f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:04.579902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eebb1c52-9199-4bd6-8c16-26d9c6990d5f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:04.580341 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eebb1c52-9199-4bd6-8c16-26d9c6990d5f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:04.710340 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eebb1c52-9199-4bd6-8c16-26d9c6990d5f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:04.718706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eebb1c52-9199-4bd6-8c16-26d9c6990d5f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:04.720429 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eebb1c52-9199-4bd6-8c16-26d9c6990d5f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:04.721615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-eebb1c52-9199-4bd6-8c16-26d9c6990d5f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155027 Jul 27 20:40:04.722181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1698/3414] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:04 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:04.782653 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-060bf6f2-0154-489b-8886-19b219894263 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:04.783267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-060bf6f2-0154-489b-8886-19b219894263 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:04.785609 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=56 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:40:04.791419 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-060bf6f2-0154-489b-8886-19b219894263 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:04.791868 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-060bf6f2-0154-489b-8886-19b219894263 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:04.792637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-060bf6f2-0154-489b-8886-19b219894263 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:04.793109 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-060bf6f2-0154-489b-8886-19b219894263 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:04.920185 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-060bf6f2-0154-489b-8886-19b219894263 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:04.928052 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-060bf6f2-0154-489b-8886-19b219894263 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149222 Jul 27 20:40:04.928608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1717/3415] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:04 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:05.745737 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-36da1e8d-683d-4c06-8e72-313c23caff08 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:05.746410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-36da1e8d-683d-4c06-8e72-313c23caff08 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:05.755134 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-36da1e8d-683d-4c06-8e72-313c23caff08 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:05.756031 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-36da1e8d-683d-4c06-8e72-313c23caff08 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:05.756983 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-36da1e8d-683d-4c06-8e72-313c23caff08 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:05.758568 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-36da1e8d-683d-4c06-8e72-313c23caff08 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:05.915961 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-36da1e8d-683d-4c06-8e72-313c23caff08 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:05.925103 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-36da1e8d-683d-4c06-8e72-313c23caff08 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:05.926622 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-36da1e8d-683d-4c06-8e72-313c23caff08 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:05.927791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-36da1e8d-683d-4c06-8e72-313c23caff08 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.186752 Jul 27 20:40:05.928342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1699/3416] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:05 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:05.950849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f1ba7c95-8a21-4ec1-8da8-e1143b096567 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:05.951713 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f1ba7c95-8a21-4ec1-8da8-e1143b096567 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:05.962165 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f1ba7c95-8a21-4ec1-8da8-e1143b096567 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:05.962932 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f1ba7c95-8a21-4ec1-8da8-e1143b096567 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:05.963985 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f1ba7c95-8a21-4ec1-8da8-e1143b096567 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:05.964617 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f1ba7c95-8a21-4ec1-8da8-e1143b096567 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:06.121868 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f1ba7c95-8a21-4ec1-8da8-e1143b096567 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:06.131241 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f1ba7c95-8a21-4ec1-8da8-e1143b096567 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.184329 Jul 27 20:40:06.131816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1718/3417] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:05 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:06.958015 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e18bc314-5deb-413a-ad5b-37698c573e4c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:06.958609 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e18bc314-5deb-413a-ad5b-37698c573e4c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:06.961432 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=52 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:40:06.966621 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e18bc314-5deb-413a-ad5b-37698c573e4c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:06.967068 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e18bc314-5deb-413a-ad5b-37698c573e4c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:06.967817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e18bc314-5deb-413a-ad5b-37698c573e4c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:06.968247 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e18bc314-5deb-413a-ad5b-37698c573e4c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:07.100696 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e18bc314-5deb-413a-ad5b-37698c573e4c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:07.110016 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e18bc314-5deb-413a-ad5b-37698c573e4c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:07.111504 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e18bc314-5deb-413a-ad5b-37698c573e4c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:07.112645 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e18bc314-5deb-413a-ad5b-37698c573e4c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.158560 Jul 27 20:40:07.113243 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1700/3418] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:06 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:07.155008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cf431114-d4f3-460a-96ac-f960e093add4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:07.155743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cf431114-d4f3-460a-96ac-f960e093add4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:07.163350 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf431114-d4f3-460a-96ac-f960e093add4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:07.163810 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf431114-d4f3-460a-96ac-f960e093add4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:07.165373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf431114-d4f3-460a-96ac-f960e093add4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:07.165862 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cf431114-d4f3-460a-96ac-f960e093add4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:07.551118 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cf431114-d4f3-460a-96ac-f960e093add4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:07.559908 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cf431114-d4f3-460a-96ac-f960e093add4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.408770 Jul 27 20:40:07.560475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1719/3419] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:07 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:08.136101 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6bd73885-51d5-4ec2-9858-712674132d70 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:08.136703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6bd73885-51d5-4ec2-9858-712674132d70 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:08.143124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6bd73885-51d5-4ec2-9858-712674132d70 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:08.143565 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6bd73885-51d5-4ec2-9858-712674132d70 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:08.144314 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6bd73885-51d5-4ec2-9858-712674132d70 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:08.144746 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6bd73885-51d5-4ec2-9858-712674132d70 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:08.271779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6bd73885-51d5-4ec2-9858-712674132d70 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:08.280771 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6bd73885-51d5-4ec2-9858-712674132d70 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:08.282291 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6bd73885-51d5-4ec2-9858-712674132d70 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:08.283431 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6bd73885-51d5-4ec2-9858-712674132d70 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.151665 Jul 27 20:40:08.283980 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1701/3420] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:08 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:08.581492 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0fdd94e7-aaef-41f6-8439-2d9f8e50f716 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:08.582116 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0fdd94e7-aaef-41f6-8439-2d9f8e50f716 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:08.588612 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0fdd94e7-aaef-41f6-8439-2d9f8e50f716 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:08.589093 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0fdd94e7-aaef-41f6-8439-2d9f8e50f716 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:08.589862 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0fdd94e7-aaef-41f6-8439-2d9f8e50f716 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:08.590335 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0fdd94e7-aaef-41f6-8439-2d9f8e50f716 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:08.728342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0fdd94e7-aaef-41f6-8439-2d9f8e50f716 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:08.736185 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0fdd94e7-aaef-41f6-8439-2d9f8e50f716 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.158834 Jul 27 20:40:08.736738 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1720/3421] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:08 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:09.307228 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1ca4c3cb-926c-404c-9bd9-747c598a51d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:09.307840 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1ca4c3cb-926c-404c-9bd9-747c598a51d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:09.314342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1ca4c3cb-926c-404c-9bd9-747c598a51d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:09.314798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1ca4c3cb-926c-404c-9bd9-747c598a51d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:09.315555 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1ca4c3cb-926c-404c-9bd9-747c598a51d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:09.315987 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1ca4c3cb-926c-404c-9bd9-747c598a51d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:09.445927 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1ca4c3cb-926c-404c-9bd9-747c598a51d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:09.456534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1ca4c3cb-926c-404c-9bd9-747c598a51d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:09.458061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1ca4c3cb-926c-404c-9bd9-747c598a51d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:09.459357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1ca4c3cb-926c-404c-9bd9-747c598a51d6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156675 Jul 27 20:40:09.459770 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1702/3422] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:09 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:40:09.757501 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0c58c181-64ab-4a93-a027-a7c9f09223e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:09.758116 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0c58c181-64ab-4a93-a027-a7c9f09223e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:09.764798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0c58c181-64ab-4a93-a027-a7c9f09223e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:09.765286 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0c58c181-64ab-4a93-a027-a7c9f09223e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:09.766097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0c58c181-64ab-4a93-a027-a7c9f09223e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:09.766543 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0c58c181-64ab-4a93-a027-a7c9f09223e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:09.896286 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0c58c181-64ab-4a93-a027-a7c9f09223e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:09.904282 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0c58c181-64ab-4a93-a027-a7c9f09223e4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150715 Jul 27 20:40:09.904848 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1721/3423] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:09 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:10.482598 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-693cbc2e-1344-45d8-9880-8f59492ec242 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:10.483203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-693cbc2e-1344-45d8-9880-8f59492ec242 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:10.489714 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-693cbc2e-1344-45d8-9880-8f59492ec242 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:10.490157 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-693cbc2e-1344-45d8-9880-8f59492ec242 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:10.490914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-693cbc2e-1344-45d8-9880-8f59492ec242 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:10.491343 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-693cbc2e-1344-45d8-9880-8f59492ec242 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:10.619672 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-693cbc2e-1344-45d8-9880-8f59492ec242 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:10.627950 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-693cbc2e-1344-45d8-9880-8f59492ec242 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:10.629471 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-693cbc2e-1344-45d8-9880-8f59492ec242 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:10.630620 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-693cbc2e-1344-45d8-9880-8f59492ec242 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.151906 Jul 27 20:40:10.631249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1703/3424] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:10 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:10.925696 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f2eb8644-5ace-4f28-acc7-c5ce1fd512d8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:10.926309 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f2eb8644-5ace-4f28-acc7-c5ce1fd512d8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:10.933320 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2eb8644-5ace-4f28-acc7-c5ce1fd512d8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:10.933768 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2eb8644-5ace-4f28-acc7-c5ce1fd512d8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:10.934520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2eb8644-5ace-4f28-acc7-c5ce1fd512d8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:10.934958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2eb8644-5ace-4f28-acc7-c5ce1fd512d8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:11.063862 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f2eb8644-5ace-4f28-acc7-c5ce1fd512d8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:11.072403 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f2eb8644-5ace-4f28-acc7-c5ce1fd512d8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150487 Jul 27 20:40:11.072988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1722/3425] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:10 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:11.655343 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2b4e7659-2145-4555-aad8-d7140d366505 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:11.655950 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2b4e7659-2145-4555-aad8-d7140d366505 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:11.662749 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b4e7659-2145-4555-aad8-d7140d366505 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:11.663192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b4e7659-2145-4555-aad8-d7140d366505 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:11.663945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b4e7659-2145-4555-aad8-d7140d366505 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:11.664377 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b4e7659-2145-4555-aad8-d7140d366505 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:11.793056 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2b4e7659-2145-4555-aad8-d7140d366505 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:11.801426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2b4e7659-2145-4555-aad8-d7140d366505 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:11.802908 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2b4e7659-2145-4555-aad8-d7140d366505 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:11.804054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2b4e7659-2145-4555-aad8-d7140d366505 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152654 Jul 27 20:40:11.804612 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1704/3426] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:11 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:12.094018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a9f8a4eb-62e8-416a-ae30-8bdfa68c2b16 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:12.094634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a9f8a4eb-62e8-416a-ae30-8bdfa68c2b16 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:12.101218 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a9f8a4eb-62e8-416a-ae30-8bdfa68c2b16 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:12.101678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a9f8a4eb-62e8-416a-ae30-8bdfa68c2b16 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:12.102478 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a9f8a4eb-62e8-416a-ae30-8bdfa68c2b16 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:12.102919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a9f8a4eb-62e8-416a-ae30-8bdfa68c2b16 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:12.234324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a9f8a4eb-62e8-416a-ae30-8bdfa68c2b16 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:12.242232 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a9f8a4eb-62e8-416a-ae30-8bdfa68c2b16 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152046 Jul 27 20:40:12.242809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1723/3427] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:12 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:12.828101 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-009609e2-e0c4-4ea9-88e6-d28da1d798b2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:12.828704 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-009609e2-e0c4-4ea9-88e6-d28da1d798b2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:12.835135 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-009609e2-e0c4-4ea9-88e6-d28da1d798b2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:12.835575 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-009609e2-e0c4-4ea9-88e6-d28da1d798b2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:12.836325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-009609e2-e0c4-4ea9-88e6-d28da1d798b2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:12.837391 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-009609e2-e0c4-4ea9-88e6-d28da1d798b2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:12.966836 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-009609e2-e0c4-4ea9-88e6-d28da1d798b2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:12.975083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-009609e2-e0c4-4ea9-88e6-d28da1d798b2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:12.976565 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-009609e2-e0c4-4ea9-88e6-d28da1d798b2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:12.977774 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-009609e2-e0c4-4ea9-88e6-d28da1d798b2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153894 Jul 27 20:40:12.978317 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1705/3428] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:12 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:13.263850 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ff0a4b02-4642-4654-b898-c3c60e794ff6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:13.264463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ff0a4b02-4642-4654-b898-c3c60e794ff6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:13.271164 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ff0a4b02-4642-4654-b898-c3c60e794ff6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:13.271621 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ff0a4b02-4642-4654-b898-c3c60e794ff6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:13.272390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ff0a4b02-4642-4654-b898-c3c60e794ff6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:13.272842 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ff0a4b02-4642-4654-b898-c3c60e794ff6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:13.398887 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ff0a4b02-4642-4654-b898-c3c60e794ff6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:13.409858 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ff0a4b02-4642-4654-b898-c3c60e794ff6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149871 Jul 27 20:40:13.410437 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1724/3429] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:13 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:14.001515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4bbce56b-10eb-4027-94f5-3e15406c4189 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:14.002123 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4bbce56b-10eb-4027-94f5-3e15406c4189 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:14.010456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4bbce56b-10eb-4027-94f5-3e15406c4189 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:14.010901 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4bbce56b-10eb-4027-94f5-3e15406c4189 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:14.011865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4bbce56b-10eb-4027-94f5-3e15406c4189 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:14.012287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4bbce56b-10eb-4027-94f5-3e15406c4189 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:14.140500 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4bbce56b-10eb-4027-94f5-3e15406c4189 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:14.148769 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4bbce56b-10eb-4027-94f5-3e15406c4189 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:14.150868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4bbce56b-10eb-4027-94f5-3e15406c4189 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:14.152036 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4bbce56b-10eb-4027-94f5-3e15406c4189 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.154480 Jul 27 20:40:14.152604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1706/3430] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:13 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:14.432714 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a2c95182-e8db-438a-9a42-19a1b491168c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:14.434313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a2c95182-e8db-438a-9a42-19a1b491168c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:14.445337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a2c95182-e8db-438a-9a42-19a1b491168c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:14.446816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a2c95182-e8db-438a-9a42-19a1b491168c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:14.448027 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a2c95182-e8db-438a-9a42-19a1b491168c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:14.448678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a2c95182-e8db-438a-9a42-19a1b491168c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:14.579850 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a2c95182-e8db-438a-9a42-19a1b491168c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:14.587906 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a2c95182-e8db-438a-9a42-19a1b491168c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.159774 Jul 27 20:40:14.588881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1725/3431] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:14 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:15.175607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1bf0ed40-b960-4a97-baf3-985a095debeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:15.176208 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1bf0ed40-b960-4a97-baf3-985a095debeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:15.182641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1bf0ed40-b960-4a97-baf3-985a095debeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:15.183076 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1bf0ed40-b960-4a97-baf3-985a095debeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:15.183822 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1bf0ed40-b960-4a97-baf3-985a095debeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:15.184250 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1bf0ed40-b960-4a97-baf3-985a095debeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:15.316428 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1bf0ed40-b960-4a97-baf3-985a095debeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:15.328159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1bf0ed40-b960-4a97-baf3-985a095debeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:15.329626 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1bf0ed40-b960-4a97-baf3-985a095debeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:15.330781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1bf0ed40-b960-4a97-baf3-985a095debeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.159044 Jul 27 20:40:15.331333 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1707/3432] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:15 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:15.608887 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-258cf07b-c1b4-49ed-a246-d6177f6703da tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:15.609522 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-258cf07b-c1b4-49ed-a246-d6177f6703da tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:15.615934 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-258cf07b-c1b4-49ed-a246-d6177f6703da tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:15.616393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-258cf07b-c1b4-49ed-a246-d6177f6703da tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:15.617195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-258cf07b-c1b4-49ed-a246-d6177f6703da tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:15.617649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-258cf07b-c1b4-49ed-a246-d6177f6703da tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:15.757802 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-258cf07b-c1b4-49ed-a246-d6177f6703da tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:15.766681 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-258cf07b-c1b4-49ed-a246-d6177f6703da tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.161655 Jul 27 20:40:15.767179 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1726/3433] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:15 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:16.355277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3a51277c-9756-4eac-bbc7-ad9145a2688c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:16.355818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3a51277c-9756-4eac-bbc7-ad9145a2688c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:16.362239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3a51277c-9756-4eac-bbc7-ad9145a2688c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:16.362679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3a51277c-9756-4eac-bbc7-ad9145a2688c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:16.363432 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3a51277c-9756-4eac-bbc7-ad9145a2688c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:16.363865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3a51277c-9756-4eac-bbc7-ad9145a2688c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:16.493434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3a51277c-9756-4eac-bbc7-ad9145a2688c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:16.502374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3a51277c-9756-4eac-bbc7-ad9145a2688c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:16.503882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3a51277c-9756-4eac-bbc7-ad9145a2688c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:16.505080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3a51277c-9756-4eac-bbc7-ad9145a2688c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.154508 Jul 27 20:40:16.505639 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1708/3434] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:16 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:16.787930 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9237c065-4f12-4dda-ba3e-e09e02654187 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:16.788585 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9237c065-4f12-4dda-ba3e-e09e02654187 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:16.795999 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9237c065-4f12-4dda-ba3e-e09e02654187 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:16.796457 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9237c065-4f12-4dda-ba3e-e09e02654187 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:16.797246 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9237c065-4f12-4dda-ba3e-e09e02654187 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:16.797692 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9237c065-4f12-4dda-ba3e-e09e02654187 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:16.925332 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9237c065-4f12-4dda-ba3e-e09e02654187 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:16.928700 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:40:16.934182 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9237c065-4f12-4dda-ba3e-e09e02654187 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150173 Jul 27 20:40:16.934753 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1727/3435] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:16 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:17.527946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-672180fb-31b0-4cfc-aa4a-e2f61a7ed890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:17.528554 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-672180fb-31b0-4cfc-aa4a-e2f61a7ed890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:17.534572 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-672180fb-31b0-4cfc-aa4a-e2f61a7ed890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:17.535022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-672180fb-31b0-4cfc-aa4a-e2f61a7ed890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:17.535778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-672180fb-31b0-4cfc-aa4a-e2f61a7ed890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:17.536210 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-672180fb-31b0-4cfc-aa4a-e2f61a7ed890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:17.661905 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-672180fb-31b0-4cfc-aa4a-e2f61a7ed890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:17.670307 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-672180fb-31b0-4cfc-aa4a-e2f61a7ed890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:17.671807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-672180fb-31b0-4cfc-aa4a-e2f61a7ed890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:17.672992 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-672180fb-31b0-4cfc-aa4a-e2f61a7ed890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.149370 Jul 27 20:40:17.673658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1709/3436] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:17 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:17.955812 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2d9f4100-e7dc-490c-a445-534fb39647b9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:17.956430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2d9f4100-e7dc-490c-a445-534fb39647b9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:17.963120 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d9f4100-e7dc-490c-a445-534fb39647b9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:17.963576 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d9f4100-e7dc-490c-a445-534fb39647b9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:17.964339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d9f4100-e7dc-490c-a445-534fb39647b9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:17.964785 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d9f4100-e7dc-490c-a445-534fb39647b9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:18.100742 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2d9f4100-e7dc-490c-a445-534fb39647b9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:18.108672 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2d9f4100-e7dc-490c-a445-534fb39647b9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.156917 Jul 27 20:40:18.109282 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1728/3437] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:17 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:18.696893 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-979f2e69-4c61-4466-a0a2-8217fb693e9c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:18.697514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-979f2e69-4c61-4466-a0a2-8217fb693e9c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:18.704269 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-979f2e69-4c61-4466-a0a2-8217fb693e9c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:18.704721 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-979f2e69-4c61-4466-a0a2-8217fb693e9c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:18.705514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-979f2e69-4c61-4466-a0a2-8217fb693e9c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:18.705956 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-979f2e69-4c61-4466-a0a2-8217fb693e9c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:18.725913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:40:18.838221 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-979f2e69-4c61-4466-a0a2-8217fb693e9c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:18.846520 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-979f2e69-4c61-4466-a0a2-8217fb693e9c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:18.848010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-979f2e69-4c61-4466-a0a2-8217fb693e9c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:18.849206 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-979f2e69-4c61-4466-a0a2-8217fb693e9c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156297 Jul 27 20:40:18.849796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1710/3438] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:18 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:19.129808 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fae0fbe0-324c-4dbb-a453-7fe939e55ada tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:19.130420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fae0fbe0-324c-4dbb-a453-7fe939e55ada tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:19.137113 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fae0fbe0-324c-4dbb-a453-7fe939e55ada tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:19.137560 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fae0fbe0-324c-4dbb-a453-7fe939e55ada tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:19.138350 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fae0fbe0-324c-4dbb-a453-7fe939e55ada tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:19.138787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fae0fbe0-324c-4dbb-a453-7fe939e55ada tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:19.265042 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fae0fbe0-324c-4dbb-a453-7fe939e55ada tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:19.272973 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fae0fbe0-324c-4dbb-a453-7fe939e55ada tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.147021 Jul 27 20:40:19.273533 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1729/3439] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:19 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:19.873673 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ee974158-e631-423b-b9f2-a8a08ecd0d9d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:19.874313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ee974158-e631-423b-b9f2-a8a08ecd0d9d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:19.880918 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee974158-e631-423b-b9f2-a8a08ecd0d9d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:19.881401 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee974158-e631-423b-b9f2-a8a08ecd0d9d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:19.882160 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee974158-e631-423b-b9f2-a8a08ecd0d9d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:19.882600 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee974158-e631-423b-b9f2-a8a08ecd0d9d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:20.012934 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ee974158-e631-423b-b9f2-a8a08ecd0d9d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:20.021415 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ee974158-e631-423b-b9f2-a8a08ecd0d9d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:20.022836 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ee974158-e631-423b-b9f2-a8a08ecd0d9d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:20.023997 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ee974158-e631-423b-b9f2-a8a08ecd0d9d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.154390 Jul 27 20:40:20.024552 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1711/3440] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:19 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:20.295201 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ecb50992-8271-4045-b22f-dcc7bc864c35 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:20.295748 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ecb50992-8271-4045-b22f-dcc7bc864c35 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:20.302248 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ecb50992-8271-4045-b22f-dcc7bc864c35 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:20.302705 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ecb50992-8271-4045-b22f-dcc7bc864c35 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:20.303469 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ecb50992-8271-4045-b22f-dcc7bc864c35 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:20.303912 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ecb50992-8271-4045-b22f-dcc7bc864c35 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:20.430817 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ecb50992-8271-4045-b22f-dcc7bc864c35 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:20.438708 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ecb50992-8271-4045-b22f-dcc7bc864c35 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148134 Jul 27 20:40:20.439274 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1730/3441] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:20 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:21.047557 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-284b67a8-2a96-4965-9f8c-4de952e9484c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:21.048156 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-284b67a8-2a96-4965-9f8c-4de952e9484c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:21.054594 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-284b67a8-2a96-4965-9f8c-4de952e9484c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:21.055034 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-284b67a8-2a96-4965-9f8c-4de952e9484c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:21.055784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-284b67a8-2a96-4965-9f8c-4de952e9484c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:21.056214 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-284b67a8-2a96-4965-9f8c-4de952e9484c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:21.416940 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-284b67a8-2a96-4965-9f8c-4de952e9484c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:21.425252 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-284b67a8-2a96-4965-9f8c-4de952e9484c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:21.426738 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-284b67a8-2a96-4965-9f8c-4de952e9484c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:21.427915 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-284b67a8-2a96-4965-9f8c-4de952e9484c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.384289 Jul 27 20:40:21.428463 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1712/3442] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:21 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:21.459483 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9d60d27d-203a-4898-bcf0-2717dd3225b2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:21.460127 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9d60d27d-203a-4898-bcf0-2717dd3225b2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:21.466669 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d60d27d-203a-4898-bcf0-2717dd3225b2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:21.467126 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d60d27d-203a-4898-bcf0-2717dd3225b2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:21.467906 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d60d27d-203a-4898-bcf0-2717dd3225b2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:21.468352 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d60d27d-203a-4898-bcf0-2717dd3225b2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:21.602608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9d60d27d-203a-4898-bcf0-2717dd3225b2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:21.611099 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9d60d27d-203a-4898-bcf0-2717dd3225b2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.155444 Jul 27 20:40:21.611691 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1731/3443] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:21 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:22.452576 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ac670b97-7feb-4f50-929f-2d6c4afd2c3a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:22.453450 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ac670b97-7feb-4f50-929f-2d6c4afd2c3a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:22.459902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ac670b97-7feb-4f50-929f-2d6c4afd2c3a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:22.460344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ac670b97-7feb-4f50-929f-2d6c4afd2c3a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:22.461121 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ac670b97-7feb-4f50-929f-2d6c4afd2c3a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:22.461550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ac670b97-7feb-4f50-929f-2d6c4afd2c3a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:22.590820 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ac670b97-7feb-4f50-929f-2d6c4afd2c3a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:22.599293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ac670b97-7feb-4f50-929f-2d6c4afd2c3a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:22.600741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ac670b97-7feb-4f50-929f-2d6c4afd2c3a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:22.601935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ac670b97-7feb-4f50-929f-2d6c4afd2c3a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153301 Jul 27 20:40:22.602496 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1713/3444] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:22 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:40:22.633113 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-965b93a9-36c4-4126-8a7e-674b95138317 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:22.633772 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-965b93a9-36c4-4126-8a7e-674b95138317 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:22.640757 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-965b93a9-36c4-4126-8a7e-674b95138317 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:22.641253 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-965b93a9-36c4-4126-8a7e-674b95138317 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:22.642023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-965b93a9-36c4-4126-8a7e-674b95138317 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:22.642468 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-965b93a9-36c4-4126-8a7e-674b95138317 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:22.774111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-965b93a9-36c4-4126-8a7e-674b95138317 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:22.782341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-965b93a9-36c4-4126-8a7e-674b95138317 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153072 Jul 27 20:40:22.782911 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1732/3445] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:22 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:23.625539 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-302961e9-98c7-4051-967b-be6264ed5e83 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:23.626143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-302961e9-98c7-4051-967b-be6264ed5e83 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:23.632606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-302961e9-98c7-4051-967b-be6264ed5e83 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:23.633091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-302961e9-98c7-4051-967b-be6264ed5e83 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:23.633843 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-302961e9-98c7-4051-967b-be6264ed5e83 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:23.634329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-302961e9-98c7-4051-967b-be6264ed5e83 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:23.764607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-302961e9-98c7-4051-967b-be6264ed5e83 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:23.773282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-302961e9-98c7-4051-967b-be6264ed5e83 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:23.774788 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-302961e9-98c7-4051-967b-be6264ed5e83 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:23.776615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-302961e9-98c7-4051-967b-be6264ed5e83 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.154911 Jul 27 20:40:23.777199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1714/3446] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:23 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:23.803376 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-74a9a61e-fd9d-4f48-bbad-b5f76085111f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:23.803994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-74a9a61e-fd9d-4f48-bbad-b5f76085111f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:23.810673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-74a9a61e-fd9d-4f48-bbad-b5f76085111f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:23.811161 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-74a9a61e-fd9d-4f48-bbad-b5f76085111f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:23.811954 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-74a9a61e-fd9d-4f48-bbad-b5f76085111f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:23.812395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-74a9a61e-fd9d-4f48-bbad-b5f76085111f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:23.944475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-74a9a61e-fd9d-4f48-bbad-b5f76085111f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:23.953330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-74a9a61e-fd9d-4f48-bbad-b5f76085111f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153448 Jul 27 20:40:23.953903 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1733/3447] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:23 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:24.799860 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b6d41363-a4bb-44e0-b18b-f22f85e3aa53 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:24.800456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b6d41363-a4bb-44e0-b18b-f22f85e3aa53 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:24.807741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6d41363-a4bb-44e0-b18b-f22f85e3aa53 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:24.808188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6d41363-a4bb-44e0-b18b-f22f85e3aa53 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:24.808948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6d41363-a4bb-44e0-b18b-f22f85e3aa53 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:24.809481 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6d41363-a4bb-44e0-b18b-f22f85e3aa53 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:24.938825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b6d41363-a4bb-44e0-b18b-f22f85e3aa53 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:24.946412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b6d41363-a4bb-44e0-b18b-f22f85e3aa53 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:24.948237 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b6d41363-a4bb-44e0-b18b-f22f85e3aa53 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:24.949426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b6d41363-a4bb-44e0-b18b-f22f85e3aa53 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153587 Jul 27 20:40:24.949989 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1715/3448] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:24 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:24.974760 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7b1f3c18-16f8-4aac-ba78-578f25b2ccf9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:24.975382 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7b1f3c18-16f8-4aac-ba78-578f25b2ccf9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:24.982590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7b1f3c18-16f8-4aac-ba78-578f25b2ccf9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:24.983047 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7b1f3c18-16f8-4aac-ba78-578f25b2ccf9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:24.983814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7b1f3c18-16f8-4aac-ba78-578f25b2ccf9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:24.984257 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7b1f3c18-16f8-4aac-ba78-578f25b2ccf9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:25.116385 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7b1f3c18-16f8-4aac-ba78-578f25b2ccf9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:25.124527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7b1f3c18-16f8-4aac-ba78-578f25b2ccf9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153577 Jul 27 20:40:25.125120 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1734/3449] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:24 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:25.973536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ecc3c97f-4f5d-4e9e-ab86-f6c3fe2a9162 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:25.974148 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ecc3c97f-4f5d-4e9e-ab86-f6c3fe2a9162 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:25.981120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ecc3c97f-4f5d-4e9e-ab86-f6c3fe2a9162 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:25.981575 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ecc3c97f-4f5d-4e9e-ab86-f6c3fe2a9162 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:25.982345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ecc3c97f-4f5d-4e9e-ab86-f6c3fe2a9162 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:25.982785 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ecc3c97f-4f5d-4e9e-ab86-f6c3fe2a9162 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:26.119874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ecc3c97f-4f5d-4e9e-ab86-f6c3fe2a9162 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:26.128306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ecc3c97f-4f5d-4e9e-ab86-f6c3fe2a9162 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:26.129827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ecc3c97f-4f5d-4e9e-ab86-f6c3fe2a9162 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:26.130994 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ecc3c97f-4f5d-4e9e-ab86-f6c3fe2a9162 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.161318 Jul 27 20:40:26.131555 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1716/3450] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:25 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:26.145302 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-74d06e67-545b-4abd-b329-0a803e014577 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:26.145920 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-74d06e67-545b-4abd-b329-0a803e014577 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:26.152746 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-74d06e67-545b-4abd-b329-0a803e014577 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:26.153234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-74d06e67-545b-4abd-b329-0a803e014577 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:26.154007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-74d06e67-545b-4abd-b329-0a803e014577 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:26.154885 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-74d06e67-545b-4abd-b329-0a803e014577 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:26.285034 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-74d06e67-545b-4abd-b329-0a803e014577 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:26.293791 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-74d06e67-545b-4abd-b329-0a803e014577 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152378 Jul 27 20:40:26.294354 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1735/3451] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:26 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:27.155372 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a661cf96-83b2-4b0d-9d6c-7306ad6382e1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:27.155992 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a661cf96-83b2-4b0d-9d6c-7306ad6382e1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:27.162566 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a661cf96-83b2-4b0d-9d6c-7306ad6382e1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:27.163134 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a661cf96-83b2-4b0d-9d6c-7306ad6382e1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:27.163953 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a661cf96-83b2-4b0d-9d6c-7306ad6382e1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:27.164448 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a661cf96-83b2-4b0d-9d6c-7306ad6382e1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:27.293228 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a661cf96-83b2-4b0d-9d6c-7306ad6382e1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:27.301471 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a661cf96-83b2-4b0d-9d6c-7306ad6382e1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:27.302945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a661cf96-83b2-4b0d-9d6c-7306ad6382e1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:27.304084 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a661cf96-83b2-4b0d-9d6c-7306ad6382e1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152632 Jul 27 20:40:27.304625 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1717/3452] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:27 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:27.315757 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-79eb07f9-e39b-40e3-8605-1badae03bf88 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:27.316383 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-79eb07f9-e39b-40e3-8605-1badae03bf88 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:27.323373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-79eb07f9-e39b-40e3-8605-1badae03bf88 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:27.323822 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-79eb07f9-e39b-40e3-8605-1badae03bf88 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:27.324587 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-79eb07f9-e39b-40e3-8605-1badae03bf88 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:27.325061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-79eb07f9-e39b-40e3-8605-1badae03bf88 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:27.450401 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-79eb07f9-e39b-40e3-8605-1badae03bf88 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:27.458532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-79eb07f9-e39b-40e3-8605-1badae03bf88 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.146776 Jul 27 20:40:27.459088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1736/3453] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:27 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:28.328554 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-736fb769-a61e-4869-8dfd-a87eada439b5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:28.329124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-736fb769-a61e-4869-8dfd-a87eada439b5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:28.335593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-736fb769-a61e-4869-8dfd-a87eada439b5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:28.336049 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-736fb769-a61e-4869-8dfd-a87eada439b5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:28.336805 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-736fb769-a61e-4869-8dfd-a87eada439b5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:28.337904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-736fb769-a61e-4869-8dfd-a87eada439b5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:28.464216 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-736fb769-a61e-4869-8dfd-a87eada439b5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:28.472574 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-736fb769-a61e-4869-8dfd-a87eada439b5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:28.474107 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-736fb769-a61e-4869-8dfd-a87eada439b5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:28.475270 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-736fb769-a61e-4869-8dfd-a87eada439b5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.150949 Jul 27 20:40:28.475831 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1718/3454] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:28 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:28.480329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-65cd72d5-da0e-485e-89bb-e968fe9ed9b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:28.480941 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-65cd72d5-da0e-485e-89bb-e968fe9ed9b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:28.487695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-65cd72d5-da0e-485e-89bb-e968fe9ed9b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:28.488152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-65cd72d5-da0e-485e-89bb-e968fe9ed9b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:28.488957 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-65cd72d5-da0e-485e-89bb-e968fe9ed9b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:28.489420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-65cd72d5-da0e-485e-89bb-e968fe9ed9b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:28.616146 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-65cd72d5-da0e-485e-89bb-e968fe9ed9b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:28.624779 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-65cd72d5-da0e-485e-89bb-e968fe9ed9b4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149181 Jul 27 20:40:28.625378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1737/3455] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:28 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:29.499727 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-11b6a4c3-f63d-4477-8ccf-b1bfb2c862c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:29.500348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-11b6a4c3-f63d-4477-8ccf-b1bfb2c862c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:29.506838 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11b6a4c3-f63d-4477-8ccf-b1bfb2c862c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:29.507276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11b6a4c3-f63d-4477-8ccf-b1bfb2c862c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:29.508018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11b6a4c3-f63d-4477-8ccf-b1bfb2c862c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:29.508447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11b6a4c3-f63d-4477-8ccf-b1bfb2c862c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:29.641314 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-11b6a4c3-f63d-4477-8ccf-b1bfb2c862c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:29.646028 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0bc6e580-cc51-44a5-94c1-44586a126320 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:29.646691 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0bc6e580-cc51-44a5-94c1-44586a126320 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:29.649611 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-11b6a4c3-f63d-4477-8ccf-b1bfb2c862c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:29.651101 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-11b6a4c3-f63d-4477-8ccf-b1bfb2c862c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:29.652249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-11b6a4c3-f63d-4477-8ccf-b1bfb2c862c9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156401 Jul 27 20:40:29.652795 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1719/3456] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:29 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:29.653233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0bc6e580-cc51-44a5-94c1-44586a126320 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:29.653790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0bc6e580-cc51-44a5-94c1-44586a126320 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:29.654575 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0bc6e580-cc51-44a5-94c1-44586a126320 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:29.655023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0bc6e580-cc51-44a5-94c1-44586a126320 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:29.786084 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0bc6e580-cc51-44a5-94c1-44586a126320 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:29.794944 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0bc6e580-cc51-44a5-94c1-44586a126320 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152799 Jul 27 20:40:29.795508 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1738/3457] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:29 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:30.675860 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-57a9ea58-6a1b-4033-bdd6-7e35c30b3fab tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:30.676449 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-57a9ea58-6a1b-4033-bdd6-7e35c30b3fab tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:30.683742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57a9ea58-6a1b-4033-bdd6-7e35c30b3fab tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:30.684180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57a9ea58-6a1b-4033-bdd6-7e35c30b3fab tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:30.684930 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57a9ea58-6a1b-4033-bdd6-7e35c30b3fab tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:30.685382 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57a9ea58-6a1b-4033-bdd6-7e35c30b3fab tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:30.815339 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-57a9ea58-6a1b-4033-bdd6-7e35c30b3fab tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:30.816294 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8abe80ee-4386-4223-9418-8314ff1192c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:30.816925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8abe80ee-4386-4223-9418-8314ff1192c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:30.823438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8abe80ee-4386-4223-9418-8314ff1192c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:30.823893 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8abe80ee-4386-4223-9418-8314ff1192c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:30.824209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-57a9ea58-6a1b-4033-bdd6-7e35c30b3fab tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:30.824666 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8abe80ee-4386-4223-9418-8314ff1192c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:30.825216 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8abe80ee-4386-4223-9418-8314ff1192c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:30.825938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-57a9ea58-6a1b-4033-bdd6-7e35c30b3fab tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:30.827154 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-57a9ea58-6a1b-4033-bdd6-7e35c30b3fab tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155207 Jul 27 20:40:30.828038 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1720/3458] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:30 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:30.951946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8abe80ee-4386-4223-9418-8314ff1192c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:30.960203 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8abe80ee-4386-4223-9418-8314ff1192c9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.147671 Jul 27 20:40:30.960773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1739/3459] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:30 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:31.850700 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e8511e75-1c27-4a4b-ba5b-37aff0a0dad7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:31.851400 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e8511e75-1c27-4a4b-ba5b-37aff0a0dad7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:31.857818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e8511e75-1c27-4a4b-ba5b-37aff0a0dad7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:31.858256 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e8511e75-1c27-4a4b-ba5b-37aff0a0dad7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:31.859004 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e8511e75-1c27-4a4b-ba5b-37aff0a0dad7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:31.859430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e8511e75-1c27-4a4b-ba5b-37aff0a0dad7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:31.982169 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-dc81e93b-a5b4-4606-830a-dd2cb84cfed6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:31.982813 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-dc81e93b-a5b4-4606-830a-dd2cb84cfed6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:31.989445 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc81e93b-a5b4-4606-830a-dd2cb84cfed6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:31.989899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc81e93b-a5b4-4606-830a-dd2cb84cfed6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:31.990142 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e8511e75-1c27-4a4b-ba5b-37aff0a0dad7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:31.990666 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc81e93b-a5b4-4606-830a-dd2cb84cfed6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:31.991108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc81e93b-a5b4-4606-830a-dd2cb84cfed6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:31.999496 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e8511e75-1c27-4a4b-ba5b-37aff0a0dad7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:32.000992 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e8511e75-1c27-4a4b-ba5b-37aff0a0dad7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:32.002145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e8511e75-1c27-4a4b-ba5b-37aff0a0dad7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155283 Jul 27 20:40:32.002692 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1721/3460] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:31 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:40:32.130660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-dc81e93b-a5b4-4606-830a-dd2cb84cfed6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:32.139261 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-dc81e93b-a5b4-4606-830a-dd2cb84cfed6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.160945 Jul 27 20:40:32.139845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1740/3461] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:31 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:33.026560 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1b06d6ab-1956-48a5-90e9-03b3d19da8d7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:33.027168 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1b06d6ab-1956-48a5-90e9-03b3d19da8d7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:33.033778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b06d6ab-1956-48a5-90e9-03b3d19da8d7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:33.034229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b06d6ab-1956-48a5-90e9-03b3d19da8d7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:33.034992 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b06d6ab-1956-48a5-90e9-03b3d19da8d7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:33.035430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b06d6ab-1956-48a5-90e9-03b3d19da8d7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:33.161227 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-82dea452-02e5-40e0-94ce-3b77174f4a13 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:33.161834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-82dea452-02e5-40e0-94ce-3b77174f4a13 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:33.168708 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-82dea452-02e5-40e0-94ce-3b77174f4a13 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:33.169178 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-82dea452-02e5-40e0-94ce-3b77174f4a13 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:33.170084 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-82dea452-02e5-40e0-94ce-3b77174f4a13 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:33.170362 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-82dea452-02e5-40e0-94ce-3b77174f4a13 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:33.172451 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1b06d6ab-1956-48a5-90e9-03b3d19da8d7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:33.180834 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1b06d6ab-1956-48a5-90e9-03b3d19da8d7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:33.182391 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1b06d6ab-1956-48a5-90e9-03b3d19da8d7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:33.183753 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1b06d6ab-1956-48a5-90e9-03b3d19da8d7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.161190 Jul 27 20:40:33.184542 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1722/3462] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:33 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:33.300747 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-82dea452-02e5-40e0-94ce-3b77174f4a13 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:33.308815 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-82dea452-02e5-40e0-94ce-3b77174f4a13 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151628 Jul 27 20:40:33.309400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1741/3463] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:33 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:34.207265 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a44d1506-23c1-454f-82fb-3bd1f6a4f87f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:34.207875 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a44d1506-23c1-454f-82fb-3bd1f6a4f87f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:34.214396 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a44d1506-23c1-454f-82fb-3bd1f6a4f87f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:34.214850 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a44d1506-23c1-454f-82fb-3bd1f6a4f87f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:34.215609 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a44d1506-23c1-454f-82fb-3bd1f6a4f87f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:34.216050 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a44d1506-23c1-454f-82fb-3bd1f6a4f87f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:34.330424 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-dc99aa0b-5b26-421f-a51d-6643f85d6509 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:34.330959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-dc99aa0b-5b26-421f-a51d-6643f85d6509 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:34.338029 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc99aa0b-5b26-421f-a51d-6643f85d6509 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:34.338492 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc99aa0b-5b26-421f-a51d-6643f85d6509 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:34.339266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc99aa0b-5b26-421f-a51d-6643f85d6509 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:34.339708 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dc99aa0b-5b26-421f-a51d-6643f85d6509 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:34.344709 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a44d1506-23c1-454f-82fb-3bd1f6a4f87f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:34.353615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a44d1506-23c1-454f-82fb-3bd1f6a4f87f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:34.355114 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a44d1506-23c1-454f-82fb-3bd1f6a4f87f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:34.356275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a44d1506-23c1-454f-82fb-3bd1f6a4f87f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153148 Jul 27 20:40:34.356833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1723/3464] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:34 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:34.466615 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-dc99aa0b-5b26-421f-a51d-6643f85d6509 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:34.474619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-dc99aa0b-5b26-421f-a51d-6643f85d6509 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148366 Jul 27 20:40:34.475188 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1742/3465] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:34 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:35.380673 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7486667a-ab6c-41ac-9183-1b9e19c63dd5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:35.381248 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7486667a-ab6c-41ac-9183-1b9e19c63dd5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:35.387945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7486667a-ab6c-41ac-9183-1b9e19c63dd5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:35.388395 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7486667a-ab6c-41ac-9183-1b9e19c63dd5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:35.389196 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7486667a-ab6c-41ac-9183-1b9e19c63dd5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:35.389634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7486667a-ab6c-41ac-9183-1b9e19c63dd5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:35.495497 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d0ff4791-1edb-4081-a8f3-0aa244ac80e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:35.496110 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d0ff4791-1edb-4081-a8f3-0aa244ac80e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:35.498511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=52 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:40:35.503837 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d0ff4791-1edb-4081-a8f3-0aa244ac80e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:35.504286 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d0ff4791-1edb-4081-a8f3-0aa244ac80e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:35.505077 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d0ff4791-1edb-4081-a8f3-0aa244ac80e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:35.505516 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d0ff4791-1edb-4081-a8f3-0aa244ac80e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:35.521451 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7486667a-ab6c-41ac-9183-1b9e19c63dd5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:35.530262 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7486667a-ab6c-41ac-9183-1b9e19c63dd5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:35.531780 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7486667a-ab6c-41ac-9183-1b9e19c63dd5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:35.532939 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7486667a-ab6c-41ac-9183-1b9e19c63dd5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156234 Jul 27 20:40:35.533514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1724/3466] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:35 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:40:35.640397 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d0ff4791-1edb-4081-a8f3-0aa244ac80e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:35.648257 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d0ff4791-1edb-4081-a8f3-0aa244ac80e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.156530 Jul 27 20:40:35.648816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1743/3467] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:35 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:36.557262 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-364a3904-41aa-432d-95e2-111ec4b9b3f7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:36.557862 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-364a3904-41aa-432d-95e2-111ec4b9b3f7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:36.564281 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-364a3904-41aa-432d-95e2-111ec4b9b3f7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:36.564728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-364a3904-41aa-432d-95e2-111ec4b9b3f7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:36.565514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-364a3904-41aa-432d-95e2-111ec4b9b3f7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:36.565950 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-364a3904-41aa-432d-95e2-111ec4b9b3f7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:36.671247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8a108756-d682-42e4-a1f5-6e3c1a4dd35e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:36.671996 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8a108756-d682-42e4-a1f5-6e3c1a4dd35e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:36.678479 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8a108756-d682-42e4-a1f5-6e3c1a4dd35e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:36.678940 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8a108756-d682-42e4-a1f5-6e3c1a4dd35e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:36.679710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8a108756-d682-42e4-a1f5-6e3c1a4dd35e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:36.680157 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8a108756-d682-42e4-a1f5-6e3c1a4dd35e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:36.692202 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-364a3904-41aa-432d-95e2-111ec4b9b3f7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:36.699173 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:40:36.701219 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-364a3904-41aa-432d-95e2-111ec4b9b3f7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:36.703042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-364a3904-41aa-432d-95e2-111ec4b9b3f7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:36.704249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-364a3904-41aa-432d-95e2-111ec4b9b3f7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.151591 Jul 27 20:40:36.704810 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1725/3468] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:36 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:40:36.809807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8a108756-d682-42e4-a1f5-6e3c1a4dd35e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:36.817598 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8a108756-d682-42e4-a1f5-6e3c1a4dd35e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150171 Jul 27 20:40:36.818162 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1744/3469] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:36 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:37.727689 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-38b5dcbf-33e0-4c4f-bb10-4b36ea0f6d65 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:37.728317 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-38b5dcbf-33e0-4c4f-bb10-4b36ea0f6d65 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:37.730658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=52 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:40:37.735952 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-38b5dcbf-33e0-4c4f-bb10-4b36ea0f6d65 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:37.736405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-38b5dcbf-33e0-4c4f-bb10-4b36ea0f6d65 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:37.737335 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-38b5dcbf-33e0-4c4f-bb10-4b36ea0f6d65 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:37.737775 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-38b5dcbf-33e0-4c4f-bb10-4b36ea0f6d65 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:37.839513 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a1696128-6d11-44a3-a98f-761e31ede38a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:37.840130 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a1696128-6d11-44a3-a98f-761e31ede38a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:37.846633 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a1696128-6d11-44a3-a98f-761e31ede38a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:37.847323 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a1696128-6d11-44a3-a98f-761e31ede38a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:37.848092 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a1696128-6d11-44a3-a98f-761e31ede38a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:37.848534 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a1696128-6d11-44a3-a98f-761e31ede38a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:37.879405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-38b5dcbf-33e0-4c4f-bb10-4b36ea0f6d65 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:37.888906 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-38b5dcbf-33e0-4c4f-bb10-4b36ea0f6d65 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:37.890433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-38b5dcbf-33e0-4c4f-bb10-4b36ea0f6d65 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:37.891614 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-38b5dcbf-33e0-4c4f-bb10-4b36ea0f6d65 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.167964 Jul 27 20:40:37.892180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1726/3470] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:37 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:37.981263 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a1696128-6d11-44a3-a98f-761e31ede38a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:37.989121 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a1696128-6d11-44a3-a98f-761e31ede38a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153865 Jul 27 20:40:37.989683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1745/3471] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:37 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:38.743296 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e0358924-8664-48c0-880d-ed205023ec99 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:38.743980 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e0358924-8664-48c0-880d-ed205023ec99 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:38.750541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0358924-8664-48c0-880d-ed205023ec99 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:38.750985 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0358924-8664-48c0-880d-ed205023ec99 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:38.751803 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0358924-8664-48c0-880d-ed205023ec99 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:38.752241 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0358924-8664-48c0-880d-ed205023ec99 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:38.755978 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:40:38.776308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e0358924-8664-48c0-880d-ed205023ec99 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/ips" status: 200 len: 145 microversion: 2.1 time: 0.036881 Jul 27 20:40:38.776866 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1727/3472] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Jul 27 20:40:38 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:40:38.915113 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-93c8b076-8ed6-4490-aff7-2dc86d700ee5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:38.915729 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-93c8b076-8ed6-4490-aff7-2dc86d700ee5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:38.922371 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-93c8b076-8ed6-4490-aff7-2dc86d700ee5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:38.922826 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-93c8b076-8ed6-4490-aff7-2dc86d700ee5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:38.923595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-93c8b076-8ed6-4490-aff7-2dc86d700ee5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:38.924042 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-93c8b076-8ed6-4490-aff7-2dc86d700ee5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:39.010620 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-733ea0c8-4e82-48bc-80b2-2f33dce9cce4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:39.011222 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-733ea0c8-4e82-48bc-80b2-2f33dce9cce4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:39.018694 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-733ea0c8-4e82-48bc-80b2-2f33dce9cce4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:39.019149 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-733ea0c8-4e82-48bc-80b2-2f33dce9cce4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:39.020015 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-733ea0c8-4e82-48bc-80b2-2f33dce9cce4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:39.020457 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-733ea0c8-4e82-48bc-80b2-2f33dce9cce4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:39.055516 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-93c8b076-8ed6-4490-aff7-2dc86d700ee5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:39.066101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-93c8b076-8ed6-4490-aff7-2dc86d700ee5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:39.067615 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-93c8b076-8ed6-4490-aff7-2dc86d700ee5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:39.068798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-93c8b076-8ed6-4490-aff7-2dc86d700ee5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157646 Jul 27 20:40:39.069710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1746/3473] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:38 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:39.153945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-733ea0c8-4e82-48bc-80b2-2f33dce9cce4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:39.161693 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-733ea0c8-4e82-48bc-80b2-2f33dce9cce4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.155423 Jul 27 20:40:39.162251 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1728/3474] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:39 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:40.092605 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f711e992-37ff-4c51-a7a2-dea1360dcc75 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:40.093333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f711e992-37ff-4c51-a7a2-dea1360dcc75 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:40.099809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f711e992-37ff-4c51-a7a2-dea1360dcc75 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:40.100264 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f711e992-37ff-4c51-a7a2-dea1360dcc75 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:40.101105 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f711e992-37ff-4c51-a7a2-dea1360dcc75 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:40.101548 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f711e992-37ff-4c51-a7a2-dea1360dcc75 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:40.184770 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dfb6f140-94cf-4343-a792-0f9026155498 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:40.185350 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dfb6f140-94cf-4343-a792-0f9026155498 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:40.191630 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dfb6f140-94cf-4343-a792-0f9026155498 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:40.192083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dfb6f140-94cf-4343-a792-0f9026155498 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:40.193119 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dfb6f140-94cf-4343-a792-0f9026155498 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:40.193802 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dfb6f140-94cf-4343-a792-0f9026155498 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:40.237918 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f711e992-37ff-4c51-a7a2-dea1360dcc75 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:40.247463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f711e992-37ff-4c51-a7a2-dea1360dcc75 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:40.248987 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f711e992-37ff-4c51-a7a2-dea1360dcc75 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:40.250542 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f711e992-37ff-4c51-a7a2-dea1360dcc75 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.161934 Jul 27 20:40:40.251106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1747/3475] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:40 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:40.358540 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dfb6f140-94cf-4343-a792-0f9026155498 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:40.367329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dfb6f140-94cf-4343-a792-0f9026155498 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.187497 Jul 27 20:40:40.367892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1729/3476] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:40 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:41.275545 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-41c1c961-84df-4d83-b7ee-12679226f173 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:41.276236 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-41c1c961-84df-4d83-b7ee-12679226f173 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:41.282715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41c1c961-84df-4d83-b7ee-12679226f173 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:41.283166 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41c1c961-84df-4d83-b7ee-12679226f173 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:41.283919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41c1c961-84df-4d83-b7ee-12679226f173 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:41.284356 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-41c1c961-84df-4d83-b7ee-12679226f173 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:41.389521 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8a50b477-3901-4b2c-b89f-4ee582880126 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:41.390348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8a50b477-3901-4b2c-b89f-4ee582880126 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:41.396849 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8a50b477-3901-4b2c-b89f-4ee582880126 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:41.397341 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8a50b477-3901-4b2c-b89f-4ee582880126 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:41.398102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8a50b477-3901-4b2c-b89f-4ee582880126 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:41.398540 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8a50b477-3901-4b2c-b89f-4ee582880126 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:41.411881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-41c1c961-84df-4d83-b7ee-12679226f173 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:41.420512 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-41c1c961-84df-4d83-b7ee-12679226f173 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:41.422089 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-41c1c961-84df-4d83-b7ee-12679226f173 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:41.423295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-41c1c961-84df-4d83-b7ee-12679226f173 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152357 Jul 27 20:40:41.424139 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1748/3477] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:41 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:41.530647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8a50b477-3901-4b2c-b89f-4ee582880126 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:41.538658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8a50b477-3901-4b2c-b89f-4ee582880126 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152914 Jul 27 20:40:41.539226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1730/3478] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:41 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:42.447041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0e6a3ace-97ce-4880-86ff-fd360088f784 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:42.448329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0e6a3ace-97ce-4880-86ff-fd360088f784 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:42.455545 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e6a3ace-97ce-4880-86ff-fd360088f784 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:42.456001 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e6a3ace-97ce-4880-86ff-fd360088f784 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:42.456777 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e6a3ace-97ce-4880-86ff-fd360088f784 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:42.457255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0e6a3ace-97ce-4880-86ff-fd360088f784 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:42.559456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1cc3ae12-e9fc-4e53-a559-940534dd5169 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:42.560063 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1cc3ae12-e9fc-4e53-a559-940534dd5169 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:42.566657 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cc3ae12-e9fc-4e53-a559-940534dd5169 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:42.567107 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cc3ae12-e9fc-4e53-a559-940534dd5169 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:42.567865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cc3ae12-e9fc-4e53-a559-940534dd5169 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:42.568302 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cc3ae12-e9fc-4e53-a559-940534dd5169 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:42.584000 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0e6a3ace-97ce-4880-86ff-fd360088f784 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:42.593120 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0e6a3ace-97ce-4880-86ff-fd360088f784 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:42.594641 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0e6a3ace-97ce-4880-86ff-fd360088f784 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:42.595822 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0e6a3ace-97ce-4880-86ff-fd360088f784 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152683 Jul 27 20:40:42.596386 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1749/3479] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:42 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:42.700438 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1cc3ae12-e9fc-4e53-a559-940534dd5169 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:42.708709 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1cc3ae12-e9fc-4e53-a559-940534dd5169 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153697 Jul 27 20:40:42.709300 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1731/3480] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:42 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:43.619006 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-200c687a-fe66-4393-ad3c-4830e69f765f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:43.620299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-200c687a-fe66-4393-ad3c-4830e69f765f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:43.626826 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-200c687a-fe66-4393-ad3c-4830e69f765f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:43.627280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-200c687a-fe66-4393-ad3c-4830e69f765f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:43.628048 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-200c687a-fe66-4393-ad3c-4830e69f765f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:43.628494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-200c687a-fe66-4393-ad3c-4830e69f765f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:43.729920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-02757c67-32d0-4068-aaea-38a38baca8d6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:43.730562 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-02757c67-32d0-4068-aaea-38a38baca8d6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:43.737029 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02757c67-32d0-4068-aaea-38a38baca8d6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:43.737486 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02757c67-32d0-4068-aaea-38a38baca8d6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:43.738286 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02757c67-32d0-4068-aaea-38a38baca8d6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:43.738728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02757c67-32d0-4068-aaea-38a38baca8d6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:43.758507 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-200c687a-fe66-4393-ad3c-4830e69f765f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:43.767689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-200c687a-fe66-4393-ad3c-4830e69f765f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:43.769232 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-200c687a-fe66-4393-ad3c-4830e69f765f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:43.770408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-200c687a-fe66-4393-ad3c-4830e69f765f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155339 Jul 27 20:40:43.771051 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1750/3481] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:43 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:43.865707 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-02757c67-32d0-4068-aaea-38a38baca8d6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:43.874157 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-02757c67-32d0-4068-aaea-38a38baca8d6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148206 Jul 27 20:40:43.874723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1732/3482] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:43 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:44.793488 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3c2da37e-2c05-4d31-9e0b-9490b35e3aee tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:44.794062 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3c2da37e-2c05-4d31-9e0b-9490b35e3aee tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:44.800611 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c2da37e-2c05-4d31-9e0b-9490b35e3aee tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:44.801096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c2da37e-2c05-4d31-9e0b-9490b35e3aee tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:44.801873 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c2da37e-2c05-4d31-9e0b-9490b35e3aee tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:44.802316 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3c2da37e-2c05-4d31-9e0b-9490b35e3aee tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:44.895669 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-38b0cad8-fd28-4fd9-9e03-e8b4b0d5a1e0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:44.896393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-38b0cad8-fd28-4fd9-9e03-e8b4b0d5a1e0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:44.903484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-38b0cad8-fd28-4fd9-9e03-e8b4b0d5a1e0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:44.903935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-38b0cad8-fd28-4fd9-9e03-e8b4b0d5a1e0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:44.904705 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-38b0cad8-fd28-4fd9-9e03-e8b4b0d5a1e0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:44.905350 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-38b0cad8-fd28-4fd9-9e03-e8b4b0d5a1e0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:44.933611 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3c2da37e-2c05-4d31-9e0b-9490b35e3aee tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:44.941973 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3c2da37e-2c05-4d31-9e0b-9490b35e3aee tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:44.943469 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3c2da37e-2c05-4d31-9e0b-9490b35e3aee tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:44.944633 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3c2da37e-2c05-4d31-9e0b-9490b35e3aee tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155252 Jul 27 20:40:44.948068 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1751/3483] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:44 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:45.036176 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-38b0cad8-fd28-4fd9-9e03-e8b4b0d5a1e0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:45.044302 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-38b0cad8-fd28-4fd9-9e03-e8b4b0d5a1e0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152490 Jul 27 20:40:45.044814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1733/3484] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:44 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:45.969304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e2feb76f-7e94-4c10-971b-49667ade727a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:45.969918 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e2feb76f-7e94-4c10-971b-49667ade727a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:45.976401 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e2feb76f-7e94-4c10-971b-49667ade727a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:45.976857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e2feb76f-7e94-4c10-971b-49667ade727a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:45.977662 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e2feb76f-7e94-4c10-971b-49667ade727a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:45.978101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e2feb76f-7e94-4c10-971b-49667ade727a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:46.066566 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c9fbbae1-703d-45c0-9177-ca22d4841d75 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:46.067201 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c9fbbae1-703d-45c0-9177-ca22d4841d75 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:46.073959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9fbbae1-703d-45c0-9177-ca22d4841d75 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:46.074462 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9fbbae1-703d-45c0-9177-ca22d4841d75 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:46.075238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9fbbae1-703d-45c0-9177-ca22d4841d75 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:46.075666 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9fbbae1-703d-45c0-9177-ca22d4841d75 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:46.113307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e2feb76f-7e94-4c10-971b-49667ade727a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:46.122108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e2feb76f-7e94-4c10-971b-49667ade727a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:46.123645 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e2feb76f-7e94-4c10-971b-49667ade727a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:46.124993 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e2feb76f-7e94-4c10-971b-49667ade727a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.159512 Jul 27 20:40:46.126207 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1752/3485] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:45 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:46.215137 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c9fbbae1-703d-45c0-9177-ca22d4841d75 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:46.222929 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c9fbbae1-703d-45c0-9177-ca22d4841d75 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.160215 Jul 27 20:40:46.223484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1734/3486] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:46 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:47.150256 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3047a2b2-bd01-48ff-8a73-e4b0efac0742 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:47.151248 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3047a2b2-bd01-48ff-8a73-e4b0efac0742 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:47.157907 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3047a2b2-bd01-48ff-8a73-e4b0efac0742 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:47.158453 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3047a2b2-bd01-48ff-8a73-e4b0efac0742 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:47.159309 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3047a2b2-bd01-48ff-8a73-e4b0efac0742 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:47.159771 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3047a2b2-bd01-48ff-8a73-e4b0efac0742 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:47.243872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-26439747-f9bd-49e4-8131-d63c6540e737 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:47.245184 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-26439747-f9bd-49e4-8131-d63c6540e737 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:47.251510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-26439747-f9bd-49e4-8131-d63c6540e737 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:47.251970 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-26439747-f9bd-49e4-8131-d63c6540e737 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:47.252732 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-26439747-f9bd-49e4-8131-d63c6540e737 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:47.253219 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-26439747-f9bd-49e4-8131-d63c6540e737 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:47.296998 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3047a2b2-bd01-48ff-8a73-e4b0efac0742 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:47.305613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3047a2b2-bd01-48ff-8a73-e4b0efac0742 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:47.307695 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3047a2b2-bd01-48ff-8a73-e4b0efac0742 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:47.308874 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3047a2b2-bd01-48ff-8a73-e4b0efac0742 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.162546 Jul 27 20:40:47.309464 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1753/3487] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:47 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:47.382257 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-26439747-f9bd-49e4-8131-d63c6540e737 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:47.390249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-26439747-f9bd-49e4-8131-d63c6540e737 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150213 Jul 27 20:40:47.390809 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1735/3488] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:47 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:48.332104 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5be8e6fb-9850-4ece-95af-ae7810cb820b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:48.332638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5be8e6fb-9850-4ece-95af-ae7810cb820b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:48.339655 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5be8e6fb-9850-4ece-95af-ae7810cb820b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:48.340081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5be8e6fb-9850-4ece-95af-ae7810cb820b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:48.340829 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5be8e6fb-9850-4ece-95af-ae7810cb820b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:48.341296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5be8e6fb-9850-4ece-95af-ae7810cb820b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:48.411689 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2b6523e5-b29f-46ba-a487-0078c9762f0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:48.412423 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2b6523e5-b29f-46ba-a487-0078c9762f0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:48.419889 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b6523e5-b29f-46ba-a487-0078c9762f0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:48.420349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b6523e5-b29f-46ba-a487-0078c9762f0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:48.421149 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b6523e5-b29f-46ba-a487-0078c9762f0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:48.421594 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b6523e5-b29f-46ba-a487-0078c9762f0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:48.469140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5be8e6fb-9850-4ece-95af-ae7810cb820b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:48.477745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5be8e6fb-9850-4ece-95af-ae7810cb820b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:48.480081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5be8e6fb-9850-4ece-95af-ae7810cb820b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:48.481284 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5be8e6fb-9850-4ece-95af-ae7810cb820b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153350 Jul 27 20:40:48.481858 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1754/3489] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:48 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:48.560560 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2b6523e5-b29f-46ba-a487-0078c9762f0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:48.568532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2b6523e5-b29f-46ba-a487-0078c9762f0b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.160737 Jul 27 20:40:48.569119 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1736/3490] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:48 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:49.505820 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ca4fb3eb-4f6f-481d-af83-3c5b03ba26e6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:49.506437 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ca4fb3eb-4f6f-481d-af83-3c5b03ba26e6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:49.513623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ca4fb3eb-4f6f-481d-af83-3c5b03ba26e6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:49.514076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ca4fb3eb-4f6f-481d-af83-3c5b03ba26e6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:49.514842 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ca4fb3eb-4f6f-481d-af83-3c5b03ba26e6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:49.515287 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ca4fb3eb-4f6f-481d-af83-3c5b03ba26e6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:49.591424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6eda5858-fa73-4262-9fc8-d474c93c4b70 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:49.592109 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6eda5858-fa73-4262-9fc8-d474c93c4b70 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:49.598732 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6eda5858-fa73-4262-9fc8-d474c93c4b70 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:49.599176 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6eda5858-fa73-4262-9fc8-d474c93c4b70 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:49.599940 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6eda5858-fa73-4262-9fc8-d474c93c4b70 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:49.600533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6eda5858-fa73-4262-9fc8-d474c93c4b70 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:49.653065 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ca4fb3eb-4f6f-481d-af83-3c5b03ba26e6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:49.661440 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ca4fb3eb-4f6f-481d-af83-3c5b03ba26e6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:49.662950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ca4fb3eb-4f6f-481d-af83-3c5b03ba26e6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:49.664108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ca4fb3eb-4f6f-481d-af83-3c5b03ba26e6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.162201 Jul 27 20:40:49.664659 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1755/3491] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:49 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:49.732442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6eda5858-fa73-4262-9fc8-d474c93c4b70 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:49.740413 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6eda5858-fa73-4262-9fc8-d474c93c4b70 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153635 Jul 27 20:40:49.740998 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1737/3492] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:49 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:50.687935 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fa5ee2ab-5b7f-47d4-8c47-f5c7ba057c38 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:50.688559 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fa5ee2ab-5b7f-47d4-8c47-f5c7ba057c38 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:50.695191 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa5ee2ab-5b7f-47d4-8c47-f5c7ba057c38 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:50.695645 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa5ee2ab-5b7f-47d4-8c47-f5c7ba057c38 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:50.696403 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa5ee2ab-5b7f-47d4-8c47-f5c7ba057c38 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:50.696841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fa5ee2ab-5b7f-47d4-8c47-f5c7ba057c38 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:50.763016 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7434f0f9-655e-4b90-b317-11d44c412e1d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:50.763633 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7434f0f9-655e-4b90-b317-11d44c412e1d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:50.770069 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7434f0f9-655e-4b90-b317-11d44c412e1d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:50.770521 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7434f0f9-655e-4b90-b317-11d44c412e1d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:50.771287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7434f0f9-655e-4b90-b317-11d44c412e1d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:50.771719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7434f0f9-655e-4b90-b317-11d44c412e1d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:50.827429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fa5ee2ab-5b7f-47d4-8c47-f5c7ba057c38 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:50.836647 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fa5ee2ab-5b7f-47d4-8c47-f5c7ba057c38 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:50.838951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fa5ee2ab-5b7f-47d4-8c47-f5c7ba057c38 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:50.840364 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fa5ee2ab-5b7f-47d4-8c47-f5c7ba057c38 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156308 Jul 27 20:40:50.840928 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1756/3493] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:50 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:50.904763 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7434f0f9-655e-4b90-b317-11d44c412e1d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:50.912589 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7434f0f9-655e-4b90-b317-11d44c412e1d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.154120 Jul 27 20:40:50.913181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1738/3494] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:50 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:51.863619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0da3609b-8e98-4ea4-a40e-14be20f9b393 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:51.864262 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0da3609b-8e98-4ea4-a40e-14be20f9b393 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:51.871509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0da3609b-8e98-4ea4-a40e-14be20f9b393 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:51.871961 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0da3609b-8e98-4ea4-a40e-14be20f9b393 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:51.872725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0da3609b-8e98-4ea4-a40e-14be20f9b393 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:51.873203 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0da3609b-8e98-4ea4-a40e-14be20f9b393 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:51.932824 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4ee0c496-7805-4f9a-ad80-da85986d192e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:51.933507 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4ee0c496-7805-4f9a-ad80-da85986d192e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:51.940083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ee0c496-7805-4f9a-ad80-da85986d192e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:51.940533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ee0c496-7805-4f9a-ad80-da85986d192e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:51.941330 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ee0c496-7805-4f9a-ad80-da85986d192e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:51.941768 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ee0c496-7805-4f9a-ad80-da85986d192e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:52.005987 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0da3609b-8e98-4ea4-a40e-14be20f9b393 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:52.014654 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0da3609b-8e98-4ea4-a40e-14be20f9b393 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:52.016123 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0da3609b-8e98-4ea4-a40e-14be20f9b393 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:52.017378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0da3609b-8e98-4ea4-a40e-14be20f9b393 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157683 Jul 27 20:40:52.018152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1757/3495] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:51 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:52.073985 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4ee0c496-7805-4f9a-ad80-da85986d192e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:52.082261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4ee0c496-7805-4f9a-ad80-da85986d192e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153410 Jul 27 20:40:52.082822 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1739/3496] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:51 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:53.041879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c61e48b7-079d-4844-ba2f-419bc865e9a8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:53.042515 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c61e48b7-079d-4844-ba2f-419bc865e9a8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:53.049049 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c61e48b7-079d-4844-ba2f-419bc865e9a8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:53.049515 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c61e48b7-079d-4844-ba2f-419bc865e9a8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:53.050282 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c61e48b7-079d-4844-ba2f-419bc865e9a8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:53.050728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c61e48b7-079d-4844-ba2f-419bc865e9a8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:53.104115 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-af20e47d-1d6f-4bf6-bc2d-e31016d93d43 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:53.104854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-af20e47d-1d6f-4bf6-bc2d-e31016d93d43 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:53.111409 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af20e47d-1d6f-4bf6-bc2d-e31016d93d43 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:53.111858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af20e47d-1d6f-4bf6-bc2d-e31016d93d43 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:53.112622 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af20e47d-1d6f-4bf6-bc2d-e31016d93d43 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:53.113085 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af20e47d-1d6f-4bf6-bc2d-e31016d93d43 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:53.178237 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c61e48b7-079d-4844-ba2f-419bc865e9a8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:53.187206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c61e48b7-079d-4844-ba2f-419bc865e9a8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:53.188721 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c61e48b7-079d-4844-ba2f-419bc865e9a8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:53.189914 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c61e48b7-079d-4844-ba2f-419bc865e9a8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152598 Jul 27 20:40:53.190471 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1758/3497] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:53 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:53.248794 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-af20e47d-1d6f-4bf6-bc2d-e31016d93d43 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:53.256658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-af20e47d-1d6f-4bf6-bc2d-e31016d93d43 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.156912 Jul 27 20:40:53.257257 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1740/3498] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:53 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:54.214418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0a4dc963-b269-44f3-8951-a42d13145f97 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:54.215032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0a4dc963-b269-44f3-8951-a42d13145f97 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:54.221673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a4dc963-b269-44f3-8951-a42d13145f97 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:54.222133 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a4dc963-b269-44f3-8951-a42d13145f97 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:54.222901 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a4dc963-b269-44f3-8951-a42d13145f97 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:54.223347 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a4dc963-b269-44f3-8951-a42d13145f97 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:54.278726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f7534ae4-724e-4ad6-82e4-0be472e0d557 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:54.279441 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f7534ae4-724e-4ad6-82e4-0be472e0d557 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:54.286078 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f7534ae4-724e-4ad6-82e4-0be472e0d557 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:54.286596 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f7534ae4-724e-4ad6-82e4-0be472e0d557 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:54.287420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f7534ae4-724e-4ad6-82e4-0be472e0d557 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:54.287846 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f7534ae4-724e-4ad6-82e4-0be472e0d557 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:54.355575 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0a4dc963-b269-44f3-8951-a42d13145f97 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:54.364017 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0a4dc963-b269-44f3-8951-a42d13145f97 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:54.365597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0a4dc963-b269-44f3-8951-a42d13145f97 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:54.366769 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0a4dc963-b269-44f3-8951-a42d13145f97 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156878 Jul 27 20:40:54.367336 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1759/3499] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:54 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:54.420560 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f7534ae4-724e-4ad6-82e4-0be472e0d557 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:54.428336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f7534ae4-724e-4ad6-82e4-0be472e0d557 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.154158 Jul 27 20:40:54.428898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1741/3500] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:54 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:55.390263 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-77c7606d-062c-44e9-add3-ddb5b895e25b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:55.390983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-77c7606d-062c-44e9-add3-ddb5b895e25b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:55.397590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-77c7606d-062c-44e9-add3-ddb5b895e25b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:55.398051 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-77c7606d-062c-44e9-add3-ddb5b895e25b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:55.398817 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-77c7606d-062c-44e9-add3-ddb5b895e25b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:55.399265 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-77c7606d-062c-44e9-add3-ddb5b895e25b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:55.449422 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6d798353-0356-45f9-8354-3d33597280bc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:55.450043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6d798353-0356-45f9-8354-3d33597280bc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:55.456768 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6d798353-0356-45f9-8354-3d33597280bc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:55.457251 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6d798353-0356-45f9-8354-3d33597280bc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:55.458025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6d798353-0356-45f9-8354-3d33597280bc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:55.458482 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6d798353-0356-45f9-8354-3d33597280bc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:55.530562 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-77c7606d-062c-44e9-add3-ddb5b895e25b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:55.538998 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-77c7606d-062c-44e9-add3-ddb5b895e25b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:55.540515 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-77c7606d-062c-44e9-add3-ddb5b895e25b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:55.542456 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-77c7606d-062c-44e9-add3-ddb5b895e25b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155967 Jul 27 20:40:55.543019 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1760/3501] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:55 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:55.588305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6d798353-0356-45f9-8354-3d33597280bc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:55.596602 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6d798353-0356-45f9-8354-3d33597280bc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151055 Jul 27 20:40:55.597193 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1742/3502] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:55 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:56.565502 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3104919b-d3ab-44f4-871b-630181a8442d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:56.566121 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3104919b-d3ab-44f4-871b-630181a8442d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:56.573818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3104919b-d3ab-44f4-871b-630181a8442d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:56.574269 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3104919b-d3ab-44f4-871b-630181a8442d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:56.575036 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3104919b-d3ab-44f4-871b-630181a8442d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:56.575470 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3104919b-d3ab-44f4-871b-630181a8442d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:56.579693 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:40:56.618408 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-12f63fac-0275-4638-8dae-df99d01a2925 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:56.619553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-12f63fac-0275-4638-8dae-df99d01a2925 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:56.626248 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12f63fac-0275-4638-8dae-df99d01a2925 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:56.626702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12f63fac-0275-4638-8dae-df99d01a2925 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:56.627473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12f63fac-0275-4638-8dae-df99d01a2925 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:56.627913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12f63fac-0275-4638-8dae-df99d01a2925 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:56.707143 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3104919b-d3ab-44f4-871b-630181a8442d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:56.715817 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3104919b-d3ab-44f4-871b-630181a8442d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:56.717343 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3104919b-d3ab-44f4-871b-630181a8442d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:56.718512 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3104919b-d3ab-44f4-871b-630181a8442d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156905 Jul 27 20:40:56.719071 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1761/3503] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:56 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:56.762000 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-12f63fac-0275-4638-8dae-df99d01a2925 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:56.769908 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-12f63fac-0275-4638-8dae-df99d01a2925 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.155382 Jul 27 20:40:56.770472 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1743/3504] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:56 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:40:57.742774 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cecd740e-5035-43e0-8913-239432e214dc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:57.743535 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cecd740e-5035-43e0-8913-239432e214dc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:57.750798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cecd740e-5035-43e0-8913-239432e214dc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:57.751353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cecd740e-5035-43e0-8913-239432e214dc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:57.752245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cecd740e-5035-43e0-8913-239432e214dc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:57.752705 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cecd740e-5035-43e0-8913-239432e214dc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:57.790682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0b8ca289-75bc-4be4-a79a-f6ae67b972cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:57.791181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0b8ca289-75bc-4be4-a79a-f6ae67b972cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:57.797848 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b8ca289-75bc-4be4-a79a-f6ae67b972cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:57.798290 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b8ca289-75bc-4be4-a79a-f6ae67b972cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:57.799043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b8ca289-75bc-4be4-a79a-f6ae67b972cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:57.799471 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b8ca289-75bc-4be4-a79a-f6ae67b972cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:57.803533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:40:57.889073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cecd740e-5035-43e0-8913-239432e214dc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:57.897781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cecd740e-5035-43e0-8913-239432e214dc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:57.899294 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cecd740e-5035-43e0-8913-239432e214dc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:57.900462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cecd740e-5035-43e0-8913-239432e214dc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.161772 Jul 27 20:40:57.901178 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1762/3505] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:57 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:57.931187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0b8ca289-75bc-4be4-a79a-f6ae67b972cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:57.939928 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0b8ca289-75bc-4be4-a79a-f6ae67b972cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153389 Jul 27 20:40:57.940486 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1744/3506] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:57 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:40:58.924273 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-62a1d8b3-3600-4f89-a8c6-4fa07ed1f651 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:58.925079 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-62a1d8b3-3600-4f89-a8c6-4fa07ed1f651 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:58.931450 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-62a1d8b3-3600-4f89-a8c6-4fa07ed1f651 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:58.931908 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-62a1d8b3-3600-4f89-a8c6-4fa07ed1f651 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:58.932675 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-62a1d8b3-3600-4f89-a8c6-4fa07ed1f651 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:58.933280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-62a1d8b3-3600-4f89-a8c6-4fa07ed1f651 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:58.962602 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dd819f4e-ce43-4854-8ff9-bec54dc15701 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:40:58.963336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dd819f4e-ce43-4854-8ff9-bec54dc15701 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:40:58.970469 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd819f4e-ce43-4854-8ff9-bec54dc15701 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:58.970962 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd819f4e-ce43-4854-8ff9-bec54dc15701 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:58.971773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd819f4e-ce43-4854-8ff9-bec54dc15701 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:40:58.972209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd819f4e-ce43-4854-8ff9-bec54dc15701 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:40:59.069461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-62a1d8b3-3600-4f89-a8c6-4fa07ed1f651 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:59.080137 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-62a1d8b3-3600-4f89-a8c6-4fa07ed1f651 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:59.081702 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-62a1d8b3-3600-4f89-a8c6-4fa07ed1f651 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:59.082867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-62a1d8b3-3600-4f89-a8c6-4fa07ed1f651 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.162548 Jul 27 20:40:59.083426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1763/3507] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:40:58 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:40:59.110964 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dd819f4e-ce43-4854-8ff9-bec54dc15701 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:40:59.118968 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dd819f4e-ce43-4854-8ff9-bec54dc15701 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.160156 Jul 27 20:40:59.119527 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1745/3508] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:40:58 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:41:00.108171 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-63b22a47-0d7b-4850-a4b3-57f179c3fd39 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:00.108786 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-63b22a47-0d7b-4850-a4b3-57f179c3fd39 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:00.115376 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63b22a47-0d7b-4850-a4b3-57f179c3fd39 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:00.115835 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63b22a47-0d7b-4850-a4b3-57f179c3fd39 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:00.116600 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63b22a47-0d7b-4850-a4b3-57f179c3fd39 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:00.117083 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63b22a47-0d7b-4850-a4b3-57f179c3fd39 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:00.139547 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-65a720f9-52be-4cbd-b3c6-f7e848d724df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:00.140157 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-65a720f9-52be-4cbd-b3c6-f7e848d724df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:00.146512 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65a720f9-52be-4cbd-b3c6-f7e848d724df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:00.146951 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65a720f9-52be-4cbd-b3c6-f7e848d724df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:00.147727 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65a720f9-52be-4cbd-b3c6-f7e848d724df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:00.148158 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65a720f9-52be-4cbd-b3c6-f7e848d724df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:00.257437 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-63b22a47-0d7b-4850-a4b3-57f179c3fd39 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:00.266205 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-63b22a47-0d7b-4850-a4b3-57f179c3fd39 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:00.267715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-63b22a47-0d7b-4850-a4b3-57f179c3fd39 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:00.268884 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-63b22a47-0d7b-4850-a4b3-57f179c3fd39 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.165407 Jul 27 20:41:00.269467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1764/3509] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:00 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:41:00.279932 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-65a720f9-52be-4cbd-b3c6-f7e848d724df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:00.287787 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-65a720f9-52be-4cbd-b3c6-f7e848d724df tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152146 Jul 27 20:41:00.288337 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1746/3510] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:00 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:41:01.293209 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e1141b7c-4003-4b98-8b72-e2642df5db1e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:01.293797 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e1141b7c-4003-4b98-8b72-e2642df5db1e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:01.300226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1141b7c-4003-4b98-8b72-e2642df5db1e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:01.300676 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1141b7c-4003-4b98-8b72-e2642df5db1e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:01.301459 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1141b7c-4003-4b98-8b72-e2642df5db1e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:01.301899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1141b7c-4003-4b98-8b72-e2642df5db1e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:01.308754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3c6b6ee0-fc75-4fa8-a3ae-fdd35f024c34 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:01.309396 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3c6b6ee0-fc75-4fa8-a3ae-fdd35f024c34 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:01.315827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c6b6ee0-fc75-4fa8-a3ae-fdd35f024c34 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:01.316276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c6b6ee0-fc75-4fa8-a3ae-fdd35f024c34 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:01.317069 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c6b6ee0-fc75-4fa8-a3ae-fdd35f024c34 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:01.317511 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c6b6ee0-fc75-4fa8-a3ae-fdd35f024c34 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:01.432822 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e1141b7c-4003-4b98-8b72-e2642df5db1e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:01.441781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e1141b7c-4003-4b98-8b72-e2642df5db1e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:01.443281 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e1141b7c-4003-4b98-8b72-e2642df5db1e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:01.444438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e1141b7c-4003-4b98-8b72-e2642df5db1e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155713 Jul 27 20:41:01.445009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1765/3511] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:01 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:41:01.449052 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3c6b6ee0-fc75-4fa8-a3ae-fdd35f024c34 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:01.457060 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3c6b6ee0-fc75-4fa8-a3ae-fdd35f024c34 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152686 Jul 27 20:41:01.457693 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1747/3512] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:01 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:41:02.466922 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2194a167-dd8b-43c5-b7d1-8392cb4db63b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:02.467543 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2194a167-dd8b-43c5-b7d1-8392cb4db63b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:02.473723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2194a167-dd8b-43c5-b7d1-8392cb4db63b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:02.474180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2194a167-dd8b-43c5-b7d1-8392cb4db63b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:02.474953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2194a167-dd8b-43c5-b7d1-8392cb4db63b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:02.475396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2194a167-dd8b-43c5-b7d1-8392cb4db63b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:02.477386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4773c4fb-8ad5-4ef1-be33-39a92ed60e72 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:02.478006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4773c4fb-8ad5-4ef1-be33-39a92ed60e72 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:02.485047 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4773c4fb-8ad5-4ef1-be33-39a92ed60e72 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:02.485498 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4773c4fb-8ad5-4ef1-be33-39a92ed60e72 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:02.486265 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4773c4fb-8ad5-4ef1-be33-39a92ed60e72 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:02.486705 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4773c4fb-8ad5-4ef1-be33-39a92ed60e72 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:02.614876 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2194a167-dd8b-43c5-b7d1-8392cb4db63b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:02.623614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2194a167-dd8b-43c5-b7d1-8392cb4db63b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:02.624235 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4773c4fb-8ad5-4ef1-be33-39a92ed60e72 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:02.625151 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2194a167-dd8b-43c5-b7d1-8392cb4db63b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:02.626331 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2194a167-dd8b-43c5-b7d1-8392cb4db63b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.163467 Jul 27 20:41:02.627101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1766/3513] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:02 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:41:02.632224 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4773c4fb-8ad5-4ef1-be33-39a92ed60e72 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.158611 Jul 27 20:41:02.632778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1748/3514] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:02 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:41:03.655660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cbb54ec8-e66e-4456-8a4f-e6ac219af799 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:03.655660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cbb54ec8-e66e-4456-8a4f-e6ac219af799 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:03.658138 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cbb54ec8-e66e-4456-8a4f-e6ac219af799 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:03.658997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cbb54ec8-e66e-4456-8a4f-e6ac219af799 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:03.659509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cbb54ec8-e66e-4456-8a4f-e6ac219af799 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:03.660004 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cbb54ec8-e66e-4456-8a4f-e6ac219af799 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:03.660205 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5f7210f9-eb17-42af-b4c3-db6e9dffa1b5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:03.660819 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5f7210f9-eb17-42af-b4c3-db6e9dffa1b5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:03.668448 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5f7210f9-eb17-42af-b4c3-db6e9dffa1b5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:03.669092 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5f7210f9-eb17-42af-b4c3-db6e9dffa1b5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:03.669868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5f7210f9-eb17-42af-b4c3-db6e9dffa1b5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:03.670303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5f7210f9-eb17-42af-b4c3-db6e9dffa1b5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:03.804158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cbb54ec8-e66e-4456-8a4f-e6ac219af799 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:03.808705 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5f7210f9-eb17-42af-b4c3-db6e9dffa1b5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:03.815845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cbb54ec8-e66e-4456-8a4f-e6ac219af799 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:03.817050 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5f7210f9-eb17-42af-b4c3-db6e9dffa1b5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.167752 Jul 27 20:41:03.817682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1749/3515] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:03 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:41:03.818155 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cbb54ec8-e66e-4456-8a4f-e6ac219af799 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:03.819467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cbb54ec8-e66e-4456-8a4f-e6ac219af799 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.173494 Jul 27 20:41:03.820113 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1767/3516] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:03 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:41:04.839975 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-05f42e90-7697-49b4-812d-2e566f0e139a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:04.840754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-05f42e90-7697-49b4-812d-2e566f0e139a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:04.843886 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ae850bc2-b3dd-47a8-9903-d547d844b96d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:04.844497 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ae850bc2-b3dd-47a8-9903-d547d844b96d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:04.847514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05f42e90-7697-49b4-812d-2e566f0e139a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:04.847969 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05f42e90-7697-49b4-812d-2e566f0e139a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:04.848742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05f42e90-7697-49b4-812d-2e566f0e139a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:04.849220 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05f42e90-7697-49b4-812d-2e566f0e139a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:04.850722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ae850bc2-b3dd-47a8-9903-d547d844b96d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:04.851169 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ae850bc2-b3dd-47a8-9903-d547d844b96d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:04.851923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ae850bc2-b3dd-47a8-9903-d547d844b96d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:04.852356 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ae850bc2-b3dd-47a8-9903-d547d844b96d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:04.982129 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ae850bc2-b3dd-47a8-9903-d547d844b96d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:04.986294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-05f42e90-7697-49b4-812d-2e566f0e139a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:04.990696 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ae850bc2-b3dd-47a8-9903-d547d844b96d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:04.992187 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ae850bc2-b3dd-47a8-9903-d547d844b96d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:04.993369 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ae850bc2-b3dd-47a8-9903-d547d844b96d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153324 Jul 27 20:41:04.993928 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1768/3517] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:04 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:04.994181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-05f42e90-7697-49b4-812d-2e566f0e139a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.158759 Jul 27 20:41:04.994739 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1750/3518] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:04 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:06.014728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1a78fee8-1995-436f-bf6e-254f54225981 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:06.015347 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1a78fee8-1995-436f-bf6e-254f54225981 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:06.017910 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=52 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:41:06.018091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f91492a3-9fc1-43de-a097-fd5090f9f5aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:06.018807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f91492a3-9fc1-43de-a097-fd5090f9f5aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:06.023443 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1a78fee8-1995-436f-bf6e-254f54225981 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:06.023906 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1a78fee8-1995-436f-bf6e-254f54225981 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:06.024690 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1a78fee8-1995-436f-bf6e-254f54225981 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:06.025296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1a78fee8-1995-436f-bf6e-254f54225981 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:06.025663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f91492a3-9fc1-43de-a097-fd5090f9f5aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:06.026117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f91492a3-9fc1-43de-a097-fd5090f9f5aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:06.026884 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f91492a3-9fc1-43de-a097-fd5090f9f5aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:06.027321 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f91492a3-9fc1-43de-a097-fd5090f9f5aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:06.159425 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f91492a3-9fc1-43de-a097-fd5090f9f5aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:06.159606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1a78fee8-1995-436f-bf6e-254f54225981 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:06.167557 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1a78fee8-1995-436f-bf6e-254f54225981 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.157249 Jul 27 20:41:06.168028 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f91492a3-9fc1-43de-a097-fd5090f9f5aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:06.168814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1769/3519] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:06 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:06.170434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f91492a3-9fc1-43de-a097-fd5090f9f5aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:06.171703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f91492a3-9fc1-43de-a097-fd5090f9f5aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.158262 Jul 27 20:41:06.172331 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1751/3520] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:06 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:07.190710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-559400e1-d436-4e7b-a053-bcee35db9e43 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:07.191320 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-559400e1-d436-4e7b-a053-bcee35db9e43 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:07.194256 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0e02b258-1927-4bc1-88b0-b164b766614f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:07.194866 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0e02b258-1927-4bc1-88b0-b164b766614f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:07.200137 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-559400e1-d436-4e7b-a053-bcee35db9e43 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:07.200593 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-559400e1-d436-4e7b-a053-bcee35db9e43 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:07.201382 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-559400e1-d436-4e7b-a053-bcee35db9e43 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:07.201822 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-559400e1-d436-4e7b-a053-bcee35db9e43 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:07.203345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e02b258-1927-4bc1-88b0-b164b766614f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:07.203800 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e02b258-1927-4bc1-88b0-b164b766614f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:07.204567 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e02b258-1927-4bc1-88b0-b164b766614f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:07.205026 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e02b258-1927-4bc1-88b0-b164b766614f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:07.360882 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-559400e1-d436-4e7b-a053-bcee35db9e43 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:07.361708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0e02b258-1927-4bc1-88b0-b164b766614f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:07.370509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-559400e1-d436-4e7b-a053-bcee35db9e43 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.183644 Jul 27 20:41:07.371079 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1770/3521] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:07 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:07.372956 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0e02b258-1927-4bc1-88b0-b164b766614f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:07.376481 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0e02b258-1927-4bc1-88b0-b164b766614f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:07.377714 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0e02b258-1927-4bc1-88b0-b164b766614f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.187300 Jul 27 20:41:07.378275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1752/3522] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:07 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:08.394114 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ec46d450-56aa-41b4-a6e8-3cfdfc364f55 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:08.394728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ec46d450-56aa-41b4-a6e8-3cfdfc364f55 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:08.401264 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec46d450-56aa-41b4-a6e8-3cfdfc364f55 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:08.401740 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec46d450-56aa-41b4-a6e8-3cfdfc364f55 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:08.403113 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec46d450-56aa-41b4-a6e8-3cfdfc364f55 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:08.403586 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec46d450-56aa-41b4-a6e8-3cfdfc364f55 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:08.406048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-faa90a06-d186-4a8d-866a-ffbafccd701b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:08.406664 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-faa90a06-d186-4a8d-866a-ffbafccd701b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:08.408955 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=54 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:41:08.414354 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-faa90a06-d186-4a8d-866a-ffbafccd701b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:08.414816 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-faa90a06-d186-4a8d-866a-ffbafccd701b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:08.415585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-faa90a06-d186-4a8d-866a-ffbafccd701b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:08.416025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-faa90a06-d186-4a8d-866a-ffbafccd701b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:08.536688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ec46d450-56aa-41b4-a6e8-3cfdfc364f55 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:08.545551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ec46d450-56aa-41b4-a6e8-3cfdfc364f55 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.155281 Jul 27 20:41:08.546125 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1771/3523] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:08 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:08.548705 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-faa90a06-d186-4a8d-866a-ffbafccd701b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:08.557078 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-faa90a06-d186-4a8d-866a-ffbafccd701b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:08.558572 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-faa90a06-d186-4a8d-866a-ffbafccd701b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:08.560171 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-faa90a06-d186-4a8d-866a-ffbafccd701b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.158611 Jul 27 20:41:08.560716 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1753/3524] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:08 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:09.567214 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-24218589-c0d4-41d5-8af0-ab7d3fac1c2c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:09.567830 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-24218589-c0d4-41d5-8af0-ab7d3fac1c2c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:09.574242 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-24218589-c0d4-41d5-8af0-ab7d3fac1c2c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:09.574691 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-24218589-c0d4-41d5-8af0-ab7d3fac1c2c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:09.575443 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-24218589-c0d4-41d5-8af0-ab7d3fac1c2c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:09.575882 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-24218589-c0d4-41d5-8af0-ab7d3fac1c2c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:09.583679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-69d06f80-6ec2-4b09-9f39-c5a29439e0a5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:09.584292 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-69d06f80-6ec2-4b09-9f39-c5a29439e0a5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:09.590735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-69d06f80-6ec2-4b09-9f39-c5a29439e0a5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:09.591184 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-69d06f80-6ec2-4b09-9f39-c5a29439e0a5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:09.592019 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-69d06f80-6ec2-4b09-9f39-c5a29439e0a5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:09.592462 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-69d06f80-6ec2-4b09-9f39-c5a29439e0a5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:09.708906 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-24218589-c0d4-41d5-8af0-ab7d3fac1c2c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:09.717036 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-24218589-c0d4-41d5-8af0-ab7d3fac1c2c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153460 Jul 27 20:41:09.718278 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1772/3525] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:09 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:09.723440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-69d06f80-6ec2-4b09-9f39-c5a29439e0a5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:09.734942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-69d06f80-6ec2-4b09-9f39-c5a29439e0a5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:09.736447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-69d06f80-6ec2-4b09-9f39-c5a29439e0a5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:09.737661 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-69d06f80-6ec2-4b09-9f39-c5a29439e0a5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157843 Jul 27 20:41:09.738212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1754/3526] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:09 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:10.737911 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4fa7064a-3563-45e2-b746-ba751e2c9fe3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:10.738596 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4fa7064a-3563-45e2-b746-ba751e2c9fe3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:10.745114 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4fa7064a-3563-45e2-b746-ba751e2c9fe3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:10.745579 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4fa7064a-3563-45e2-b746-ba751e2c9fe3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:10.746348 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4fa7064a-3563-45e2-b746-ba751e2c9fe3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:10.746792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4fa7064a-3563-45e2-b746-ba751e2c9fe3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:10.761308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e735e981-3aca-42f2-9353-6e45c339e734 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:10.762605 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e735e981-3aca-42f2-9353-6e45c339e734 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:10.769884 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e735e981-3aca-42f2-9353-6e45c339e734 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:10.770333 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e735e981-3aca-42f2-9353-6e45c339e734 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:10.771091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e735e981-3aca-42f2-9353-6e45c339e734 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:10.771520 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e735e981-3aca-42f2-9353-6e45c339e734 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:10.877711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4fa7064a-3563-45e2-b746-ba751e2c9fe3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:10.885578 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4fa7064a-3563-45e2-b746-ba751e2c9fe3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151548 Jul 27 20:41:10.886427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1773/3527] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:10 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:10.904058 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e735e981-3aca-42f2-9353-6e45c339e734 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:10.912431 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e735e981-3aca-42f2-9353-6e45c339e734 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:10.914008 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e735e981-3aca-42f2-9353-6e45c339e734 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:10.915172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e735e981-3aca-42f2-9353-6e45c339e734 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157830 Jul 27 20:41:10.915724 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1755/3528] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:10 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:11.907728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b2500a95-5f57-4e4a-9ae7-8ac57755a35a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:11.908350 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b2500a95-5f57-4e4a-9ae7-8ac57755a35a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:11.914964 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b2500a95-5f57-4e4a-9ae7-8ac57755a35a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:11.915421 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b2500a95-5f57-4e4a-9ae7-8ac57755a35a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:11.916190 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b2500a95-5f57-4e4a-9ae7-8ac57755a35a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:11.916636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b2500a95-5f57-4e4a-9ae7-8ac57755a35a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:11.938679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-03fc9e9c-edd7-40c9-9cdd-6aa39c94dde6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:11.939283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-03fc9e9c-edd7-40c9-9cdd-6aa39c94dde6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:11.945670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03fc9e9c-edd7-40c9-9cdd-6aa39c94dde6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:11.946116 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03fc9e9c-edd7-40c9-9cdd-6aa39c94dde6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:11.946879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03fc9e9c-edd7-40c9-9cdd-6aa39c94dde6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:11.947315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03fc9e9c-edd7-40c9-9cdd-6aa39c94dde6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:12.055358 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b2500a95-5f57-4e4a-9ae7-8ac57755a35a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:12.064101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b2500a95-5f57-4e4a-9ae7-8ac57755a35a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.160754 Jul 27 20:41:12.064868 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1774/3529] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:11 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:12.085795 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-03fc9e9c-edd7-40c9-9cdd-6aa39c94dde6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:12.094757 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-03fc9e9c-edd7-40c9-9cdd-6aa39c94dde6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:12.096246 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-03fc9e9c-edd7-40c9-9cdd-6aa39c94dde6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:12.097436 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-03fc9e9c-edd7-40c9-9cdd-6aa39c94dde6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.162684 Jul 27 20:41:12.097991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1756/3530] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:11 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:13.086422 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-266970a5-a0f3-44f1-9356-1ad5f89d2a1f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:13.087044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-266970a5-a0f3-44f1-9356-1ad5f89d2a1f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:13.094496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-266970a5-a0f3-44f1-9356-1ad5f89d2a1f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:13.095068 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-266970a5-a0f3-44f1-9356-1ad5f89d2a1f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:13.095871 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-266970a5-a0f3-44f1-9356-1ad5f89d2a1f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:13.096324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-266970a5-a0f3-44f1-9356-1ad5f89d2a1f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:13.121108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-88e434dd-7c3d-45c4-b4ec-02fe6685263c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:13.121722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-88e434dd-7c3d-45c4-b4ec-02fe6685263c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:13.128362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-88e434dd-7c3d-45c4-b4ec-02fe6685263c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:13.128814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-88e434dd-7c3d-45c4-b4ec-02fe6685263c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:13.129611 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-88e434dd-7c3d-45c4-b4ec-02fe6685263c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:13.130052 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-88e434dd-7c3d-45c4-b4ec-02fe6685263c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:13.227170 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-266970a5-a0f3-44f1-9356-1ad5f89d2a1f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:13.235859 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-266970a5-a0f3-44f1-9356-1ad5f89d2a1f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153497 Jul 27 20:41:13.242102 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1775/3531] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:13 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:13.264319 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-88e434dd-7c3d-45c4-b4ec-02fe6685263c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:13.272540 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-88e434dd-7c3d-45c4-b4ec-02fe6685263c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:13.274087 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-88e434dd-7c3d-45c4-b4ec-02fe6685263c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:13.275230 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-88e434dd-7c3d-45c4-b4ec-02fe6685263c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157976 Jul 27 20:41:13.275779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1757/3532] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:13 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:14.258771 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6f29ba11-8ad3-4ba5-9fcf-97cf68b96a35 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:14.259383 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6f29ba11-8ad3-4ba5-9fcf-97cf68b96a35 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:14.266524 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6f29ba11-8ad3-4ba5-9fcf-97cf68b96a35 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:14.266968 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6f29ba11-8ad3-4ba5-9fcf-97cf68b96a35 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:14.267720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6f29ba11-8ad3-4ba5-9fcf-97cf68b96a35 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:14.268154 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6f29ba11-8ad3-4ba5-9fcf-97cf68b96a35 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:14.298489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-57f9fc69-228b-45a2-90c8-0a5c017dfe61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:14.299124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-57f9fc69-228b-45a2-90c8-0a5c017dfe61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:14.305855 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57f9fc69-228b-45a2-90c8-0a5c017dfe61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:14.306305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57f9fc69-228b-45a2-90c8-0a5c017dfe61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:14.307077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57f9fc69-228b-45a2-90c8-0a5c017dfe61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:14.307516 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57f9fc69-228b-45a2-90c8-0a5c017dfe61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:14.398344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6f29ba11-8ad3-4ba5-9fcf-97cf68b96a35 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:14.406349 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6f29ba11-8ad3-4ba5-9fcf-97cf68b96a35 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151378 Jul 27 20:41:14.407255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1776/3533] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:14 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:14.438731 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-57f9fc69-228b-45a2-90c8-0a5c017dfe61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:14.447217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-57f9fc69-228b-45a2-90c8-0a5c017dfe61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:14.448732 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-57f9fc69-228b-45a2-90c8-0a5c017dfe61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:14.449925 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-57f9fc69-228b-45a2-90c8-0a5c017dfe61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155584 Jul 27 20:41:14.450488 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1758/3534] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:14 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:15.427660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ce546502-9bc4-4ae2-9eb0-e6e9751212e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:15.428270 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ce546502-9bc4-4ae2-9eb0-e6e9751212e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:15.434757 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ce546502-9bc4-4ae2-9eb0-e6e9751212e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:15.435206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ce546502-9bc4-4ae2-9eb0-e6e9751212e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:15.435975 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ce546502-9bc4-4ae2-9eb0-e6e9751212e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:15.436406 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ce546502-9bc4-4ae2-9eb0-e6e9751212e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:15.473935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dd1141ad-127e-41b8-8cea-a99d541ca6d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:15.474544 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dd1141ad-127e-41b8-8cea-a99d541ca6d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:15.481188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd1141ad-127e-41b8-8cea-a99d541ca6d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:15.481641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd1141ad-127e-41b8-8cea-a99d541ca6d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:15.482455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd1141ad-127e-41b8-8cea-a99d541ca6d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:15.482896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd1141ad-127e-41b8-8cea-a99d541ca6d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:15.565002 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ce546502-9bc4-4ae2-9eb0-e6e9751212e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:15.568420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:41:15.573508 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ce546502-9bc4-4ae2-9eb0-e6e9751212e2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149666 Jul 27 20:41:15.574083 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1777/3535] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:15 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:15.616749 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dd1141ad-127e-41b8-8cea-a99d541ca6d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:15.625196 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dd1141ad-127e-41b8-8cea-a99d541ca6d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:15.626718 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dd1141ad-127e-41b8-8cea-a99d541ca6d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:15.627880 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dd1141ad-127e-41b8-8cea-a99d541ca6d4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157779 Jul 27 20:41:15.628440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1759/3536] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:15 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:16.595635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d2aa68c8-60aa-4bf4-bc7e-63b82bcc312f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:16.596261 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d2aa68c8-60aa-4bf4-bc7e-63b82bcc312f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:16.603418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d2aa68c8-60aa-4bf4-bc7e-63b82bcc312f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:16.603878 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d2aa68c8-60aa-4bf4-bc7e-63b82bcc312f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:16.604649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d2aa68c8-60aa-4bf4-bc7e-63b82bcc312f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:16.605163 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d2aa68c8-60aa-4bf4-bc7e-63b82bcc312f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:16.652345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-00c321cc-c43f-46c2-a451-bbf92232b718 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:16.652983 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-00c321cc-c43f-46c2-a451-bbf92232b718 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:16.659770 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00c321cc-c43f-46c2-a451-bbf92232b718 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:16.660224 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00c321cc-c43f-46c2-a451-bbf92232b718 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:16.661010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00c321cc-c43f-46c2-a451-bbf92232b718 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:16.661455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00c321cc-c43f-46c2-a451-bbf92232b718 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:16.736021 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d2aa68c8-60aa-4bf4-bc7e-63b82bcc312f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:16.744012 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d2aa68c8-60aa-4bf4-bc7e-63b82bcc312f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153108 Jul 27 20:41:16.744590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1778/3537] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:16 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:16.794233 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-00c321cc-c43f-46c2-a451-bbf92232b718 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:16.797607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:41:16.803617 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-00c321cc-c43f-46c2-a451-bbf92232b718 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:16.805280 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-00c321cc-c43f-46c2-a451-bbf92232b718 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:16.806445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-00c321cc-c43f-46c2-a451-bbf92232b718 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.159261 Jul 27 20:41:16.807002 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1760/3538] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:16 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:17.766505 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-855fc9ce-e19e-4682-a830-a2ae31d2e463 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:17.767147 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-855fc9ce-e19e-4682-a830-a2ae31d2e463 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:17.773662 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-855fc9ce-e19e-4682-a830-a2ae31d2e463 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:17.774116 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-855fc9ce-e19e-4682-a830-a2ae31d2e463 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:17.774907 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-855fc9ce-e19e-4682-a830-a2ae31d2e463 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:17.775339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-855fc9ce-e19e-4682-a830-a2ae31d2e463 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:17.831583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-497f1345-da53-4905-ac45-7491f07a0983 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:17.832254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-497f1345-da53-4905-ac45-7491f07a0983 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:17.838236 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-497f1345-da53-4905-ac45-7491f07a0983 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:17.838680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-497f1345-da53-4905-ac45-7491f07a0983 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:17.839434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-497f1345-da53-4905-ac45-7491f07a0983 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:17.839862 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-497f1345-da53-4905-ac45-7491f07a0983 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:17.910412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-855fc9ce-e19e-4682-a830-a2ae31d2e463 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:17.918424 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-855fc9ce-e19e-4682-a830-a2ae31d2e463 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.156234 Jul 27 20:41:17.918998 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1779/3539] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:17 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:17.971498 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-497f1345-da53-4905-ac45-7491f07a0983 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:17.980405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-497f1345-da53-4905-ac45-7491f07a0983 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:17.981927 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-497f1345-da53-4905-ac45-7491f07a0983 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:17.983329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-497f1345-da53-4905-ac45-7491f07a0983 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156213 Jul 27 20:41:17.984000 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1761/3540] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:17 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:18.939899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b9dfb435-5b68-4fb5-9c15-8a74757ebb40 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:18.940759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b9dfb435-5b68-4fb5-9c15-8a74757ebb40 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:18.947680 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b9dfb435-5b68-4fb5-9c15-8a74757ebb40 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:18.948133 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b9dfb435-5b68-4fb5-9c15-8a74757ebb40 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:18.949002 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b9dfb435-5b68-4fb5-9c15-8a74757ebb40 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:18.949393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b9dfb435-5b68-4fb5-9c15-8a74757ebb40 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:19.007775 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-08b07b8a-9f01-49ee-9f46-e43a9a5ef83b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:19.008306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-08b07b8a-9f01-49ee-9f46-e43a9a5ef83b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:19.014803 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-08b07b8a-9f01-49ee-9f46-e43a9a5ef83b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:19.015254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-08b07b8a-9f01-49ee-9f46-e43a9a5ef83b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:19.016033 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-08b07b8a-9f01-49ee-9f46-e43a9a5ef83b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:19.016485 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-08b07b8a-9f01-49ee-9f46-e43a9a5ef83b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:19.086219 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b9dfb435-5b68-4fb5-9c15-8a74757ebb40 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:19.095492 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b9dfb435-5b68-4fb5-9c15-8a74757ebb40 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.159579 Jul 27 20:41:19.096359 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1780/3541] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:18 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:19.155683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-08b07b8a-9f01-49ee-9f46-e43a9a5ef83b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:19.163897 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-08b07b8a-9f01-49ee-9f46-e43a9a5ef83b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:19.165412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-08b07b8a-9f01-49ee-9f46-e43a9a5ef83b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:19.166555 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-08b07b8a-9f01-49ee-9f46-e43a9a5ef83b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.162782 Jul 27 20:41:19.167105 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1762/3542] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:19 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:20.117152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cde64b78-23a4-4925-8ce0-d9f5646d824c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:20.117775 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cde64b78-23a4-4925-8ce0-d9f5646d824c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:20.125117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cde64b78-23a4-4925-8ce0-d9f5646d824c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:20.125578 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cde64b78-23a4-4925-8ce0-d9f5646d824c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:20.126349 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cde64b78-23a4-4925-8ce0-d9f5646d824c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:20.126793 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cde64b78-23a4-4925-8ce0-d9f5646d824c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:20.190266 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0bc30d59-637e-4ccf-aa77-2ae177044419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:20.190905 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0bc30d59-637e-4ccf-aa77-2ae177044419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:20.197429 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0bc30d59-637e-4ccf-aa77-2ae177044419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:20.197882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0bc30d59-637e-4ccf-aa77-2ae177044419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:20.198645 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0bc30d59-637e-4ccf-aa77-2ae177044419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:20.199087 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0bc30d59-637e-4ccf-aa77-2ae177044419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:20.258411 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cde64b78-23a4-4925-8ce0-d9f5646d824c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:20.266905 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cde64b78-23a4-4925-8ce0-d9f5646d824c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153653 Jul 27 20:41:20.267574 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1781/3543] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:20 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:20.330056 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0bc30d59-637e-4ccf-aa77-2ae177044419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:20.338293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0bc30d59-637e-4ccf-aa77-2ae177044419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:20.339775 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0bc30d59-637e-4ccf-aa77-2ae177044419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:20.340915 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0bc30d59-637e-4ccf-aa77-2ae177044419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155563 Jul 27 20:41:20.342017 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1763/3544] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:20 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:21.288785 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7be306b6-8b53-4a11-b99e-43a3aaf91e45 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:21.289428 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7be306b6-8b53-4a11-b99e-43a3aaf91e45 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:21.296072 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7be306b6-8b53-4a11-b99e-43a3aaf91e45 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:21.296527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7be306b6-8b53-4a11-b99e-43a3aaf91e45 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:21.297317 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7be306b6-8b53-4a11-b99e-43a3aaf91e45 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:21.297754 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7be306b6-8b53-4a11-b99e-43a3aaf91e45 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:21.364308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7e60d02d-1d1f-434c-b5f5-a2b86855ccb2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:21.364847 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7e60d02d-1d1f-434c-b5f5-a2b86855ccb2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:21.371433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7e60d02d-1d1f-434c-b5f5-a2b86855ccb2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:21.371883 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7e60d02d-1d1f-434c-b5f5-a2b86855ccb2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:21.372784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7e60d02d-1d1f-434c-b5f5-a2b86855ccb2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:21.373790 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7e60d02d-1d1f-434c-b5f5-a2b86855ccb2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:21.426464 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7be306b6-8b53-4a11-b99e-43a3aaf91e45 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:21.434453 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7be306b6-8b53-4a11-b99e-43a3aaf91e45 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149592 Jul 27 20:41:21.435126 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1782/3545] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:21 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:21.501009 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7e60d02d-1d1f-434c-b5f5-a2b86855ccb2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:21.509311 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7e60d02d-1d1f-434c-b5f5-a2b86855ccb2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:21.510820 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7e60d02d-1d1f-434c-b5f5-a2b86855ccb2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:21.512016 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7e60d02d-1d1f-434c-b5f5-a2b86855ccb2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.151705 Jul 27 20:41:21.512586 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1764/3546] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:21 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:41:22.456142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a1d71f19-c8cb-475c-aed3-a6c6b6728f6a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:22.456750 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a1d71f19-c8cb-475c-aed3-a6c6b6728f6a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:22.463238 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a1d71f19-c8cb-475c-aed3-a6c6b6728f6a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:22.463696 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a1d71f19-c8cb-475c-aed3-a6c6b6728f6a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:22.464454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a1d71f19-c8cb-475c-aed3-a6c6b6728f6a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:22.464891 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a1d71f19-c8cb-475c-aed3-a6c6b6728f6a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:22.536229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-83fb2e83-9eb3-4388-bc71-bd046c18c1fb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:22.536836 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-83fb2e83-9eb3-4388-bc71-bd046c18c1fb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:22.543207 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83fb2e83-9eb3-4388-bc71-bd046c18c1fb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:22.543651 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83fb2e83-9eb3-4388-bc71-bd046c18c1fb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:22.544405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83fb2e83-9eb3-4388-bc71-bd046c18c1fb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:22.545434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83fb2e83-9eb3-4388-bc71-bd046c18c1fb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:22.598248 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a1d71f19-c8cb-475c-aed3-a6c6b6728f6a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:22.606281 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a1d71f19-c8cb-475c-aed3-a6c6b6728f6a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.154280 Jul 27 20:41:22.606791 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1783/3547] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:22 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:22.678887 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-83fb2e83-9eb3-4388-bc71-bd046c18c1fb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:22.687621 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-83fb2e83-9eb3-4388-bc71-bd046c18c1fb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:22.689154 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-83fb2e83-9eb3-4388-bc71-bd046c18c1fb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:22.690346 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-83fb2e83-9eb3-4388-bc71-bd046c18c1fb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.158047 Jul 27 20:41:22.690902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1765/3548] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:22 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:23.627770 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bee638a6-8d0e-4526-b00c-7a6db57ad4a1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:23.628391 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bee638a6-8d0e-4526-b00c-7a6db57ad4a1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:23.634894 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bee638a6-8d0e-4526-b00c-7a6db57ad4a1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:23.635348 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bee638a6-8d0e-4526-b00c-7a6db57ad4a1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:23.636115 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bee638a6-8d0e-4526-b00c-7a6db57ad4a1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:23.636557 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bee638a6-8d0e-4526-b00c-7a6db57ad4a1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:23.714632 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0328eef0-0db4-4420-9418-1e8e6b952711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:23.715258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0328eef0-0db4-4420-9418-1e8e6b952711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:23.722942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0328eef0-0db4-4420-9418-1e8e6b952711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:23.723421 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0328eef0-0db4-4420-9418-1e8e6b952711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:23.724190 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0328eef0-0db4-4420-9418-1e8e6b952711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:23.724630 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0328eef0-0db4-4420-9418-1e8e6b952711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:23.766396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bee638a6-8d0e-4526-b00c-7a6db57ad4a1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:23.774526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bee638a6-8d0e-4526-b00c-7a6db57ad4a1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150653 Jul 27 20:41:23.775095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1784/3549] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:23 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:23.854427 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0328eef0-0db4-4420-9418-1e8e6b952711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:23.862902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0328eef0-0db4-4420-9418-1e8e6b952711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:23.864407 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0328eef0-0db4-4420-9418-1e8e6b952711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:23.865599 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0328eef0-0db4-4420-9418-1e8e6b952711 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.154917 Jul 27 20:41:23.866165 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1766/3550] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:23 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:24.795651 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ce8f9798-77ec-48de-afdf-dd3ea4b7422e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:24.796283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ce8f9798-77ec-48de-afdf-dd3ea4b7422e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:24.802794 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ce8f9798-77ec-48de-afdf-dd3ea4b7422e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:24.803271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ce8f9798-77ec-48de-afdf-dd3ea4b7422e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:24.804024 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ce8f9798-77ec-48de-afdf-dd3ea4b7422e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:24.804459 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ce8f9798-77ec-48de-afdf-dd3ea4b7422e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:24.890498 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bf4184e8-8270-477d-bb10-e05ae3ca02e6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:24.891124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bf4184e8-8270-477d-bb10-e05ae3ca02e6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:24.898096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf4184e8-8270-477d-bb10-e05ae3ca02e6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:24.898915 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf4184e8-8270-477d-bb10-e05ae3ca02e6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:24.900047 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf4184e8-8270-477d-bb10-e05ae3ca02e6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:24.900527 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf4184e8-8270-477d-bb10-e05ae3ca02e6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:24.934550 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ce8f9798-77ec-48de-afdf-dd3ea4b7422e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:24.943477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ce8f9798-77ec-48de-afdf-dd3ea4b7422e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151709 Jul 27 20:41:24.944051 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1785/3551] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:24 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:25.040848 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bf4184e8-8270-477d-bb10-e05ae3ca02e6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:25.049681 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bf4184e8-8270-477d-bb10-e05ae3ca02e6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:25.051122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bf4184e8-8270-477d-bb10-e05ae3ca02e6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:25.052291 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bf4184e8-8270-477d-bb10-e05ae3ca02e6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.167037 Jul 27 20:41:25.052853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1767/3552] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:24 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:25.965623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e2980862-6065-4438-990a-11b36dc0222d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:25.966256 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e2980862-6065-4438-990a-11b36dc0222d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:25.972623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e2980862-6065-4438-990a-11b36dc0222d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:25.973100 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e2980862-6065-4438-990a-11b36dc0222d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:25.973859 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e2980862-6065-4438-990a-11b36dc0222d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:25.974295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e2980862-6065-4438-990a-11b36dc0222d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:26.078458 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fec16b72-7aa1-44a0-9139-464cc58fced2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:26.079501 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fec16b72-7aa1-44a0-9139-464cc58fced2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:26.085608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fec16b72-7aa1-44a0-9139-464cc58fced2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:26.086058 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fec16b72-7aa1-44a0-9139-464cc58fced2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:26.086891 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fec16b72-7aa1-44a0-9139-464cc58fced2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:26.087257 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fec16b72-7aa1-44a0-9139-464cc58fced2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:26.114685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e2980862-6065-4438-990a-11b36dc0222d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:26.123612 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e2980862-6065-4438-990a-11b36dc0222d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.160911 Jul 27 20:41:26.124200 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1786/3553] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:25 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:26.218673 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fec16b72-7aa1-44a0-9139-464cc58fced2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:26.226994 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fec16b72-7aa1-44a0-9139-464cc58fced2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:26.228485 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fec16b72-7aa1-44a0-9139-464cc58fced2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:26.229676 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fec16b72-7aa1-44a0-9139-464cc58fced2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157130 Jul 27 20:41:26.230233 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1768/3554] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:26 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:41:27.145912 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bc01ae31-417b-4117-8269-15ae58fa86af tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:27.146527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bc01ae31-417b-4117-8269-15ae58fa86af tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:27.153101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bc01ae31-417b-4117-8269-15ae58fa86af tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:27.153551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bc01ae31-417b-4117-8269-15ae58fa86af tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:27.154435 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bc01ae31-417b-4117-8269-15ae58fa86af tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:27.154875 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bc01ae31-417b-4117-8269-15ae58fa86af tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:27.254553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4bfb5a7b-0bcb-478c-a07a-b574fafcdad7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:27.255293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4bfb5a7b-0bcb-478c-a07a-b574fafcdad7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:27.261733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4bfb5a7b-0bcb-478c-a07a-b574fafcdad7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:27.262173 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4bfb5a7b-0bcb-478c-a07a-b574fafcdad7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:27.262926 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4bfb5a7b-0bcb-478c-a07a-b574fafcdad7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:27.263937 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4bfb5a7b-0bcb-478c-a07a-b574fafcdad7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:27.284109 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bc01ae31-417b-4117-8269-15ae58fa86af tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:27.291957 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bc01ae31-417b-4117-8269-15ae58fa86af tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149898 Jul 27 20:41:27.292522 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1787/3555] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:27 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:27.394361 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4bfb5a7b-0bcb-478c-a07a-b574fafcdad7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:27.402620 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4bfb5a7b-0bcb-478c-a07a-b574fafcdad7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:27.404108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4bfb5a7b-0bcb-478c-a07a-b574fafcdad7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:27.405319 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4bfb5a7b-0bcb-478c-a07a-b574fafcdad7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.154546 Jul 27 20:41:27.405885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1769/3556] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:27 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:28.313845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9c2cd214-6c2a-4d6d-a897-568691b8de83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:28.314470 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9c2cd214-6c2a-4d6d-a897-568691b8de83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:28.321074 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9c2cd214-6c2a-4d6d-a897-568691b8de83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:28.321534 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9c2cd214-6c2a-4d6d-a897-568691b8de83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:28.322300 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9c2cd214-6c2a-4d6d-a897-568691b8de83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:28.322743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9c2cd214-6c2a-4d6d-a897-568691b8de83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:28.428958 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-054813a6-6625-4236-80e4-1f2d19ad2332 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:28.429586 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-054813a6-6625-4236-80e4-1f2d19ad2332 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:28.436126 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-054813a6-6625-4236-80e4-1f2d19ad2332 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:28.436573 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-054813a6-6625-4236-80e4-1f2d19ad2332 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:28.437361 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-054813a6-6625-4236-80e4-1f2d19ad2332 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:28.437798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-054813a6-6625-4236-80e4-1f2d19ad2332 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:28.455074 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9c2cd214-6c2a-4d6d-a897-568691b8de83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:28.463738 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9c2cd214-6c2a-4d6d-a897-568691b8de83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153935 Jul 27 20:41:28.464464 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1788/3557] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:28 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:28.568210 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-054813a6-6625-4236-80e4-1f2d19ad2332 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:28.577426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-054813a6-6625-4236-80e4-1f2d19ad2332 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:28.579223 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-054813a6-6625-4236-80e4-1f2d19ad2332 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:28.580369 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-054813a6-6625-4236-80e4-1f2d19ad2332 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155477 Jul 27 20:41:28.580929 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1770/3558] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:28 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:29.486334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d905058d-35c3-4be2-8edc-d03be91304db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:29.487006 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d905058d-35c3-4be2-8edc-d03be91304db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:29.493525 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d905058d-35c3-4be2-8edc-d03be91304db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:29.493979 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d905058d-35c3-4be2-8edc-d03be91304db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:29.494748 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d905058d-35c3-4be2-8edc-d03be91304db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:29.495192 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d905058d-35c3-4be2-8edc-d03be91304db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:29.603779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4e9d78dc-8c5c-4576-9456-c216ad18feeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:29.604484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4e9d78dc-8c5c-4576-9456-c216ad18feeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:29.611575 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e9d78dc-8c5c-4576-9456-c216ad18feeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:29.612107 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e9d78dc-8c5c-4576-9456-c216ad18feeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:29.612882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e9d78dc-8c5c-4576-9456-c216ad18feeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:29.613364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e9d78dc-8c5c-4576-9456-c216ad18feeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:29.622092 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d905058d-35c3-4be2-8edc-d03be91304db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:29.630474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d905058d-35c3-4be2-8edc-d03be91304db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148602 Jul 27 20:41:29.631260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1789/3559] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:29 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:29.743965 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4e9d78dc-8c5c-4576-9456-c216ad18feeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:29.755708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4e9d78dc-8c5c-4576-9456-c216ad18feeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:29.757260 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4e9d78dc-8c5c-4576-9456-c216ad18feeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:29.758430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4e9d78dc-8c5c-4576-9456-c216ad18feeb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.158541 Jul 27 20:41:29.758991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1771/3560] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:29 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:30.651629 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8ab3711e-90e6-40d8-9469-9e3fb22e9390 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:30.652253 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8ab3711e-90e6-40d8-9469-9e3fb22e9390 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:30.659109 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8ab3711e-90e6-40d8-9469-9e3fb22e9390 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:30.659568 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8ab3711e-90e6-40d8-9469-9e3fb22e9390 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:30.660343 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8ab3711e-90e6-40d8-9469-9e3fb22e9390 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:30.660787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8ab3711e-90e6-40d8-9469-9e3fb22e9390 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:30.783105 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-39576579-9539-4db4-bc50-27d15d70cde2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:30.783722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-39576579-9539-4db4-bc50-27d15d70cde2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:30.790442 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39576579-9539-4db4-bc50-27d15d70cde2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:30.790966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39576579-9539-4db4-bc50-27d15d70cde2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:30.791830 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39576579-9539-4db4-bc50-27d15d70cde2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:30.792341 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39576579-9539-4db4-bc50-27d15d70cde2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:30.796161 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8ab3711e-90e6-40d8-9469-9e3fb22e9390 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:30.804372 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8ab3711e-90e6-40d8-9469-9e3fb22e9390 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.156577 Jul 27 20:41:30.804947 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1790/3561] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:30 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:30.921402 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-39576579-9539-4db4-bc50-27d15d70cde2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:30.929788 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-39576579-9539-4db4-bc50-27d15d70cde2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:30.931298 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-39576579-9539-4db4-bc50-27d15d70cde2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:30.932474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-39576579-9539-4db4-bc50-27d15d70cde2 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153743 Jul 27 20:41:30.933054 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1772/3562] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:30 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:31.825744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6e642636-f818-411a-a773-58b9f2414b97 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:31.827038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6e642636-f818-411a-a773-58b9f2414b97 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:31.833802 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6e642636-f818-411a-a773-58b9f2414b97 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:31.834252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6e642636-f818-411a-a773-58b9f2414b97 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:31.835003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6e642636-f818-411a-a773-58b9f2414b97 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:31.835437 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6e642636-f818-411a-a773-58b9f2414b97 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:31.956275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-81c49c20-a373-47e1-b493-63ffe07c6952 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:31.956904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-81c49c20-a373-47e1-b493-63ffe07c6952 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:31.963711 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81c49c20-a373-47e1-b493-63ffe07c6952 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:31.964200 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6e642636-f818-411a-a773-58b9f2414b97 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:31.964349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81c49c20-a373-47e1-b493-63ffe07c6952 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:31.965019 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81c49c20-a373-47e1-b493-63ffe07c6952 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:31.965453 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81c49c20-a373-47e1-b493-63ffe07c6952 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:31.972376 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6e642636-f818-411a-a773-58b9f2414b97 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150403 Jul 27 20:41:31.972948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1791/3563] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:31 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:32.095647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-81c49c20-a373-47e1-b493-63ffe07c6952 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:32.104120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-81c49c20-a373-47e1-b493-63ffe07c6952 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:32.105667 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-81c49c20-a373-47e1-b493-63ffe07c6952 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:32.106862 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-81c49c20-a373-47e1-b493-63ffe07c6952 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155071 Jul 27 20:41:32.107438 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1773/3564] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:31 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:32.994473 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fb9007dc-1c9d-4daa-90ef-95b24a32366d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:32.995611 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fb9007dc-1c9d-4daa-90ef-95b24a32366d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:33.004300 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fb9007dc-1c9d-4daa-90ef-95b24a32366d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:33.004762 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fb9007dc-1c9d-4daa-90ef-95b24a32366d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:33.005576 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fb9007dc-1c9d-4daa-90ef-95b24a32366d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:33.006013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fb9007dc-1c9d-4daa-90ef-95b24a32366d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:33.130699 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-58686a20-1718-4d2b-b0f7-f32740b11693 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:33.131455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-58686a20-1718-4d2b-b0f7-f32740b11693 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:33.136436 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fb9007dc-1c9d-4daa-90ef-95b24a32366d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:33.138044 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-58686a20-1718-4d2b-b0f7-f32740b11693 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:33.138498 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-58686a20-1718-4d2b-b0f7-f32740b11693 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:33.139873 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-58686a20-1718-4d2b-b0f7-f32740b11693 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:33.140420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-58686a20-1718-4d2b-b0f7-f32740b11693 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:33.145037 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fb9007dc-1c9d-4daa-90ef-95b24a32366d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.154818 Jul 27 20:41:33.145594 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1792/3565] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:32 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:41:33.272720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-58686a20-1718-4d2b-b0f7-f32740b11693 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:33.281728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-58686a20-1718-4d2b-b0f7-f32740b11693 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:33.283263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-58686a20-1718-4d2b-b0f7-f32740b11693 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:33.284428 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-58686a20-1718-4d2b-b0f7-f32740b11693 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157682 Jul 27 20:41:33.285013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1774/3566] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:33 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:34.165279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-63594283-7567-413c-b0b4-1c67d8f6f640 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:34.165908 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-63594283-7567-413c-b0b4-1c67d8f6f640 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:34.172335 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63594283-7567-413c-b0b4-1c67d8f6f640 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:34.172783 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63594283-7567-413c-b0b4-1c67d8f6f640 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:34.173566 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63594283-7567-413c-b0b4-1c67d8f6f640 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:34.174005 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63594283-7567-413c-b0b4-1c67d8f6f640 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:34.302978 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-63594283-7567-413c-b0b4-1c67d8f6f640 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:34.306717 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ae254d6a-eba5-45ec-b8c6-ed570fc034a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:34.307325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ae254d6a-eba5-45ec-b8c6-ed570fc034a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:34.310991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-63594283-7567-413c-b0b4-1c67d8f6f640 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149430 Jul 27 20:41:34.311596 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1793/3567] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:34 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:34.314232 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae254d6a-eba5-45ec-b8c6-ed570fc034a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:34.314679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae254d6a-eba5-45ec-b8c6-ed570fc034a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:34.315440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae254d6a-eba5-45ec-b8c6-ed570fc034a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:34.315875 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae254d6a-eba5-45ec-b8c6-ed570fc034a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:34.443074 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ae254d6a-eba5-45ec-b8c6-ed570fc034a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:34.451915 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ae254d6a-eba5-45ec-b8c6-ed570fc034a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:34.453816 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ae254d6a-eba5-45ec-b8c6-ed570fc034a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:34.454982 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ae254d6a-eba5-45ec-b8c6-ed570fc034a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152109 Jul 27 20:41:34.455540 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1775/3568] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:34 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:35.332397 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ffc77de1-771f-4d49-b99c-c0d23dfed9bf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:35.332925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ffc77de1-771f-4d49-b99c-c0d23dfed9bf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:35.339308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ffc77de1-771f-4d49-b99c-c0d23dfed9bf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:35.339754 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ffc77de1-771f-4d49-b99c-c0d23dfed9bf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:35.340506 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ffc77de1-771f-4d49-b99c-c0d23dfed9bf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:35.340942 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ffc77de1-771f-4d49-b99c-c0d23dfed9bf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:35.359611 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:41:35.468993 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ffc77de1-771f-4d49-b99c-c0d23dfed9bf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:35.476835 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ffc77de1-771f-4d49-b99c-c0d23dfed9bf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148369 Jul 27 20:41:35.477421 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1794/3569] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:35 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:35.479120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5b8123fb-1de7-43f4-9360-d0a1baf3af7a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:35.479736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5b8123fb-1de7-43f4-9360-d0a1baf3af7a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:35.487287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b8123fb-1de7-43f4-9360-d0a1baf3af7a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:35.487739 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b8123fb-1de7-43f4-9360-d0a1baf3af7a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:35.488526 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b8123fb-1de7-43f4-9360-d0a1baf3af7a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:35.488983 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b8123fb-1de7-43f4-9360-d0a1baf3af7a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:35.623241 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5b8123fb-1de7-43f4-9360-d0a1baf3af7a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:35.631548 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5b8123fb-1de7-43f4-9360-d0a1baf3af7a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:35.633087 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5b8123fb-1de7-43f4-9360-d0a1baf3af7a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:35.634237 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5b8123fb-1de7-43f4-9360-d0a1baf3af7a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.159016 Jul 27 20:41:35.634796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1776/3570] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:35 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:36.555033 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7d001fb9-ef89-4a4a-8227-50ffdec222f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:36.555638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7d001fb9-ef89-4a4a-8227-50ffdec222f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:36.557941 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=52 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:41:36.563857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d001fb9-ef89-4a4a-8227-50ffdec222f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:36.564317 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d001fb9-ef89-4a4a-8227-50ffdec222f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:36.565111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d001fb9-ef89-4a4a-8227-50ffdec222f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:36.565560 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d001fb9-ef89-4a4a-8227-50ffdec222f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:36.658297 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cd1593f7-c6a2-499e-9be3-c852fe6b6860 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:36.658920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cd1593f7-c6a2-499e-9be3-c852fe6b6860 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:36.665307 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd1593f7-c6a2-499e-9be3-c852fe6b6860 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:36.665752 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd1593f7-c6a2-499e-9be3-c852fe6b6860 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:36.666504 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd1593f7-c6a2-499e-9be3-c852fe6b6860 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:36.666938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd1593f7-c6a2-499e-9be3-c852fe6b6860 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:36.684934 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:41:36.694832 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7d001fb9-ef89-4a4a-8227-50ffdec222f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:36.703245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7d001fb9-ef89-4a4a-8227-50ffdec222f1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151751 Jul 27 20:41:36.703821 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1795/3571] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:36 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:36.799708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cd1593f7-c6a2-499e-9be3-c852fe6b6860 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:36.808040 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cd1593f7-c6a2-499e-9be3-c852fe6b6860 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:36.809500 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cd1593f7-c6a2-499e-9be3-c852fe6b6860 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:36.810706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cd1593f7-c6a2-499e-9be3-c852fe6b6860 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156336 Jul 27 20:41:36.811544 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1777/3572] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:36 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:37.723914 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1ba94c3f-9c16-41f8-8423-ed0912bbf445 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:37.724510 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1ba94c3f-9c16-41f8-8423-ed0912bbf445 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:37.731115 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1ba94c3f-9c16-41f8-8423-ed0912bbf445 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:37.731566 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1ba94c3f-9c16-41f8-8423-ed0912bbf445 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:37.732349 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1ba94c3f-9c16-41f8-8423-ed0912bbf445 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:37.732776 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1ba94c3f-9c16-41f8-8423-ed0912bbf445 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:37.834256 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ab22969f-79a3-4929-ad88-24eacef50a2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:37.834864 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ab22969f-79a3-4929-ad88-24eacef50a2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:37.841221 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab22969f-79a3-4929-ad88-24eacef50a2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:37.841727 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab22969f-79a3-4929-ad88-24eacef50a2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:37.842696 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab22969f-79a3-4929-ad88-24eacef50a2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:37.843122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab22969f-79a3-4929-ad88-24eacef50a2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:37.867622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1ba94c3f-9c16-41f8-8423-ed0912bbf445 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:37.876379 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1ba94c3f-9c16-41f8-8423-ed0912bbf445 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.156268 Jul 27 20:41:37.876954 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1796/3573] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:37 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:37.971058 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ab22969f-79a3-4929-ad88-24eacef50a2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:37.979441 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ab22969f-79a3-4929-ad88-24eacef50a2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:37.980887 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ab22969f-79a3-4929-ad88-24eacef50a2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:37.982079 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ab22969f-79a3-4929-ad88-24eacef50a2a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.151698 Jul 27 20:41:37.983217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1778/3574] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:37 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:38.897564 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-62b083b5-20c9-4f59-b81f-f3c92f8c8f09 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:38.898222 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-62b083b5-20c9-4f59-b81f-f3c92f8c8f09 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:38.905366 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-62b083b5-20c9-4f59-b81f-f3c92f8c8f09 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:38.905826 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-62b083b5-20c9-4f59-b81f-f3c92f8c8f09 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:38.906598 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-62b083b5-20c9-4f59-b81f-f3c92f8c8f09 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:38.907044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-62b083b5-20c9-4f59-b81f-f3c92f8c8f09 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:39.005780 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e3901a1a-5367-471e-a683-3bf0c6aefafb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:39.006397 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e3901a1a-5367-471e-a683-3bf0c6aefafb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:39.008687 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=52 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:41:39.014830 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e3901a1a-5367-471e-a683-3bf0c6aefafb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:39.015290 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e3901a1a-5367-471e-a683-3bf0c6aefafb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:39.016068 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e3901a1a-5367-471e-a683-3bf0c6aefafb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:39.016512 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e3901a1a-5367-471e-a683-3bf0c6aefafb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:39.035008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-62b083b5-20c9-4f59-b81f-f3c92f8c8f09 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:39.042854 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-62b083b5-20c9-4f59-b81f-f3c92f8c8f09 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149137 Jul 27 20:41:39.043427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1797/3575] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:38 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:39.150882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e3901a1a-5367-471e-a683-3bf0c6aefafb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:39.159295 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e3901a1a-5367-471e-a683-3bf0c6aefafb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:39.160801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e3901a1a-5367-471e-a683-3bf0c6aefafb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:39.161995 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e3901a1a-5367-471e-a683-3bf0c6aefafb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.160133 Jul 27 20:41:39.162557 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1779/3576] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:39 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:40.064378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e13aefcc-fead-460f-b232-d98279db3a27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:40.065113 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e13aefcc-fead-460f-b232-d98279db3a27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:40.071580 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e13aefcc-fead-460f-b232-d98279db3a27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:40.072048 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e13aefcc-fead-460f-b232-d98279db3a27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:40.072833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e13aefcc-fead-460f-b232-d98279db3a27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:40.073378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e13aefcc-fead-460f-b232-d98279db3a27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:40.185125 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e91f9045-72b2-449b-a675-26b7442f508a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:40.185747 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e91f9045-72b2-449b-a675-26b7442f508a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:40.192171 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e91f9045-72b2-449b-a675-26b7442f508a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:40.192613 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e91f9045-72b2-449b-a675-26b7442f508a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:40.193411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e91f9045-72b2-449b-a675-26b7442f508a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:40.194035 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e91f9045-72b2-449b-a675-26b7442f508a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:40.211528 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e13aefcc-fead-460f-b232-d98279db3a27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:40.220536 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e13aefcc-fead-460f-b232-d98279db3a27 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.160193 Jul 27 20:41:40.221377 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1798/3577] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:40 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:40.320896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e91f9045-72b2-449b-a675-26b7442f508a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:40.330161 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e91f9045-72b2-449b-a675-26b7442f508a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:40.331645 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e91f9045-72b2-449b-a675-26b7442f508a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:40.332796 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e91f9045-72b2-449b-a675-26b7442f508a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.151555 Jul 27 20:41:40.333365 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1780/3578] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:40 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:41:41.242921 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-58c4ce5e-e147-40c6-afe9-67c7780180f6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:41.243580 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-58c4ce5e-e147-40c6-afe9-67c7780180f6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:41.250137 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-58c4ce5e-e147-40c6-afe9-67c7780180f6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:41.250590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-58c4ce5e-e147-40c6-afe9-67c7780180f6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:41.251360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-58c4ce5e-e147-40c6-afe9-67c7780180f6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:41.251807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-58c4ce5e-e147-40c6-afe9-67c7780180f6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:41.356906 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0b1de683-7eb2-40b8-a5a8-a026d545aa8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:41.358137 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0b1de683-7eb2-40b8-a5a8-a026d545aa8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:41.365225 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b1de683-7eb2-40b8-a5a8-a026d545aa8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:41.365679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b1de683-7eb2-40b8-a5a8-a026d545aa8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:41.366459 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b1de683-7eb2-40b8-a5a8-a026d545aa8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:41.366898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b1de683-7eb2-40b8-a5a8-a026d545aa8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:41.507228 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0b1de683-7eb2-40b8-a5a8-a026d545aa8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:41.516861 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0b1de683-7eb2-40b8-a5a8-a026d545aa8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:41.518416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0b1de683-7eb2-40b8-a5a8-a026d545aa8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:41.519589 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0b1de683-7eb2-40b8-a5a8-a026d545aa8e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.166687 Jul 27 20:41:41.520151 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1781/3579] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:41 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:41.538612 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-58c4ce5e-e147-40c6-afe9-67c7780180f6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:41.547290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-58c4ce5e-e147-40c6-afe9-67c7780180f6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.308301 Jul 27 20:41:41.547851 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1799/3580] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:41 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:42.543203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f72e366b-9e7f-46d1-89ed-571203e677d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:42.543822 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f72e366b-9e7f-46d1-89ed-571203e677d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:42.550758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f72e366b-9e7f-46d1-89ed-571203e677d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:42.551201 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f72e366b-9e7f-46d1-89ed-571203e677d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:42.551951 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f72e366b-9e7f-46d1-89ed-571203e677d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:42.552433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f72e366b-9e7f-46d1-89ed-571203e677d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:42.568899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-21d52164-d949-476e-9123-969b73b084c8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:42.569544 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-21d52164-d949-476e-9123-969b73b084c8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:42.576006 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-21d52164-d949-476e-9123-969b73b084c8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:42.576470 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-21d52164-d949-476e-9123-969b73b084c8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:42.577440 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-21d52164-d949-476e-9123-969b73b084c8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:42.578150 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-21d52164-d949-476e-9123-969b73b084c8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:42.685380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f72e366b-9e7f-46d1-89ed-571203e677d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:42.694968 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f72e366b-9e7f-46d1-89ed-571203e677d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:42.696461 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f72e366b-9e7f-46d1-89ed-571203e677d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:42.697654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f72e366b-9e7f-46d1-89ed-571203e677d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.158445 Jul 27 20:41:42.698218 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1782/3581] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:42 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:41:42.710881 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-21d52164-d949-476e-9123-969b73b084c8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:42.720279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-21d52164-d949-476e-9123-969b73b084c8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.154981 Jul 27 20:41:42.721200 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1800/3582] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:42 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:41:43.084857 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:41:43.085049 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:41:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:41:43.721347 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-76b307d5-31f1-4d56-aa37-71b6f47bc890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:43.722019 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-76b307d5-31f1-4d56-aa37-71b6f47bc890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:43.728351 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76b307d5-31f1-4d56-aa37-71b6f47bc890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:43.728793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76b307d5-31f1-4d56-aa37-71b6f47bc890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:43.729567 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76b307d5-31f1-4d56-aa37-71b6f47bc890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:43.730000 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76b307d5-31f1-4d56-aa37-71b6f47bc890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:43.743401 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-eb77f6fa-8919-4cb4-b253-9d0ab78525f2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:43.744016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-eb77f6fa-8919-4cb4-b253-9d0ab78525f2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:43.751085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eb77f6fa-8919-4cb4-b253-9d0ab78525f2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:43.751540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eb77f6fa-8919-4cb4-b253-9d0ab78525f2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:43.752319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eb77f6fa-8919-4cb4-b253-9d0ab78525f2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:43.752767 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eb77f6fa-8919-4cb4-b253-9d0ab78525f2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:43.867699 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-76b307d5-31f1-4d56-aa37-71b6f47bc890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:43.876803 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-76b307d5-31f1-4d56-aa37-71b6f47bc890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:43.878342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-76b307d5-31f1-4d56-aa37-71b6f47bc890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:43.879515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-76b307d5-31f1-4d56-aa37-71b6f47bc890 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.162035 Jul 27 20:41:43.880073 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1783/3583] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:43 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:41:43.884552 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-eb77f6fa-8919-4cb4-b253-9d0ab78525f2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:43.892671 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-eb77f6fa-8919-4cb4-b253-9d0ab78525f2 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153046 Jul 27 20:41:43.893262 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1801/3584] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:43 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:41:44.902255 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a36b5ea9-f075-4d1c-845f-d2d5cbef674f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:44.902895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a36b5ea9-f075-4d1c-845f-d2d5cbef674f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:44.910091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a36b5ea9-f075-4d1c-845f-d2d5cbef674f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:44.910536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a36b5ea9-f075-4d1c-845f-d2d5cbef674f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:44.911294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a36b5ea9-f075-4d1c-845f-d2d5cbef674f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:44.911727 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a36b5ea9-f075-4d1c-845f-d2d5cbef674f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:44.913665 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d9f9202a-debf-41c4-98c4-cba7041360db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:44.914289 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d9f9202a-debf-41c4-98c4-cba7041360db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:44.920799 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d9f9202a-debf-41c4-98c4-cba7041360db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:44.921299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d9f9202a-debf-41c4-98c4-cba7041360db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:44.922077 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d9f9202a-debf-41c4-98c4-cba7041360db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:44.922524 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d9f9202a-debf-41c4-98c4-cba7041360db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:45.042098 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a36b5ea9-f075-4d1c-845f-d2d5cbef674f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:45.050942 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d9f9202a-debf-41c4-98c4-cba7041360db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:45.051149 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a36b5ea9-f075-4d1c-845f-d2d5cbef674f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:45.052483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a36b5ea9-f075-4d1c-845f-d2d5cbef674f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:45.053670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a36b5ea9-f075-4d1c-845f-d2d5cbef674f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155319 Jul 27 20:41:45.054232 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1784/3585] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:44 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:41:45.059155 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d9f9202a-debf-41c4-98c4-cba7041360db tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149292 Jul 27 20:41:45.059715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1802/3586] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:44 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:41:46.080310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f70232c4-746d-48ef-92a0-aa736535025a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:46.080928 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f70232c4-746d-48ef-92a0-aa736535025a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:46.081075 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b03cccee-bcac-4ea3-9e49-29da34789092 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:46.081641 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b03cccee-bcac-4ea3-9e49-29da34789092 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:46.087514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f70232c4-746d-48ef-92a0-aa736535025a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:46.087964 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b03cccee-bcac-4ea3-9e49-29da34789092 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:46.088110 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f70232c4-746d-48ef-92a0-aa736535025a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:46.088417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b03cccee-bcac-4ea3-9e49-29da34789092 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:46.088742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f70232c4-746d-48ef-92a0-aa736535025a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:46.089207 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b03cccee-bcac-4ea3-9e49-29da34789092 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:46.089340 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f70232c4-746d-48ef-92a0-aa736535025a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:46.089707 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b03cccee-bcac-4ea3-9e49-29da34789092 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:46.221530 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b03cccee-bcac-4ea3-9e49-29da34789092 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:46.222810 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f70232c4-746d-48ef-92a0-aa736535025a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:46.229407 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b03cccee-bcac-4ea3-9e49-29da34789092 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153182 Jul 27 20:41:46.229975 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1803/3587] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:46 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:41:46.231053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f70232c4-746d-48ef-92a0-aa736535025a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:46.233360 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f70232c4-746d-48ef-92a0-aa736535025a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:46.234523 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f70232c4-746d-48ef-92a0-aa736535025a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.159896 Jul 27 20:41:46.235065 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1785/3588] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:46 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:46.961564 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:41:46.961844 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:41:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:41:47.251170 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d21a02da-38b9-48d2-aed3-6017d0e94432 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:47.251759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d21a02da-38b9-48d2-aed3-6017d0e94432 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:47.257872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-55eb09e9-392e-4e6f-a96c-c198983e8309 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:47.258359 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d21a02da-38b9-48d2-aed3-6017d0e94432 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:47.258519 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-55eb09e9-392e-4e6f-a96c-c198983e8309 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:47.258676 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d21a02da-38b9-48d2-aed3-6017d0e94432 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:47.259387 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d21a02da-38b9-48d2-aed3-6017d0e94432 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:47.259827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d21a02da-38b9-48d2-aed3-6017d0e94432 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:47.265046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55eb09e9-392e-4e6f-a96c-c198983e8309 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:47.265506 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55eb09e9-392e-4e6f-a96c-c198983e8309 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:47.266274 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55eb09e9-392e-4e6f-a96c-c198983e8309 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:47.266711 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55eb09e9-392e-4e6f-a96c-c198983e8309 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:47.309838 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:41:47.310104 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:41:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff (ip 10.222.0.65) !!! Jul 27 20:41:47.392609 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d21a02da-38b9-48d2-aed3-6017d0e94432 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:47.393233 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-55eb09e9-392e-4e6f-a96c-c198983e8309 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:47.400768 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d21a02da-38b9-48d2-aed3-6017d0e94432 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153574 Jul 27 20:41:47.401370 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1804/3589] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:47 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:47.401644 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-55eb09e9-392e-4e6f-a96c-c198983e8309 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:47.403152 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-55eb09e9-392e-4e6f-a96c-c198983e8309 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:47.404912 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-55eb09e9-392e-4e6f-a96c-c198983e8309 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.150843 Jul 27 20:41:47.405491 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1786/3590] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:47 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:48.422921 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8d2466c2-de3f-474b-b01c-247ea9849848 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:48.423540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8d2466c2-de3f-474b-b01c-247ea9849848 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:48.427550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4b7d752f-adc7-4a85-98cb-90706fbce193 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:48.428197 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4b7d752f-adc7-4a85-98cb-90706fbce193 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:48.430167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8d2466c2-de3f-474b-b01c-247ea9849848 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:48.430617 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8d2466c2-de3f-474b-b01c-247ea9849848 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:48.431379 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8d2466c2-de3f-474b-b01c-247ea9849848 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:48.431818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8d2466c2-de3f-474b-b01c-247ea9849848 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:48.434628 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b7d752f-adc7-4a85-98cb-90706fbce193 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:48.435085 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b7d752f-adc7-4a85-98cb-90706fbce193 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:48.436635 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b7d752f-adc7-4a85-98cb-90706fbce193 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:48.437110 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b7d752f-adc7-4a85-98cb-90706fbce193 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:48.566183 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4b7d752f-adc7-4a85-98cb-90706fbce193 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:48.566360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8d2466c2-de3f-474b-b01c-247ea9849848 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:48.574238 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8d2466c2-de3f-474b-b01c-247ea9849848 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.155856 Jul 27 20:41:48.574671 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4b7d752f-adc7-4a85-98cb-90706fbce193 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:48.575104 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1805/3591] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:48 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:48.576211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4b7d752f-adc7-4a85-98cb-90706fbce193 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:48.577404 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4b7d752f-adc7-4a85-98cb-90706fbce193 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153816 Jul 27 20:41:48.578227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1787/3592] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:48 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:49.595832 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-542e279d-9be1-426c-b223-7543d3b76b60 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:49.596446 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-542e279d-9be1-426c-b223-7543d3b76b60 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:49.600608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d20e7065-9c5b-40f8-9a62-0f9ac68581cd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:49.601242 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d20e7065-9c5b-40f8-9a62-0f9ac68581cd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:49.602959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-542e279d-9be1-426c-b223-7543d3b76b60 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:49.603418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-542e279d-9be1-426c-b223-7543d3b76b60 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:49.604539 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-542e279d-9be1-426c-b223-7543d3b76b60 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:49.604679 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-542e279d-9be1-426c-b223-7543d3b76b60 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:49.607608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d20e7065-9c5b-40f8-9a62-0f9ac68581cd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:49.608057 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d20e7065-9c5b-40f8-9a62-0f9ac68581cd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:49.608816 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d20e7065-9c5b-40f8-9a62-0f9ac68581cd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:49.609276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d20e7065-9c5b-40f8-9a62-0f9ac68581cd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:49.734889 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-542e279d-9be1-426c-b223-7543d3b76b60 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:49.742299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d20e7065-9c5b-40f8-9a62-0f9ac68581cd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:49.743878 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-542e279d-9be1-426c-b223-7543d3b76b60 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151773 Jul 27 20:41:49.744319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1806/3593] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:49 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:49.752717 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d20e7065-9c5b-40f8-9a62-0f9ac68581cd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:49.754194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d20e7065-9c5b-40f8-9a62-0f9ac68581cd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:49.755498 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d20e7065-9c5b-40f8-9a62-0f9ac68581cd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.158735 Jul 27 20:41:49.756256 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1788/3594] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:49 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:50.768111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fb875a68-fc41-4394-b6ed-1d356f4df2e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:50.768730 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-fb875a68-fc41-4394-b6ed-1d356f4df2e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:50.776599 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fb875a68-fc41-4394-b6ed-1d356f4df2e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:50.777092 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fb875a68-fc41-4394-b6ed-1d356f4df2e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:50.777874 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fb875a68-fc41-4394-b6ed-1d356f4df2e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:50.778323 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-fb875a68-fc41-4394-b6ed-1d356f4df2e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:50.780397 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ce79e4ea-b7ae-4fe3-b1c9-d91e3ec25521 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:50.781036 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ce79e4ea-b7ae-4fe3-b1c9-d91e3ec25521 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:50.792882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ce79e4ea-b7ae-4fe3-b1c9-d91e3ec25521 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:50.793363 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ce79e4ea-b7ae-4fe3-b1c9-d91e3ec25521 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:50.794140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ce79e4ea-b7ae-4fe3-b1c9-d91e3ec25521 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:50.794622 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ce79e4ea-b7ae-4fe3-b1c9-d91e3ec25521 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:50.911568 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-fb875a68-fc41-4394-b6ed-1d356f4df2e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:50.919759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fb875a68-fc41-4394-b6ed-1d356f4df2e9 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.155422 Jul 27 20:41:50.920337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1807/3595] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:50 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:50.921956 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ce79e4ea-b7ae-4fe3-b1c9-d91e3ec25521 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:50.930412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ce79e4ea-b7ae-4fe3-b1c9-d91e3ec25521 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:50.931915 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ce79e4ea-b7ae-4fe3-b1c9-d91e3ec25521 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:50.933130 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ce79e4ea-b7ae-4fe3-b1c9-d91e3ec25521 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157422 Jul 27 20:41:50.933709 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1789/3596] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:50 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:41:51.942007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-eae8c58d-dd8c-4757-8848-8b90643f1f41 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:51.942623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-eae8c58d-dd8c-4757-8848-8b90643f1f41 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:51.949097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eae8c58d-dd8c-4757-8848-8b90643f1f41 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:51.949560 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eae8c58d-dd8c-4757-8848-8b90643f1f41 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:51.950329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eae8c58d-dd8c-4757-8848-8b90643f1f41 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:51.950777 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-eae8c58d-dd8c-4757-8848-8b90643f1f41 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:51.955970 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a8a1633f-e434-4047-b003-2e9149efe5ae tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:51.956593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a8a1633f-e434-4047-b003-2e9149efe5ae tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:51.963020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a8a1633f-e434-4047-b003-2e9149efe5ae tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:51.963473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a8a1633f-e434-4047-b003-2e9149efe5ae tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:51.964237 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a8a1633f-e434-4047-b003-2e9149efe5ae tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:51.964677 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a8a1633f-e434-4047-b003-2e9149efe5ae tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:52.082748 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-eae8c58d-dd8c-4757-8848-8b90643f1f41 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:52.090793 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-eae8c58d-dd8c-4757-8848-8b90643f1f41 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152586 Jul 27 20:41:52.092667 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1808/3597] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:51 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:52.101297 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a8a1633f-e434-4047-b003-2e9149efe5ae tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:52.110326 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a8a1633f-e434-4047-b003-2e9149efe5ae tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:52.111847 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a8a1633f-e434-4047-b003-2e9149efe5ae tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:52.113055 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a8a1633f-e434-4047-b003-2e9149efe5ae tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.161317 Jul 27 20:41:52.113607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1790/3598] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:51 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:53.112221 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f24d559e-6c52-45ab-861f-1146a61f7216 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:53.112830 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f24d559e-6c52-45ab-861f-1146a61f7216 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:53.119328 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f24d559e-6c52-45ab-861f-1146a61f7216 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:53.119779 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f24d559e-6c52-45ab-861f-1146a61f7216 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:53.120538 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f24d559e-6c52-45ab-861f-1146a61f7216 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:53.120985 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f24d559e-6c52-45ab-861f-1146a61f7216 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:53.135621 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-46b38838-6fd5-411a-b9ac-519550cd1257 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:53.136371 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-46b38838-6fd5-411a-b9ac-519550cd1257 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:53.142999 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-46b38838-6fd5-411a-b9ac-519550cd1257 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:53.143447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-46b38838-6fd5-411a-b9ac-519550cd1257 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:53.144212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-46b38838-6fd5-411a-b9ac-519550cd1257 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:53.144688 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-46b38838-6fd5-411a-b9ac-519550cd1257 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:53.251402 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f24d559e-6c52-45ab-861f-1146a61f7216 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:53.259415 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f24d559e-6c52-45ab-861f-1146a61f7216 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151096 Jul 27 20:41:53.259980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1809/3599] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:53 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:53.276387 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-46b38838-6fd5-411a-b9ac-519550cd1257 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:53.285452 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-46b38838-6fd5-411a-b9ac-519550cd1257 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:53.286940 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-46b38838-6fd5-411a-b9ac-519550cd1257 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:53.288083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-46b38838-6fd5-411a-b9ac-519550cd1257 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156297 Jul 27 20:41:53.288629 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1791/3600] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:53 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:54.279702 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7ec7bab2-f91f-4df2-a030-3238a982b4a6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:54.280327 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7ec7bab2-f91f-4df2-a030-3238a982b4a6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:54.286818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7ec7bab2-f91f-4df2-a030-3238a982b4a6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:54.287273 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7ec7bab2-f91f-4df2-a030-3238a982b4a6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:54.288043 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7ec7bab2-f91f-4df2-a030-3238a982b4a6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:54.288491 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7ec7bab2-f91f-4df2-a030-3238a982b4a6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:54.312159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7dca0ad8-1fb9-40c5-8458-0cae646aa2bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:54.312768 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7dca0ad8-1fb9-40c5-8458-0cae646aa2bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:54.319213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7dca0ad8-1fb9-40c5-8458-0cae646aa2bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:54.319658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7dca0ad8-1fb9-40c5-8458-0cae646aa2bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:54.320448 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7dca0ad8-1fb9-40c5-8458-0cae646aa2bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:54.320887 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7dca0ad8-1fb9-40c5-8458-0cae646aa2bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:54.420523 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7ec7bab2-f91f-4df2-a030-3238a982b4a6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:54.428266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7ec7bab2-f91f-4df2-a030-3238a982b4a6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152442 Jul 27 20:41:54.428858 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1810/3601] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:54 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:54.451782 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7dca0ad8-1fb9-40c5-8458-0cae646aa2bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:54.460341 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7dca0ad8-1fb9-40c5-8458-0cae646aa2bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:54.461918 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7dca0ad8-1fb9-40c5-8458-0cae646aa2bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:54.463073 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7dca0ad8-1fb9-40c5-8458-0cae646aa2bf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155318 Jul 27 20:41:54.463626 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1792/3602] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:54 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:55.450208 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-209638b3-a68b-4a39-a91b-4c604195575c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:55.451378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-209638b3-a68b-4a39-a91b-4c604195575c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:55.458089 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-209638b3-a68b-4a39-a91b-4c604195575c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:55.458547 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-209638b3-a68b-4a39-a91b-4c604195575c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:55.459313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-209638b3-a68b-4a39-a91b-4c604195575c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:55.459759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-209638b3-a68b-4a39-a91b-4c604195575c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:55.463623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:41:55.486951 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-eaaa3ef5-d94c-4587-acdc-e236a736e9ed tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:55.487589 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-eaaa3ef5-d94c-4587-acdc-e236a736e9ed tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:55.494081 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eaaa3ef5-d94c-4587-acdc-e236a736e9ed tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:55.494530 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eaaa3ef5-d94c-4587-acdc-e236a736e9ed tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:55.495288 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eaaa3ef5-d94c-4587-acdc-e236a736e9ed tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:55.495733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eaaa3ef5-d94c-4587-acdc-e236a736e9ed tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:55.592019 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-209638b3-a68b-4a39-a91b-4c604195575c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:55.600617 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-209638b3-a68b-4a39-a91b-4c604195575c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.154274 Jul 27 20:41:55.601229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1811/3603] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:55 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:55.630581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eaaa3ef5-d94c-4587-acdc-e236a736e9ed tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:55.639505 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eaaa3ef5-d94c-4587-acdc-e236a736e9ed tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:55.641025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eaaa3ef5-d94c-4587-acdc-e236a736e9ed tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:55.642181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-eaaa3ef5-d94c-4587-acdc-e236a736e9ed tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.159096 Jul 27 20:41:55.642735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1793/3604] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:55 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:56.621837 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-29011c71-2e39-4cda-ade4-69e9ef7afa89 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:56.623043 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-29011c71-2e39-4cda-ade4-69e9ef7afa89 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:56.629592 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-29011c71-2e39-4cda-ade4-69e9ef7afa89 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:56.630046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-29011c71-2e39-4cda-ade4-69e9ef7afa89 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:56.630812 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-29011c71-2e39-4cda-ade4-69e9ef7afa89 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:56.631254 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-29011c71-2e39-4cda-ade4-69e9ef7afa89 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:56.665405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-aa990a8d-8f9d-411d-9629-d8a576af022c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:56.666006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-aa990a8d-8f9d-411d-9629-d8a576af022c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:56.673035 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa990a8d-8f9d-411d-9629-d8a576af022c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:56.673497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa990a8d-8f9d-411d-9629-d8a576af022c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:56.674279 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa990a8d-8f9d-411d-9629-d8a576af022c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:56.674723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa990a8d-8f9d-411d-9629-d8a576af022c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:56.679309 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:41:56.763248 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-29011c71-2e39-4cda-ade4-69e9ef7afa89 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:56.771319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-29011c71-2e39-4cda-ade4-69e9ef7afa89 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153355 Jul 27 20:41:56.771889 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1812/3605] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:56 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:56.805091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aa990a8d-8f9d-411d-9629-d8a576af022c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:56.814173 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aa990a8d-8f9d-411d-9629-d8a576af022c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:56.815669 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aa990a8d-8f9d-411d-9629-d8a576af022c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:56.816810 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-aa990a8d-8f9d-411d-9629-d8a576af022c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155277 Jul 27 20:41:56.817396 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1794/3606] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:56 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:41:57.792747 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a5c6f858-e9d9-4c35-90b0-e8b5663deaaf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:57.793421 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a5c6f858-e9d9-4c35-90b0-e8b5663deaaf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:57.799963 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a5c6f858-e9d9-4c35-90b0-e8b5663deaaf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:57.800425 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a5c6f858-e9d9-4c35-90b0-e8b5663deaaf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:57.801299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a5c6f858-e9d9-4c35-90b0-e8b5663deaaf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:57.801748 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a5c6f858-e9d9-4c35-90b0-e8b5663deaaf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:57.840146 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-494b4647-2fcb-4fb3-8344-6884c7c2fbbb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:57.840751 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-494b4647-2fcb-4fb3-8344-6884c7c2fbbb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:57.847460 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-494b4647-2fcb-4fb3-8344-6884c7c2fbbb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:57.847902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-494b4647-2fcb-4fb3-8344-6884c7c2fbbb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:57.848679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-494b4647-2fcb-4fb3-8344-6884c7c2fbbb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:57.849120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-494b4647-2fcb-4fb3-8344-6884c7c2fbbb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:57.936278 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a5c6f858-e9d9-4c35-90b0-e8b5663deaaf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:57.944266 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a5c6f858-e9d9-4c35-90b0-e8b5663deaaf tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.155356 Jul 27 20:41:57.945075 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1813/3607] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:57 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:58.212114 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-494b4647-2fcb-4fb3-8344-6884c7c2fbbb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:58.220454 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-494b4647-2fcb-4fb3-8344-6884c7c2fbbb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:58.221985 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-494b4647-2fcb-4fb3-8344-6884c7c2fbbb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:58.223128 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-494b4647-2fcb-4fb3-8344-6884c7c2fbbb tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.386748 Jul 27 20:41:58.223682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1795/3608] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:57 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:41:58.967532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bec46df8-f43d-4147-be7f-db759172a689 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:58.968149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bec46df8-f43d-4147-be7f-db759172a689 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:58.974793 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bec46df8-f43d-4147-be7f-db759172a689 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:58.975247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bec46df8-f43d-4147-be7f-db759172a689 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:58.976012 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bec46df8-f43d-4147-be7f-db759172a689 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:58.976483 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bec46df8-f43d-4147-be7f-db759172a689 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:59.105196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bec46df8-f43d-4147-be7f-db759172a689 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:59.113141 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bec46df8-f43d-4147-be7f-db759172a689 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150071 Jul 27 20:41:59.113807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1814/3609] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:41:58 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:41:59.245923 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9f65db38-a9dd-4685-a08f-198a2b97cae6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:41:59.246445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9f65db38-a9dd-4685-a08f-198a2b97cae6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:41:59.253483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f65db38-a9dd-4685-a08f-198a2b97cae6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:59.253933 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f65db38-a9dd-4685-a08f-198a2b97cae6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:59.254686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f65db38-a9dd-4685-a08f-198a2b97cae6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:41:59.255118 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f65db38-a9dd-4685-a08f-198a2b97cae6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:41:59.380430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9f65db38-a9dd-4685-a08f-198a2b97cae6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:59.389535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9f65db38-a9dd-4685-a08f-198a2b97cae6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:59.391064 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9f65db38-a9dd-4685-a08f-198a2b97cae6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:41:59.392213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9f65db38-a9dd-4685-a08f-198a2b97cae6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.150213 Jul 27 20:41:59.392761 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1796/3610] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:41:59 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:00.134657 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1d56d9f1-f1fe-4d67-b42f-163ba48ad6cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:00.135270 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1d56d9f1-f1fe-4d67-b42f-163ba48ad6cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:00.141808 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1d56d9f1-f1fe-4d67-b42f-163ba48ad6cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:00.142258 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1d56d9f1-f1fe-4d67-b42f-163ba48ad6cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:00.143016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1d56d9f1-f1fe-4d67-b42f-163ba48ad6cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:00.143453 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1d56d9f1-f1fe-4d67-b42f-163ba48ad6cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:00.273370 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1d56d9f1-f1fe-4d67-b42f-163ba48ad6cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:00.281831 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1d56d9f1-f1fe-4d67-b42f-163ba48ad6cd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151040 Jul 27 20:42:00.282386 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1815/3611] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:00 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:00.415543 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0cd9860f-0e85-40df-9605-ea92e4ab3801 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:00.416182 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0cd9860f-0e85-40df-9605-ea92e4ab3801 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:00.422606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0cd9860f-0e85-40df-9605-ea92e4ab3801 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:00.423050 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0cd9860f-0e85-40df-9605-ea92e4ab3801 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:00.423805 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0cd9860f-0e85-40df-9605-ea92e4ab3801 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:00.424239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0cd9860f-0e85-40df-9605-ea92e4ab3801 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:00.557719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0cd9860f-0e85-40df-9605-ea92e4ab3801 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:00.566197 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0cd9860f-0e85-40df-9605-ea92e4ab3801 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:00.567695 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0cd9860f-0e85-40df-9605-ea92e4ab3801 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:00.568854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0cd9860f-0e85-40df-9605-ea92e4ab3801 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157187 Jul 27 20:42:00.569450 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1797/3612] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:00 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:01.303428 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bb0be7cb-e3cc-433a-9091-d67106dfdd8a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:01.304048 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bb0be7cb-e3cc-433a-9091-d67106dfdd8a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:01.311508 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb0be7cb-e3cc-433a-9091-d67106dfdd8a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:01.311967 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb0be7cb-e3cc-433a-9091-d67106dfdd8a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:01.312738 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb0be7cb-e3cc-433a-9091-d67106dfdd8a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:01.313214 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb0be7cb-e3cc-433a-9091-d67106dfdd8a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:01.439486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bb0be7cb-e3cc-433a-9091-d67106dfdd8a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:01.447392 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bb0be7cb-e3cc-433a-9091-d67106dfdd8a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.147910 Jul 27 20:42:01.447955 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1816/3613] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:01 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:01.593382 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-42e2c8bc-19ad-40dd-bc3c-9370fd3d9537 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:01.593993 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-42e2c8bc-19ad-40dd-bc3c-9370fd3d9537 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:01.600332 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-42e2c8bc-19ad-40dd-bc3c-9370fd3d9537 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:01.600775 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-42e2c8bc-19ad-40dd-bc3c-9370fd3d9537 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:01.601559 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-42e2c8bc-19ad-40dd-bc3c-9370fd3d9537 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:01.601991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-42e2c8bc-19ad-40dd-bc3c-9370fd3d9537 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:01.727440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-42e2c8bc-19ad-40dd-bc3c-9370fd3d9537 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:01.736363 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-42e2c8bc-19ad-40dd-bc3c-9370fd3d9537 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:01.737878 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-42e2c8bc-19ad-40dd-bc3c-9370fd3d9537 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:01.739026 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-42e2c8bc-19ad-40dd-bc3c-9370fd3d9537 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.150090 Jul 27 20:42:01.739573 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1798/3614] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:01 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:02.468449 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bc24f5a0-692a-4dd5-8ac6-51c2e640f5f8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:02.469106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bc24f5a0-692a-4dd5-8ac6-51c2e640f5f8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:02.475139 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bc24f5a0-692a-4dd5-8ac6-51c2e640f5f8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:02.475601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bc24f5a0-692a-4dd5-8ac6-51c2e640f5f8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:02.476380 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bc24f5a0-692a-4dd5-8ac6-51c2e640f5f8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:02.476827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bc24f5a0-692a-4dd5-8ac6-51c2e640f5f8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:02.607160 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bc24f5a0-692a-4dd5-8ac6-51c2e640f5f8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:02.615054 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bc24f5a0-692a-4dd5-8ac6-51c2e640f5f8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150778 Jul 27 20:42:02.615623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1817/3615] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:02 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:02.762646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-370d5e2e-a9a3-405d-b8d3-0c0ed0a57b40 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:02.763310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-370d5e2e-a9a3-405d-b8d3-0c0ed0a57b40 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:02.769914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-370d5e2e-a9a3-405d-b8d3-0c0ed0a57b40 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:02.770362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-370d5e2e-a9a3-405d-b8d3-0c0ed0a57b40 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:02.771139 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-370d5e2e-a9a3-405d-b8d3-0c0ed0a57b40 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:02.771554 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-370d5e2e-a9a3-405d-b8d3-0c0ed0a57b40 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:02.901382 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-370d5e2e-a9a3-405d-b8d3-0c0ed0a57b40 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:02.910172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-370d5e2e-a9a3-405d-b8d3-0c0ed0a57b40 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:02.911670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-370d5e2e-a9a3-405d-b8d3-0c0ed0a57b40 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:02.912814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-370d5e2e-a9a3-405d-b8d3-0c0ed0a57b40 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.154144 Jul 27 20:42:02.913582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1799/3616] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:02 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:03.636361 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e13d1761-f3b1-4c83-a1ab-f1530c1a0444 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:03.636995 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e13d1761-f3b1-4c83-a1ab-f1530c1a0444 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:03.643989 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e13d1761-f3b1-4c83-a1ab-f1530c1a0444 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:03.644439 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e13d1761-f3b1-4c83-a1ab-f1530c1a0444 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:03.645228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e13d1761-f3b1-4c83-a1ab-f1530c1a0444 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:03.645702 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e13d1761-f3b1-4c83-a1ab-f1530c1a0444 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:03.785657 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e13d1761-f3b1-4c83-a1ab-f1530c1a0444 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:03.793517 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e13d1761-f3b1-4c83-a1ab-f1530c1a0444 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.161073 Jul 27 20:42:03.794075 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1818/3617] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:03 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:03.936943 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c994f50f-034c-4489-94af-0fa8db420744 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:03.937519 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c994f50f-034c-4489-94af-0fa8db420744 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:03.943860 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c994f50f-034c-4489-94af-0fa8db420744 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:03.944306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c994f50f-034c-4489-94af-0fa8db420744 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:03.945082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c994f50f-034c-4489-94af-0fa8db420744 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:03.945517 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c994f50f-034c-4489-94af-0fa8db420744 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:04.070449 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c994f50f-034c-4489-94af-0fa8db420744 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:04.079971 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c994f50f-034c-4489-94af-0fa8db420744 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:04.081517 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c994f50f-034c-4489-94af-0fa8db420744 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:04.082668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c994f50f-034c-4489-94af-0fa8db420744 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.150244 Jul 27 20:42:04.083228 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1800/3618] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:03 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:04.815074 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-34231304-58e0-42de-a21a-429cc4498909 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:04.815690 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-34231304-58e0-42de-a21a-429cc4498909 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:04.822171 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-34231304-58e0-42de-a21a-429cc4498909 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:04.822623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-34231304-58e0-42de-a21a-429cc4498909 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:04.823385 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-34231304-58e0-42de-a21a-429cc4498909 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:04.823826 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-34231304-58e0-42de-a21a-429cc4498909 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:04.952143 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-34231304-58e0-42de-a21a-429cc4498909 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:04.960323 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-34231304-58e0-42de-a21a-429cc4498909 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149127 Jul 27 20:42:04.960884 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1819/3619] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:04 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:05.106800 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2ed73d50-8db2-40c3-a217-60f24dbf1277 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:05.107506 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2ed73d50-8db2-40c3-a217-60f24dbf1277 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:05.113984 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ed73d50-8db2-40c3-a217-60f24dbf1277 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:05.114424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ed73d50-8db2-40c3-a217-60f24dbf1277 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:05.115174 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ed73d50-8db2-40c3-a217-60f24dbf1277 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:05.115603 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ed73d50-8db2-40c3-a217-60f24dbf1277 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:05.243295 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2ed73d50-8db2-40c3-a217-60f24dbf1277 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:05.252238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2ed73d50-8db2-40c3-a217-60f24dbf1277 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:05.253765 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2ed73d50-8db2-40c3-a217-60f24dbf1277 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:05.254903 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2ed73d50-8db2-40c3-a217-60f24dbf1277 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152027 Jul 27 20:42:05.255458 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1801/3620] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:05 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:05.982612 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b882b012-46d8-4c5d-9ec7-ae0cebc5e79c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:05.983234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b882b012-46d8-4c5d-9ec7-ae0cebc5e79c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:05.989848 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b882b012-46d8-4c5d-9ec7-ae0cebc5e79c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:05.990306 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b882b012-46d8-4c5d-9ec7-ae0cebc5e79c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:05.991080 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b882b012-46d8-4c5d-9ec7-ae0cebc5e79c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:05.991526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b882b012-46d8-4c5d-9ec7-ae0cebc5e79c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:06.119083 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b882b012-46d8-4c5d-9ec7-ae0cebc5e79c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:06.127082 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b882b012-46d8-4c5d-9ec7-ae0cebc5e79c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149099 Jul 27 20:42:06.127651 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1820/3621] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:05 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:06.157859 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:42:06.158055 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:42:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:42:06.279174 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-02ccc96a-34a6-4642-9a6d-ff07d4f7d593 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:06.279772 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-02ccc96a-34a6-4642-9a6d-ff07d4f7d593 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:06.286186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02ccc96a-34a6-4642-9a6d-ff07d4f7d593 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:06.286631 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02ccc96a-34a6-4642-9a6d-ff07d4f7d593 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:06.287375 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02ccc96a-34a6-4642-9a6d-ff07d4f7d593 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:06.287805 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02ccc96a-34a6-4642-9a6d-ff07d4f7d593 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:06.419375 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-02ccc96a-34a6-4642-9a6d-ff07d4f7d593 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:06.427876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-02ccc96a-34a6-4642-9a6d-ff07d4f7d593 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:06.429397 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-02ccc96a-34a6-4642-9a6d-ff07d4f7d593 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:06.430545 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-02ccc96a-34a6-4642-9a6d-ff07d4f7d593 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155691 Jul 27 20:42:06.431106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1802/3622] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:06 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:07.147581 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-838b27cc-96a1-4c41-a13d-d50019e43845 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:07.148204 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-838b27cc-96a1-4c41-a13d-d50019e43845 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:07.150542 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=52 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:42:07.155968 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-838b27cc-96a1-4c41-a13d-d50019e43845 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:07.156423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-838b27cc-96a1-4c41-a13d-d50019e43845 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:07.157213 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-838b27cc-96a1-4c41-a13d-d50019e43845 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:07.157656 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-838b27cc-96a1-4c41-a13d-d50019e43845 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:07.283916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-838b27cc-96a1-4c41-a13d-d50019e43845 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:07.291857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-838b27cc-96a1-4c41-a13d-d50019e43845 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148150 Jul 27 20:42:07.292412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1821/3623] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:07 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:07.453935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-95e9161e-fea4-4a50-865a-80154ed160e7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:07.454545 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-95e9161e-fea4-4a50-865a-80154ed160e7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:07.460930 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95e9161e-fea4-4a50-865a-80154ed160e7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:07.461430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95e9161e-fea4-4a50-865a-80154ed160e7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:07.462181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95e9161e-fea4-4a50-865a-80154ed160e7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:07.462611 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95e9161e-fea4-4a50-865a-80154ed160e7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:07.589673 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-95e9161e-fea4-4a50-865a-80154ed160e7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:07.598423 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-95e9161e-fea4-4a50-865a-80154ed160e7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:07.599925 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-95e9161e-fea4-4a50-865a-80154ed160e7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:07.601104 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-95e9161e-fea4-4a50-865a-80154ed160e7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.151336 Jul 27 20:42:07.601664 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1803/3624] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:07 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:08.314110 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-923864a7-290d-4a80-86cc-c77c4407cfb1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:08.314716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-923864a7-290d-4a80-86cc-c77c4407cfb1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:08.321184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-923864a7-290d-4a80-86cc-c77c4407cfb1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:08.321638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-923864a7-290d-4a80-86cc-c77c4407cfb1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:08.322428 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-923864a7-290d-4a80-86cc-c77c4407cfb1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:08.322972 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-923864a7-290d-4a80-86cc-c77c4407cfb1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:08.452352 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-923864a7-290d-4a80-86cc-c77c4407cfb1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:08.460522 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-923864a7-290d-4a80-86cc-c77c4407cfb1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150932 Jul 27 20:42:08.461101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1822/3625] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:08 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:08.626209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5de6d79b-13a3-461e-b01f-112b0f45a852 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:08.626816 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5de6d79b-13a3-461e-b01f-112b0f45a852 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:08.633394 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5de6d79b-13a3-461e-b01f-112b0f45a852 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:08.633842 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5de6d79b-13a3-461e-b01f-112b0f45a852 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:08.634594 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5de6d79b-13a3-461e-b01f-112b0f45a852 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:08.635029 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5de6d79b-13a3-461e-b01f-112b0f45a852 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:08.773685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5de6d79b-13a3-461e-b01f-112b0f45a852 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:08.784097 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5de6d79b-13a3-461e-b01f-112b0f45a852 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:08.785625 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5de6d79b-13a3-461e-b01f-112b0f45a852 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:08.787117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5de6d79b-13a3-461e-b01f-112b0f45a852 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.165901 Jul 27 20:42:08.787677 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1804/3626] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:08 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:09.482047 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f30ec48c-6610-4fe2-9926-77658e9abe4c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:09.482646 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f30ec48c-6610-4fe2-9926-77658e9abe4c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:09.489324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f30ec48c-6610-4fe2-9926-77658e9abe4c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:09.489777 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f30ec48c-6610-4fe2-9926-77658e9abe4c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:09.490543 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f30ec48c-6610-4fe2-9926-77658e9abe4c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:09.490983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f30ec48c-6610-4fe2-9926-77658e9abe4c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:09.617098 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f30ec48c-6610-4fe2-9926-77658e9abe4c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:09.624987 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f30ec48c-6610-4fe2-9926-77658e9abe4c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.146817 Jul 27 20:42:09.625560 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1823/3627] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:09 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:42:09.812226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4ef163ec-2592-4421-90ab-607a0042f4e1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:09.812827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4ef163ec-2592-4421-90ab-607a0042f4e1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:09.815143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=52 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:42:09.820307 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ef163ec-2592-4421-90ab-607a0042f4e1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:09.820752 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ef163ec-2592-4421-90ab-607a0042f4e1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:09.821536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ef163ec-2592-4421-90ab-607a0042f4e1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:09.821968 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ef163ec-2592-4421-90ab-607a0042f4e1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:09.953598 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4ef163ec-2592-4421-90ab-607a0042f4e1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:09.961912 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4ef163ec-2592-4421-90ab-607a0042f4e1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:09.963397 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4ef163ec-2592-4421-90ab-607a0042f4e1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:09.964546 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4ef163ec-2592-4421-90ab-607a0042f4e1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156801 Jul 27 20:42:09.965122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1805/3628] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:09 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:10.646629 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8698737a-e156-411a-9d9e-6efe4ff08507 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:10.647254 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8698737a-e156-411a-9d9e-6efe4ff08507 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:10.654392 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8698737a-e156-411a-9d9e-6efe4ff08507 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:10.654841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8698737a-e156-411a-9d9e-6efe4ff08507 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:10.655607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8698737a-e156-411a-9d9e-6efe4ff08507 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:10.656053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8698737a-e156-411a-9d9e-6efe4ff08507 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:10.785303 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8698737a-e156-411a-9d9e-6efe4ff08507 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:10.793507 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8698737a-e156-411a-9d9e-6efe4ff08507 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150756 Jul 27 20:42:10.794669 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1824/3629] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:10 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:10.987582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c2b045f5-6941-44cf-a7c0-64f8e3b185fc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:10.988116 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c2b045f5-6941-44cf-a7c0-64f8e3b185fc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:10.994563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2b045f5-6941-44cf-a7c0-64f8e3b185fc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:10.995013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2b045f5-6941-44cf-a7c0-64f8e3b185fc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:10.995766 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2b045f5-6941-44cf-a7c0-64f8e3b185fc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:10.996203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2b045f5-6941-44cf-a7c0-64f8e3b185fc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:11.123804 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c2b045f5-6941-44cf-a7c0-64f8e3b185fc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:11.132069 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c2b045f5-6941-44cf-a7c0-64f8e3b185fc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:11.133598 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c2b045f5-6941-44cf-a7c0-64f8e3b185fc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:11.134750 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c2b045f5-6941-44cf-a7c0-64f8e3b185fc tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.151144 Jul 27 20:42:11.135301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1806/3630] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:10 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:11.816705 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cb6a3cf5-4ea3-4d63-ab2a-cb4ffb04b1f6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:11.817418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cb6a3cf5-4ea3-4d63-ab2a-cb4ffb04b1f6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:11.825314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb6a3cf5-4ea3-4d63-ab2a-cb4ffb04b1f6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:11.825940 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb6a3cf5-4ea3-4d63-ab2a-cb4ffb04b1f6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:11.827016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb6a3cf5-4ea3-4d63-ab2a-cb4ffb04b1f6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:11.827463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb6a3cf5-4ea3-4d63-ab2a-cb4ffb04b1f6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:11.967737 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cb6a3cf5-4ea3-4d63-ab2a-cb4ffb04b1f6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:11.975644 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cb6a3cf5-4ea3-4d63-ab2a-cb4ffb04b1f6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.162794 Jul 27 20:42:11.976208 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1825/3631] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:11 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:12.158630 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3b07478d-6f2e-4b35-8742-52e5afb4c90c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:12.159241 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3b07478d-6f2e-4b35-8742-52e5afb4c90c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:12.165671 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b07478d-6f2e-4b35-8742-52e5afb4c90c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:12.166126 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b07478d-6f2e-4b35-8742-52e5afb4c90c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:12.166881 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b07478d-6f2e-4b35-8742-52e5afb4c90c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:12.167313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b07478d-6f2e-4b35-8742-52e5afb4c90c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:12.296456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3b07478d-6f2e-4b35-8742-52e5afb4c90c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:12.304881 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3b07478d-6f2e-4b35-8742-52e5afb4c90c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:12.307136 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3b07478d-6f2e-4b35-8742-52e5afb4c90c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:12.308419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3b07478d-6f2e-4b35-8742-52e5afb4c90c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153586 Jul 27 20:42:12.309271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1807/3632] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:12 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:12.997472 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8dbfc592-b993-463b-a798-d55cc049e429 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:12.998444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8dbfc592-b993-463b-a798-d55cc049e429 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:13.005003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8dbfc592-b993-463b-a798-d55cc049e429 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:13.005471 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8dbfc592-b993-463b-a798-d55cc049e429 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:13.006239 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8dbfc592-b993-463b-a798-d55cc049e429 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:13.006683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8dbfc592-b993-463b-a798-d55cc049e429 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:13.134303 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8dbfc592-b993-463b-a798-d55cc049e429 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:13.142883 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8dbfc592-b993-463b-a798-d55cc049e429 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149556 Jul 27 20:42:13.143456 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1826/3633] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:12 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:42:13.334754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-74838431-d7d3-4f9a-8413-efe1569fb41b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:13.335276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-74838431-d7d3-4f9a-8413-efe1569fb41b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:13.342316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74838431-d7d3-4f9a-8413-efe1569fb41b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:13.342765 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74838431-d7d3-4f9a-8413-efe1569fb41b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:13.343529 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74838431-d7d3-4f9a-8413-efe1569fb41b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:13.343965 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74838431-d7d3-4f9a-8413-efe1569fb41b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:13.473023 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-74838431-d7d3-4f9a-8413-efe1569fb41b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:13.481266 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-74838431-d7d3-4f9a-8413-efe1569fb41b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:13.482760 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-74838431-d7d3-4f9a-8413-efe1569fb41b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:13.483912 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-74838431-d7d3-4f9a-8413-efe1569fb41b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153152 Jul 27 20:42:13.484458 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1808/3634] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:13 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:14.164798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-73e74207-11cb-4f0e-bf0e-030341c8aef7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:14.165448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-73e74207-11cb-4f0e-bf0e-030341c8aef7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:14.172496 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-73e74207-11cb-4f0e-bf0e-030341c8aef7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:14.172956 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-73e74207-11cb-4f0e-bf0e-030341c8aef7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:14.173751 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-73e74207-11cb-4f0e-bf0e-030341c8aef7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:14.174230 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-73e74207-11cb-4f0e-bf0e-030341c8aef7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:14.303855 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-73e74207-11cb-4f0e-bf0e-030341c8aef7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:14.307255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:42:14.312896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-73e74207-11cb-4f0e-bf0e-030341c8aef7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151968 Jul 27 20:42:14.313530 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1827/3635] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:14 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:14.507610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f1959e8c-4ec1-4c0b-908b-4620bc4520f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:14.508217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f1959e8c-4ec1-4c0b-908b-4620bc4520f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:14.514922 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1959e8c-4ec1-4c0b-908b-4620bc4520f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:14.515374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1959e8c-4ec1-4c0b-908b-4620bc4520f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:14.516127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1959e8c-4ec1-4c0b-908b-4620bc4520f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:14.516562 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1959e8c-4ec1-4c0b-908b-4620bc4520f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:14.646607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f1959e8c-4ec1-4c0b-908b-4620bc4520f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:14.655587 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f1959e8c-4ec1-4c0b-908b-4620bc4520f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:14.657091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f1959e8c-4ec1-4c0b-908b-4620bc4520f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:14.658244 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f1959e8c-4ec1-4c0b-908b-4620bc4520f5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.154508 Jul 27 20:42:14.658809 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1809/3636] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:14 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:15.334425 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b421e77a-7a0c-4c26-a79c-2da699856edd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:15.334957 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b421e77a-7a0c-4c26-a79c-2da699856edd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:15.342259 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b421e77a-7a0c-4c26-a79c-2da699856edd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:15.342710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b421e77a-7a0c-4c26-a79c-2da699856edd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:15.343475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b421e77a-7a0c-4c26-a79c-2da699856edd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:15.343918 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b421e77a-7a0c-4c26-a79c-2da699856edd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:15.469586 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b421e77a-7a0c-4c26-a79c-2da699856edd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:15.477562 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b421e77a-7a0c-4c26-a79c-2da699856edd tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.147191 Jul 27 20:42:15.478131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1828/3637] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:15 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:15.681464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-70dab3f3-d3ca-4286-9a3f-e56ad15c1133 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:15.682074 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-70dab3f3-d3ca-4286-9a3f-e56ad15c1133 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:15.688757 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70dab3f3-d3ca-4286-9a3f-e56ad15c1133 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:15.689263 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70dab3f3-d3ca-4286-9a3f-e56ad15c1133 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:15.690024 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70dab3f3-d3ca-4286-9a3f-e56ad15c1133 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:15.690463 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70dab3f3-d3ca-4286-9a3f-e56ad15c1133 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:15.820781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-70dab3f3-d3ca-4286-9a3f-e56ad15c1133 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:15.824121 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:42:15.830878 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-70dab3f3-d3ca-4286-9a3f-e56ad15c1133 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:15.832196 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-70dab3f3-d3ca-4286-9a3f-e56ad15c1133 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:15.833439 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-70dab3f3-d3ca-4286-9a3f-e56ad15c1133 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155806 Jul 27 20:42:15.833932 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1810/3638] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:15 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:16.498411 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ec49ae28-6cae-46c3-ba11-5650375ddd73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:16.499065 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ec49ae28-6cae-46c3-ba11-5650375ddd73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:16.505694 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec49ae28-6cae-46c3-ba11-5650375ddd73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:16.506156 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec49ae28-6cae-46c3-ba11-5650375ddd73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:16.506934 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec49ae28-6cae-46c3-ba11-5650375ddd73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:16.507384 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec49ae28-6cae-46c3-ba11-5650375ddd73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:16.635981 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ec49ae28-6cae-46c3-ba11-5650375ddd73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:16.643833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ec49ae28-6cae-46c3-ba11-5650375ddd73 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149271 Jul 27 20:42:16.644404 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1829/3639] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:16 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:16.857644 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c84d8797-7647-4d04-bdb2-51b0b467a4e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:16.858215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c84d8797-7647-4d04-bdb2-51b0b467a4e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:16.865168 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c84d8797-7647-4d04-bdb2-51b0b467a4e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:16.865627 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c84d8797-7647-4d04-bdb2-51b0b467a4e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:16.866390 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c84d8797-7647-4d04-bdb2-51b0b467a4e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:16.866832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c84d8797-7647-4d04-bdb2-51b0b467a4e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:16.998743 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c84d8797-7647-4d04-bdb2-51b0b467a4e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:17.007142 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c84d8797-7647-4d04-bdb2-51b0b467a4e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:17.008640 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c84d8797-7647-4d04-bdb2-51b0b467a4e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:17.009956 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c84d8797-7647-4d04-bdb2-51b0b467a4e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157088 Jul 27 20:42:17.010523 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1811/3640] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:16 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:17.664692 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-abd9cd6f-7de8-416e-9f96-ba210bf0d61e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:17.665352 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-abd9cd6f-7de8-416e-9f96-ba210bf0d61e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:17.671860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-abd9cd6f-7de8-416e-9f96-ba210bf0d61e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:17.672318 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-abd9cd6f-7de8-416e-9f96-ba210bf0d61e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:17.673115 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-abd9cd6f-7de8-416e-9f96-ba210bf0d61e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:17.673567 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-abd9cd6f-7de8-416e-9f96-ba210bf0d61e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:17.802193 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-abd9cd6f-7de8-416e-9f96-ba210bf0d61e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:17.810293 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-abd9cd6f-7de8-416e-9f96-ba210bf0d61e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149266 Jul 27 20:42:17.810844 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1830/3641] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:17 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:18.033277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9f3d74e5-e650-4d33-823d-14d486b832f9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:18.033835 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9f3d74e5-e650-4d33-823d-14d486b832f9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:18.039967 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f3d74e5-e650-4d33-823d-14d486b832f9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:18.040435 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f3d74e5-e650-4d33-823d-14d486b832f9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:18.041216 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f3d74e5-e650-4d33-823d-14d486b832f9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:18.041655 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f3d74e5-e650-4d33-823d-14d486b832f9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:18.171104 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9f3d74e5-e650-4d33-823d-14d486b832f9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:18.179314 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9f3d74e5-e650-4d33-823d-14d486b832f9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:18.180791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9f3d74e5-e650-4d33-823d-14d486b832f9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:18.181966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9f3d74e5-e650-4d33-823d-14d486b832f9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152713 Jul 27 20:42:18.182524 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1812/3642] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:18 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:18.832234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2d422961-fcb1-487b-8343-e9a19f1f4075 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:18.832846 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2d422961-fcb1-487b-8343-e9a19f1f4075 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:18.839331 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d422961-fcb1-487b-8343-e9a19f1f4075 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:18.839792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d422961-fcb1-487b-8343-e9a19f1f4075 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:18.840573 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d422961-fcb1-487b-8343-e9a19f1f4075 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:18.841193 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d422961-fcb1-487b-8343-e9a19f1f4075 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:18.973761 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2d422961-fcb1-487b-8343-e9a19f1f4075 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:18.982012 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2d422961-fcb1-487b-8343-e9a19f1f4075 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153351 Jul 27 20:42:18.982849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1831/3643] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:18 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:19.205635 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6b21bb23-94db-4e98-a34d-667ac425f756 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:19.206249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6b21bb23-94db-4e98-a34d-667ac425f756 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:19.212789 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b21bb23-94db-4e98-a34d-667ac425f756 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:19.213268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b21bb23-94db-4e98-a34d-667ac425f756 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:19.214026 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b21bb23-94db-4e98-a34d-667ac425f756 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:19.214465 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b21bb23-94db-4e98-a34d-667ac425f756 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:19.344151 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6b21bb23-94db-4e98-a34d-667ac425f756 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:19.352452 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6b21bb23-94db-4e98-a34d-667ac425f756 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:19.353970 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6b21bb23-94db-4e98-a34d-667ac425f756 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:19.355123 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6b21bb23-94db-4e98-a34d-667ac425f756 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153673 Jul 27 20:42:19.355685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1813/3644] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:19 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:20.003770 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f0499d88-8964-4e63-8b2b-33442c1fb742 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:20.004393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f0499d88-8964-4e63-8b2b-33442c1fb742 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:20.010981 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0499d88-8964-4e63-8b2b-33442c1fb742 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:20.011437 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0499d88-8964-4e63-8b2b-33442c1fb742 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:20.012725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0499d88-8964-4e63-8b2b-33442c1fb742 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:20.013206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0499d88-8964-4e63-8b2b-33442c1fb742 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:20.141113 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f0499d88-8964-4e63-8b2b-33442c1fb742 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:20.149127 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f0499d88-8964-4e63-8b2b-33442c1fb742 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149216 Jul 27 20:42:20.149691 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1832/3645] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:19 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:20.379122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3bc24a9d-4513-4dfd-b32f-22962619b7d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:20.379656 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3bc24a9d-4513-4dfd-b32f-22962619b7d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:20.386091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3bc24a9d-4513-4dfd-b32f-22962619b7d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:20.386540 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3bc24a9d-4513-4dfd-b32f-22962619b7d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:20.387908 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3bc24a9d-4513-4dfd-b32f-22962619b7d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:20.388352 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3bc24a9d-4513-4dfd-b32f-22962619b7d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:20.518484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3bc24a9d-4513-4dfd-b32f-22962619b7d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:20.526819 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3bc24a9d-4513-4dfd-b32f-22962619b7d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:20.528480 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3bc24a9d-4513-4dfd-b32f-22962619b7d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:20.529675 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3bc24a9d-4513-4dfd-b32f-22962619b7d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.154507 Jul 27 20:42:20.530234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1814/3646] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:20 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:21.171919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5b18cd33-7cb6-4632-a63e-dfadae64d9c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:21.172563 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5b18cd33-7cb6-4632-a63e-dfadae64d9c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:21.179098 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5b18cd33-7cb6-4632-a63e-dfadae64d9c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:21.179557 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5b18cd33-7cb6-4632-a63e-dfadae64d9c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:21.180330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5b18cd33-7cb6-4632-a63e-dfadae64d9c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:21.180781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5b18cd33-7cb6-4632-a63e-dfadae64d9c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:21.307650 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5b18cd33-7cb6-4632-a63e-dfadae64d9c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:21.316088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5b18cd33-7cb6-4632-a63e-dfadae64d9c0 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148894 Jul 27 20:42:21.316665 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1833/3647] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:21 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:21.552860 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b1660e92-e42f-47d7-a3ae-c82cbcad2daa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:21.553498 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b1660e92-e42f-47d7-a3ae-c82cbcad2daa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:21.560204 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1660e92-e42f-47d7-a3ae-c82cbcad2daa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:21.560648 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1660e92-e42f-47d7-a3ae-c82cbcad2daa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:21.561426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1660e92-e42f-47d7-a3ae-c82cbcad2daa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:21.561855 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1660e92-e42f-47d7-a3ae-c82cbcad2daa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:21.692133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b1660e92-e42f-47d7-a3ae-c82cbcad2daa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:21.701090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b1660e92-e42f-47d7-a3ae-c82cbcad2daa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:21.702827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b1660e92-e42f-47d7-a3ae-c82cbcad2daa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:21.703985 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b1660e92-e42f-47d7-a3ae-c82cbcad2daa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155019 Jul 27 20:42:21.704545 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1815/3648] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:21 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:22.338346 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c2994bbf-6349-4648-abda-1f2c2c5d8350 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:22.338975 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c2994bbf-6349-4648-abda-1f2c2c5d8350 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:22.345792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c2994bbf-6349-4648-abda-1f2c2c5d8350 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:22.346252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c2994bbf-6349-4648-abda-1f2c2c5d8350 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:22.347032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c2994bbf-6349-4648-abda-1f2c2c5d8350 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:22.347485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c2994bbf-6349-4648-abda-1f2c2c5d8350 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:22.477834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c2994bbf-6349-4648-abda-1f2c2c5d8350 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:22.486347 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c2994bbf-6349-4648-abda-1f2c2c5d8350 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152142 Jul 27 20:42:22.486911 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1834/3649] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:22 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:22.727035 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6e95e92a-e871-4b24-8328-5dca3182682e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:22.727649 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6e95e92a-e871-4b24-8328-5dca3182682e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:22.734741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6e95e92a-e871-4b24-8328-5dca3182682e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:22.735192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6e95e92a-e871-4b24-8328-5dca3182682e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:22.735957 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6e95e92a-e871-4b24-8328-5dca3182682e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:22.736405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6e95e92a-e871-4b24-8328-5dca3182682e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:22.867562 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6e95e92a-e871-4b24-8328-5dca3182682e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:22.875886 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6e95e92a-e871-4b24-8328-5dca3182682e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:22.877425 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6e95e92a-e871-4b24-8328-5dca3182682e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:22.878590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6e95e92a-e871-4b24-8328-5dca3182682e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.155479 Jul 27 20:42:22.879156 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1816/3650] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:22 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:23.507679 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b1467ea2-4610-4966-ad6c-d65db9abf40b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:23.508306 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b1467ea2-4610-4966-ad6c-d65db9abf40b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:23.515556 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b1467ea2-4610-4966-ad6c-d65db9abf40b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:23.516032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b1467ea2-4610-4966-ad6c-d65db9abf40b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:23.516791 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b1467ea2-4610-4966-ad6c-d65db9abf40b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:23.517268 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b1467ea2-4610-4966-ad6c-d65db9abf40b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:23.642663 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b1467ea2-4610-4966-ad6c-d65db9abf40b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:23.650595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b1467ea2-4610-4966-ad6c-d65db9abf40b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.146822 Jul 27 20:42:23.651157 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1835/3651] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:23 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:42:23.902516 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6b61e82e-7dda-4dc6-9e7f-982c8bfc9738 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:23.903127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6b61e82e-7dda-4dc6-9e7f-982c8bfc9738 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:23.909661 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b61e82e-7dda-4dc6-9e7f-982c8bfc9738 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:23.910111 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b61e82e-7dda-4dc6-9e7f-982c8bfc9738 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:23.910865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b61e82e-7dda-4dc6-9e7f-982c8bfc9738 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:23.911301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b61e82e-7dda-4dc6-9e7f-982c8bfc9738 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:24.040443 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6b61e82e-7dda-4dc6-9e7f-982c8bfc9738 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:24.049411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6b61e82e-7dda-4dc6-9e7f-982c8bfc9738 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:24.050915 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6b61e82e-7dda-4dc6-9e7f-982c8bfc9738 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:24.052115 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6b61e82e-7dda-4dc6-9e7f-982c8bfc9738 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153458 Jul 27 20:42:24.052674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1817/3652] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:23 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:24.671676 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-56376014-0d97-4f87-828c-72876bf2910c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:24.672325 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-56376014-0d97-4f87-828c-72876bf2910c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:24.678874 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56376014-0d97-4f87-828c-72876bf2910c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:24.679336 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56376014-0d97-4f87-828c-72876bf2910c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:24.680105 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56376014-0d97-4f87-828c-72876bf2910c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:24.680556 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-56376014-0d97-4f87-828c-72876bf2910c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:24.807615 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-56376014-0d97-4f87-828c-72876bf2910c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:24.816020 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-56376014-0d97-4f87-828c-72876bf2910c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148269 Jul 27 20:42:24.816589 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1836/3653] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:24 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:25.075692 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c206c368-6d42-4236-8712-6390b55fb277 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:25.076541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c206c368-6d42-4236-8712-6390b55fb277 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:25.083730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c206c368-6d42-4236-8712-6390b55fb277 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:25.084173 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c206c368-6d42-4236-8712-6390b55fb277 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:25.084937 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c206c368-6d42-4236-8712-6390b55fb277 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:25.085392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c206c368-6d42-4236-8712-6390b55fb277 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:25.212900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c206c368-6d42-4236-8712-6390b55fb277 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:25.221229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c206c368-6d42-4236-8712-6390b55fb277 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:25.222732 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c206c368-6d42-4236-8712-6390b55fb277 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:25.223884 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c206c368-6d42-4236-8712-6390b55fb277 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152730 Jul 27 20:42:25.224439 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1818/3654] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:25 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:25.837840 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3dbefb0a-ae24-4993-968a-33f87f6d5800 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:25.838469 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3dbefb0a-ae24-4993-968a-33f87f6d5800 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:25.845552 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3dbefb0a-ae24-4993-968a-33f87f6d5800 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:25.846012 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3dbefb0a-ae24-4993-968a-33f87f6d5800 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:25.846786 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3dbefb0a-ae24-4993-968a-33f87f6d5800 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:25.847232 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3dbefb0a-ae24-4993-968a-33f87f6d5800 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:25.974427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3dbefb0a-ae24-4993-968a-33f87f6d5800 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:25.982355 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3dbefb0a-ae24-4993-968a-33f87f6d5800 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148394 Jul 27 20:42:25.982909 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1837/3655] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:25 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:26.248126 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-61cec9bd-9d5a-4d85-b0d8-efb96c9fa18f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:26.248730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-61cec9bd-9d5a-4d85-b0d8-efb96c9fa18f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:26.255221 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-61cec9bd-9d5a-4d85-b0d8-efb96c9fa18f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:26.255669 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-61cec9bd-9d5a-4d85-b0d8-efb96c9fa18f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:26.256428 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-61cec9bd-9d5a-4d85-b0d8-efb96c9fa18f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:26.256862 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-61cec9bd-9d5a-4d85-b0d8-efb96c9fa18f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:26.390106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-61cec9bd-9d5a-4d85-b0d8-efb96c9fa18f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:26.398374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-61cec9bd-9d5a-4d85-b0d8-efb96c9fa18f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:26.399861 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-61cec9bd-9d5a-4d85-b0d8-efb96c9fa18f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:26.401042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-61cec9bd-9d5a-4d85-b0d8-efb96c9fa18f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157245 Jul 27 20:42:26.401593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1819/3656] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:26 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:27.003268 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-aa1a5df2-4ba2-4d82-863a-48423c8beb30 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:27.003893 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-aa1a5df2-4ba2-4d82-863a-48423c8beb30 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:27.010462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aa1a5df2-4ba2-4d82-863a-48423c8beb30 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:27.010918 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aa1a5df2-4ba2-4d82-863a-48423c8beb30 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:27.011691 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aa1a5df2-4ba2-4d82-863a-48423c8beb30 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:27.012137 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aa1a5df2-4ba2-4d82-863a-48423c8beb30 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:27.141225 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-aa1a5df2-4ba2-4d82-863a-48423c8beb30 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:27.149121 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-aa1a5df2-4ba2-4d82-863a-48423c8beb30 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149726 Jul 27 20:42:27.149678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1838/3657] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:26 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:27.423761 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-efd4dcfe-3da2-4757-a347-4b75beae6be8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:27.424373 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-efd4dcfe-3da2-4757-a347-4b75beae6be8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:27.431003 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-efd4dcfe-3da2-4757-a347-4b75beae6be8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:27.431451 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-efd4dcfe-3da2-4757-a347-4b75beae6be8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:27.432211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-efd4dcfe-3da2-4757-a347-4b75beae6be8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:27.432652 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-efd4dcfe-3da2-4757-a347-4b75beae6be8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:27.560499 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-efd4dcfe-3da2-4757-a347-4b75beae6be8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:27.568847 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-efd4dcfe-3da2-4757-a347-4b75beae6be8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:27.570379 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-efd4dcfe-3da2-4757-a347-4b75beae6be8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:27.571535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-efd4dcfe-3da2-4757-a347-4b75beae6be8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.151682 Jul 27 20:42:27.572088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1820/3658] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:27 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:28.171840 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8aab860b-ec52-4b4a-9ca1-c4de154418ff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:28.172460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8aab860b-ec52-4b4a-9ca1-c4de154418ff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:28.179024 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8aab860b-ec52-4b4a-9ca1-c4de154418ff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:28.179480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8aab860b-ec52-4b4a-9ca1-c4de154418ff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:28.180247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8aab860b-ec52-4b4a-9ca1-c4de154418ff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:28.180693 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8aab860b-ec52-4b4a-9ca1-c4de154418ff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:28.309624 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8aab860b-ec52-4b4a-9ca1-c4de154418ff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:28.317566 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8aab860b-ec52-4b4a-9ca1-c4de154418ff tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150452 Jul 27 20:42:28.318134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1839/3659] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:28 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:28.595510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-77fd650e-c4ee-49d7-ac37-3823b270e1c5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:28.596045 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-77fd650e-c4ee-49d7-ac37-3823b270e1c5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:28.602472 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-77fd650e-c4ee-49d7-ac37-3823b270e1c5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:28.602922 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-77fd650e-c4ee-49d7-ac37-3823b270e1c5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:28.603682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-77fd650e-c4ee-49d7-ac37-3823b270e1c5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:28.604120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-77fd650e-c4ee-49d7-ac37-3823b270e1c5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:28.736916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-77fd650e-c4ee-49d7-ac37-3823b270e1c5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:28.745234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-77fd650e-c4ee-49d7-ac37-3823b270e1c5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:28.747247 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-77fd650e-c4ee-49d7-ac37-3823b270e1c5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:28.748398 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-77fd650e-c4ee-49d7-ac37-3823b270e1c5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156862 Jul 27 20:42:28.748956 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1821/3660] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:28 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:29.339139 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-78bb878b-b500-4603-8c01-c9559d4614f3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:29.339717 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-78bb878b-b500-4603-8c01-c9559d4614f3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:29.346596 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-78bb878b-b500-4603-8c01-c9559d4614f3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:29.347044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-78bb878b-b500-4603-8c01-c9559d4614f3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:29.347800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-78bb878b-b500-4603-8c01-c9559d4614f3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:29.348234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-78bb878b-b500-4603-8c01-c9559d4614f3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:29.474038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-78bb878b-b500-4603-8c01-c9559d4614f3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:29.482500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-78bb878b-b500-4603-8c01-c9559d4614f3 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.147335 Jul 27 20:42:29.483049 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1840/3661] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:29 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:29.772891 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6e59e923-a56d-44fe-810b-f8d1526a6339 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:29.773530 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6e59e923-a56d-44fe-810b-f8d1526a6339 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:29.780813 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6e59e923-a56d-44fe-810b-f8d1526a6339 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:29.781291 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6e59e923-a56d-44fe-810b-f8d1526a6339 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:29.782055 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6e59e923-a56d-44fe-810b-f8d1526a6339 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:29.782494 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6e59e923-a56d-44fe-810b-f8d1526a6339 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:29.910099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6e59e923-a56d-44fe-810b-f8d1526a6339 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:29.918848 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6e59e923-a56d-44fe-810b-f8d1526a6339 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:29.920336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6e59e923-a56d-44fe-810b-f8d1526a6339 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:29.921508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6e59e923-a56d-44fe-810b-f8d1526a6339 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152911 Jul 27 20:42:29.922062 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1822/3662] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:29 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:30.503510 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3822422a-6088-4327-8287-5205e81d44cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:30.504123 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3822422a-6088-4327-8287-5205e81d44cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:30.510975 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3822422a-6088-4327-8287-5205e81d44cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:30.511425 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3822422a-6088-4327-8287-5205e81d44cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:30.512465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3822422a-6088-4327-8287-5205e81d44cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:30.512914 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3822422a-6088-4327-8287-5205e81d44cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:30.642093 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3822422a-6088-4327-8287-5205e81d44cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:30.650919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3822422a-6088-4327-8287-5205e81d44cb tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151049 Jul 27 20:42:30.651490 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1841/3663] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:30 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:30.943807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4b638529-6b7f-4303-97fc-e761f96bcb03 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:30.944425 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4b638529-6b7f-4303-97fc-e761f96bcb03 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:30.951042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b638529-6b7f-4303-97fc-e761f96bcb03 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:30.951494 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b638529-6b7f-4303-97fc-e761f96bcb03 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:30.952261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b638529-6b7f-4303-97fc-e761f96bcb03 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:30.953006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b638529-6b7f-4303-97fc-e761f96bcb03 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:31.085234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4b638529-6b7f-4303-97fc-e761f96bcb03 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:31.094285 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4b638529-6b7f-4303-97fc-e761f96bcb03 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:31.095770 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4b638529-6b7f-4303-97fc-e761f96bcb03 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:31.096936 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4b638529-6b7f-4303-97fc-e761f96bcb03 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157017 Jul 27 20:42:31.097502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1823/3664] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:30 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:31.672287 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d5dc6e8e-432a-405c-a0c0-ab4eb61d5a83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:31.672912 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d5dc6e8e-432a-405c-a0c0-ab4eb61d5a83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:31.679555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d5dc6e8e-432a-405c-a0c0-ab4eb61d5a83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:31.680012 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d5dc6e8e-432a-405c-a0c0-ab4eb61d5a83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:31.680776 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d5dc6e8e-432a-405c-a0c0-ab4eb61d5a83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:31.681254 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d5dc6e8e-432a-405c-a0c0-ab4eb61d5a83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:31.806298 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d5dc6e8e-432a-405c-a0c0-ab4eb61d5a83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:31.814716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d5dc6e8e-432a-405c-a0c0-ab4eb61d5a83 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.146497 Jul 27 20:42:31.815279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1842/3665] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:31 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:32.119952 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-73973ed6-aa1d-4321-92c1-0e788cd13735 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:32.120564 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-73973ed6-aa1d-4321-92c1-0e788cd13735 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:32.127807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73973ed6-aa1d-4321-92c1-0e788cd13735 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:32.128255 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73973ed6-aa1d-4321-92c1-0e788cd13735 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:32.129031 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73973ed6-aa1d-4321-92c1-0e788cd13735 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:32.129471 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73973ed6-aa1d-4321-92c1-0e788cd13735 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:32.257935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-73973ed6-aa1d-4321-92c1-0e788cd13735 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:32.266363 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-73973ed6-aa1d-4321-92c1-0e788cd13735 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:32.267870 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-73973ed6-aa1d-4321-92c1-0e788cd13735 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:32.269090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-73973ed6-aa1d-4321-92c1-0e788cd13735 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152954 Jul 27 20:42:32.269651 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1824/3666] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:32 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:32.836083 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9886a631-8c31-4a49-8e91-ac77cb9ca044 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:32.836680 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9886a631-8c31-4a49-8e91-ac77cb9ca044 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:32.843553 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9886a631-8c31-4a49-8e91-ac77cb9ca044 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:32.844007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9886a631-8c31-4a49-8e91-ac77cb9ca044 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:32.844793 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9886a631-8c31-4a49-8e91-ac77cb9ca044 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:32.845248 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9886a631-8c31-4a49-8e91-ac77cb9ca044 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:32.973721 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9886a631-8c31-4a49-8e91-ac77cb9ca044 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:32.981773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9886a631-8c31-4a49-8e91-ac77cb9ca044 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149728 Jul 27 20:42:32.982339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1843/3667] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:32 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:33.293267 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5d2a6075-80af-4bad-a1c5-e3d9dccd4067 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:33.293898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5d2a6075-80af-4bad-a1c5-e3d9dccd4067 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:33.300391 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d2a6075-80af-4bad-a1c5-e3d9dccd4067 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:33.300878 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d2a6075-80af-4bad-a1c5-e3d9dccd4067 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:33.301674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d2a6075-80af-4bad-a1c5-e3d9dccd4067 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:33.302114 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d2a6075-80af-4bad-a1c5-e3d9dccd4067 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:33.430537 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5d2a6075-80af-4bad-a1c5-e3d9dccd4067 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:33.439515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5d2a6075-80af-4bad-a1c5-e3d9dccd4067 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:33.441050 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5d2a6075-80af-4bad-a1c5-e3d9dccd4067 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:33.442211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5d2a6075-80af-4bad-a1c5-e3d9dccd4067 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152853 Jul 27 20:42:33.442772 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1825/3668] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:33 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:34.003212 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f91f056f-3dee-49ea-8960-57ca85000c7e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:34.003825 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f91f056f-3dee-49ea-8960-57ca85000c7e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:34.010591 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f91f056f-3dee-49ea-8960-57ca85000c7e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:34.011046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f91f056f-3dee-49ea-8960-57ca85000c7e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:34.011810 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f91f056f-3dee-49ea-8960-57ca85000c7e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:34.012253 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f91f056f-3dee-49ea-8960-57ca85000c7e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:34.030712 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:42:34.143607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f91f056f-3dee-49ea-8960-57ca85000c7e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:34.151507 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f91f056f-3dee-49ea-8960-57ca85000c7e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.152177 Jul 27 20:42:34.152078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1844/3669] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:33 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:34.466233 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-adf65b47-59d4-4550-8103-f6c143d2f393 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:34.466924 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-adf65b47-59d4-4550-8103-f6c143d2f393 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:34.473445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-adf65b47-59d4-4550-8103-f6c143d2f393 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:34.473895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-adf65b47-59d4-4550-8103-f6c143d2f393 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:34.474653 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-adf65b47-59d4-4550-8103-f6c143d2f393 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:34.475085 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-adf65b47-59d4-4550-8103-f6c143d2f393 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:34.606770 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-adf65b47-59d4-4550-8103-f6c143d2f393 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:34.615161 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-adf65b47-59d4-4550-8103-f6c143d2f393 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:34.616669 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-adf65b47-59d4-4550-8103-f6c143d2f393 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:34.617863 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-adf65b47-59d4-4550-8103-f6c143d2f393 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156081 Jul 27 20:42:34.618420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1826/3670] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:34 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:35.172433 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-73e1430a-613e-41b3-971e-6615b51c92cc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:35.173066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-73e1430a-613e-41b3-971e-6615b51c92cc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:35.179581 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-73e1430a-613e-41b3-971e-6615b51c92cc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:35.180040 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-73e1430a-613e-41b3-971e-6615b51c92cc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:35.180812 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-73e1430a-613e-41b3-971e-6615b51c92cc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:35.181289 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-73e1430a-613e-41b3-971e-6615b51c92cc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:35.312237 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-73e1430a-613e-41b3-971e-6615b51c92cc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:35.320132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-73e1430a-613e-41b3-971e-6615b51c92cc tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151663 Jul 27 20:42:35.320753 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1845/3671] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:35 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:35.641454 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-737d2900-e5a5-4245-a556-eaae050c451e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:35.642066 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-737d2900-e5a5-4245-a556-eaae050c451e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:35.648512 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-737d2900-e5a5-4245-a556-eaae050c451e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:35.648978 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-737d2900-e5a5-4245-a556-eaae050c451e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:35.649741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-737d2900-e5a5-4245-a556-eaae050c451e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:35.650179 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-737d2900-e5a5-4245-a556-eaae050c451e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:35.667714 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:42:35.778661 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-737d2900-e5a5-4245-a556-eaae050c451e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:35.786955 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-737d2900-e5a5-4245-a556-eaae050c451e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:35.788459 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-737d2900-e5a5-4245-a556-eaae050c451e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:35.789640 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-737d2900-e5a5-4245-a556-eaae050c451e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152267 Jul 27 20:42:35.790193 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1827/3672] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:35 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:36.342487 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-afc0b4c5-e9a7-45d5-9cab-0bfb4b09c595 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:36.343064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-afc0b4c5-e9a7-45d5-9cab-0bfb4b09c595 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:36.349541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-afc0b4c5-e9a7-45d5-9cab-0bfb4b09c595 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:36.350002 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-afc0b4c5-e9a7-45d5-9cab-0bfb4b09c595 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:36.350769 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-afc0b4c5-e9a7-45d5-9cab-0bfb4b09c595 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:36.351214 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-afc0b4c5-e9a7-45d5-9cab-0bfb4b09c595 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:36.479974 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-afc0b4c5-e9a7-45d5-9cab-0bfb4b09c595 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:36.488001 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-afc0b4c5-e9a7-45d5-9cab-0bfb4b09c595 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150240 Jul 27 20:42:36.488560 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1846/3673] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:36 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:36.813714 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5c73dc8e-cb09-40e8-af3b-38b76e0905fd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:36.814335 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5c73dc8e-cb09-40e8-af3b-38b76e0905fd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:36.820723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c73dc8e-cb09-40e8-af3b-38b76e0905fd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:36.821200 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c73dc8e-cb09-40e8-af3b-38b76e0905fd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:36.821947 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c73dc8e-cb09-40e8-af3b-38b76e0905fd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:36.822383 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c73dc8e-cb09-40e8-af3b-38b76e0905fd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:36.957667 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5c73dc8e-cb09-40e8-af3b-38b76e0905fd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:36.966828 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5c73dc8e-cb09-40e8-af3b-38b76e0905fd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:36.968316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5c73dc8e-cb09-40e8-af3b-38b76e0905fd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:36.969520 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5c73dc8e-cb09-40e8-af3b-38b76e0905fd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.160321 Jul 27 20:42:36.970069 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1828/3674] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:36 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:37.509345 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-986ba0ed-0b8b-4c07-86a6-fff5d183b81a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:37.509993 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-986ba0ed-0b8b-4c07-86a6-fff5d183b81a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:37.512277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=52 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:42:37.517698 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-986ba0ed-0b8b-4c07-86a6-fff5d183b81a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:37.518151 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-986ba0ed-0b8b-4c07-86a6-fff5d183b81a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:37.518914 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-986ba0ed-0b8b-4c07-86a6-fff5d183b81a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:37.519353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-986ba0ed-0b8b-4c07-86a6-fff5d183b81a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:37.645461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-986ba0ed-0b8b-4c07-86a6-fff5d183b81a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:37.653854 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-986ba0ed-0b8b-4c07-86a6-fff5d183b81a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148367 Jul 27 20:42:37.654416 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1847/3675] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:37 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:37.992669 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-93893275-3c1c-4394-8823-989d850b297a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:37.993313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-93893275-3c1c-4394-8823-989d850b297a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:37.999996 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93893275-3c1c-4394-8823-989d850b297a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:38.000443 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93893275-3c1c-4394-8823-989d850b297a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:38.001245 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93893275-3c1c-4394-8823-989d850b297a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:38.001679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93893275-3c1c-4394-8823-989d850b297a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:38.282487 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-93893275-3c1c-4394-8823-989d850b297a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:38.290882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-93893275-3c1c-4394-8823-989d850b297a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:38.292390 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-93893275-3c1c-4394-8823-989d850b297a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:38.293654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-93893275-3c1c-4394-8823-989d850b297a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.304779 Jul 27 20:42:38.294216 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1829/3676] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:37 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:38.675349 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cbbfbba7-5767-41fd-b15c-f2e324ad35d4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:38.675971 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cbbfbba7-5767-41fd-b15c-f2e324ad35d4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:38.682511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cbbfbba7-5767-41fd-b15c-f2e324ad35d4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:38.682969 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cbbfbba7-5767-41fd-b15c-f2e324ad35d4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:38.683740 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cbbfbba7-5767-41fd-b15c-f2e324ad35d4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:38.684821 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cbbfbba7-5767-41fd-b15c-f2e324ad35d4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:38.813369 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cbbfbba7-5767-41fd-b15c-f2e324ad35d4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:38.821242 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cbbfbba7-5767-41fd-b15c-f2e324ad35d4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149807 Jul 27 20:42:38.821809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1848/3677] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:38 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:39.316816 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-96edfdf1-3dcb-45fe-b7da-42126fe6508c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:39.317455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-96edfdf1-3dcb-45fe-b7da-42126fe6508c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:39.323862 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96edfdf1-3dcb-45fe-b7da-42126fe6508c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:39.324311 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96edfdf1-3dcb-45fe-b7da-42126fe6508c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:39.325702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96edfdf1-3dcb-45fe-b7da-42126fe6508c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:39.326067 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96edfdf1-3dcb-45fe-b7da-42126fe6508c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:39.452097 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-96edfdf1-3dcb-45fe-b7da-42126fe6508c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:39.460553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-96edfdf1-3dcb-45fe-b7da-42126fe6508c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:39.462067 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-96edfdf1-3dcb-45fe-b7da-42126fe6508c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:39.463202 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-96edfdf1-3dcb-45fe-b7da-42126fe6508c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.150292 Jul 27 20:42:39.463739 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1830/3678] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:39 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:39.842651 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0a083484-a07d-46d3-b6f4-cddf3274143c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:39.843258 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0a083484-a07d-46d3-b6f4-cddf3274143c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:39.849829 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a083484-a07d-46d3-b6f4-cddf3274143c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:39.850283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a083484-a07d-46d3-b6f4-cddf3274143c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:39.851039 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a083484-a07d-46d3-b6f4-cddf3274143c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:39.851471 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0a083484-a07d-46d3-b6f4-cddf3274143c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:39.977913 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0a083484-a07d-46d3-b6f4-cddf3274143c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:39.986557 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0a083484-a07d-46d3-b6f4-cddf3274143c tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.147996 Jul 27 20:42:39.987113 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1849/3679] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:39 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:40.487120 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-adb9e52f-eab5-4ada-8547-1c4ef958db34 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:40.487756 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-adb9e52f-eab5-4ada-8547-1c4ef958db34 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:40.490102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=52 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:42:40.495326 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-adb9e52f-eab5-4ada-8547-1c4ef958db34 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:40.495777 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-adb9e52f-eab5-4ada-8547-1c4ef958db34 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:40.497058 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-adb9e52f-eab5-4ada-8547-1c4ef958db34 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:40.497508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-adb9e52f-eab5-4ada-8547-1c4ef958db34 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:40.628769 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-adb9e52f-eab5-4ada-8547-1c4ef958db34 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:40.638059 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-adb9e52f-eab5-4ada-8547-1c4ef958db34 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:40.639747 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-adb9e52f-eab5-4ada-8547-1c4ef958db34 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:40.640955 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-adb9e52f-eab5-4ada-8547-1c4ef958db34 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157702 Jul 27 20:42:40.641539 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1831/3680] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:40 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:41.008720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f7b0a56f-5c2f-47c7-bb56-ec8e4e86e72d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:41.009347 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f7b0a56f-5c2f-47c7-bb56-ec8e4e86e72d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:41.018158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f7b0a56f-5c2f-47c7-bb56-ec8e4e86e72d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:41.018619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f7b0a56f-5c2f-47c7-bb56-ec8e4e86e72d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:41.019398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f7b0a56f-5c2f-47c7-bb56-ec8e4e86e72d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:41.019845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f7b0a56f-5c2f-47c7-bb56-ec8e4e86e72d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:41.157769 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f7b0a56f-5c2f-47c7-bb56-ec8e4e86e72d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:41.165600 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f7b0a56f-5c2f-47c7-bb56-ec8e4e86e72d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.160753 Jul 27 20:42:41.166163 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1850/3681] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:41 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:41.663603 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3c49c5b8-8d69-432e-a9f9-8c9374758318 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:41.664323 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3c49c5b8-8d69-432e-a9f9-8c9374758318 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:41.671149 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c49c5b8-8d69-432e-a9f9-8c9374758318 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:41.671602 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c49c5b8-8d69-432e-a9f9-8c9374758318 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:41.672366 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c49c5b8-8d69-432e-a9f9-8c9374758318 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:41.672805 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c49c5b8-8d69-432e-a9f9-8c9374758318 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:41.831382 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3c49c5b8-8d69-432e-a9f9-8c9374758318 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:41.840143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3c49c5b8-8d69-432e-a9f9-8c9374758318 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:41.842349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3c49c5b8-8d69-432e-a9f9-8c9374758318 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:41.843575 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3c49c5b8-8d69-432e-a9f9-8c9374758318 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.183790 Jul 27 20:42:41.844410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1832/3682] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:41 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:42.187627 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9d3784b9-9cce-40d7-ae6b-9d753c29438d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:42.188241 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9d3784b9-9cce-40d7-ae6b-9d753c29438d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:42.194581 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d3784b9-9cce-40d7-ae6b-9d753c29438d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:42.195032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d3784b9-9cce-40d7-ae6b-9d753c29438d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:42.195790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d3784b9-9cce-40d7-ae6b-9d753c29438d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:42.196222 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9d3784b9-9cce-40d7-ae6b-9d753c29438d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:42.328018 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9d3784b9-9cce-40d7-ae6b-9d753c29438d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:42.336862 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9d3784b9-9cce-40d7-ae6b-9d753c29438d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153723 Jul 27 20:42:42.337484 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1851/3683] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:42 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:42.867235 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c075af62-9b91-4e80-a9df-d522647ac2d7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:42.867979 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c075af62-9b91-4e80-a9df-d522647ac2d7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:42.874852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c075af62-9b91-4e80-a9df-d522647ac2d7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:42.875306 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c075af62-9b91-4e80-a9df-d522647ac2d7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:42.876077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c075af62-9b91-4e80-a9df-d522647ac2d7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:42.876574 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c075af62-9b91-4e80-a9df-d522647ac2d7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:43.010979 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c075af62-9b91-4e80-a9df-d522647ac2d7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:43.019771 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c075af62-9b91-4e80-a9df-d522647ac2d7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:43.021307 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c075af62-9b91-4e80-a9df-d522647ac2d7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:43.022457 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c075af62-9b91-4e80-a9df-d522647ac2d7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.159120 Jul 27 20:42:43.023006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1833/3684] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:42 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:43.359082 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-390f5816-97bd-45d9-bb5d-eb324da09e9b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:43.359649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-390f5816-97bd-45d9-bb5d-eb324da09e9b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:43.366078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-390f5816-97bd-45d9-bb5d-eb324da09e9b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:43.366532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-390f5816-97bd-45d9-bb5d-eb324da09e9b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:43.367295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-390f5816-97bd-45d9-bb5d-eb324da09e9b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:43.367736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-390f5816-97bd-45d9-bb5d-eb324da09e9b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:43.495518 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-390f5816-97bd-45d9-bb5d-eb324da09e9b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:43.503956 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-390f5816-97bd-45d9-bb5d-eb324da09e9b tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149677 Jul 27 20:42:43.504529 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1852/3685] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:43 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:44.046244 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-95e73896-f842-4273-8aac-00b3dacba1b9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:44.046849 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-95e73896-f842-4273-8aac-00b3dacba1b9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:44.053293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95e73896-f842-4273-8aac-00b3dacba1b9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:44.053739 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95e73896-f842-4273-8aac-00b3dacba1b9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:44.054524 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95e73896-f842-4273-8aac-00b3dacba1b9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:44.054954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95e73896-f842-4273-8aac-00b3dacba1b9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:44.185226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-95e73896-f842-4273-8aac-00b3dacba1b9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:44.193393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-95e73896-f842-4273-8aac-00b3dacba1b9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:44.194859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-95e73896-f842-4273-8aac-00b3dacba1b9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:44.195993 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-95e73896-f842-4273-8aac-00b3dacba1b9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.154306 Jul 27 20:42:44.196534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1834/3686] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:44 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:44.525810 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e4fc4abf-222e-431e-b04d-7f41bac55ac1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:44.526431 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e4fc4abf-222e-431e-b04d-7f41bac55ac1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:44.533431 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4fc4abf-222e-431e-b04d-7f41bac55ac1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:44.533894 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4fc4abf-222e-431e-b04d-7f41bac55ac1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:44.534665 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4fc4abf-222e-431e-b04d-7f41bac55ac1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:44.535113 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e4fc4abf-222e-431e-b04d-7f41bac55ac1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:44.912048 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e4fc4abf-222e-431e-b04d-7f41bac55ac1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:44.920937 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e4fc4abf-222e-431e-b04d-7f41bac55ac1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.399005 Jul 27 20:42:44.921521 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1853/3687] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:44 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:45.222011 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-93d554ec-c9eb-4ba2-9661-e3135d62ae5d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:45.222534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-93d554ec-c9eb-4ba2-9661-e3135d62ae5d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:45.229021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93d554ec-c9eb-4ba2-9661-e3135d62ae5d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:45.229476 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93d554ec-c9eb-4ba2-9661-e3135d62ae5d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:45.230241 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93d554ec-c9eb-4ba2-9661-e3135d62ae5d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:45.230684 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93d554ec-c9eb-4ba2-9661-e3135d62ae5d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:45.363181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-93d554ec-c9eb-4ba2-9661-e3135d62ae5d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:45.371484 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-93d554ec-c9eb-4ba2-9661-e3135d62ae5d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:45.373196 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-93d554ec-c9eb-4ba2-9661-e3135d62ae5d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:45.374354 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-93d554ec-c9eb-4ba2-9661-e3135d62ae5d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156359 Jul 27 20:42:45.374907 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1835/3688] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:45 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:45.941977 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1788a54e-5e55-4ef8-adb7-feefe1820660 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:45.942597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1788a54e-5e55-4ef8-adb7-feefe1820660 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:45.949142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1788a54e-5e55-4ef8-adb7-feefe1820660 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:45.950283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1788a54e-5e55-4ef8-adb7-feefe1820660 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:45.951067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1788a54e-5e55-4ef8-adb7-feefe1820660 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:45.951504 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1788a54e-5e55-4ef8-adb7-feefe1820660 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:46.078236 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1788a54e-5e55-4ef8-adb7-feefe1820660 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:46.086316 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1788a54e-5e55-4ef8-adb7-feefe1820660 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148219 Jul 27 20:42:46.086883 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1854/3689] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:45 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:42:46.398549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-84b69292-a052-4b5e-97f0-c29478ba6b35 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:46.399143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-84b69292-a052-4b5e-97f0-c29478ba6b35 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:46.405821 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-84b69292-a052-4b5e-97f0-c29478ba6b35 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:46.406276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-84b69292-a052-4b5e-97f0-c29478ba6b35 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:46.407046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-84b69292-a052-4b5e-97f0-c29478ba6b35 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:46.407491 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-84b69292-a052-4b5e-97f0-c29478ba6b35 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:46.534953 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-84b69292-a052-4b5e-97f0-c29478ba6b35 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:46.544360 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-84b69292-a052-4b5e-97f0-c29478ba6b35 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:46.546118 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-84b69292-a052-4b5e-97f0-c29478ba6b35 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:46.547268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-84b69292-a052-4b5e-97f0-c29478ba6b35 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152609 Jul 27 20:42:46.547818 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1836/3690] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:46 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:47.112909 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4f17fbb8-bed7-4ce1-918d-14cfbf3c4553 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:47.113545 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4f17fbb8-bed7-4ce1-918d-14cfbf3c4553 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:47.119992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4f17fbb8-bed7-4ce1-918d-14cfbf3c4553 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:47.120481 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4f17fbb8-bed7-4ce1-918d-14cfbf3c4553 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:47.121260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4f17fbb8-bed7-4ce1-918d-14cfbf3c4553 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:47.121749 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4f17fbb8-bed7-4ce1-918d-14cfbf3c4553 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:47.250926 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4f17fbb8-bed7-4ce1-918d-14cfbf3c4553 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:47.258800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4f17fbb8-bed7-4ce1-918d-14cfbf3c4553 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149787 Jul 27 20:42:47.259356 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1855/3691] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:47 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:47.570786 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d663bed7-9420-4c78-9ed3-8a0fe8a690e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:47.571395 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d663bed7-9420-4c78-9ed3-8a0fe8a690e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:47.578310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d663bed7-9420-4c78-9ed3-8a0fe8a690e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:47.578762 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d663bed7-9420-4c78-9ed3-8a0fe8a690e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:47.579523 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d663bed7-9420-4c78-9ed3-8a0fe8a690e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:47.579967 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d663bed7-9420-4c78-9ed3-8a0fe8a690e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:47.709933 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d663bed7-9420-4c78-9ed3-8a0fe8a690e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:47.718540 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d663bed7-9420-4c78-9ed3-8a0fe8a690e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:47.720049 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d663bed7-9420-4c78-9ed3-8a0fe8a690e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:47.721232 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d663bed7-9420-4c78-9ed3-8a0fe8a690e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.154461 Jul 27 20:42:47.721794 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1837/3692] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:47 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:42:48.280656 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-463a4210-327a-4352-8925-33d025d2151e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:48.281301 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-463a4210-327a-4352-8925-33d025d2151e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:48.287807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-463a4210-327a-4352-8925-33d025d2151e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:48.288274 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-463a4210-327a-4352-8925-33d025d2151e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:48.289066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-463a4210-327a-4352-8925-33d025d2151e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:48.289518 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-463a4210-327a-4352-8925-33d025d2151e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:48.415696 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-463a4210-327a-4352-8925-33d025d2151e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:48.424195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-463a4210-327a-4352-8925-33d025d2151e tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.147917 Jul 27 20:42:48.424764 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1856/3693] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:48 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:48.744987 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-50556a7a-134d-4892-af3d-12f6174f2645 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:48.745609 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-50556a7a-134d-4892-af3d-12f6174f2645 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:48.752353 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-50556a7a-134d-4892-af3d-12f6174f2645 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:48.752806 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-50556a7a-134d-4892-af3d-12f6174f2645 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:48.753607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-50556a7a-134d-4892-af3d-12f6174f2645 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:48.754052 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-50556a7a-134d-4892-af3d-12f6174f2645 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:48.882550 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-50556a7a-134d-4892-af3d-12f6174f2645 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:48.890930 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-50556a7a-134d-4892-af3d-12f6174f2645 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:48.892467 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-50556a7a-134d-4892-af3d-12f6174f2645 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:48.893665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-50556a7a-134d-4892-af3d-12f6174f2645 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.152601 Jul 27 20:42:48.894213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1838/3694] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:48 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:49.446054 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f94a9dca-3ce9-4afc-b342-7ac670410233 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:49.446661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f94a9dca-3ce9-4afc-b342-7ac670410233 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:49.454401 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f94a9dca-3ce9-4afc-b342-7ac670410233 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:49.454845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f94a9dca-3ce9-4afc-b342-7ac670410233 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:49.455601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f94a9dca-3ce9-4afc-b342-7ac670410233 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:49.456035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f94a9dca-3ce9-4afc-b342-7ac670410233 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:49.584600 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f94a9dca-3ce9-4afc-b342-7ac670410233 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:49.592939 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f94a9dca-3ce9-4afc-b342-7ac670410233 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150802 Jul 27 20:42:49.593527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1857/3695] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:49 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:49.917424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8170eacc-f1fe-44aa-8ff3-55f0cc344079 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:49.918038 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8170eacc-f1fe-44aa-8ff3-55f0cc344079 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:49.925490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8170eacc-f1fe-44aa-8ff3-55f0cc344079 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:49.925948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8170eacc-f1fe-44aa-8ff3-55f0cc344079 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:49.926726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8170eacc-f1fe-44aa-8ff3-55f0cc344079 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:49.927199 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8170eacc-f1fe-44aa-8ff3-55f0cc344079 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:50.055298 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8170eacc-f1fe-44aa-8ff3-55f0cc344079 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:50.064367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8170eacc-f1fe-44aa-8ff3-55f0cc344079 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:50.065906 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8170eacc-f1fe-44aa-8ff3-55f0cc344079 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:50.067053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8170eacc-f1fe-44aa-8ff3-55f0cc344079 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153874 Jul 27 20:42:50.067597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1839/3696] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:49 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:50.613522 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cce480e7-191e-4e89-9224-8904942ba1ca tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:50.614174 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cce480e7-191e-4e89-9224-8904942ba1ca tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:50.620637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cce480e7-191e-4e89-9224-8904942ba1ca tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:50.621126 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cce480e7-191e-4e89-9224-8904942ba1ca tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:50.621895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cce480e7-191e-4e89-9224-8904942ba1ca tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:50.622332 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cce480e7-191e-4e89-9224-8904942ba1ca tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:50.750481 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cce480e7-191e-4e89-9224-8904942ba1ca tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:50.758410 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cce480e7-191e-4e89-9224-8904942ba1ca tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148756 Jul 27 20:42:50.758986 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1858/3697] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:50 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:51.091036 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fdc6d47f-b40a-4290-9aa6-4ded4f64e76b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:51.091655 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fdc6d47f-b40a-4290-9aa6-4ded4f64e76b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:51.098500 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fdc6d47f-b40a-4290-9aa6-4ded4f64e76b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:51.098953 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fdc6d47f-b40a-4290-9aa6-4ded4f64e76b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:51.099729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fdc6d47f-b40a-4290-9aa6-4ded4f64e76b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:51.100170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fdc6d47f-b40a-4290-9aa6-4ded4f64e76b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:51.229533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fdc6d47f-b40a-4290-9aa6-4ded4f64e76b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:51.237991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fdc6d47f-b40a-4290-9aa6-4ded4f64e76b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:51.239511 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fdc6d47f-b40a-4290-9aa6-4ded4f64e76b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:51.240674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fdc6d47f-b40a-4290-9aa6-4ded4f64e76b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153559 Jul 27 20:42:51.241276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1840/3698] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:51 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:51.779607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f667cc74-c179-473a-94b0-4b410ac20d76 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:51.780218 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f667cc74-c179-473a-94b0-4b410ac20d76 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:51.786759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f667cc74-c179-473a-94b0-4b410ac20d76 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:51.787286 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f667cc74-c179-473a-94b0-4b410ac20d76 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:51.788044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f667cc74-c179-473a-94b0-4b410ac20d76 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:51.788482 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f667cc74-c179-473a-94b0-4b410ac20d76 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:51.913404 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f667cc74-c179-473a-94b0-4b410ac20d76 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:51.921890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f667cc74-c179-473a-94b0-4b410ac20d76 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.146686 Jul 27 20:42:51.922449 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1859/3699] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:51 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:52.265661 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bd6b24a1-98c0-40e1-8da8-a01a4f43f7a1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:52.266276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bd6b24a1-98c0-40e1-8da8-a01a4f43f7a1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:52.272801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bd6b24a1-98c0-40e1-8da8-a01a4f43f7a1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:52.273299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bd6b24a1-98c0-40e1-8da8-a01a4f43f7a1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:52.274067 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bd6b24a1-98c0-40e1-8da8-a01a4f43f7a1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:52.274511 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bd6b24a1-98c0-40e1-8da8-a01a4f43f7a1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:52.407920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bd6b24a1-98c0-40e1-8da8-a01a4f43f7a1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:52.416212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bd6b24a1-98c0-40e1-8da8-a01a4f43f7a1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:52.417742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bd6b24a1-98c0-40e1-8da8-a01a4f43f7a1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:52.419087 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bd6b24a1-98c0-40e1-8da8-a01a4f43f7a1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157849 Jul 27 20:42:52.419632 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1841/3700] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:52 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:52.942101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-352feefa-e00a-4fd7-af66-904fcbd47486 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:52.942726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-352feefa-e00a-4fd7-af66-904fcbd47486 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:52.949311 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-352feefa-e00a-4fd7-af66-904fcbd47486 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:52.949776 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-352feefa-e00a-4fd7-af66-904fcbd47486 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:52.950551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-352feefa-e00a-4fd7-af66-904fcbd47486 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:52.950997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-352feefa-e00a-4fd7-af66-904fcbd47486 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:53.080797 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-352feefa-e00a-4fd7-af66-904fcbd47486 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:53.088839 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-352feefa-e00a-4fd7-af66-904fcbd47486 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150564 Jul 27 20:42:53.089441 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1860/3701] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:52 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:53.442524 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-55da96cb-a381-4ba4-8400-cb20a95febaf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:53.443132 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-55da96cb-a381-4ba4-8400-cb20a95febaf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:53.449646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55da96cb-a381-4ba4-8400-cb20a95febaf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:53.450099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55da96cb-a381-4ba4-8400-cb20a95febaf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:53.450868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55da96cb-a381-4ba4-8400-cb20a95febaf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:53.451310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55da96cb-a381-4ba4-8400-cb20a95febaf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:53.584074 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-55da96cb-a381-4ba4-8400-cb20a95febaf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:53.593124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-55da96cb-a381-4ba4-8400-cb20a95febaf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:53.594619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-55da96cb-a381-4ba4-8400-cb20a95febaf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:53.595775 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-55da96cb-a381-4ba4-8400-cb20a95febaf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157137 Jul 27 20:42:53.596333 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1842/3702] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:53 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:42:54.110530 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d9612e4b-0960-4680-a8bf-efe411a62add tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:54.111082 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d9612e4b-0960-4680-a8bf-efe411a62add tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:54.117612 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d9612e4b-0960-4680-a8bf-efe411a62add tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:54.118069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d9612e4b-0960-4680-a8bf-efe411a62add tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:54.118845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d9612e4b-0960-4680-a8bf-efe411a62add tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:54.119294 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d9612e4b-0960-4680-a8bf-efe411a62add tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:54.123948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:42:54.248605 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d9612e4b-0960-4680-a8bf-efe411a62add tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:54.256741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d9612e4b-0960-4680-a8bf-efe411a62add tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150210 Jul 27 20:42:54.257341 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1861/3703] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:54 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:54.618971 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5158f271-dd3f-4a64-8e2b-49874b75b1d5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:54.619568 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5158f271-dd3f-4a64-8e2b-49874b75b1d5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:54.626591 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5158f271-dd3f-4a64-8e2b-49874b75b1d5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:54.627069 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5158f271-dd3f-4a64-8e2b-49874b75b1d5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:54.627835 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5158f271-dd3f-4a64-8e2b-49874b75b1d5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:54.628275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5158f271-dd3f-4a64-8e2b-49874b75b1d5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:54.754697 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5158f271-dd3f-4a64-8e2b-49874b75b1d5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:54.763089 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5158f271-dd3f-4a64-8e2b-49874b75b1d5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:54.764572 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5158f271-dd3f-4a64-8e2b-49874b75b1d5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:54.765749 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5158f271-dd3f-4a64-8e2b-49874b75b1d5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.150690 Jul 27 20:42:54.766315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1843/3704] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:54 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:55.278770 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-661f584e-4007-473d-955c-21578fb8b0fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:55.279333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-661f584e-4007-473d-955c-21578fb8b0fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:55.285789 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-661f584e-4007-473d-955c-21578fb8b0fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:55.286241 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-661f584e-4007-473d-955c-21578fb8b0fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:55.286993 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-661f584e-4007-473d-955c-21578fb8b0fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:55.287429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-661f584e-4007-473d-955c-21578fb8b0fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:55.416791 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-661f584e-4007-473d-955c-21578fb8b0fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:55.424780 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-661f584e-4007-473d-955c-21578fb8b0fa tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150518 Jul 27 20:42:55.425393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1862/3705] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:55 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:55.792811 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8a82cec1-c858-42b4-8f0b-84bb22bbdfa5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:55.793542 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8a82cec1-c858-42b4-8f0b-84bb22bbdfa5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:55.799985 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8a82cec1-c858-42b4-8f0b-84bb22bbdfa5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:55.800448 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8a82cec1-c858-42b4-8f0b-84bb22bbdfa5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:55.801249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8a82cec1-c858-42b4-8f0b-84bb22bbdfa5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:55.801693 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8a82cec1-c858-42b4-8f0b-84bb22bbdfa5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:55.805637 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:42:55.930634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8a82cec1-c858-42b4-8f0b-84bb22bbdfa5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:55.939712 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8a82cec1-c858-42b4-8f0b-84bb22bbdfa5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:55.941246 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8a82cec1-c858-42b4-8f0b-84bb22bbdfa5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:55.942407 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8a82cec1-c858-42b4-8f0b-84bb22bbdfa5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153592 Jul 27 20:42:55.942964 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1844/3706] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:55 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:56.448072 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-137c66b8-0f2b-4427-8e0b-b72a69eb9ebe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:56.448869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-137c66b8-0f2b-4427-8e0b-b72a69eb9ebe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:56.456894 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-137c66b8-0f2b-4427-8e0b-b72a69eb9ebe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:56.457377 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-137c66b8-0f2b-4427-8e0b-b72a69eb9ebe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:56.458142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-137c66b8-0f2b-4427-8e0b-b72a69eb9ebe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:56.458580 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-137c66b8-0f2b-4427-8e0b-b72a69eb9ebe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:56.584658 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-137c66b8-0f2b-4427-8e0b-b72a69eb9ebe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:56.592689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-137c66b8-0f2b-4427-8e0b-b72a69eb9ebe tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149181 Jul 27 20:42:56.593295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1863/3707] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:56 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:56.967138 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-084011d2-8f59-417e-a2ad-ffecc08c63a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:56.967752 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-084011d2-8f59-417e-a2ad-ffecc08c63a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:56.974259 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-084011d2-8f59-417e-a2ad-ffecc08c63a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:56.974717 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-084011d2-8f59-417e-a2ad-ffecc08c63a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:56.975482 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-084011d2-8f59-417e-a2ad-ffecc08c63a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:56.975925 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-084011d2-8f59-417e-a2ad-ffecc08c63a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:57.108879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-084011d2-8f59-417e-a2ad-ffecc08c63a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:57.117287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-084011d2-8f59-417e-a2ad-ffecc08c63a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:57.118799 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-084011d2-8f59-417e-a2ad-ffecc08c63a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:57.119996 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-084011d2-8f59-417e-a2ad-ffecc08c63a0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157358 Jul 27 20:42:57.120545 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1845/3708] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:56 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:57.614442 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4ed07a6e-7ff3-48ac-b2cf-8842c9f525e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:57.615032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4ed07a6e-7ff3-48ac-b2cf-8842c9f525e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:57.621853 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4ed07a6e-7ff3-48ac-b2cf-8842c9f525e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:57.622311 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4ed07a6e-7ff3-48ac-b2cf-8842c9f525e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:57.623088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4ed07a6e-7ff3-48ac-b2cf-8842c9f525e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:57.623651 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4ed07a6e-7ff3-48ac-b2cf-8842c9f525e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:57.753346 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4ed07a6e-7ff3-48ac-b2cf-8842c9f525e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:57.762494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4ed07a6e-7ff3-48ac-b2cf-8842c9f525e1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151295 Jul 27 20:42:57.763076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1864/3709] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:57 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:58.145217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8108eb9d-32d8-41ca-8f7d-17e1d3b49abf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:58.145806 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8108eb9d-32d8-41ca-8f7d-17e1d3b49abf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:58.153685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8108eb9d-32d8-41ca-8f7d-17e1d3b49abf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:58.154489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8108eb9d-32d8-41ca-8f7d-17e1d3b49abf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:58.155890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8108eb9d-32d8-41ca-8f7d-17e1d3b49abf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:58.156366 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8108eb9d-32d8-41ca-8f7d-17e1d3b49abf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:58.285989 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8108eb9d-32d8-41ca-8f7d-17e1d3b49abf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:58.294876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8108eb9d-32d8-41ca-8f7d-17e1d3b49abf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:58.296376 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8108eb9d-32d8-41ca-8f7d-17e1d3b49abf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:58.297579 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8108eb9d-32d8-41ca-8f7d-17e1d3b49abf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156417 Jul 27 20:42:58.298143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1846/3710] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:58 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:58.784746 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5e6e0d36-504d-45f1-a23c-afdd6099a008 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:58.786060 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5e6e0d36-504d-45f1-a23c-afdd6099a008 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:58.792525 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5e6e0d36-504d-45f1-a23c-afdd6099a008 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:58.793596 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5e6e0d36-504d-45f1-a23c-afdd6099a008 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:58.794362 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5e6e0d36-504d-45f1-a23c-afdd6099a008 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:58.794804 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5e6e0d36-504d-45f1-a23c-afdd6099a008 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:58.923254 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5e6e0d36-504d-45f1-a23c-afdd6099a008 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:58.931256 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5e6e0d36-504d-45f1-a23c-afdd6099a008 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150868 Jul 27 20:42:58.931810 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1865/3711] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:58 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:42:59.322051 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9fd992f2-8536-47cf-9916-0ce92bc2d828 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:59.322675 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9fd992f2-8536-47cf-9916-0ce92bc2d828 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:59.330021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9fd992f2-8536-47cf-9916-0ce92bc2d828 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:59.330451 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9fd992f2-8536-47cf-9916-0ce92bc2d828 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:59.331202 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9fd992f2-8536-47cf-9916-0ce92bc2d828 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:59.331637 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9fd992f2-8536-47cf-9916-0ce92bc2d828 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:59.464774 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9fd992f2-8536-47cf-9916-0ce92bc2d828 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:59.474034 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9fd992f2-8536-47cf-9916-0ce92bc2d828 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:59.475536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9fd992f2-8536-47cf-9916-0ce92bc2d828 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:42:59.476721 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9fd992f2-8536-47cf-9916-0ce92bc2d828 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.158659 Jul 27 20:42:59.477316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1847/3712] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:42:59 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:42:59.951850 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-88f6c30b-f260-426e-b293-47de15d88217 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:42:59.952478 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-88f6c30b-f260-426e-b293-47de15d88217 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:42:59.959283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88f6c30b-f260-426e-b293-47de15d88217 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:59.959744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88f6c30b-f260-426e-b293-47de15d88217 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:42:59.960516 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88f6c30b-f260-426e-b293-47de15d88217 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:42:59.960986 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-88f6c30b-f260-426e-b293-47de15d88217 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:00.088733 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-88f6c30b-f260-426e-b293-47de15d88217 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:00.097962 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-88f6c30b-f260-426e-b293-47de15d88217 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150250 Jul 27 20:43:00.098540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1866/3713] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:42:59 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:00.500358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-99a33889-9e81-479c-9113-355cd27ecf03 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:00.500981 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-99a33889-9e81-479c-9113-355cd27ecf03 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:00.507493 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99a33889-9e81-479c-9113-355cd27ecf03 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:00.507949 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99a33889-9e81-479c-9113-355cd27ecf03 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:00.508716 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99a33889-9e81-479c-9113-355cd27ecf03 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:00.509189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99a33889-9e81-479c-9113-355cd27ecf03 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:00.636253 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-99a33889-9e81-479c-9113-355cd27ecf03 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:00.645183 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-99a33889-9e81-479c-9113-355cd27ecf03 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:00.646689 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-99a33889-9e81-479c-9113-355cd27ecf03 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:00.647854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-99a33889-9e81-479c-9113-355cd27ecf03 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.151452 Jul 27 20:43:00.648405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1848/3714] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:00 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:01.119949 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-469adde4-6dec-4e14-bd63-33f00c2e8c77 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:01.120571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-469adde4-6dec-4e14-bd63-33f00c2e8c77 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:01.127912 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-469adde4-6dec-4e14-bd63-33f00c2e8c77 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:01.128373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-469adde4-6dec-4e14-bd63-33f00c2e8c77 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:01.129175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-469adde4-6dec-4e14-bd63-33f00c2e8c77 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:01.129626 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-469adde4-6dec-4e14-bd63-33f00c2e8c77 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:01.257970 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-469adde4-6dec-4e14-bd63-33f00c2e8c77 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:01.265752 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-469adde4-6dec-4e14-bd63-33f00c2e8c77 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150007 Jul 27 20:43:01.266317 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1867/3715] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:01 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:01.673327 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7366f0b4-0ae8-43ce-97af-a91970cda01b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:01.673917 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7366f0b4-0ae8-43ce-97af-a91970cda01b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:01.680347 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7366f0b4-0ae8-43ce-97af-a91970cda01b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:01.680795 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7366f0b4-0ae8-43ce-97af-a91970cda01b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:01.681580 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7366f0b4-0ae8-43ce-97af-a91970cda01b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:01.682018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7366f0b4-0ae8-43ce-97af-a91970cda01b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:01.811851 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7366f0b4-0ae8-43ce-97af-a91970cda01b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:01.820073 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7366f0b4-0ae8-43ce-97af-a91970cda01b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:01.821597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7366f0b4-0ae8-43ce-97af-a91970cda01b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:01.822740 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7366f0b4-0ae8-43ce-97af-a91970cda01b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153474 Jul 27 20:43:01.823285 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1849/3716] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:01 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:02.286889 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-31e16027-6a7d-4ea2-a22c-c0a2bc2d6690 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:02.287568 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-31e16027-6a7d-4ea2-a22c-c0a2bc2d6690 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:02.294424 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-31e16027-6a7d-4ea2-a22c-c0a2bc2d6690 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:02.294882 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-31e16027-6a7d-4ea2-a22c-c0a2bc2d6690 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:02.295649 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-31e16027-6a7d-4ea2-a22c-c0a2bc2d6690 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:02.296100 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-31e16027-6a7d-4ea2-a22c-c0a2bc2d6690 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:02.427582 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-31e16027-6a7d-4ea2-a22c-c0a2bc2d6690 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:02.436075 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-31e16027-6a7d-4ea2-a22c-c0a2bc2d6690 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153070 Jul 27 20:43:02.436635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1868/3717] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:02 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:02.847090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-63252071-0058-42b6-9b63-89a371a37c54 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:02.847689 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-63252071-0058-42b6-9b63-89a371a37c54 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:02.854109 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63252071-0058-42b6-9b63-89a371a37c54 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:02.854554 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63252071-0058-42b6-9b63-89a371a37c54 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:02.855898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63252071-0058-42b6-9b63-89a371a37c54 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:02.856335 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63252071-0058-42b6-9b63-89a371a37c54 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:02.984118 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-63252071-0058-42b6-9b63-89a371a37c54 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:02.992368 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-63252071-0058-42b6-9b63-89a371a37c54 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:02.993870 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-63252071-0058-42b6-9b63-89a371a37c54 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:02.995018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-63252071-0058-42b6-9b63-89a371a37c54 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.151812 Jul 27 20:43:02.995569 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1850/3718] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:02 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:03.458161 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-90ff54ad-9f7d-4f85-a729-86573c4d541d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:03.458788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-90ff54ad-9f7d-4f85-a729-86573c4d541d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:03.465884 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90ff54ad-9f7d-4f85-a729-86573c4d541d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:03.466461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90ff54ad-9f7d-4f85-a729-86573c4d541d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:03.467227 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90ff54ad-9f7d-4f85-a729-86573c4d541d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:03.467663 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-90ff54ad-9f7d-4f85-a729-86573c4d541d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:03.597006 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-90ff54ad-9f7d-4f85-a729-86573c4d541d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:03.604832 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-90ff54ad-9f7d-4f85-a729-86573c4d541d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150532 Jul 27 20:43:03.605513 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1869/3719] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:03 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:04.018460 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1337398f-b8f8-4df0-9518-61a4a1ec88e9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:04.019058 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1337398f-b8f8-4df0-9518-61a4a1ec88e9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:04.025473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1337398f-b8f8-4df0-9518-61a4a1ec88e9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:04.025915 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1337398f-b8f8-4df0-9518-61a4a1ec88e9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:04.026664 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1337398f-b8f8-4df0-9518-61a4a1ec88e9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:04.027105 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1337398f-b8f8-4df0-9518-61a4a1ec88e9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:04.155267 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1337398f-b8f8-4df0-9518-61a4a1ec88e9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:04.163463 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1337398f-b8f8-4df0-9518-61a4a1ec88e9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:04.164940 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1337398f-b8f8-4df0-9518-61a4a1ec88e9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:04.166108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1337398f-b8f8-4df0-9518-61a4a1ec88e9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.151514 Jul 27 20:43:04.166654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1851/3720] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:04 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:04.626289 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3b0b0481-1752-4fea-bc33-e9b642686fa8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:04.626845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3b0b0481-1752-4fea-bc33-e9b642686fa8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:04.633416 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3b0b0481-1752-4fea-bc33-e9b642686fa8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:04.633961 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3b0b0481-1752-4fea-bc33-e9b642686fa8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:04.635052 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3b0b0481-1752-4fea-bc33-e9b642686fa8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:04.635173 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3b0b0481-1752-4fea-bc33-e9b642686fa8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:04.772669 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3b0b0481-1752-4fea-bc33-e9b642686fa8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:04.780833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3b0b0481-1752-4fea-bc33-e9b642686fa8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.158411 Jul 27 20:43:04.781646 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1870/3721] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:04 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:05.189940 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c08df633-210a-40b5-befd-ced1979f1cb0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:05.190585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c08df633-210a-40b5-befd-ced1979f1cb0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:05.197063 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c08df633-210a-40b5-befd-ced1979f1cb0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:05.197513 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c08df633-210a-40b5-befd-ced1979f1cb0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:05.198281 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c08df633-210a-40b5-befd-ced1979f1cb0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:05.198720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c08df633-210a-40b5-befd-ced1979f1cb0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:05.332001 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c08df633-210a-40b5-befd-ced1979f1cb0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:05.341082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c08df633-210a-40b5-befd-ced1979f1cb0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:05.342590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c08df633-210a-40b5-befd-ced1979f1cb0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:05.343752 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c08df633-210a-40b5-befd-ced1979f1cb0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.157688 Jul 27 20:43:05.344316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1852/3722] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:05 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:05.803411 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-741cf1f6-1767-43ab-8532-b37945c1d54f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:05.804025 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-741cf1f6-1767-43ab-8532-b37945c1d54f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:05.810995 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-741cf1f6-1767-43ab-8532-b37945c1d54f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:05.811474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-741cf1f6-1767-43ab-8532-b37945c1d54f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:05.812241 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-741cf1f6-1767-43ab-8532-b37945c1d54f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:05.812685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-741cf1f6-1767-43ab-8532-b37945c1d54f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:05.942031 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-741cf1f6-1767-43ab-8532-b37945c1d54f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:05.950357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-741cf1f6-1767-43ab-8532-b37945c1d54f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150855 Jul 27 20:43:05.950927 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1871/3723] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:05 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:06.367792 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a0015a9c-0045-4424-9721-f014baf3de3d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:06.368346 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a0015a9c-0045-4424-9721-f014baf3de3d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:06.375472 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0015a9c-0045-4424-9721-f014baf3de3d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:06.375921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0015a9c-0045-4424-9721-f014baf3de3d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:06.376673 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0015a9c-0045-4424-9721-f014baf3de3d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:06.377150 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0015a9c-0045-4424-9721-f014baf3de3d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:06.503916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a0015a9c-0045-4424-9721-f014baf3de3d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:06.512174 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a0015a9c-0045-4424-9721-f014baf3de3d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:06.513702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a0015a9c-0045-4424-9721-f014baf3de3d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:06.514856 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a0015a9c-0045-4424-9721-f014baf3de3d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.151109 Jul 27 20:43:06.515432 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1853/3724] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:06 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:06.971755 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-92bae4b9-a8b2-41d0-8d08-0947f60133ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:06.972362 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-92bae4b9-a8b2-41d0-8d08-0947f60133ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:06.979096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-92bae4b9-a8b2-41d0-8d08-0947f60133ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:06.979552 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-92bae4b9-a8b2-41d0-8d08-0947f60133ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:06.980948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-92bae4b9-a8b2-41d0-8d08-0947f60133ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:06.981417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-92bae4b9-a8b2-41d0-8d08-0947f60133ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:07.114232 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-92bae4b9-a8b2-41d0-8d08-0947f60133ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:07.122423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-92bae4b9-a8b2-41d0-8d08-0947f60133ed tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.154571 Jul 27 20:43:07.122994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1872/3725] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:06 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:43:07.539000 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d0d63eee-42d7-4b1b-87ca-1fc1e2cb4872 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:07.539621 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d0d63eee-42d7-4b1b-87ca-1fc1e2cb4872 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:07.546387 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d0d63eee-42d7-4b1b-87ca-1fc1e2cb4872 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:07.546840 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d0d63eee-42d7-4b1b-87ca-1fc1e2cb4872 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:07.547601 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d0d63eee-42d7-4b1b-87ca-1fc1e2cb4872 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:07.548042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d0d63eee-42d7-4b1b-87ca-1fc1e2cb4872 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:07.680430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d0d63eee-42d7-4b1b-87ca-1fc1e2cb4872 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:07.689440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d0d63eee-42d7-4b1b-87ca-1fc1e2cb4872 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:07.690955 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d0d63eee-42d7-4b1b-87ca-1fc1e2cb4872 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:07.692104 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d0d63eee-42d7-4b1b-87ca-1fc1e2cb4872 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.158067 Jul 27 20:43:07.692658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1854/3726] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:07 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:08.143667 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-dcbc2285-9f59-4d3f-a778-0d0f3f017dd8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:08.144323 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-dcbc2285-9f59-4d3f-a778-0d0f3f017dd8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:08.146621 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=52 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:43:08.151960 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dcbc2285-9f59-4d3f-a778-0d0f3f017dd8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:08.152423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dcbc2285-9f59-4d3f-a778-0d0f3f017dd8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:08.153317 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dcbc2285-9f59-4d3f-a778-0d0f3f017dd8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:08.153768 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dcbc2285-9f59-4d3f-a778-0d0f3f017dd8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:08.282252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-dcbc2285-9f59-4d3f-a778-0d0f3f017dd8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:08.290373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-dcbc2285-9f59-4d3f-a778-0d0f3f017dd8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150575 Jul 27 20:43:08.290940 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1873/3727] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:08 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:08.716195 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-794c4e89-e71d-4fb3-a184-4791f73cd1fa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:08.717610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-794c4e89-e71d-4fb3-a184-4791f73cd1fa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:08.724065 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-794c4e89-e71d-4fb3-a184-4791f73cd1fa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:08.724517 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-794c4e89-e71d-4fb3-a184-4791f73cd1fa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:08.725313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-794c4e89-e71d-4fb3-a184-4791f73cd1fa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:08.725752 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-794c4e89-e71d-4fb3-a184-4791f73cd1fa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:08.860516 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-794c4e89-e71d-4fb3-a184-4791f73cd1fa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:08.868927 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-794c4e89-e71d-4fb3-a184-4791f73cd1fa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:08.870450 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-794c4e89-e71d-4fb3-a184-4791f73cd1fa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:08.871610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-794c4e89-e71d-4fb3-a184-4791f73cd1fa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.159402 Jul 27 20:43:08.872422 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1855/3728] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:08 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:09.312783 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ae05e9ca-dfbf-4a4a-9777-1c2a3ff536ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:09.313535 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ae05e9ca-dfbf-4a4a-9777-1c2a3ff536ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:09.320090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ae05e9ca-dfbf-4a4a-9777-1c2a3ff536ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:09.320543 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ae05e9ca-dfbf-4a4a-9777-1c2a3ff536ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:09.321342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ae05e9ca-dfbf-4a4a-9777-1c2a3ff536ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:09.321787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ae05e9ca-dfbf-4a4a-9777-1c2a3ff536ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:09.450675 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ae05e9ca-dfbf-4a4a-9777-1c2a3ff536ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:09.458770 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ae05e9ca-dfbf-4a4a-9777-1c2a3ff536ee tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150609 Jul 27 20:43:09.459331 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1874/3729] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:09 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:09.894850 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-aac0ec23-c701-46ec-ae5e-09332209df21 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:09.895461 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-aac0ec23-c701-46ec-ae5e-09332209df21 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:09.902023 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aac0ec23-c701-46ec-ae5e-09332209df21 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:09.902476 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aac0ec23-c701-46ec-ae5e-09332209df21 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:09.903238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aac0ec23-c701-46ec-ae5e-09332209df21 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:09.904198 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aac0ec23-c701-46ec-ae5e-09332209df21 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:10.029307 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aac0ec23-c701-46ec-ae5e-09332209df21 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:10.037682 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aac0ec23-c701-46ec-ae5e-09332209df21 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:10.039185 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aac0ec23-c701-46ec-ae5e-09332209df21 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:10.040342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-aac0ec23-c701-46ec-ae5e-09332209df21 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.149404 Jul 27 20:43:10.040895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1856/3730] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:09 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:10.479852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b56593d8-2d09-484c-9363-c561893174a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:10.480468 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b56593d8-2d09-484c-9363-c561893174a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:10.486974 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b56593d8-2d09-484c-9363-c561893174a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:10.487425 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b56593d8-2d09-484c-9363-c561893174a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:10.488184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b56593d8-2d09-484c-9363-c561893174a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:10.488627 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b56593d8-2d09-484c-9363-c561893174a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:10.614883 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b56593d8-2d09-484c-9363-c561893174a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:10.627396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b56593d8-2d09-484c-9363-c561893174a5 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.151412 Jul 27 20:43:10.627959 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1875/3731] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:10 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:11.065658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-30fd85f7-0b3f-4b62-9759-32af54fd6943 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:11.066262 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-30fd85f7-0b3f-4b62-9759-32af54fd6943 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:11.068571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=52 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:43:11.073996 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30fd85f7-0b3f-4b62-9759-32af54fd6943 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:11.074447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30fd85f7-0b3f-4b62-9759-32af54fd6943 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:11.075226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30fd85f7-0b3f-4b62-9759-32af54fd6943 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:11.076393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30fd85f7-0b3f-4b62-9759-32af54fd6943 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:11.236936 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-30fd85f7-0b3f-4b62-9759-32af54fd6943 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:11.247355 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-30fd85f7-0b3f-4b62-9759-32af54fd6943 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:11.248985 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-30fd85f7-0b3f-4b62-9759-32af54fd6943 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:11.250180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-30fd85f7-0b3f-4b62-9759-32af54fd6943 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.188432 Jul 27 20:43:11.250742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1857/3732] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:11 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:11.651624 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3414b2e2-a266-4ce2-88eb-4fa7493a4be8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:11.652262 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3414b2e2-a266-4ce2-88eb-4fa7493a4be8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:11.659883 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3414b2e2-a266-4ce2-88eb-4fa7493a4be8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:11.660333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3414b2e2-a266-4ce2-88eb-4fa7493a4be8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:11.661115 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3414b2e2-a266-4ce2-88eb-4fa7493a4be8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:11.661552 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3414b2e2-a266-4ce2-88eb-4fa7493a4be8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:11.788706 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3414b2e2-a266-4ce2-88eb-4fa7493a4be8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:11.796924 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3414b2e2-a266-4ce2-88eb-4fa7493a4be8 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.149095 Jul 27 20:43:11.797528 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1876/3733] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:11 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:12.279119 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2756c5cc-3c42-436c-a82e-fc97b17df7a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:12.279758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2756c5cc-3c42-436c-a82e-fc97b17df7a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:12.286401 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2756c5cc-3c42-436c-a82e-fc97b17df7a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:12.286842 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2756c5cc-3c42-436c-a82e-fc97b17df7a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:12.287594 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2756c5cc-3c42-436c-a82e-fc97b17df7a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:12.288022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2756c5cc-3c42-436c-a82e-fc97b17df7a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:12.413596 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2756c5cc-3c42-436c-a82e-fc97b17df7a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:12.422462 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2756c5cc-3c42-436c-a82e-fc97b17df7a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:12.423974 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2756c5cc-3c42-436c-a82e-fc97b17df7a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:12.425174 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2756c5cc-3c42-436c-a82e-fc97b17df7a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.149954 Jul 27 20:43:12.425727 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1858/3734] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:12 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:12.818337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-73b3af50-4acc-4ad9-81f0-298a4cf6ece4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:12.818952 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-73b3af50-4acc-4ad9-81f0-298a4cf6ece4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:12.825571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-73b3af50-4acc-4ad9-81f0-298a4cf6ece4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:12.826025 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-73b3af50-4acc-4ad9-81f0-298a4cf6ece4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:12.826843 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-73b3af50-4acc-4ad9-81f0-298a4cf6ece4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:12.827280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-73b3af50-4acc-4ad9-81f0-298a4cf6ece4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:12.958720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-73b3af50-4acc-4ad9-81f0-298a4cf6ece4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:12.962083 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:43:12.967923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-73b3af50-4acc-4ad9-81f0-298a4cf6ece4 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.153518 Jul 27 20:43:12.968485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1877/3735] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:12 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:13.448891 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c0a36157-28dd-4bea-8a56-3c5f91f08154 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:13.449639 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c0a36157-28dd-4bea-8a56-3c5f91f08154 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:13.456947 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c0a36157-28dd-4bea-8a56-3c5f91f08154 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:13.457426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c0a36157-28dd-4bea-8a56-3c5f91f08154 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:13.458191 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c0a36157-28dd-4bea-8a56-3c5f91f08154 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:13.458628 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c0a36157-28dd-4bea-8a56-3c5f91f08154 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:13.598649 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c0a36157-28dd-4bea-8a56-3c5f91f08154 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:13.606933 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c0a36157-28dd-4bea-8a56-3c5f91f08154 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:13.608405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c0a36157-28dd-4bea-8a56-3c5f91f08154 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:13.609580 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c0a36157-28dd-4bea-8a56-3c5f91f08154 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.164608 Jul 27 20:43:13.610127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1859/3736] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:13 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:13.989976 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-735089f1-b85b-42bf-bec0-ecbbb0b3ade6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:13.990586 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-735089f1-b85b-42bf-bec0-ecbbb0b3ade6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:13.997306 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-735089f1-b85b-42bf-bec0-ecbbb0b3ade6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:13.998382 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-735089f1-b85b-42bf-bec0-ecbbb0b3ade6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:13.999195 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-735089f1-b85b-42bf-bec0-ecbbb0b3ade6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:13.999666 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-735089f1-b85b-42bf-bec0-ecbbb0b3ade6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:14.126841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-735089f1-b85b-42bf-bec0-ecbbb0b3ade6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:14.134732 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-735089f1-b85b-42bf-bec0-ecbbb0b3ade6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148649 Jul 27 20:43:14.135346 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1878/3737] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:13 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:14.633127 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d5e61491-c713-4e30-aad5-5988a34a6af5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:14.633734 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d5e61491-c713-4e30-aad5-5988a34a6af5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:14.640423 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5e61491-c713-4e30-aad5-5988a34a6af5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:14.640868 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5e61491-c713-4e30-aad5-5988a34a6af5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:14.641644 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5e61491-c713-4e30-aad5-5988a34a6af5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:14.642076 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5e61491-c713-4e30-aad5-5988a34a6af5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:14.770670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d5e61491-c713-4e30-aad5-5988a34a6af5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:14.773990 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:43:14.779874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d5e61491-c713-4e30-aad5-5988a34a6af5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:14.781386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d5e61491-c713-4e30-aad5-5988a34a6af5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:14.782578 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d5e61491-c713-4e30-aad5-5988a34a6af5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153359 Jul 27 20:43:14.783586 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1860/3738] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:14 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:15.156308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5b892f38-3072-4bc9-9373-0aa55fbbc958 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:15.157278 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5b892f38-3072-4bc9-9373-0aa55fbbc958 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:15.163821 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5b892f38-3072-4bc9-9373-0aa55fbbc958 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:15.164276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5b892f38-3072-4bc9-9373-0aa55fbbc958 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:15.165073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5b892f38-3072-4bc9-9373-0aa55fbbc958 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:15.165518 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5b892f38-3072-4bc9-9373-0aa55fbbc958 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:15.301032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5b892f38-3072-4bc9-9373-0aa55fbbc958 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:15.309061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5b892f38-3072-4bc9-9373-0aa55fbbc958 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.157167 Jul 27 20:43:15.309565 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1879/3739] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:15 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:15.807778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-26729fb0-05cc-41de-baad-b1d4d8fe059e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:15.808508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-26729fb0-05cc-41de-baad-b1d4d8fe059e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:15.816264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-26729fb0-05cc-41de-baad-b1d4d8fe059e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:15.816704 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-26729fb0-05cc-41de-baad-b1d4d8fe059e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:15.817497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-26729fb0-05cc-41de-baad-b1d4d8fe059e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:15.817927 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-26729fb0-05cc-41de-baad-b1d4d8fe059e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:15.947171 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-26729fb0-05cc-41de-baad-b1d4d8fe059e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:15.956446 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-26729fb0-05cc-41de-baad-b1d4d8fe059e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:15.957967 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-26729fb0-05cc-41de-baad-b1d4d8fe059e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:15.959121 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-26729fb0-05cc-41de-baad-b1d4d8fe059e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.156014 Jul 27 20:43:15.959675 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1861/3740] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:15 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:16.330531 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7a2a5ebc-f97c-45c0-ab9d-0cd6837d5694 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:16.331090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7a2a5ebc-f97c-45c0-ab9d-0cd6837d5694 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:16.337621 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7a2a5ebc-f97c-45c0-ab9d-0cd6837d5694 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:16.338110 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7a2a5ebc-f97c-45c0-ab9d-0cd6837d5694 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:16.338883 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7a2a5ebc-f97c-45c0-ab9d-0cd6837d5694 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:16.339329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7a2a5ebc-f97c-45c0-ab9d-0cd6837d5694 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:16.467106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7a2a5ebc-f97c-45c0-ab9d-0cd6837d5694 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:16.475049 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7a2a5ebc-f97c-45c0-ab9d-0cd6837d5694 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.148738 Jul 27 20:43:16.475619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1880/3741] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:16 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:16.982462 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7e3aa55c-1d77-4b0c-bda4-e5dd0f23cf04 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:16.983056 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7e3aa55c-1d77-4b0c-bda4-e5dd0f23cf04 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:16.989575 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7e3aa55c-1d77-4b0c-bda4-e5dd0f23cf04 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:16.990030 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7e3aa55c-1d77-4b0c-bda4-e5dd0f23cf04 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:16.990797 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7e3aa55c-1d77-4b0c-bda4-e5dd0f23cf04 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:16.991239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7e3aa55c-1d77-4b0c-bda4-e5dd0f23cf04 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:17.121089 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7e3aa55c-1d77-4b0c-bda4-e5dd0f23cf04 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:17.129532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7e3aa55c-1d77-4b0c-bda4-e5dd0f23cf04 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:17.131033 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7e3aa55c-1d77-4b0c-bda4-e5dd0f23cf04 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:17.132190 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7e3aa55c-1d77-4b0c-bda4-e5dd0f23cf04 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153923 Jul 27 20:43:17.132745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1862/3742] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:16 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:17.496519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3834628c-9e2a-49a2-9f4e-1ec06cf0e5c6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:17.497685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3834628c-9e2a-49a2-9f4e-1ec06cf0e5c6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:17.504203 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3834628c-9e2a-49a2-9f4e-1ec06cf0e5c6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:17.504662 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3834628c-9e2a-49a2-9f4e-1ec06cf0e5c6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:17.505457 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3834628c-9e2a-49a2-9f4e-1ec06cf0e5c6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:17.505904 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3834628c-9e2a-49a2-9f4e-1ec06cf0e5c6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:17.645393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3834628c-9e2a-49a2-9f4e-1ec06cf0e5c6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:17.653278 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3834628c-9e2a-49a2-9f4e-1ec06cf0e5c6 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.160844 Jul 27 20:43:17.654004 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1881/3743] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:17 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:43:18.156589 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0f9ed3d2-26f6-4f47-b09d-e46209ec06bd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:18.157226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0f9ed3d2-26f6-4f47-b09d-e46209ec06bd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:18.163257 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f9ed3d2-26f6-4f47-b09d-e46209ec06bd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:18.163712 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f9ed3d2-26f6-4f47-b09d-e46209ec06bd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:18.164474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f9ed3d2-26f6-4f47-b09d-e46209ec06bd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:18.164909 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f9ed3d2-26f6-4f47-b09d-e46209ec06bd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:18.293598 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0f9ed3d2-26f6-4f47-b09d-e46209ec06bd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:18.302519 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0f9ed3d2-26f6-4f47-b09d-e46209ec06bd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:18.304006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0f9ed3d2-26f6-4f47-b09d-e46209ec06bd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:18.305188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0f9ed3d2-26f6-4f47-b09d-e46209ec06bd tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 200 len: 1801 microversion: 2.20 time: 0.153177 Jul 27 20:43:18.305743 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1863/3744] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:18 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:18.328630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c6a02f50-306d-48ba-9af1-07f30ec67c63 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '.version_select at 0x7fc7f389be50>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:18.333143 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c6a02f50-306d-48ba-9af1-07f30ec67c63 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [93182de2-03dc-48c6-9a5e-6287f232c9d0] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 27 20:43:18.674373 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c501c066-320d-4fad-923c-54132d40740f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:18.674980 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c501c066-320d-4fad-923c-54132d40740f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 0d634922-ac08-46f6-aa94-44abf09f6bc3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:18.680948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c501c066-320d-4fad-923c-54132d40740f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:18.681428 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c501c066-320d-4fad-923c-54132d40740f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:18.682196 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c501c066-320d-4fad-923c-54132d40740f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:18.682636 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c501c066-320d-4fad-923c-54132d40740f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:18.813295 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c501c066-320d-4fad-923c-54132d40740f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:18.821262 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c501c066-320d-4fad-923c-54132d40740f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3" status: 200 len: 1731 microversion: 2.1 time: 0.150714 Jul 27 20:43:18.821821 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1864/3745] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:43:18 2022] GET /compute/v2.1/servers/0d634922-ac08-46f6-aa94-44abf09f6bc3 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:43:18.842108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-28c41e66-ea04-4767-8256-2e4a3e16b0f7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '.version_select at 0x7fc7f03b55e0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:18.863418 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-28c41e66-ea04-4767-8256-2e4a3e16b0f7 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-425300320" status: 202 len: 0 microversion: 2.1 time: 0.025007 Jul 27 20:43:18.864015 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1865/3746] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Jul 27 20:43:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-425300320 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 20:43:19.340044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [None req-c6a02f50-306d-48ba-9af1-07f30ec67c63 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [93182de2-03dc-48c6-9a5e-6287f232c9d0] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 40740. Jul 27 20:43:19.362181 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c6a02f50-306d-48ba-9af1-07f30ec67c63 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-789069220" status: 204 len: 0 microversion: 2.20 time: 1.038037 Jul 27 20:43:19.366026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1882/3747] 10.222.0.65 () {60 vars in 1259 bytes} [Wed Jul 27 20:43:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-789069220 => generated 0 bytes in 1039 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 20:43:19.770865 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-a208f6b5-ae33-4312-a6cb-dd3e78120d3e req-2cd60e42-6569-4184-98b7-4ff6861b91c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d634922-ac08-46f6-aa94-44abf09f6bc3", "tag": "63624ac2-681a-4488-9360-3a3a6dc129bc"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:43:19.783417 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-a208f6b5-ae33-4312-a6cb-dd3e78120d3e req-2cd60e42-6569-4184-98b7-4ff6861b91c0 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:19.783861 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-a208f6b5-ae33-4312-a6cb-dd3e78120d3e req-2cd60e42-6569-4184-98b7-4ff6861b91c0 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:19.796077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-a208f6b5-ae33-4312-a6cb-dd3e78120d3e req-2cd60e42-6569-4184-98b7-4ff6861b91c0 service nova] Creating event network-changed:63624ac2-681a-4488-9360-3a3a6dc129bc for instance 0d634922-ac08-46f6-aa94-44abf09f6bc3 on hv-cinder-79987 Jul 27 20:43:19.801843 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-a208f6b5-ae33-4312-a6cb-dd3e78120d3e req-2cd60e42-6569-4184-98b7-4ff6861b91c0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034607 Jul 27 20:43:19.802690 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1866/3748] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:43:20.337493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-ad09409c-67b6-4098-8d04-8c2812955531 req-95acfae8-e7e4-4cc3-a69b-1932f242e74d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d725356e-73a3-486b-b590-0324916667ff", "tag": "899741ce-2752-45e1-aee9-3a2da333cdf0"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:43:20.359844 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-ad09409c-67b6-4098-8d04-8c2812955531 req-95acfae8-e7e4-4cc3-a69b-1932f242e74d service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:20.360534 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-ad09409c-67b6-4098-8d04-8c2812955531 req-95acfae8-e7e4-4cc3-a69b-1932f242e74d service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:20.375288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-ad09409c-67b6-4098-8d04-8c2812955531 req-95acfae8-e7e4-4cc3-a69b-1932f242e74d service nova] Creating event network-changed:899741ce-2752-45e1-aee9-3a2da333cdf0 for instance d725356e-73a3-486b-b590-0324916667ff on hv-cinder-79987 Jul 27 20:43:20.385996 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-ad09409c-67b6-4098-8d04-8c2812955531 req-95acfae8-e7e4-4cc3-a69b-1932f242e74d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051966 Jul 27 20:43:20.387090 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1883/3749] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:43:20.539357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f6b1ff26-2d7e-45a6-b3b7-3d119fbe306c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Action: 'create', calling method: .version_select at 0x7fc7eae80d30>, body: {"keypair": {"name": "tempest-keypair-2055010840", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVNxEo9XXYZHLJyM99PxoPVIEs+rkMSzF8k8MxYy5GrzNeAPHt1RP++tlxJZ5QDPnPFdP8fKjYiLeDjC+NVV7Bn1TAkFdYszIFTEsGWPhjrf/FSgcEf3hXDyZQdBzUH6A=="}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:43:20.558485 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-f6b1ff26-2d7e-45a6-b3b7-3d119fbe306c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Getting quotas for project ec01b599458b451e8d04a428c1c33513. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:43:20.563352 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-f6b1ff26-2d7e-45a6-b3b7-3d119fbe306c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Getting quotas for user b734a345bfe5483d9a5a1e35d89c935b and project ec01b599458b451e8d04a428c1c33513. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:43:20.592846 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f6b1ff26-2d7e-45a6-b3b7-3d119fbe306c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.057680 Jul 27 20:43:20.600373 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1867/3750] 10.222.0.65 () {62 vars in 1200 bytes} [Wed Jul 27 20:43:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 27 20:43:21.990361 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-453fde36-ab18-4f4c-917d-7c13cd33b252 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-167896547", "imageRef": "fb689bea-534a-4aac-bec3-8f55591dba58", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5057539b-dab4-4848-a916-7b9e9cc4f43e"}], "security_groups": [{"name": "tempest-securitygroup--229780503"}], "key_name": "tempest-keypair-2055010840", "user_data": "}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:43:22.095713 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.network.neutron [None req-453fde36-ab18-4f4c-917d-7c13cd33b252 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] validate_networks() for [('5057539b-dab4-4848-a916-7b9e9cc4f43e', None, None, None, None, None)] {{(pid=117876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:43:22.472236 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-453fde36-ab18-4f4c-917d-7c13cd33b252 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Flavor limits 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:43:22.472673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-453fde36-ab18-4f4c-917d-7c13cd33b252 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Image limits 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:43:22.473197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-453fde36-ab18-4f4c-917d-7c13cd33b252 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Flavor pref 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:43:22.473618 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-453fde36-ab18-4f4c-917d-7c13cd33b252 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Image pref 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:43:22.474048 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-453fde36-ab18-4f4c-917d-7c13cd33b252 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:43:22.485631 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-453fde36-ab18-4f4c-917d-7c13cd33b252 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:22.485790 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-453fde36-ab18-4f4c-917d-7c13cd33b252 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:22.486772 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-453fde36-ab18-4f4c-917d-7c13cd33b252 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:22.487218 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-453fde36-ab18-4f4c-917d-7c13cd33b252 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:22.504542 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-453fde36-ab18-4f4c-917d-7c13cd33b252 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Getting quotas for project ec01b599458b451e8d04a428c1c33513. Resources: {'cores', 'instances', 'ram'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:43:22.508533 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-453fde36-ab18-4f4c-917d-7c13cd33b252 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Getting quotas for user b734a345bfe5483d9a5a1e35d89c935b and project ec01b599458b451e8d04a428c1c33513. Resources: {'cores', 'instances', 'ram'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:43:22.519926 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-453fde36-ab18-4f4c-917d-7c13cd33b252 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Going to run 1 instances... {{(pid=117876) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:43:22.522381 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-453fde36-ab18-4f4c-917d-7c13cd33b252 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb689bea-534a-4aac-bec3-8f55591dba58',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:43:22.576152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-453fde36-ab18-4f4c-917d-7c13cd33b252 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.590883 Jul 27 20:43:22.576802 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1884/3751] 10.222.0.65 () {62 vars in 1188 bytes} [Wed Jul 27 20:43:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 27 20:43:22.588618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4022b394-ee35-4752-a0ba-251c7f455899 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:22.589507 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4022b394-ee35-4752-a0ba-251c7f455899 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:22.643963 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4022b394-ee35-4752-a0ba-251c7f455899 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:22.652144 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4022b394-ee35-4752-a0ba-251c7f455899 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:22.654229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4022b394-ee35-4752-a0ba-251c7f455899 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:22.655395 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4022b394-ee35-4752-a0ba-251c7f455899 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1281 microversion: 2.20 time: 0.071420 Jul 27 20:43:22.656018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1868/3752] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:22 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:43:23.678802 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5311f390-b679-4d61-9c10-0f8e5b2f1468 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:23.679497 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5311f390-b679-4d61-9c10-0f8e5b2f1468 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:23.686727 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5311f390-b679-4d61-9c10-0f8e5b2f1468 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:23.687271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5311f390-b679-4d61-9c10-0f8e5b2f1468 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:23.688179 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5311f390-b679-4d61-9c10-0f8e5b2f1468 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:23.688709 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5311f390-b679-4d61-9c10-0f8e5b2f1468 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:23.758807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5311f390-b679-4d61-9c10-0f8e5b2f1468 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:23.766802 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5311f390-b679-4d61-9c10-0f8e5b2f1468 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:23.768301 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5311f390-b679-4d61-9c10-0f8e5b2f1468 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:23.769419 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5311f390-b679-4d61-9c10-0f8e5b2f1468 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1339 microversion: 2.20 time: 0.095159 Jul 27 20:43:23.769969 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1885/3753] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:23 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1339 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:24.791226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bfd025d6-c5d3-4339-9643-6fb476af6fd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:24.792474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bfd025d6-c5d3-4339-9643-6fb476af6fd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:24.799985 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfd025d6-c5d3-4339-9643-6fb476af6fd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:24.800389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfd025d6-c5d3-4339-9643-6fb476af6fd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:24.801198 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfd025d6-c5d3-4339-9643-6fb476af6fd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:24.801624 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfd025d6-c5d3-4339-9643-6fb476af6fd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:25.007250 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bfd025d6-c5d3-4339-9643-6fb476af6fd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:25.015518 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bfd025d6-c5d3-4339-9643-6fb476af6fd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:25.017056 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bfd025d6-c5d3-4339-9643-6fb476af6fd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:25.018161 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bfd025d6-c5d3-4339-9643-6fb476af6fd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1406 microversion: 2.20 time: 0.230812 Jul 27 20:43:25.018728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1869/3754] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:24 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:25.114337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-d95306c9-52e6-4519-b66b-8c88fe83a071 req-e7231bb1-d034-4a78-971a-ce21edb6d8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9989ae14-684b-494e-bc1d-df4a26faf42b", "tag": "e3e29ab1-5d40-4baf-aa9a-dab68126df17"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:43:25.124909 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-d95306c9-52e6-4519-b66b-8c88fe83a071 req-e7231bb1-d034-4a78-971a-ce21edb6d8c4 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:25.125402 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-d95306c9-52e6-4519-b66b-8c88fe83a071 req-e7231bb1-d034-4a78-971a-ce21edb6d8c4 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:25.143295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-d95306c9-52e6-4519-b66b-8c88fe83a071 req-e7231bb1-d034-4a78-971a-ce21edb6d8c4 service nova] Creating event network-changed:e3e29ab1-5d40-4baf-aa9a-dab68126df17 for instance 9989ae14-684b-494e-bc1d-df4a26faf42b on hv-cinder-79987 Jul 27 20:43:25.148259 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-d95306c9-52e6-4519-b66b-8c88fe83a071 req-e7231bb1-d034-4a78-971a-ce21edb6d8c4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037585 Jul 27 20:43:25.148861 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1886/3755] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:43:26.040922 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ae017d83-6895-4153-801a-33ddf8b38acf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:26.041564 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ae017d83-6895-4153-801a-33ddf8b38acf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:26.048580 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae017d83-6895-4153-801a-33ddf8b38acf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:26.049059 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae017d83-6895-4153-801a-33ddf8b38acf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:26.049811 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae017d83-6895-4153-801a-33ddf8b38acf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:26.050240 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae017d83-6895-4153-801a-33ddf8b38acf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:26.177455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ae017d83-6895-4153-801a-33ddf8b38acf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:26.186041 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ae017d83-6895-4153-801a-33ddf8b38acf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:26.187535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ae017d83-6895-4153-801a-33ddf8b38acf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:26.188630 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ae017d83-6895-4153-801a-33ddf8b38acf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1406 microversion: 2.20 time: 0.151574 Jul 27 20:43:26.189215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1870/3756] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:26 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:27.212050 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-426e5138-8586-4d0a-a5d0-64140929f685 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:27.212756 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-426e5138-8586-4d0a-a5d0-64140929f685 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:27.219589 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-426e5138-8586-4d0a-a5d0-64140929f685 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:27.220046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-426e5138-8586-4d0a-a5d0-64140929f685 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:27.220819 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-426e5138-8586-4d0a-a5d0-64140929f685 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:27.221293 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-426e5138-8586-4d0a-a5d0-64140929f685 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:27.350707 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-426e5138-8586-4d0a-a5d0-64140929f685 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:27.358682 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-426e5138-8586-4d0a-a5d0-64140929f685 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:27.360189 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-426e5138-8586-4d0a-a5d0-64140929f685 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:27.361329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-426e5138-8586-4d0a-a5d0-64140929f685 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1406 microversion: 2.20 time: 0.154063 Jul 27 20:43:27.361889 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1887/3757] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:27 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:28.383647 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dd8254ec-5803-4ed3-934e-266dfccfc1d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:28.384206 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dd8254ec-5803-4ed3-934e-266dfccfc1d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:28.391227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd8254ec-5803-4ed3-934e-266dfccfc1d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:28.391670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd8254ec-5803-4ed3-934e-266dfccfc1d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:28.392420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd8254ec-5803-4ed3-934e-266dfccfc1d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:28.392851 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd8254ec-5803-4ed3-934e-266dfccfc1d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:28.521589 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dd8254ec-5803-4ed3-934e-266dfccfc1d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:28.529501 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dd8254ec-5803-4ed3-934e-266dfccfc1d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:28.530996 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dd8254ec-5803-4ed3-934e-266dfccfc1d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:28.532087 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dd8254ec-5803-4ed3-934e-266dfccfc1d1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1406 microversion: 2.20 time: 0.152384 Jul 27 20:43:28.532634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1871/3758] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:28 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:29.554045 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-95213b79-36ab-45dd-9d8a-0078a69a1b2e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:29.554625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-95213b79-36ab-45dd-9d8a-0078a69a1b2e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:29.561364 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-95213b79-36ab-45dd-9d8a-0078a69a1b2e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:29.561825 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-95213b79-36ab-45dd-9d8a-0078a69a1b2e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:29.562598 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-95213b79-36ab-45dd-9d8a-0078a69a1b2e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:29.563045 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-95213b79-36ab-45dd-9d8a-0078a69a1b2e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:29.694862 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-95213b79-36ab-45dd-9d8a-0078a69a1b2e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:29.703541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-95213b79-36ab-45dd-9d8a-0078a69a1b2e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:29.705084 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-95213b79-36ab-45dd-9d8a-0078a69a1b2e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:29.707080 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-95213b79-36ab-45dd-9d8a-0078a69a1b2e tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1406 microversion: 2.20 time: 0.156148 Jul 27 20:43:29.707651 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1888/3759] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:29 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:30.730302 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-25835bc1-e028-4ef5-b086-6b50e48e4d61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:30.730982 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-25835bc1-e028-4ef5-b086-6b50e48e4d61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:30.737798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-25835bc1-e028-4ef5-b086-6b50e48e4d61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:30.738258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-25835bc1-e028-4ef5-b086-6b50e48e4d61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:30.739024 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-25835bc1-e028-4ef5-b086-6b50e48e4d61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:30.739466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-25835bc1-e028-4ef5-b086-6b50e48e4d61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:30.870474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-25835bc1-e028-4ef5-b086-6b50e48e4d61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:30.879078 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-25835bc1-e028-4ef5-b086-6b50e48e4d61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:30.880583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-25835bc1-e028-4ef5-b086-6b50e48e4d61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:30.881725 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-25835bc1-e028-4ef5-b086-6b50e48e4d61 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1406 microversion: 2.20 time: 0.155385 Jul 27 20:43:30.882283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1872/3760] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:30 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:31.258966 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-047a0365-550c-485f-a1dc-94e0b272531a req-0e3db3f5-3f78-4c8f-873e-bd46f325f32b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9989ae14-684b-494e-bc1d-df4a26faf42b", "name": "network-vif-plugged", "status": "completed", "tag": "e3e29ab1-5d40-4baf-aa9a-dab68126df17"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:43:31.269584 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-047a0365-550c-485f-a1dc-94e0b272531a req-0e3db3f5-3f78-4c8f-873e-bd46f325f32b service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:31.270028 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-047a0365-550c-485f-a1dc-94e0b272531a req-0e3db3f5-3f78-4c8f-873e-bd46f325f32b service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:31.281408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-047a0365-550c-485f-a1dc-94e0b272531a req-0e3db3f5-3f78-4c8f-873e-bd46f325f32b service nova] Creating event network-vif-plugged:e3e29ab1-5d40-4baf-aa9a-dab68126df17 for instance 9989ae14-684b-494e-bc1d-df4a26faf42b on hv-cinder-79987 Jul 27 20:43:31.286252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-047a0365-550c-485f-a1dc-94e0b272531a req-0e3db3f5-3f78-4c8f-873e-bd46f325f32b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030939 Jul 27 20:43:31.286846 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1889/3761] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:43:31.904939 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e837f0c7-f2ff-4d2c-8e7b-6962e222a506 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:31.905607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e837f0c7-f2ff-4d2c-8e7b-6962e222a506 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:31.912320 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e837f0c7-f2ff-4d2c-8e7b-6962e222a506 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:31.912776 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e837f0c7-f2ff-4d2c-8e7b-6962e222a506 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:31.913588 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e837f0c7-f2ff-4d2c-8e7b-6962e222a506 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:31.914033 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e837f0c7-f2ff-4d2c-8e7b-6962e222a506 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:32.050437 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e837f0c7-f2ff-4d2c-8e7b-6962e222a506 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:32.058312 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e837f0c7-f2ff-4d2c-8e7b-6962e222a506 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:32.059816 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e837f0c7-f2ff-4d2c-8e7b-6962e222a506 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:32.061608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e837f0c7-f2ff-4d2c-8e7b-6962e222a506 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1406 microversion: 2.20 time: 0.160981 Jul 27 20:43:32.062166 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1873/3762] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:31 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:33.082713 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=2 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:43:33.083489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=6 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:43:33.088041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-829c2f30-27c0-433e-944b-fb920bfb68e3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:33.088443 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-829c2f30-27c0-433e-944b-fb920bfb68e3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:33.096283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-829c2f30-27c0-433e-944b-fb920bfb68e3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:33.096746 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-829c2f30-27c0-433e-944b-fb920bfb68e3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:33.097543 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-829c2f30-27c0-433e-944b-fb920bfb68e3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:33.097986 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-829c2f30-27c0-433e-944b-fb920bfb68e3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:33.230252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-829c2f30-27c0-433e-944b-fb920bfb68e3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:33.240848 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-829c2f30-27c0-433e-944b-fb920bfb68e3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:33.242408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-829c2f30-27c0-433e-944b-fb920bfb68e3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:43:33.243676 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-829c2f30-27c0-433e-944b-fb920bfb68e3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1598 microversion: 2.20 time: 0.162359 Jul 27 20:43:33.244212 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1890/3763] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:43:33 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:43:33.267013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6f419234-7e14-45be-90ea-7b6489395002 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:43:33.267536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6f419234-7e14-45be-90ea-7b6489395002 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:43:33.269456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=6 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:43:33.274985 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f419234-7e14-45be-90ea-7b6489395002 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:33.275430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f419234-7e14-45be-90ea-7b6489395002 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:33.276187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f419234-7e14-45be-90ea-7b6489395002 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:33.276635 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f419234-7e14-45be-90ea-7b6489395002 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:33.352210 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6f419234-7e14-45be-90ea-7b6489395002 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.089871 Jul 27 20:43:33.352819 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1874/3764] 10.222.0.65 () {60 vars in 1316 bytes} [Wed Jul 27 20:43:33 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:43:34.264891 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-d5cb9477-553e-432f-ba21-027bb193061d req-9f81d012-7428-4309-9fe7-ace68d4942ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9989ae14-684b-494e-bc1d-df4a26faf42b", "tag": "e3e29ab1-5d40-4baf-aa9a-dab68126df17"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:43:34.274817 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-d5cb9477-553e-432f-ba21-027bb193061d req-9f81d012-7428-4309-9fe7-ace68d4942ba service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:43:34.275347 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-d5cb9477-553e-432f-ba21-027bb193061d req-9f81d012-7428-4309-9fe7-ace68d4942ba service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:43:34.286829 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-d5cb9477-553e-432f-ba21-027bb193061d req-9f81d012-7428-4309-9fe7-ace68d4942ba service nova] Creating event network-changed:e3e29ab1-5d40-4baf-aa9a-dab68126df17 for instance 9989ae14-684b-494e-bc1d-df4a26faf42b on hv-cinder-79987 Jul 27 20:43:34.292114 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-d5cb9477-553e-432f-ba21-027bb193061d req-9f81d012-7428-4309-9fe7-ace68d4942ba service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031379 Jul 27 20:43:34.292744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1891/3765] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:44:39.003746 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:44:39.004641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=60 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:44:39.008982 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2ab56c2f-382a-4696-ad36-b81680b0993c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:44:39.009470 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2ab56c2f-382a-4696-ad36-b81680b0993c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:44:39.017398 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ab56c2f-382a-4696-ad36-b81680b0993c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:39.017842 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ab56c2f-382a-4696-ad36-b81680b0993c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:39.018594 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ab56c2f-382a-4696-ad36-b81680b0993c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:44:39.019026 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ab56c2f-382a-4696-ad36-b81680b0993c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:44:39.043249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2ab56c2f-382a-4696-ad36-b81680b0993c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b/ips" status: 200 len: 152 microversion: 2.20 time: 0.041314 Jul 27 20:44:39.043803 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1875/3766] 10.222.0.65 () {60 vars in 1289 bytes} [Wed Jul 27 20:44:39 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 27 20:45:07.318314 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:45:07.319066 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:45:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:45:12.507547 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:45:12.508277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=58 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:45:12.512997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f11f93b0-8162-4914-a0b0-8e14f0079ddc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c9d5742-c7c0-411f-b15e-9768974a0205"}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:45:12.516598 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f11f93b0-8162-4914-a0b0-8e14f0079ddc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:12.525321 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f11f93b0-8162-4914-a0b0-8e14f0079ddc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:12.525792 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f11f93b0-8162-4914-a0b0-8e14f0079ddc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:12.526945 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f11f93b0-8162-4914-a0b0-8e14f0079ddc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:12.527471 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f11f93b0-8162-4914-a0b0-8e14f0079ddc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:13.203850 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f11f93b0-8162-4914-a0b0-8e14f0079ddc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "POST /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.698182 Jul 27 20:45:13.204487 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1892/3767] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Jul 27 20:45:12 2022] POST /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/os-volume_attachments => generated 194 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:45:14.176469 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-04303f21-db61-4d02-9a4a-c49ed7d2874c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:45:14.177132 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-04303f21-db61-4d02-9a4a-c49ed7d2874c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:14.178993 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:45:14.179627 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=4 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:45:14.185444 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04303f21-db61-4d02-9a4a-c49ed7d2874c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:14.185882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04303f21-db61-4d02-9a4a-c49ed7d2874c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:14.186637 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04303f21-db61-4d02-9a4a-c49ed7d2874c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:14.187066 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04303f21-db61-4d02-9a4a-c49ed7d2874c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:14.212951 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-04303f21-db61-4d02-9a4a-c49ed7d2874c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lazy-loading 'flavor' on Instance uuid 9989ae14-684b-494e-bc1d-df4a26faf42b {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:45:14.507826 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-04303f21-db61-4d02-9a4a-c49ed7d2874c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "POST /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b/action" status: 202 len: 0 microversion: 2.20 time: 0.335422 Jul 27 20:45:14.508732 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1876/3768] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Jul 27 20:45:14 2022] POST /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:45:14.520252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3feb1a78-ad10-4831-a15b-ec3faaf0e9ff tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:14.521435 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3feb1a78-ad10-4831-a15b-ec3faaf0e9ff tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:14.529547 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3feb1a78-ad10-4831-a15b-ec3faaf0e9ff tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:14.530163 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3feb1a78-ad10-4831-a15b-ec3faaf0e9ff tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:14.531841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3feb1a78-ad10-4831-a15b-ec3faaf0e9ff tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:14.531841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3feb1a78-ad10-4831-a15b-ec3faaf0e9ff tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:14.675499 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3feb1a78-ad10-4831-a15b-ec3faaf0e9ff tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:14.689016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3feb1a78-ad10-4831-a15b-ec3faaf0e9ff tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:14.691304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3feb1a78-ad10-4831-a15b-ec3faaf0e9ff tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:14.692521 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3feb1a78-ad10-4831-a15b-ec3faaf0e9ff tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.177623 Jul 27 20:45:14.693422 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1893/3769] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:14 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:15.310890 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-817bbb86-4d4f-42f3-b480-a429c07c4992 req-f40cc315-26f1-4b39-aaa1-4d03c5b83231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d634922-ac08-46f6-aa94-44abf09f6bc3", "name": "network-vif-deleted", "tag": "63624ac2-681a-4488-9360-3a3a6dc129bc"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:45:15.322200 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-817bbb86-4d4f-42f3-b480-a429c07c4992 req-f40cc315-26f1-4b39-aaa1-4d03c5b83231 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:15.322665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-817bbb86-4d4f-42f3-b480-a429c07c4992 req-f40cc315-26f1-4b39-aaa1-4d03c5b83231 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:15.333716 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-817bbb86-4d4f-42f3-b480-a429c07c4992 req-f40cc315-26f1-4b39-aaa1-4d03c5b83231 service nova] Creating event network-vif-deleted:63624ac2-681a-4488-9360-3a3a6dc129bc for instance 0d634922-ac08-46f6-aa94-44abf09f6bc3 on hv-cinder-79987 Jul 27 20:45:15.338526 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-817bbb86-4d4f-42f3-b480-a429c07c4992 req-f40cc315-26f1-4b39-aaa1-4d03c5b83231 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089399 Jul 27 20:45:15.339098 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1877/3770] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:45:15.717623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3533fd1d-a1bf-42cb-a859-b59e88a2268b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:15.719370 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3533fd1d-a1bf-42cb-a859-b59e88a2268b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:15.725811 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3533fd1d-a1bf-42cb-a859-b59e88a2268b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:15.726276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3533fd1d-a1bf-42cb-a859-b59e88a2268b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:15.727049 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3533fd1d-a1bf-42cb-a859-b59e88a2268b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:15.727501 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3533fd1d-a1bf-42cb-a859-b59e88a2268b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:15.861801 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3533fd1d-a1bf-42cb-a859-b59e88a2268b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:15.869727 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3533fd1d-a1bf-42cb-a859-b59e88a2268b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:15.871249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3533fd1d-a1bf-42cb-a859-b59e88a2268b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:15.872410 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3533fd1d-a1bf-42cb-a859-b59e88a2268b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.158818 Jul 27 20:45:15.872998 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1894/3771] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:15 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:16.896189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9e133a42-5c78-4ccc-9197-25568f5da2b4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:16.896876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9e133a42-5c78-4ccc-9197-25568f5da2b4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:16.903743 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9e133a42-5c78-4ccc-9197-25568f5da2b4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:16.904128 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9e133a42-5c78-4ccc-9197-25568f5da2b4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:16.904939 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9e133a42-5c78-4ccc-9197-25568f5da2b4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:16.905416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9e133a42-5c78-4ccc-9197-25568f5da2b4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:17.100801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9e133a42-5c78-4ccc-9197-25568f5da2b4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:17.109300 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9e133a42-5c78-4ccc-9197-25568f5da2b4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:17.111603 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9e133a42-5c78-4ccc-9197-25568f5da2b4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:17.112840 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9e133a42-5c78-4ccc-9197-25568f5da2b4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.220903 Jul 27 20:45:17.113422 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1878/3772] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:16 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:17.355494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-07f32e8d-2f60-40f0-94dd-a641373205d0 req-6006582b-8645-4b5b-b54c-29394d945361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d725356e-73a3-486b-b590-0324916667ff", "name": "network-vif-deleted", "tag": "899741ce-2752-45e1-aee9-3a2da333cdf0"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:45:17.366634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-07f32e8d-2f60-40f0-94dd-a641373205d0 req-6006582b-8645-4b5b-b54c-29394d945361 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:17.367078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-07f32e8d-2f60-40f0-94dd-a641373205d0 req-6006582b-8645-4b5b-b54c-29394d945361 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:17.378523 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-07f32e8d-2f60-40f0-94dd-a641373205d0 req-6006582b-8645-4b5b-b54c-29394d945361 service nova] Creating event network-vif-deleted:899741ce-2752-45e1-aee9-3a2da333cdf0 for instance d725356e-73a3-486b-b590-0324916667ff on hv-cinder-79987 Jul 27 20:45:17.383537 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-07f32e8d-2f60-40f0-94dd-a641373205d0 req-6006582b-8645-4b5b-b54c-29394d945361 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032584 Jul 27 20:45:17.384211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1895/3773] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:45:18.135641 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4e6f7d7e-1df2-4063-b3db-a3203db0dcb6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:18.136261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4e6f7d7e-1df2-4063-b3db-a3203db0dcb6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:18.143209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e6f7d7e-1df2-4063-b3db-a3203db0dcb6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:18.143660 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e6f7d7e-1df2-4063-b3db-a3203db0dcb6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:18.144424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e6f7d7e-1df2-4063-b3db-a3203db0dcb6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:18.144861 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e6f7d7e-1df2-4063-b3db-a3203db0dcb6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:18.355631 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4e6f7d7e-1df2-4063-b3db-a3203db0dcb6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:18.363432 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4e6f7d7e-1df2-4063-b3db-a3203db0dcb6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:18.364920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4e6f7d7e-1df2-4063-b3db-a3203db0dcb6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:18.366085 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4e6f7d7e-1df2-4063-b3db-a3203db0dcb6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.234336 Jul 27 20:45:18.366633 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1879/3774] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:18 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:19.390179 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1aa3cb1e-1983-47b9-b4c3-d3a63938431d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:19.391271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1aa3cb1e-1983-47b9-b4c3-d3a63938431d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:19.397665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-d828e2b6-d8e2-4854-87f3-1a956279cbf7 req-fa800339-84ee-46cf-bb45-d6d68f826846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1fe489c-2f01-4942-ad86-cf5193eaac25", "name": "network-vif-deleted", "tag": "0b60938e-7325-48a4-ae3d-78799fa3951c"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:45:19.398225 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1aa3cb1e-1983-47b9-b4c3-d3a63938431d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:19.398688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1aa3cb1e-1983-47b9-b4c3-d3a63938431d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:19.399466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1aa3cb1e-1983-47b9-b4c3-d3a63938431d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:19.399913 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1aa3cb1e-1983-47b9-b4c3-d3a63938431d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:19.408412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-d828e2b6-d8e2-4854-87f3-1a956279cbf7 req-fa800339-84ee-46cf-bb45-d6d68f826846 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:19.408849 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-d828e2b6-d8e2-4854-87f3-1a956279cbf7 req-fa800339-84ee-46cf-bb45-d6d68f826846 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:19.419829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-d828e2b6-d8e2-4854-87f3-1a956279cbf7 req-fa800339-84ee-46cf-bb45-d6d68f826846 service nova] Creating event network-vif-deleted:0b60938e-7325-48a4-ae3d-78799fa3951c for instance e1fe489c-2f01-4942-ad86-cf5193eaac25 on hv-cinder-79987 Jul 27 20:45:19.425659 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-d828e2b6-d8e2-4854-87f3-1a956279cbf7 req-fa800339-84ee-46cf-bb45-d6d68f826846 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031468 Jul 27 20:45:19.426254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1880/3775] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:45:19.528519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1aa3cb1e-1983-47b9-b4c3-d3a63938431d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:19.537002 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1aa3cb1e-1983-47b9-b4c3-d3a63938431d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:19.538505 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1aa3cb1e-1983-47b9-b4c3-d3a63938431d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:19.539653 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1aa3cb1e-1983-47b9-b4c3-d3a63938431d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.153835 Jul 27 20:45:19.540214 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1896/3776] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:19 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:20.564380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f671fbed-8276-491b-b01d-d192c60ddc97 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:20.565093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f671fbed-8276-491b-b01d-d192c60ddc97 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:20.571213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f671fbed-8276-491b-b01d-d192c60ddc97 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:20.571656 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f671fbed-8276-491b-b01d-d192c60ddc97 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:20.572406 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f671fbed-8276-491b-b01d-d192c60ddc97 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:20.572834 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f671fbed-8276-491b-b01d-d192c60ddc97 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:20.708623 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f671fbed-8276-491b-b01d-d192c60ddc97 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:20.716407 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f671fbed-8276-491b-b01d-d192c60ddc97 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:20.717921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f671fbed-8276-491b-b01d-d192c60ddc97 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:20.719787 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f671fbed-8276-491b-b01d-d192c60ddc97 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.159346 Jul 27 20:45:20.720333 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1881/3777] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:20 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:21.742495 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bb010e92-24ce-42bc-9990-ee801e579931 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:21.743107 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bb010e92-24ce-42bc-9990-ee801e579931 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:21.749541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb010e92-24ce-42bc-9990-ee801e579931 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:21.749996 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb010e92-24ce-42bc-9990-ee801e579931 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:21.750745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb010e92-24ce-42bc-9990-ee801e579931 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:21.751177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bb010e92-24ce-42bc-9990-ee801e579931 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:21.881139 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bb010e92-24ce-42bc-9990-ee801e579931 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:21.889015 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bb010e92-24ce-42bc-9990-ee801e579931 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:21.891179 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bb010e92-24ce-42bc-9990-ee801e579931 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:21.892610 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bb010e92-24ce-42bc-9990-ee801e579931 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.154006 Jul 27 20:45:21.893245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1897/3778] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:21 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:22.916482 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f1d68b76-1303-4990-aa6b-8669b19342c6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:22.917165 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f1d68b76-1303-4990-aa6b-8669b19342c6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:22.924165 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1d68b76-1303-4990-aa6b-8669b19342c6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:22.924604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1d68b76-1303-4990-aa6b-8669b19342c6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:22.925420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1d68b76-1303-4990-aa6b-8669b19342c6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:22.925847 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1d68b76-1303-4990-aa6b-8669b19342c6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:23.056935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f1d68b76-1303-4990-aa6b-8669b19342c6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:23.064790 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f1d68b76-1303-4990-aa6b-8669b19342c6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:23.066315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f1d68b76-1303-4990-aa6b-8669b19342c6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:23.067473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f1d68b76-1303-4990-aa6b-8669b19342c6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.154942 Jul 27 20:45:23.068059 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1882/3779] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:22 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:23.918153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-65370d91-b221-4d63-97ba-dc1c0169682f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:23.920300 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-65370d91-b221-4d63-97ba-dc1c0169682f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:23.927143 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-65370d91-b221-4d63-97ba-dc1c0169682f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:23.927595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-65370d91-b221-4d63-97ba-dc1c0169682f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:23.928821 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-65370d91-b221-4d63-97ba-dc1c0169682f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:23.928821 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-65370d91-b221-4d63-97ba-dc1c0169682f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:23.958888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-65370d91-b221-4d63-97ba-dc1c0169682f tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044663 Jul 27 20:45:23.959432 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1898/3780] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:45:23 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:45:23.969929 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-49610f8c-4d0a-4a90-8312-7d9e2ae0a651 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:23.970434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-49610f8c-4d0a-4a90-8312-7d9e2ae0a651 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:23.976790 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49610f8c-4d0a-4a90-8312-7d9e2ae0a651 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:23.977363 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49610f8c-4d0a-4a90-8312-7d9e2ae0a651 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:23.978185 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49610f8c-4d0a-4a90-8312-7d9e2ae0a651 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:23.978631 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49610f8c-4d0a-4a90-8312-7d9e2ae0a651 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:24.007606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-49610f8c-4d0a-4a90-8312-7d9e2ae0a651 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/os-volume_attachments/7c9d5742-c7c0-411f-b15e-9768974a0205" status: 200 len: 194 microversion: 2.1 time: 0.041629 Jul 27 20:45:24.008195 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1883/3781] 10.222.0.65 () {58 vars in 1413 bytes} [Wed Jul 27 20:45:23 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/os-volume_attachments/7c9d5742-c7c0-411f-b15e-9768974a0205 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:45:24.091071 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c47617a6-ed7c-464f-8c43-89becf46c460 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:24.091789 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c47617a6-ed7c-464f-8c43-89becf46c460 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:24.098096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c47617a6-ed7c-464f-8c43-89becf46c460 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:24.098554 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c47617a6-ed7c-464f-8c43-89becf46c460 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:24.099328 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c47617a6-ed7c-464f-8c43-89becf46c460 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:24.099771 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c47617a6-ed7c-464f-8c43-89becf46c460 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:24.241219 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c47617a6-ed7c-464f-8c43-89becf46c460 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:24.252051 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c47617a6-ed7c-464f-8c43-89becf46c460 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:24.253834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c47617a6-ed7c-464f-8c43-89becf46c460 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:24.255218 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c47617a6-ed7c-464f-8c43-89becf46c460 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.168063 Jul 27 20:45:24.255782 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1899/3782] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:24 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:25.279421 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a7427e05-8131-4456-9106-1a3fbc5412d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:25.279987 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a7427e05-8131-4456-9106-1a3fbc5412d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:25.286479 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7427e05-8131-4456-9106-1a3fbc5412d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:25.286922 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7427e05-8131-4456-9106-1a3fbc5412d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:25.287668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7427e05-8131-4456-9106-1a3fbc5412d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:25.288099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7427e05-8131-4456-9106-1a3fbc5412d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:25.356992 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7fd7c535-8a32-46ea-8797-0acd50bffbb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b22018c0-0bdb-4d07-a0c2-c4f7a1a6a123"}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:45:25.359326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7fd7c535-8a32-46ea-8797-0acd50bffbb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:25.366484 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7fd7c535-8a32-46ea-8797-0acd50bffbb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:25.366941 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7fd7c535-8a32-46ea-8797-0acd50bffbb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:25.367711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7fd7c535-8a32-46ea-8797-0acd50bffbb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:25.368153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7fd7c535-8a32-46ea-8797-0acd50bffbb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:25.423839 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a7427e05-8131-4456-9106-1a3fbc5412d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:25.431742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a7427e05-8131-4456-9106-1a3fbc5412d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:25.433308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a7427e05-8131-4456-9106-1a3fbc5412d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:25.434481 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a7427e05-8131-4456-9106-1a3fbc5412d8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.158986 Jul 27 20:45:25.435162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1884/3783] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:25 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:25.624140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7fd7c535-8a32-46ea-8797-0acd50bffbb0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "POST /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271027 Jul 27 20:45:25.630781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1900/3784] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Jul 27 20:45:25 2022] POST /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:45:26.459164 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d5138248-a9ee-4eea-ad33-4b10362b3a6b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:26.459770 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d5138248-a9ee-4eea-ad33-4b10362b3a6b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:26.466294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5138248-a9ee-4eea-ad33-4b10362b3a6b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:26.466737 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5138248-a9ee-4eea-ad33-4b10362b3a6b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:26.467494 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5138248-a9ee-4eea-ad33-4b10362b3a6b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:26.467924 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5138248-a9ee-4eea-ad33-4b10362b3a6b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:26.597734 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d5138248-a9ee-4eea-ad33-4b10362b3a6b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:26.607179 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d5138248-a9ee-4eea-ad33-4b10362b3a6b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:26.608690 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d5138248-a9ee-4eea-ad33-4b10362b3a6b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:26.610116 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d5138248-a9ee-4eea-ad33-4b10362b3a6b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.154881 Jul 27 20:45:26.610664 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1885/3785] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:26 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:27.634302 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-93e1bc9f-2095-4166-8c06-047fa5a18021 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:27.634994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-93e1bc9f-2095-4166-8c06-047fa5a18021 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:27.641504 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-93e1bc9f-2095-4166-8c06-047fa5a18021 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:27.641951 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-93e1bc9f-2095-4166-8c06-047fa5a18021 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:27.642701 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-93e1bc9f-2095-4166-8c06-047fa5a18021 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:27.643134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-93e1bc9f-2095-4166-8c06-047fa5a18021 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:27.777472 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-93e1bc9f-2095-4166-8c06-047fa5a18021 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:27.786494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-93e1bc9f-2095-4166-8c06-047fa5a18021 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:27.788181 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-93e1bc9f-2095-4166-8c06-047fa5a18021 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:27.789280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-93e1bc9f-2095-4166-8c06-047fa5a18021 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.159589 Jul 27 20:45:27.790005 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1901/3786] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:27 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:28.814324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ef17f7bd-248f-40e0-9667-891a68fb8e9d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:28.814934 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ef17f7bd-248f-40e0-9667-891a68fb8e9d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:28.821477 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef17f7bd-248f-40e0-9667-891a68fb8e9d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:28.821928 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef17f7bd-248f-40e0-9667-891a68fb8e9d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:28.822693 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef17f7bd-248f-40e0-9667-891a68fb8e9d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:28.823615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef17f7bd-248f-40e0-9667-891a68fb8e9d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:28.958614 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ef17f7bd-248f-40e0-9667-891a68fb8e9d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:28.966477 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ef17f7bd-248f-40e0-9667-891a68fb8e9d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:28.967985 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ef17f7bd-248f-40e0-9667-891a68fb8e9d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:28.969333 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ef17f7bd-248f-40e0-9667-891a68fb8e9d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.159300 Jul 27 20:45:28.969887 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1886/3787] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:28 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:29.992913 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-83de371b-6095-461c-ac0c-0be497e3261b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:29.993713 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-83de371b-6095-461c-ac0c-0be497e3261b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:30.000981 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-83de371b-6095-461c-ac0c-0be497e3261b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:30.001451 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-83de371b-6095-461c-ac0c-0be497e3261b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:30.002226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-83de371b-6095-461c-ac0c-0be497e3261b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:30.002670 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-83de371b-6095-461c-ac0c-0be497e3261b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:30.131497 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-83de371b-6095-461c-ac0c-0be497e3261b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:30.139392 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-83de371b-6095-461c-ac0c-0be497e3261b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:30.141565 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-83de371b-6095-461c-ac0c-0be497e3261b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:30.142726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-83de371b-6095-461c-ac0c-0be497e3261b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.153735 Jul 27 20:45:30.143319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1902/3788] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:29 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:31.165852 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f8823b59-f802-4354-8c32-91865f453122 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:31.166454 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f8823b59-f802-4354-8c32-91865f453122 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:31.172950 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8823b59-f802-4354-8c32-91865f453122 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:31.173412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8823b59-f802-4354-8c32-91865f453122 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:31.174162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8823b59-f802-4354-8c32-91865f453122 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:31.174590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8823b59-f802-4354-8c32-91865f453122 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:31.302337 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f8823b59-f802-4354-8c32-91865f453122 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:31.310141 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f8823b59-f802-4354-8c32-91865f453122 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:31.311639 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f8823b59-f802-4354-8c32-91865f453122 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:31.313723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f8823b59-f802-4354-8c32-91865f453122 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.151587 Jul 27 20:45:31.314281 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1887/3789] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:31 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:32.338491 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7d5947a9-b82f-4849-997d-47970a192302 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:32.339037 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7d5947a9-b82f-4849-997d-47970a192302 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:32.346326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d5947a9-b82f-4849-997d-47970a192302 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:32.346763 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d5947a9-b82f-4849-997d-47970a192302 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:32.347520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d5947a9-b82f-4849-997d-47970a192302 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:32.347958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7d5947a9-b82f-4849-997d-47970a192302 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:32.475053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7d5947a9-b82f-4849-997d-47970a192302 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:32.482939 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7d5947a9-b82f-4849-997d-47970a192302 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:32.484711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7d5947a9-b82f-4849-997d-47970a192302 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:32.485911 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7d5947a9-b82f-4849-997d-47970a192302 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.151390 Jul 27 20:45:32.486478 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1903/3790] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:32 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:33.152445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c3c1dae5-ac70-498b-bfaa-9b17ebf9364a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:33.154679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c3c1dae5-ac70-498b-bfaa-9b17ebf9364a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:33.161279 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3c1dae5-ac70-498b-bfaa-9b17ebf9364a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:33.161731 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3c1dae5-ac70-498b-bfaa-9b17ebf9364a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:33.162492 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3c1dae5-ac70-498b-bfaa-9b17ebf9364a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:33.162929 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3c1dae5-ac70-498b-bfaa-9b17ebf9364a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:33.192189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c3c1dae5-ac70-498b-bfaa-9b17ebf9364a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043657 Jul 27 20:45:33.192731 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1888/3791] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:45:33 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:45:33.335542 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4844d209-e427-494d-bf83-7010b99b160d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:33.335945 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4844d209-e427-494d-bf83-7010b99b160d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:33.342029 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4844d209-e427-494d-bf83-7010b99b160d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:33.342605 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4844d209-e427-494d-bf83-7010b99b160d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:33.343240 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4844d209-e427-494d-bf83-7010b99b160d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:33.343689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4844d209-e427-494d-bf83-7010b99b160d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:33.373126 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4844d209-e427-494d-bf83-7010b99b160d tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/os-volume_attachments/7c9d5742-c7c0-411f-b15e-9768974a0205" status: 200 len: 194 microversion: 2.1 time: 0.041593 Jul 27 20:45:33.373720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1904/3792] 10.222.0.65 () {58 vars in 1413 bytes} [Wed Jul 27 20:45:33 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/os-volume_attachments/7c9d5742-c7c0-411f-b15e-9768974a0205 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:45:33.384386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7217be98-7f8c-4daa-9a66-070ecbf06ac9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:33.384855 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7217be98-7f8c-4daa-9a66-070ecbf06ac9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:33.390765 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7217be98-7f8c-4daa-9a66-070ecbf06ac9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:33.391207 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7217be98-7f8c-4daa-9a66-070ecbf06ac9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:33.391952 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7217be98-7f8c-4daa-9a66-070ecbf06ac9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:33.392382 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7217be98-7f8c-4daa-9a66-070ecbf06ac9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:33.471212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-7217be98-7f8c-4daa-9a66-070ecbf06ac9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lazy-loading 'services' on Instance uuid 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:45:33.517177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4d768898-87c6-4ac6-90b3-efe871db543d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:33.517177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4d768898-87c6-4ac6-90b3-efe871db543d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:33.517177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4d768898-87c6-4ac6-90b3-efe871db543d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:33.517177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4d768898-87c6-4ac6-90b3-efe871db543d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:33.517863 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4d768898-87c6-4ac6-90b3-efe871db543d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:33.517863 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4d768898-87c6-4ac6-90b3-efe871db543d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:33.550479 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7217be98-7f8c-4daa-9a66-070ecbf06ac9 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/os-volume_attachments/7c9d5742-c7c0-411f-b15e-9768974a0205" status: 202 len: 0 microversion: 2.1 time: 0.169736 Jul 27 20:45:33.551515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1889/3793] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Jul 27 20:45:33 2022] DELETE /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/os-volume_attachments/7c9d5742-c7c0-411f-b15e-9768974a0205 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 20:45:33.659335 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4d768898-87c6-4ac6-90b3-efe871db543d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:33.667457 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4d768898-87c6-4ac6-90b3-efe871db543d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:33.669003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4d768898-87c6-4ac6-90b3-efe871db543d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:33.670183 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4d768898-87c6-4ac6-90b3-efe871db543d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.164881 Jul 27 20:45:33.670731 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1905/3794] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:33 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:45:34.695226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2867dada-7714-4516-bafe-488f8c7034b6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:34.696096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2867dada-7714-4516-bafe-488f8c7034b6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:34.704173 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2867dada-7714-4516-bafe-488f8c7034b6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:34.704635 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2867dada-7714-4516-bafe-488f8c7034b6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:34.705439 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2867dada-7714-4516-bafe-488f8c7034b6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:34.705881 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2867dada-7714-4516-bafe-488f8c7034b6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:34.840305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2867dada-7714-4516-bafe-488f8c7034b6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:34.848510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2867dada-7714-4516-bafe-488f8c7034b6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:34.850079 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2867dada-7714-4516-bafe-488f8c7034b6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:34.851239 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2867dada-7714-4516-bafe-488f8c7034b6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.160594 Jul 27 20:45:34.851812 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1890/3795] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:34 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:35.734288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a7be57ca-9ac8-4c25-8824-25f938f96d80 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:35.734795 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a7be57ca-9ac8-4c25-8824-25f938f96d80 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:35.741359 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a7be57ca-9ac8-4c25-8824-25f938f96d80 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:35.741806 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a7be57ca-9ac8-4c25-8824-25f938f96d80 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:35.742557 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a7be57ca-9ac8-4c25-8824-25f938f96d80 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:35.742995 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a7be57ca-9ac8-4c25-8824-25f938f96d80 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:35.759960 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:45:35.774326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a7be57ca-9ac8-4c25-8824-25f938f96d80 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/os-volume_attachments/b22018c0-0bdb-4d07-a0c2-c4f7a1a6a123" status: 200 len: 194 microversion: 2.1 time: 0.043990 Jul 27 20:45:35.774898 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1906/3796] 10.222.0.65 () {58 vars in 1413 bytes} [Wed Jul 27 20:45:35 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/os-volume_attachments/b22018c0-0bdb-4d07-a0c2-c4f7a1a6a123 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:45:35.785311 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-055b0106-dc7e-4038-b8be-d5b3b13f8362 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:35.785807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-055b0106-dc7e-4038-b8be-d5b3b13f8362 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:35.792243 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-055b0106-dc7e-4038-b8be-d5b3b13f8362 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:35.792691 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-055b0106-dc7e-4038-b8be-d5b3b13f8362 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:35.793491 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-055b0106-dc7e-4038-b8be-d5b3b13f8362 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:35.793926 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-055b0106-dc7e-4038-b8be-d5b3b13f8362 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:35.798008 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:45:35.873310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-055b0106-dc7e-4038-b8be-d5b3b13f8362 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lazy-loading 'services' on Instance uuid 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:45:35.879737 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9b0c285b-7b1e-4fcf-917b-cfa1d8a08ba0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:35.880351 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9b0c285b-7b1e-4fcf-917b-cfa1d8a08ba0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:35.886232 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9b0c285b-7b1e-4fcf-917b-cfa1d8a08ba0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:35.886687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9b0c285b-7b1e-4fcf-917b-cfa1d8a08ba0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:35.887456 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9b0c285b-7b1e-4fcf-917b-cfa1d8a08ba0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:35.887905 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9b0c285b-7b1e-4fcf-917b-cfa1d8a08ba0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:35.949058 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-055b0106-dc7e-4038-b8be-d5b3b13f8362 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/os-volume_attachments/b22018c0-0bdb-4d07-a0c2-c4f7a1a6a123" status: 202 len: 0 microversion: 2.1 time: 0.167597 Jul 27 20:45:35.949900 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1891/3797] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Jul 27 20:45:35 2022] DELETE /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/os-volume_attachments/b22018c0-0bdb-4d07-a0c2-c4f7a1a6a123 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:45:36.035778 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9b0c285b-7b1e-4fcf-917b-cfa1d8a08ba0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:36.043856 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9b0c285b-7b1e-4fcf-917b-cfa1d8a08ba0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:36.045404 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9b0c285b-7b1e-4fcf-917b-cfa1d8a08ba0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:36.046609 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9b0c285b-7b1e-4fcf-917b-cfa1d8a08ba0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.171115 Jul 27 20:45:36.047180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1907/3798] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:35 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:45:37.071572 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8308d2a0-a42d-4e02-824e-a797f87cc09a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:37.072857 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8308d2a0-a42d-4e02-824e-a797f87cc09a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:37.079874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8308d2a0-a42d-4e02-824e-a797f87cc09a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:37.080394 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8308d2a0-a42d-4e02-824e-a797f87cc09a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:37.081203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8308d2a0-a42d-4e02-824e-a797f87cc09a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:37.081634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8308d2a0-a42d-4e02-824e-a797f87cc09a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:37.124504 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8088f6c6-8334-408b-960e-29092be60d8a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:37.127494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8088f6c6-8334-408b-960e-29092be60d8a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:37.134088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8088f6c6-8334-408b-960e-29092be60d8a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:37.134608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8088f6c6-8334-408b-960e-29092be60d8a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:37.135440 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8088f6c6-8334-408b-960e-29092be60d8a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:37.135941 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8088f6c6-8334-408b-960e-29092be60d8a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:37.165544 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8088f6c6-8334-408b-960e-29092be60d8a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044812 Jul 27 20:45:37.166043 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1908/3799] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:45:37 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 27 20:45:37.217248 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8308d2a0-a42d-4e02-824e-a797f87cc09a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:37.225860 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8308d2a0-a42d-4e02-824e-a797f87cc09a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:37.227592 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8308d2a0-a42d-4e02-824e-a797f87cc09a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:37.228942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8308d2a0-a42d-4e02-824e-a797f87cc09a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.162153 Jul 27 20:45:37.229527 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1892/3800] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:37 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:37.278869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cfa663cb-c3bc-4c08-9cc7-b092fb5f57bc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:37.281597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cfa663cb-c3bc-4c08-9cc7-b092fb5f57bc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:37.287659 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cfa663cb-c3bc-4c08-9cc7-b092fb5f57bc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:37.288117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cfa663cb-c3bc-4c08-9cc7-b092fb5f57bc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:37.288884 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cfa663cb-c3bc-4c08-9cc7-b092fb5f57bc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:37.289351 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cfa663cb-c3bc-4c08-9cc7-b092fb5f57bc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:37.318186 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cfa663cb-c3bc-4c08-9cc7-b092fb5f57bc tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043405 Jul 27 20:45:37.318740 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1909/3801] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:45:37 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 20:45:37.379496 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c8cd0d46-8ec1-4b76-a689-c879052c342a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:37.379994 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c8cd0d46-8ec1-4b76-a689-c879052c342a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:37.385941 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c8cd0d46-8ec1-4b76-a689-c879052c342a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:37.386384 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c8cd0d46-8ec1-4b76-a689-c879052c342a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:37.387134 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c8cd0d46-8ec1-4b76-a689-c879052c342a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:37.387569 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c8cd0d46-8ec1-4b76-a689-c879052c342a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:37.411927 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c8cd0d46-8ec1-4b76-a689-c879052c342a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:45:37.487809 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c8cd0d46-8ec1-4b76-a689-c879052c342a tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734" status: 204 len: 0 microversion: 2.1 time: 0.111732 Jul 27 20:45:37.488424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1893/3802] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 20:45:37 2022] DELETE /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:45:37.496917 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b18ba568-82d8-4115-a81c-ea61324e7778 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:37.497576 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b18ba568-82d8-4115-a81c-ea61324e7778 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:37.503539 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b18ba568-82d8-4115-a81c-ea61324e7778 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:37.504000 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b18ba568-82d8-4115-a81c-ea61324e7778 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:37.504766 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b18ba568-82d8-4115-a81c-ea61324e7778 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:37.505256 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b18ba568-82d8-4115-a81c-ea61324e7778 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:37.637889 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b18ba568-82d8-4115-a81c-ea61324e7778 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:37.645922 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b18ba568-82d8-4115-a81c-ea61324e7778 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734" status: 200 len: 1672 microversion: 2.1 time: 0.153050 Jul 27 20:45:37.646478 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1910/3803] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:45:37 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:45:38.253963 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-837eb463-e6c4-4037-95ba-9053ce434453 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:38.254619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-837eb463-e6c4-4037-95ba-9053ce434453 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:38.261237 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-837eb463-e6c4-4037-95ba-9053ce434453 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:38.261681 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-837eb463-e6c4-4037-95ba-9053ce434453 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:38.262431 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-837eb463-e6c4-4037-95ba-9053ce434453 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:38.262860 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-837eb463-e6c4-4037-95ba-9053ce434453 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:38.390237 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-837eb463-e6c4-4037-95ba-9053ce434453 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:38.398064 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-837eb463-e6c4-4037-95ba-9053ce434453 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:38.399543 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-837eb463-e6c4-4037-95ba-9053ce434453 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:38.400680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-837eb463-e6c4-4037-95ba-9053ce434453 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.151559 Jul 27 20:45:38.401262 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1894/3804] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:38 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:38.667628 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-81f71fd0-e2bc-4df2-bbbf-1472ebc034ac tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:38.668254 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-81f71fd0-e2bc-4df2-bbbf-1472ebc034ac tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:38.675344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-81f71fd0-e2bc-4df2-bbbf-1472ebc034ac tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:38.675800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-81f71fd0-e2bc-4df2-bbbf-1472ebc034ac tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:38.676572 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-81f71fd0-e2bc-4df2-bbbf-1472ebc034ac tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:38.677047 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-81f71fd0-e2bc-4df2-bbbf-1472ebc034ac tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:38.810102 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-81f71fd0-e2bc-4df2-bbbf-1472ebc034ac tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:38.817735 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-81f71fd0-e2bc-4df2-bbbf-1472ebc034ac tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734" status: 200 len: 1672 microversion: 2.1 time: 0.153999 Jul 27 20:45:38.818328 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1911/3805] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:45:38 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:45:39.424713 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-14101207-7cca-445f-b4d4-5741f64789f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:39.425335 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-14101207-7cca-445f-b4d4-5741f64789f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:39.432591 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14101207-7cca-445f-b4d4-5741f64789f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:39.433036 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14101207-7cca-445f-b4d4-5741f64789f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:39.433783 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14101207-7cca-445f-b4d4-5741f64789f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:39.434223 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14101207-7cca-445f-b4d4-5741f64789f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:39.651805 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-14101207-7cca-445f-b4d4-5741f64789f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:39.663144 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-14101207-7cca-445f-b4d4-5741f64789f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:39.664708 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-14101207-7cca-445f-b4d4-5741f64789f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:39.665920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-14101207-7cca-445f-b4d4-5741f64789f8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.245827 Jul 27 20:45:39.666483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1895/3806] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:39 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:39.708519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-9f19ddc3-392f-4ee6-b82e-5277b0919d4a req-97439122-be70-4332-9376-fe80759f9b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b9db8a2-db32-4e01-9dbe-6e767e8b9734", "name": "network-vif-deleted", "tag": "939f80b9-ff52-4cba-9679-35b5650c5b6d"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:45:39.722587 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-9f19ddc3-392f-4ee6-b82e-5277b0919d4a req-97439122-be70-4332-9376-fe80759f9b8b service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:39.723462 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-9f19ddc3-392f-4ee6-b82e-5277b0919d4a req-97439122-be70-4332-9376-fe80759f9b8b service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:39.742592 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-9f19ddc3-392f-4ee6-b82e-5277b0919d4a req-97439122-be70-4332-9376-fe80759f9b8b service nova] Creating event network-vif-deleted:939f80b9-ff52-4cba-9679-35b5650c5b6d for instance 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 on hv-cinder-79987 Jul 27 20:45:39.753220 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-9f19ddc3-392f-4ee6-b82e-5277b0919d4a req-97439122-be70-4332-9376-fe80759f9b8b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048675 Jul 27 20:45:39.753950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1912/3807] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:45:39.838346 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e69f605e-25e2-4ec2-ad3e-7a955fd3526c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:39.839210 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e69f605e-25e2-4ec2-ad3e-7a955fd3526c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:39.850268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e69f605e-25e2-4ec2-ad3e-7a955fd3526c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:39.850733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e69f605e-25e2-4ec2-ad3e-7a955fd3526c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:39.851499 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e69f605e-25e2-4ec2-ad3e-7a955fd3526c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:39.852125 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e69f605e-25e2-4ec2-ad3e-7a955fd3526c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:39.919003 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e69f605e-25e2-4ec2-ad3e-7a955fd3526c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:39.919455 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e69f605e-25e2-4ec2-ad3e-7a955fd3526c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:39.919913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-e69f605e-25e2-4ec2-ad3e-7a955fd3526c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lazy-loading 'fault' on Instance uuid 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:45:39.971639 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e69f605e-25e2-4ec2-ad3e-7a955fd3526c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea3c5c3007e04391b5b108473da62787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9a9e3a2b0e4918950cfd454aab9fbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:39.982268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e69f605e-25e2-4ec2-ad3e-7a955fd3526c tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734" status: 200 len: 1326 microversion: 2.1 time: 0.147696 Jul 27 20:45:39.983050 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1896/3808] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:45:39 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734 => generated 1326 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:45:40.690599 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1f4425aa-ca08-41ee-a642-b75f34b2d4e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:40.691309 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1f4425aa-ca08-41ee-a642-b75f34b2d4e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:40.697779 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f4425aa-ca08-41ee-a642-b75f34b2d4e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:40.698304 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f4425aa-ca08-41ee-a642-b75f34b2d4e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:40.699091 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f4425aa-ca08-41ee-a642-b75f34b2d4e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:40.699399 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f4425aa-ca08-41ee-a642-b75f34b2d4e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:40.831796 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1f4425aa-ca08-41ee-a642-b75f34b2d4e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:40.839848 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1f4425aa-ca08-41ee-a642-b75f34b2d4e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:40.841418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1f4425aa-ca08-41ee-a642-b75f34b2d4e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:40.842569 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1f4425aa-ca08-41ee-a642-b75f34b2d4e0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.156626 Jul 27 20:45:40.843483 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1913/3809] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:40 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:41.004567 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-de3433c2-6164-4d21-8392-5fe0889499c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:41.005215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-de3433c2-6164-4d21-8392-5fe0889499c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:41.011676 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-de3433c2-6164-4d21-8392-5fe0889499c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:41.012129 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-de3433c2-6164-4d21-8392-5fe0889499c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:41.012892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-de3433c2-6164-4d21-8392-5fe0889499c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:41.013374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-de3433c2-6164-4d21-8392-5fe0889499c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:41.026392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-de3433c2-6164-4d21-8392-5fe0889499c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] HTTP exception thrown: Instance 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 could not be found. Jul 27 20:45:41.028070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-de3433c2-6164-4d21-8392-5fe0889499c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Request method failure captured: Jul 27 20:45:41.028070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734 HTTP/1.1 Jul 27 20:45:41.028070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:45:41.028070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:45:41.028070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:45:41.028070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:45:41.028070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:45:41.028070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:45:41.028070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:45:41.028070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:45:41.028070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4Zs1W3D7PKSXHs4Bd30ybMq7u2IIlU6z01glDGWAFyPpzQavcBMmBz1jEBj5-GF4Yu7e2-oRG6B9aYqFce6_1g6pwSd_vq347dogDci-7oYKzEY1sjPaHWeDKKMI-zQdof42fg9vggfnxmIKS-IW9ukKNX36NqtpboHNCn1-no_YpBM Jul 27 20:45:41.028070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:45:41.028070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:45:41.028070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:45:41.028070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:45:41.028070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:45:41.028070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:45:41.028070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: 8d9a9e3a2b0e4918950cfd454aab9fbb Jul 27 20:45:41.028070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeTestJSON-239156931 Jul 27 20:45:41.028070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:45:41.028070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:45:41.029916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d9a9e3a2b0e4918950cfd454aab9fbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8d9a9e3a2b0e4918950cfd454aab9fbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8d9a9e3a2b0e4918950cfd454aab9fbb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d9a9e3a2b0e4918950cfd454aab9fbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:45:41.029916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeTestJSON-239156931 Jul 27 20:45:41.029916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 8d9a9e3a2b0e4918950cfd454aab9fbb Jul 27 20:45:41.029916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeTestJSON-239156931 Jul 27 20:45:41.029916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeTestJSON-239156931-project Jul 27 20:45:41.029916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:45:41.029916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:45:41.029916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: ea3c5c3007e04391b5b108473da62787 Jul 27 20:45:41.029916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeTestJSON-239156931-project Jul 27 20:45:41.029916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:45:41.029916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Instance 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 could not be found. Jul 27 20:45:41.029916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'id': '7b9db8a2-db32-4e01-9dbe-6e767e8b9734'} Jul 27 20:45:41.031615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:45:41.031615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:45:41.031615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:45:41.031615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:45:41.031615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:45:41.031615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:45:41.031615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:45:41.031615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:45:41.031615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:45:41.031615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:45:41.031615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 could not be found. Jul 27 20:45:41.031615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:45:41.031615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:45:41.031615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:45:41.031615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:45:41.031615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:45:41.031615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:45:41.031615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:45:41.031615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:45:41.031615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:45:41.033416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:45:41.033416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:45:41.033416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:45:41.033416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:45:41.033416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:45:41.033416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:45:41.033416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:45:41.033416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 could not be found. Jul 27 20:45:41.033416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:45:41.033416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:45:41.033416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:45:41.033416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:45:41.033416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:45:41.033416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:45:41.033416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:45:41.033416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:45:41.033416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 could not be found. Jul 27 20:45:41.033416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:45:41.034993 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-de3433c2-6164-4d21-8392-5fe0889499c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Returning 404 to user: Instance 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:45:41.034993 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-de3433c2-6164-4d21-8392-5fe0889499c7 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734" status: 404 len: 111 microversion: 2.1 time: 0.028721 Jul 27 20:45:41.034993 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1897/3810] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:45:40 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:45:41.038898 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e670e2f0-c54b-4599-b324-c751a62c6bf0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '.version_select at 0x7fc7f01099d0>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:41.057430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e670e2f0-c54b-4599-b324-c751a62c6bf0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1427936615" status: 202 len: 0 microversion: 2.1 time: 0.022404 Jul 27 20:45:41.057982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1914/3811] 10.222.0.65 () {58 vars in 1221 bytes} [Wed Jul 27 20:45:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1427936615 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 20:45:41.866040 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0f8bf9b9-f6c8-4ddd-a64f-ebf31441c884 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:41.866674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0f8bf9b9-f6c8-4ddd-a64f-ebf31441c884 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:41.872481 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f8bf9b9-f6c8-4ddd-a64f-ebf31441c884 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:41.872934 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f8bf9b9-f6c8-4ddd-a64f-ebf31441c884 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:41.873738 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f8bf9b9-f6c8-4ddd-a64f-ebf31441c884 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:41.874171 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f8bf9b9-f6c8-4ddd-a64f-ebf31441c884 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:42.020599 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0f8bf9b9-f6c8-4ddd-a64f-ebf31441c884 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:42.029338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0f8bf9b9-f6c8-4ddd-a64f-ebf31441c884 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:42.030913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0f8bf9b9-f6c8-4ddd-a64f-ebf31441c884 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:42.032251 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0f8bf9b9-f6c8-4ddd-a64f-ebf31441c884 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.170220 Jul 27 20:45:42.032808 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1898/3812] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:41 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:43.056171 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cdc71610-7cdd-4e2c-be59-546b88401702 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:43.057526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cdc71610-7cdd-4e2c-be59-546b88401702 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:43.059458 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:45:43.066227 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cdc71610-7cdd-4e2c-be59-546b88401702 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:43.066671 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cdc71610-7cdd-4e2c-be59-546b88401702 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:43.067445 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cdc71610-7cdd-4e2c-be59-546b88401702 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:43.067882 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cdc71610-7cdd-4e2c-be59-546b88401702 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:43.223577 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cdc71610-7cdd-4e2c-be59-546b88401702 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:43.231748 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cdc71610-7cdd-4e2c-be59-546b88401702 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:43.233275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cdc71610-7cdd-4e2c-be59-546b88401702 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:43.235124 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cdc71610-7cdd-4e2c-be59-546b88401702 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.182854 Jul 27 20:45:43.235930 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1915/3813] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:43 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:44.206981 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5d2919a4-7a29-458e-be67-29f2e827b544 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:44.207466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5d2919a4-7a29-458e-be67-29f2e827b544 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:44.209882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:45:44.215846 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d2919a4-7a29-458e-be67-29f2e827b544 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:44.216292 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d2919a4-7a29-458e-be67-29f2e827b544 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:44.217075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d2919a4-7a29-458e-be67-29f2e827b544 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:44.217512 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d2919a4-7a29-458e-be67-29f2e827b544 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:44.233430 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-5d2919a4-7a29-458e-be67-29f2e827b544 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] HTTP exception thrown: Instance 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 could not be found. Jul 27 20:45:44.234944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5d2919a4-7a29-458e-be67-29f2e827b544 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Request method failure captured: Jul 27 20:45:44.234944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734 HTTP/1.1 Jul 27 20:45:44.234944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:45:44.234944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:45:44.234944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:45:44.234944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:45:44.234944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:45:44.234944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:45:44.234944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:45:44.234944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:45:44.234944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4Zs1W3D7PKSXHs4Bd30ybMq7u2IIlU6z01glDGWAFyPpzQavcBMmBz1jEBj5-GF4Yu7e2-oRG6B9aYqFce6_1g6pwSd_vq347dogDci-7oYKzEY1sjPaHWeDKKMI-zQdof42fg9vggfnxmIKS-IW9ukKNX36NqtpboHNCn1-no_YpBM Jul 27 20:45:44.234944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:45:44.234944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:45:44.234944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:45:44.234944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:45:44.234944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:45:44.234944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:45:44.234944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: 8d9a9e3a2b0e4918950cfd454aab9fbb Jul 27 20:45:44.234944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeTestJSON-239156931 Jul 27 20:45:44.234944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:45:44.234944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:45:44.236434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d9a9e3a2b0e4918950cfd454aab9fbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8d9a9e3a2b0e4918950cfd454aab9fbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8d9a9e3a2b0e4918950cfd454aab9fbb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d9a9e3a2b0e4918950cfd454aab9fbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:45:44.236434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeTestJSON-239156931 Jul 27 20:45:44.236434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 8d9a9e3a2b0e4918950cfd454aab9fbb Jul 27 20:45:44.236434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeTestJSON-239156931 Jul 27 20:45:44.236434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeTestJSON-239156931-project Jul 27 20:45:44.236434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:45:44.236434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:45:44.236434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: ea3c5c3007e04391b5b108473da62787 Jul 27 20:45:44.236434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeTestJSON-239156931-project Jul 27 20:45:44.236434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:45:44.236434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Instance 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 could not be found. Jul 27 20:45:44.236434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'id': '7b9db8a2-db32-4e01-9dbe-6e767e8b9734'} Jul 27 20:45:44.237658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:45:44.237658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:45:44.237658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:45:44.237658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:45:44.237658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:45:44.237658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:45:44.237658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:45:44.237658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:45:44.237658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:45:44.237658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:45:44.237658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 could not be found. Jul 27 20:45:44.237658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:45:44.237658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:45:44.237658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:45:44.237658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:45:44.237658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:45:44.237658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:45:44.237658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:45:44.237658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:45:44.237658 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:45:44.239433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:45:44.239433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 20:45:44.239433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 20:45:44.239433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 20:45:44.239433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 20:45:44.239433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:45:44.239433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:45:44.239433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:45:44.239433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:45:44.239433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 could not be found. Jul 27 20:45:44.239433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:45:44.239433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:45:44.239433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:45:44.239433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:45:44.239433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:45:44.239433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:45:44.239433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:45:44.239433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:45:44.239433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 could not be found. Jul 27 20:45:44.239433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:45:44.241365 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5d2919a4-7a29-458e-be67-29f2e827b544 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Returning 404 to user: Instance 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:45:44.241365 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5d2919a4-7a29-458e-be67-29f2e827b544 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734" status: 404 len: 111 microversion: 2.1 time: 0.034235 Jul 27 20:45:44.241365 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1899/3814] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 20:45:44 2022] DELETE /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:45:44.244741 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e8dd2d28-4b8d-4c7d-94e6-8dbe5f9ab9e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:44.245390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e8dd2d28-4b8d-4c7d-94e6-8dbe5f9ab9e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 7b9db8a2-db32-4e01-9dbe-6e767e8b9734] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:44.252477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8dd2d28-4b8d-4c7d-94e6-8dbe5f9ab9e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:44.252931 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8dd2d28-4b8d-4c7d-94e6-8dbe5f9ab9e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:44.253720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8dd2d28-4b8d-4c7d-94e6-8dbe5f9ab9e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:44.254164 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8dd2d28-4b8d-4c7d-94e6-8dbe5f9ab9e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:44.258141 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f838832f-b56a-4e39-9119-a3db3d5dacc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:44.258779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f838832f-b56a-4e39-9119-a3db3d5dacc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:44.264592 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f838832f-b56a-4e39-9119-a3db3d5dacc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:44.265067 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f838832f-b56a-4e39-9119-a3db3d5dacc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:44.265819 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f838832f-b56a-4e39-9119-a3db3d5dacc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:44.267017 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f838832f-b56a-4e39-9119-a3db3d5dacc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:44.268467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-e8dd2d28-4b8d-4c7d-94e6-8dbe5f9ab9e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] HTTP exception thrown: Instance 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 could not be found. Jul 27 20:45:44.270153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e8dd2d28-4b8d-4c7d-94e6-8dbe5f9ab9e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Request method failure captured: Jul 27 20:45:44.270153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734 HTTP/1.1 Jul 27 20:45:44.270153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:45:44.270153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:45:44.270153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:45:44.270153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:45:44.270153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:45:44.270153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:45:44.270153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:45:44.270153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:45:44.270153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4Zs1W3D7PKSXHs4Bd30ybMq7u2IIlU6z01glDGWAFyPpzQavcBMmBz1jEBj5-GF4Yu7e2-oRG6B9aYqFce6_1g6pwSd_vq347dogDci-7oYKzEY1sjPaHWeDKKMI-zQdof42fg9vggfnxmIKS-IW9ukKNX36NqtpboHNCn1-no_YpBM Jul 27 20:45:44.270153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:45:44.270153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:45:44.270153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:45:44.270153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:45:44.270153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:45:44.270153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:45:44.270153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 8d9a9e3a2b0e4918950cfd454aab9fbb Jul 27 20:45:44.270153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-AttachVolumeTestJSON-239156931 Jul 27 20:45:44.270153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:45:44.270153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:45:44.271765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d9a9e3a2b0e4918950cfd454aab9fbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8d9a9e3a2b0e4918950cfd454aab9fbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8d9a9e3a2b0e4918950cfd454aab9fbb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d9a9e3a2b0e4918950cfd454aab9fbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:45:44.271765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-AttachVolumeTestJSON-239156931 Jul 27 20:45:44.271765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 8d9a9e3a2b0e4918950cfd454aab9fbb Jul 27 20:45:44.271765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-AttachVolumeTestJSON-239156931 Jul 27 20:45:44.271765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-AttachVolumeTestJSON-239156931-project Jul 27 20:45:44.271765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:45:44.271765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:45:44.271765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: ea3c5c3007e04391b5b108473da62787 Jul 27 20:45:44.271765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-AttachVolumeTestJSON-239156931-project Jul 27 20:45:44.271765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:45:44.271765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Instance 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 could not be found. Jul 27 20:45:44.271765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'id': '7b9db8a2-db32-4e01-9dbe-6e767e8b9734'} Jul 27 20:45:44.272841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:45:44.272841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:45:44.272841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:45:44.272841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:45:44.272841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:45:44.272841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:45:44.272841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:45:44.272841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:45:44.272841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:45:44.272841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:45:44.272841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 could not be found. Jul 27 20:45:44.272841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:45:44.272841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:45:44.272841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:45:44.272841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:45:44.272841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:45:44.272841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:45:44.272841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:45:44.272841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:45:44.272841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:45:44.274288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:45:44.274288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:45:44.274288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:45:44.274288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:45:44.274288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:45:44.274288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:45:44.274288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:45:44.274288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 could not be found. Jul 27 20:45:44.274288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:45:44.274288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:45:44.274288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:45:44.274288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:45:44.274288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:45:44.274288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:45:44.274288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:45:44.274288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:45:44.274288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 could not be found. Jul 27 20:45:44.274288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:45:44.275673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e8dd2d28-4b8d-4c7d-94e6-8dbe5f9ab9e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Returning 404 to user: Instance 7b9db8a2-db32-4e01-9dbe-6e767e8b9734 could not be found. {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:45:44.275673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e8dd2d28-4b8d-4c7d-94e6-8dbe5f9ab9e0 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734" status: 404 len: 111 microversion: 2.1 time: 0.030648 Jul 27 20:45:44.275673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1916/3815] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:45:44 2022] GET /compute/v2.1/servers/7b9db8a2-db32-4e01-9dbe-6e767e8b9734 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:45:44.405163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f838832f-b56a-4e39-9119-a3db3d5dacc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:44.414048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f838832f-b56a-4e39-9119-a3db3d5dacc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:44.415538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f838832f-b56a-4e39-9119-a3db3d5dacc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:44.416688 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f838832f-b56a-4e39-9119-a3db3d5dacc8 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.162266 Jul 27 20:45:44.417270 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1900/3816] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:44 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:45:45.408719 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1f4d818f-8437-4547-9e27-622d89d22342 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:45.409251 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1f4d818f-8437-4547-9e27-622d89d22342 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:45.415641 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f4d818f-8437-4547-9e27-622d89d22342 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:45.416097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f4d818f-8437-4547-9e27-622d89d22342 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:45.416863 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f4d818f-8437-4547-9e27-622d89d22342 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:45.417460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1f4d818f-8437-4547-9e27-622d89d22342 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:45.433028 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-1f4d818f-8437-4547-9e27-622d89d22342 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] HTTP exception thrown: Instance 8779e897-ecd4-43b8-9f87-a8e0c524c94a could not be found. Jul 27 20:45:45.434643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1f4d818f-8437-4547-9e27-622d89d22342 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Request method failure captured: Jul 27 20:45:45.434643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: DELETE /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a HTTP/1.1 Jul 27 20:45:45.434643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:45:45.434643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:45:45.434643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:45:45.434643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:45:45.434643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:45:45.434643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:45:45.434643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:45:45.434643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:45:45.434643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4Zs1W3D7PKSXHs4Bd30ybMq7u2IIlU6z01glDGWAFyPpzQavcBMmBz1jEBj5-GF4Yu7e2-oRG6B9aYqFce6_1g6pwSd_vq347dogDci-7oYKzEY1sjPaHWeDKKMI-zQdof42fg9vggfnxmIKS-IW9ukKNX36NqtpboHNCn1-no_YpBM Jul 27 20:45:45.434643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:45:45.434643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:45:45.434643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:45:45.434643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:45:45.434643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:45:45.434643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:45:45.434643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 8d9a9e3a2b0e4918950cfd454aab9fbb Jul 27 20:45:45.434643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-AttachVolumeTestJSON-239156931 Jul 27 20:45:45.434643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:45:45.434643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:45:45.436408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d9a9e3a2b0e4918950cfd454aab9fbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8d9a9e3a2b0e4918950cfd454aab9fbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8d9a9e3a2b0e4918950cfd454aab9fbb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d9a9e3a2b0e4918950cfd454aab9fbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:45:45.436408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-AttachVolumeTestJSON-239156931 Jul 27 20:45:45.436408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 8d9a9e3a2b0e4918950cfd454aab9fbb Jul 27 20:45:45.436408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-AttachVolumeTestJSON-239156931 Jul 27 20:45:45.436408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-AttachVolumeTestJSON-239156931-project Jul 27 20:45:45.436408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:45:45.436408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:45:45.436408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: ea3c5c3007e04391b5b108473da62787 Jul 27 20:45:45.436408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-AttachVolumeTestJSON-239156931-project Jul 27 20:45:45.436408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:45:45.436408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Instance 8779e897-ecd4-43b8-9f87-a8e0c524c94a could not be found. Jul 27 20:45:45.436408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'id': '8779e897-ecd4-43b8-9f87-a8e0c524c94a'} Jul 27 20:45:45.437342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:45:45.437342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:45:45.437342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:45:45.437342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:45:45.437342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:45:45.437342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:45:45.437342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:45:45.437342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:45:45.437342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:45:45.437342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:45:45.437342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8779e897-ecd4-43b8-9f87-a8e0c524c94a could not be found. Jul 27 20:45:45.437342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:45:45.437342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:45:45.437342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:45:45.437342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:45:45.437342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:45:45.437342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:45:45.437342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:45:45.437342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:45:45.437342 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:45:45.439896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:45:45.439896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 20:45:45.439896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 20:45:45.439896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 20:45:45.439896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 20:45:45.439896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:45:45.439896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:45:45.439896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:45:45.439896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:45:45.439896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8779e897-ecd4-43b8-9f87-a8e0c524c94a could not be found. Jul 27 20:45:45.439896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:45:45.439896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:45:45.439896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:45:45.439896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:45:45.439896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:45:45.439896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:45:45.439896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:45:45.439896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:45:45.439896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8779e897-ecd4-43b8-9f87-a8e0c524c94a could not be found. Jul 27 20:45:45.439896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:45:45.441892 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1f4d818f-8437-4547-9e27-622d89d22342 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Returning 404 to user: Instance 8779e897-ecd4-43b8-9f87-a8e0c524c94a could not be found. {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:45:45.441892 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1f4d818f-8437-4547-9e27-622d89d22342 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 404 len: 111 microversion: 2.1 time: 0.031310 Jul 27 20:45:45.441892 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1917/3817] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 20:45:45 2022] DELETE /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:45:45.442380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-832de020-eaac-4320-8650-437403d60ae7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:45.442989 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-832de020-eaac-4320-8650-437403d60ae7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:45.446971 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-da328cd3-a3f4-4fab-8624-f0400980cc27 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:45.447584 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-da328cd3-a3f4-4fab-8624-f0400980cc27 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] [instance: 8779e897-ecd4-43b8-9f87-a8e0c524c94a] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:45.449525 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-832de020-eaac-4320-8650-437403d60ae7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:45.449968 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-832de020-eaac-4320-8650-437403d60ae7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:45.450725 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-832de020-eaac-4320-8650-437403d60ae7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:45.451215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-832de020-eaac-4320-8650-437403d60ae7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:45.454595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-da328cd3-a3f4-4fab-8624-f0400980cc27 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:45.455029 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-da328cd3-a3f4-4fab-8624-f0400980cc27 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:45.455804 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-da328cd3-a3f4-4fab-8624-f0400980cc27 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:45.456291 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-da328cd3-a3f4-4fab-8624-f0400980cc27 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:45.470636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-da328cd3-a3f4-4fab-8624-f0400980cc27 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] HTTP exception thrown: Instance 8779e897-ecd4-43b8-9f87-a8e0c524c94a could not be found. Jul 27 20:45:45.472175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-da328cd3-a3f4-4fab-8624-f0400980cc27 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Request method failure captured: Jul 27 20:45:45.472175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a HTTP/1.1 Jul 27 20:45:45.472175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:45:45.472175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:45:45.472175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:45:45.472175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:45:45.472175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:45:45.472175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:45:45.472175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:45:45.472175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:45:45.472175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4Zs1W3D7PKSXHs4Bd30ybMq7u2IIlU6z01glDGWAFyPpzQavcBMmBz1jEBj5-GF4Yu7e2-oRG6B9aYqFce6_1g6pwSd_vq347dogDci-7oYKzEY1sjPaHWeDKKMI-zQdof42fg9vggfnxmIKS-IW9ukKNX36NqtpboHNCn1-no_YpBM Jul 27 20:45:45.472175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:45:45.472175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:45:45.472175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:45:45.472175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:45:45.472175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:45:45.472175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:45:45.472175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 8d9a9e3a2b0e4918950cfd454aab9fbb Jul 27 20:45:45.472175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-AttachVolumeTestJSON-239156931 Jul 27 20:45:45.472175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:45:45.472175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:45:45.473916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d9a9e3a2b0e4918950cfd454aab9fbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8d9a9e3a2b0e4918950cfd454aab9fbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8d9a9e3a2b0e4918950cfd454aab9fbb", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d9a9e3a2b0e4918950cfd454aab9fbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:45:45.473916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-AttachVolumeTestJSON-239156931 Jul 27 20:45:45.473916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 8d9a9e3a2b0e4918950cfd454aab9fbb Jul 27 20:45:45.473916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-AttachVolumeTestJSON-239156931 Jul 27 20:45:45.473916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-AttachVolumeTestJSON-239156931-project Jul 27 20:45:45.473916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:45:45.473916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:45:45.473916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: ea3c5c3007e04391b5b108473da62787 Jul 27 20:45:45.473916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-AttachVolumeTestJSON-239156931-project Jul 27 20:45:45.473916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:45:45.473916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Instance 8779e897-ecd4-43b8-9f87-a8e0c524c94a could not be found. Jul 27 20:45:45.473916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'id': '8779e897-ecd4-43b8-9f87-a8e0c524c94a'} Jul 27 20:45:45.474788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:45:45.474788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:45:45.474788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:45:45.474788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:45:45.474788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:45:45.474788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:45:45.474788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:45:45.474788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:45:45.474788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:45:45.474788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:45:45.474788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8779e897-ecd4-43b8-9f87-a8e0c524c94a could not be found. Jul 27 20:45:45.474788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:45:45.474788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:45:45.474788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:45:45.474788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:45:45.474788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:45:45.474788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:45:45.474788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:45:45.474788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:45:45.474788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:45:45.476142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:45:45.476142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:45:45.476142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:45:45.476142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:45:45.476142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:45:45.476142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:45:45.476142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:45:45.476142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8779e897-ecd4-43b8-9f87-a8e0c524c94a could not be found. Jul 27 20:45:45.476142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:45:45.476142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:45:45.476142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:45:45.476142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:45:45.476142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:45:45.476142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:45:45.476142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:45:45.476142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:45:45.476142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8779e897-ecd4-43b8-9f87-a8e0c524c94a could not be found. Jul 27 20:45:45.476142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:45:45.477434 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-da328cd3-a3f4-4fab-8624-f0400980cc27 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] Returning 404 to user: Instance 8779e897-ecd4-43b8-9f87-a8e0c524c94a could not be found. {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:45:45.477434 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-da328cd3-a3f4-4fab-8624-f0400980cc27 tempest-AttachVolumeTestJSON-239156931 tempest-AttachVolumeTestJSON-239156931-project] 10.222.0.65 "GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a" status: 404 len: 111 microversion: 2.1 time: 0.030265 Jul 27 20:45:45.477434 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1918/3818] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:45:45 2022] GET /compute/v2.1/servers/8779e897-ecd4-43b8-9f87-a8e0c524c94a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:45:45.675787 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-832de020-eaac-4320-8650-437403d60ae7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:45.684227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-832de020-eaac-4320-8650-437403d60ae7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:45.685766 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-832de020-eaac-4320-8650-437403d60ae7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:45.686917 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-832de020-eaac-4320-8650-437403d60ae7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.249210 Jul 27 20:45:45.687463 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1901/3819] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:45 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:45:46.714847 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3eb5f49a-740c-4be1-9f56-66f7bfde1fa6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:46.715455 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3eb5f49a-740c-4be1-9f56-66f7bfde1fa6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:46.722108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3eb5f49a-740c-4be1-9f56-66f7bfde1fa6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:46.722553 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3eb5f49a-740c-4be1-9f56-66f7bfde1fa6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:46.723314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3eb5f49a-740c-4be1-9f56-66f7bfde1fa6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:46.723757 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3eb5f49a-740c-4be1-9f56-66f7bfde1fa6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:46.854451 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3eb5f49a-740c-4be1-9f56-66f7bfde1fa6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:46.870073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3eb5f49a-740c-4be1-9f56-66f7bfde1fa6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:46.871781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3eb5f49a-740c-4be1-9f56-66f7bfde1fa6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:46.872976 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3eb5f49a-740c-4be1-9f56-66f7bfde1fa6 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1744 microversion: 2.20 time: 0.162223 Jul 27 20:45:46.873541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1919/3820] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:46 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:47.898752 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1efaeb03-f7f8-47c8-acf1-e92306adb74f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:47.899420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1efaeb03-f7f8-47c8-acf1-e92306adb74f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:47.906137 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1efaeb03-f7f8-47c8-acf1-e92306adb74f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:47.907091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1efaeb03-f7f8-47c8-acf1-e92306adb74f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:47.907896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1efaeb03-f7f8-47c8-acf1-e92306adb74f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:47.908338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1efaeb03-f7f8-47c8-acf1-e92306adb74f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:48.285640 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1efaeb03-f7f8-47c8-acf1-e92306adb74f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:48.295154 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1efaeb03-f7f8-47c8-acf1-e92306adb74f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:48.296656 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1efaeb03-f7f8-47c8-acf1-e92306adb74f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:48.298414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1efaeb03-f7f8-47c8-acf1-e92306adb74f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1744 microversion: 2.20 time: 0.403944 Jul 27 20:45:48.304076 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1902/3821] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:47 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1744 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:49.329205 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4d28a786-b557-41ee-94c0-70ea1564cd95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:49.330564 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4d28a786-b557-41ee-94c0-70ea1564cd95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:49.337086 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4d28a786-b557-41ee-94c0-70ea1564cd95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:49.337540 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4d28a786-b557-41ee-94c0-70ea1564cd95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:49.338569 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4d28a786-b557-41ee-94c0-70ea1564cd95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:49.339196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4d28a786-b557-41ee-94c0-70ea1564cd95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:49.472501 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4d28a786-b557-41ee-94c0-70ea1564cd95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:49.480805 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4d28a786-b557-41ee-94c0-70ea1564cd95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:49.482370 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4d28a786-b557-41ee-94c0-70ea1564cd95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:49.483531 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4d28a786-b557-41ee-94c0-70ea1564cd95 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1744 microversion: 2.20 time: 0.159839 Jul 27 20:45:49.484082 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1920/3822] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:49 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:45:50.507748 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fcd671da-2474-453e-a3f2-20a085b3fcb9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:50.508729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fcd671da-2474-453e-a3f2-20a085b3fcb9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:50.516514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fcd671da-2474-453e-a3f2-20a085b3fcb9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:50.517115 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fcd671da-2474-453e-a3f2-20a085b3fcb9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:50.518045 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fcd671da-2474-453e-a3f2-20a085b3fcb9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:50.518585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fcd671da-2474-453e-a3f2-20a085b3fcb9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:50.715004 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fcd671da-2474-453e-a3f2-20a085b3fcb9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:50.724208 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fcd671da-2474-453e-a3f2-20a085b3fcb9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:50.725814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fcd671da-2474-453e-a3f2-20a085b3fcb9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:50.727064 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fcd671da-2474-453e-a3f2-20a085b3fcb9 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1744 microversion: 2.20 time: 0.223348 Jul 27 20:45:50.727694 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1903/3823] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:50 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1744 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:51.750565 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4c34b1df-0d94-42a3-b9e8-840d8d42838d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:51.752085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4c34b1df-0d94-42a3-b9e8-840d8d42838d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:51.767668 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4c34b1df-0d94-42a3-b9e8-840d8d42838d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:51.768134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4c34b1df-0d94-42a3-b9e8-840d8d42838d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:51.768928 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4c34b1df-0d94-42a3-b9e8-840d8d42838d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:51.769411 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4c34b1df-0d94-42a3-b9e8-840d8d42838d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:51.971938 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4c34b1df-0d94-42a3-b9e8-840d8d42838d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:51.981309 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4c34b1df-0d94-42a3-b9e8-840d8d42838d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:51.987373 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4c34b1df-0d94-42a3-b9e8-840d8d42838d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:51.989426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4c34b1df-0d94-42a3-b9e8-840d8d42838d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1739 microversion: 2.20 time: 0.243227 Jul 27 20:45:52.011804 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1921/3824] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:51 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1739 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:52.302819 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-e5ae0711-f547-46a5-a26d-7061bc782365 req-4af20f01-5d7e-443e-8570-89b497dd807d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9989ae14-684b-494e-bc1d-df4a26faf42b", "name": "network-vif-plugged", "status": "completed", "tag": "e3e29ab1-5d40-4baf-aa9a-dab68126df17"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:45:52.315066 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-e5ae0711-f547-46a5-a26d-7061bc782365 req-4af20f01-5d7e-443e-8570-89b497dd807d service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:52.315801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-e5ae0711-f547-46a5-a26d-7061bc782365 req-4af20f01-5d7e-443e-8570-89b497dd807d service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:52.337730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-e5ae0711-f547-46a5-a26d-7061bc782365 req-4af20f01-5d7e-443e-8570-89b497dd807d service nova] Creating event network-vif-plugged:e3e29ab1-5d40-4baf-aa9a-dab68126df17 for instance 9989ae14-684b-494e-bc1d-df4a26faf42b on hv-cinder-79987 Jul 27 20:45:52.348340 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-e5ae0711-f547-46a5-a26d-7061bc782365 req-4af20f01-5d7e-443e-8570-89b497dd807d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.314303 Jul 27 20:45:52.349283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1904/3825] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:45:53.018229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-af90f398-b5d9-4b81-b3aa-63b818321cca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:53.018827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-af90f398-b5d9-4b81-b3aa-63b818321cca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:53.036634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-af90f398-b5d9-4b81-b3aa-63b818321cca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:53.037102 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-af90f398-b5d9-4b81-b3aa-63b818321cca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:53.038080 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-af90f398-b5d9-4b81-b3aa-63b818321cca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:53.038675 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-af90f398-b5d9-4b81-b3aa-63b818321cca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:53.291666 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-af90f398-b5d9-4b81-b3aa-63b818321cca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:53.305309 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-af90f398-b5d9-4b81-b3aa-63b818321cca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:53.307767 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-af90f398-b5d9-4b81-b3aa-63b818321cca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:53.309866 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-af90f398-b5d9-4b81-b3aa-63b818321cca tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1739 microversion: 2.20 time: 0.296088 Jul 27 20:45:53.326106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1922/3826] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:53 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1739 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:54.336356 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9f91ca71-b31f-42fb-aab7-f535e45855a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:54.337129 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9f91ca71-b31f-42fb-aab7-f535e45855a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:54.353800 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f91ca71-b31f-42fb-aab7-f535e45855a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:54.354766 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f91ca71-b31f-42fb-aab7-f535e45855a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:54.355565 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f91ca71-b31f-42fb-aab7-f535e45855a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:54.356007 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f91ca71-b31f-42fb-aab7-f535e45855a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:54.541535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9f91ca71-b31f-42fb-aab7-f535e45855a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:54.551606 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9f91ca71-b31f-42fb-aab7-f535e45855a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:54.553510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9f91ca71-b31f-42fb-aab7-f535e45855a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:54.554988 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9f91ca71-b31f-42fb-aab7-f535e45855a7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1739 microversion: 2.20 time: 0.222873 Jul 27 20:45:54.556048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1905/3827] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:54 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:55.269041 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ce135164-48ad-4d76-83f7-7199ae918037 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Action: 'create', calling method: .version_select at 0x7fc7f385b1f0>, body: {"keypair": {"name": "tempest-keypair-1145877817", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgJQYUqaF66exQZfr0X14wQThHVxI0m0wdmSrc80lncMRZubh7A0hlA0KBXxZFIBRpNCGn8AXmlepZqla70OOJiq4VRUmbIh+gtKqknDW+M3vEVStFv5RJiI+WAmYOEZA=="}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:45:55.286706 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-ce135164-48ad-4d76-83f7-7199ae918037 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Getting quotas for project 6a1fbeedf5134a5a9432e42a35e1d955. Resources: {'key_pairs'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:45:55.290965 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-ce135164-48ad-4d76-83f7-7199ae918037 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Getting quotas for user 30051341684845938161bb5ec0680d68 and project 6a1fbeedf5134a5a9432e42a35e1d955. Resources: {'key_pairs'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:45:55.333093 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ce135164-48ad-4d76-83f7-7199ae918037 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.140893 Jul 27 20:45:55.333093 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1923/3828] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Jul 27 20:45:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:45:55.579966 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9cf96bdc-1f4f-4ef3-a7f6-4808756eb83d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:55.580466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9cf96bdc-1f4f-4ef3-a7f6-4808756eb83d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:55.587672 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9cf96bdc-1f4f-4ef3-a7f6-4808756eb83d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:55.588122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9cf96bdc-1f4f-4ef3-a7f6-4808756eb83d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:55.588891 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9cf96bdc-1f4f-4ef3-a7f6-4808756eb83d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:55.589611 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9cf96bdc-1f4f-4ef3-a7f6-4808756eb83d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:55.824581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9cf96bdc-1f4f-4ef3-a7f6-4808756eb83d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:55.869026 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9cf96bdc-1f4f-4ef3-a7f6-4808756eb83d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:55.871923 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9cf96bdc-1f4f-4ef3-a7f6-4808756eb83d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:55.877190 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9cf96bdc-1f4f-4ef3-a7f6-4808756eb83d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1739 microversion: 2.20 time: 0.298296 Jul 27 20:45:55.877190 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1906/3829] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:55 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1739 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:45:56.902224 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c25b5399-dfc3-4299-be3a-c095c5ecc74a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:56.903095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c25b5399-dfc3-4299-be3a-c095c5ecc74a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:56.920264 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c25b5399-dfc3-4299-be3a-c095c5ecc74a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:56.921405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c25b5399-dfc3-4299-be3a-c095c5ecc74a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:56.922627 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c25b5399-dfc3-4299-be3a-c095c5ecc74a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:56.923519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c25b5399-dfc3-4299-be3a-c095c5ecc74a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:57.200535 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c25b5399-dfc3-4299-be3a-c095c5ecc74a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:57.209849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c25b5399-dfc3-4299-be3a-c095c5ecc74a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:57.211646 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c25b5399-dfc3-4299-be3a-c095c5ecc74a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:57.212934 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c25b5399-dfc3-4299-be3a-c095c5ecc74a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1739 microversion: 2.20 time: 0.317164 Jul 27 20:45:57.237182 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1924/3830] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:56 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1739 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:57.296051 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a8b011d0-1ec1-426c-93e2-895ca4a62baf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-700991153", "imageRef": "fb689bea-534a-4aac-bec3-8f55591dba58", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3e92f9c-ddde-4f3c-bca6-344bcb620cac"}], "security_groups": [{"name": "tempest-securitygroup--1736103881"}], "key_name": "tempest-keypair-1145877817", "user_data": "}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:45:57.431637 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-a8b011d0-1ec1-426c-93e2-895ca4a62baf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] validate_networks() for [('a3e92f9c-ddde-4f3c-bca6-344bcb620cac', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:45:58.065362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-a8b011d0-1ec1-426c-93e2-895ca4a62baf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:45:58.066057 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-a8b011d0-1ec1-426c-93e2-895ca4a62baf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:45:58.066751 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-a8b011d0-1ec1-426c-93e2-895ca4a62baf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:45:58.067348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-a8b011d0-1ec1-426c-93e2-895ca4a62baf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:45:58.067767 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-a8b011d0-1ec1-426c-93e2-895ca4a62baf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:45:58.090154 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a8b011d0-1ec1-426c-93e2-895ca4a62baf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:58.090884 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a8b011d0-1ec1-426c-93e2-895ca4a62baf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:58.091995 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a8b011d0-1ec1-426c-93e2-895ca4a62baf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:58.092615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a8b011d0-1ec1-426c-93e2-895ca4a62baf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:58.101926 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:45:58.118200 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-a8b011d0-1ec1-426c-93e2-895ca4a62baf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Getting quotas for project 6a1fbeedf5134a5a9432e42a35e1d955. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:45:58.127457 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-a8b011d0-1ec1-426c-93e2-895ca4a62baf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Getting quotas for user 30051341684845938161bb5ec0680d68 and project 6a1fbeedf5134a5a9432e42a35e1d955. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:45:58.165245 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a8b011d0-1ec1-426c-93e2-895ca4a62baf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:45:58.167561 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a8b011d0-1ec1-426c-93e2-895ca4a62baf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb689bea-534a-4aac-bec3-8f55591dba58',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:45:58.241537 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a8b011d0-1ec1-426c-93e2-895ca4a62baf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.949737 Jul 27 20:45:58.252838 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1907/3831] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Jul 27 20:45:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:45:58.256012 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c83708a0-a6f3-4303-8eb7-888516fb778c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:58.256736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c83708a0-a6f3-4303-8eb7-888516fb778c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:58.260161 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a0cab434-5d24-47d7-97de-0dab4ab67caf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:58.261018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a0cab434-5d24-47d7-97de-0dab4ab67caf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:58.274631 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c83708a0-a6f3-4303-8eb7-888516fb778c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:58.275165 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c83708a0-a6f3-4303-8eb7-888516fb778c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:58.275995 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c83708a0-a6f3-4303-8eb7-888516fb778c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:58.279226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c83708a0-a6f3-4303-8eb7-888516fb778c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:58.341121 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a0cab434-5d24-47d7-97de-0dab4ab67caf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:58.349395 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a0cab434-5d24-47d7-97de-0dab4ab67caf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596" status: 200 len: 1241 microversion: 2.1 time: 0.094541 Jul 27 20:45:58.352714 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1908/3832] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:45:58 2022] GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596 => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:45:58.516853 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c83708a0-a6f3-4303-8eb7-888516fb778c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:58.528890 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c83708a0-a6f3-4303-8eb7-888516fb778c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:58.530422 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c83708a0-a6f3-4303-8eb7-888516fb778c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:58.532256 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c83708a0-a6f3-4303-8eb7-888516fb778c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1739 microversion: 2.20 time: 0.285951 Jul 27 20:45:58.550405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1925/3833] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:58 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1739 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:45:59.391424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-78e385f3-c1db-4355-ade9-6da0195ab47f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:59.393012 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-78e385f3-c1db-4355-ade9-6da0195ab47f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:59.418548 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-78e385f3-c1db-4355-ade9-6da0195ab47f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:59.421153 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-78e385f3-c1db-4355-ade9-6da0195ab47f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:59.423386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-78e385f3-c1db-4355-ade9-6da0195ab47f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:59.432142 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-78e385f3-c1db-4355-ade9-6da0195ab47f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:59.555450 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-537e03e5-c417-4c43-bdfb-2905d0689e8f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:45:59.556382 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-537e03e5-c417-4c43-bdfb-2905d0689e8f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:45:59.571334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-537e03e5-c417-4c43-bdfb-2905d0689e8f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:59.574853 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-537e03e5-c417-4c43-bdfb-2905d0689e8f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:59.576678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-537e03e5-c417-4c43-bdfb-2905d0689e8f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:45:59.579658 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-537e03e5-c417-4c43-bdfb-2905d0689e8f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:45:59.622206 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-78e385f3-c1db-4355-ade9-6da0195ab47f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:59.631615 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-78e385f3-c1db-4355-ade9-6da0195ab47f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596" status: 200 len: 1237 microversion: 2.1 time: 0.257507 Jul 27 20:45:59.659051 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1909/3834] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:45:59 2022] GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596 => generated 1237 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:45:59.823927 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-537e03e5-c417-4c43-bdfb-2905d0689e8f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:59.834251 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-537e03e5-c417-4c43-bdfb-2905d0689e8f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:59.836015 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-537e03e5-c417-4c43-bdfb-2905d0689e8f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:45:59.837299 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-537e03e5-c417-4c43-bdfb-2905d0689e8f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1739 microversion: 2.20 time: 0.285673 Jul 27 20:45:59.838943 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1926/3835] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:45:59 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1739 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:46:00.666251 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f9d5312a-238c-4e7b-a4b2-df41b4ab35a1 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:00.666833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f9d5312a-238c-4e7b-a4b2-df41b4ab35a1 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:00.679456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9d5312a-238c-4e7b-a4b2-df41b4ab35a1 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:00.679908 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9d5312a-238c-4e7b-a4b2-df41b4ab35a1 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:00.680707 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9d5312a-238c-4e7b-a4b2-df41b4ab35a1 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:00.685889 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9d5312a-238c-4e7b-a4b2-df41b4ab35a1 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:00.772030 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f9d5312a-238c-4e7b-a4b2-df41b4ab35a1 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:00.787877 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f9d5312a-238c-4e7b-a4b2-df41b4ab35a1 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596" status: 200 len: 1299 microversion: 2.1 time: 0.125504 Jul 27 20:46:00.798083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1910/3836] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:46:00 2022] GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596 => generated 1299 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:46:00.875909 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cc937d6d-25be-4317-a9f4-f152af8c158d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:00.876688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cc937d6d-25be-4317-a9f4-f152af8c158d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:00.899285 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc937d6d-25be-4317-a9f4-f152af8c158d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:00.900165 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc937d6d-25be-4317-a9f4-f152af8c158d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:00.901259 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc937d6d-25be-4317-a9f4-f152af8c158d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:00.902327 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cc937d6d-25be-4317-a9f4-f152af8c158d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:01.135564 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cc937d6d-25be-4317-a9f4-f152af8c158d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:01.139245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=100 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:46:01.150284 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cc937d6d-25be-4317-a9f4-f152af8c158d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:01.160389 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cc937d6d-25be-4317-a9f4-f152af8c158d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:01.161888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cc937d6d-25be-4317-a9f4-f152af8c158d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1739 microversion: 2.20 time: 0.290096 Jul 27 20:46:01.176991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1927/3837] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:00 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1739 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:01.819906 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a58b00bc-fbdc-4a8f-8e2b-7a2359e35747 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:01.820472 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a58b00bc-fbdc-4a8f-8e2b-7a2359e35747 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:01.829587 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a58b00bc-fbdc-4a8f-8e2b-7a2359e35747 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:01.830299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a58b00bc-fbdc-4a8f-8e2b-7a2359e35747 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:01.831259 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a58b00bc-fbdc-4a8f-8e2b-7a2359e35747 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:01.831694 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a58b00bc-fbdc-4a8f-8e2b-7a2359e35747 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:02.104266 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a58b00bc-fbdc-4a8f-8e2b-7a2359e35747 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:02.121627 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a58b00bc-fbdc-4a8f-8e2b-7a2359e35747 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596" status: 200 len: 1367 microversion: 2.1 time: 0.305279 Jul 27 20:46:02.122749 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1911/3838] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:46:01 2022] GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596 => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:46:02.192043 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b810f4b3-6501-4a68-be36-87177765e7aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:02.193534 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b810f4b3-6501-4a68-be36-87177765e7aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:02.199844 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b810f4b3-6501-4a68-be36-87177765e7aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:02.200546 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b810f4b3-6501-4a68-be36-87177765e7aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:02.202452 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b810f4b3-6501-4a68-be36-87177765e7aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:02.203305 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b810f4b3-6501-4a68-be36-87177765e7aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:02.389861 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-6021407e-2175-422c-9660-3660ee98aa5d req-7d9e603d-a1ee-4d17-b9ef-188bd4c53b84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a25e07e9-eb88-4dc7-9833-108d25d57596", "tag": "17629eca-2b57-4d9b-b17b-66f54466cdd0"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:46:02.415987 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b810f4b3-6501-4a68-be36-87177765e7aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:02.430863 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-6021407e-2175-422c-9660-3660ee98aa5d req-7d9e603d-a1ee-4d17-b9ef-188bd4c53b84 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:02.432707 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-6021407e-2175-422c-9660-3660ee98aa5d req-7d9e603d-a1ee-4d17-b9ef-188bd4c53b84 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:02.444013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b810f4b3-6501-4a68-be36-87177765e7aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:02.450024 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b810f4b3-6501-4a68-be36-87177765e7aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:02.459458 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b810f4b3-6501-4a68-be36-87177765e7aa tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1739 microversion: 2.20 time: 0.274851 Jul 27 20:46:02.473761 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1928/3839] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:02 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1739 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:02.479201 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-6021407e-2175-422c-9660-3660ee98aa5d req-7d9e603d-a1ee-4d17-b9ef-188bd4c53b84 service nova] Creating event network-changed:17629eca-2b57-4d9b-b17b-66f54466cdd0 for instance a25e07e9-eb88-4dc7-9833-108d25d57596 on hv-cinder-79987 Jul 27 20:46:02.492770 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-6021407e-2175-422c-9660-3660ee98aa5d req-7d9e603d-a1ee-4d17-b9ef-188bd4c53b84 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107034 Jul 27 20:46:02.494487 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1912/3840] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:46:03.145149 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1718e1e9-3b1b-47c0-89cc-881641dd7b27 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:03.146355 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1718e1e9-3b1b-47c0-89cc-881641dd7b27 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:03.152231 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1718e1e9-3b1b-47c0-89cc-881641dd7b27 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:03.152877 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1718e1e9-3b1b-47c0-89cc-881641dd7b27 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:03.154177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1718e1e9-3b1b-47c0-89cc-881641dd7b27 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:03.154837 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1718e1e9-3b1b-47c0-89cc-881641dd7b27 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:03.319243 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-1718e1e9-3b1b-47c0-89cc-881641dd7b27 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:03.326632 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1718e1e9-3b1b-47c0-89cc-881641dd7b27 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596" status: 200 len: 1367 microversion: 2.1 time: 0.186962 Jul 27 20:46:03.327457 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1929/3841] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:46:03 2022] GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:46:03.487752 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2c2da0bc-3cb5-42f8-b976-ef76470a1487 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:03.488437 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2c2da0bc-3cb5-42f8-b976-ef76470a1487 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:03.497444 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c2da0bc-3cb5-42f8-b976-ef76470a1487 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:03.498116 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c2da0bc-3cb5-42f8-b976-ef76470a1487 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:03.499070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c2da0bc-3cb5-42f8-b976-ef76470a1487 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:03.500243 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c2da0bc-3cb5-42f8-b976-ef76470a1487 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:03.646825 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2c2da0bc-3cb5-42f8-b976-ef76470a1487 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:03.655243 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2c2da0bc-3cb5-42f8-b976-ef76470a1487 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:03.657341 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2c2da0bc-3cb5-42f8-b976-ef76470a1487 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:03.658742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2c2da0bc-3cb5-42f8-b976-ef76470a1487 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1739 microversion: 2.20 time: 0.175573 Jul 27 20:46:03.673553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1913/3842] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:03 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:04.348277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-71d43b6b-bdb4-447f-96b1-9d681b98aa9d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:04.348833 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-71d43b6b-bdb4-447f-96b1-9d681b98aa9d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:04.355265 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-71d43b6b-bdb4-447f-96b1-9d681b98aa9d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:04.355713 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-71d43b6b-bdb4-447f-96b1-9d681b98aa9d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:04.356465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-71d43b6b-bdb4-447f-96b1-9d681b98aa9d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:04.356898 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-71d43b6b-bdb4-447f-96b1-9d681b98aa9d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:04.487526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-71d43b6b-bdb4-447f-96b1-9d681b98aa9d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:04.495134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-71d43b6b-bdb4-447f-96b1-9d681b98aa9d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596" status: 200 len: 1367 microversion: 2.1 time: 0.150811 Jul 27 20:46:04.495698 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1930/3843] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:46:04 2022] GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:46:04.683342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c6c1358b-8621-41d5-af99-63ca853806c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:04.683944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c6c1358b-8621-41d5-af99-63ca853806c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:04.690936 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c6c1358b-8621-41d5-af99-63ca853806c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:04.691380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c6c1358b-8621-41d5-af99-63ca853806c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:04.692137 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c6c1358b-8621-41d5-af99-63ca853806c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:04.692566 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c6c1358b-8621-41d5-af99-63ca853806c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:04.820780 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c6c1358b-8621-41d5-af99-63ca853806c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:04.829872 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c6c1358b-8621-41d5-af99-63ca853806c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:04.831375 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c6c1358b-8621-41d5-af99-63ca853806c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:04.832528 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c6c1358b-8621-41d5-af99-63ca853806c3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1739 microversion: 2.20 time: 0.153136 Jul 27 20:46:04.833094 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1914/3844] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:04 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:05.515536 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-94cf9511-5ae2-4604-ab0d-8f6355b1b2fa tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:05.516146 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-94cf9511-5ae2-4604-ab0d-8f6355b1b2fa tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:05.518028 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=4 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:46:05.523762 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-94cf9511-5ae2-4604-ab0d-8f6355b1b2fa tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:05.524209 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-94cf9511-5ae2-4604-ab0d-8f6355b1b2fa tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:05.524986 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-94cf9511-5ae2-4604-ab0d-8f6355b1b2fa tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:05.525427 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-94cf9511-5ae2-4604-ab0d-8f6355b1b2fa tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:05.663987 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-94cf9511-5ae2-4604-ab0d-8f6355b1b2fa tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:05.671972 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-94cf9511-5ae2-4604-ab0d-8f6355b1b2fa tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596" status: 200 len: 1367 microversion: 2.1 time: 0.159756 Jul 27 20:46:05.672532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1931/3845] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:46:05 2022] GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:46:05.855585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6fcae214-e64d-4280-b3d9-c8b1096c891c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:05.856193 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6fcae214-e64d-4280-b3d9-c8b1096c891c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:05.863366 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6fcae214-e64d-4280-b3d9-c8b1096c891c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:05.863816 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6fcae214-e64d-4280-b3d9-c8b1096c891c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:05.864597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6fcae214-e64d-4280-b3d9-c8b1096c891c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:05.865081 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6fcae214-e64d-4280-b3d9-c8b1096c891c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:05.998810 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6fcae214-e64d-4280-b3d9-c8b1096c891c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:06.007160 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6fcae214-e64d-4280-b3d9-c8b1096c891c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:06.008638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6fcae214-e64d-4280-b3d9-c8b1096c891c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:06.009814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6fcae214-e64d-4280-b3d9-c8b1096c891c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1739 microversion: 2.20 time: 0.158165 Jul 27 20:46:06.010359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1915/3846] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:05 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:06.693280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5d990325-a652-46f2-afb0-0a1c90268582 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:06.693988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5d990325-a652-46f2-afb0-0a1c90268582 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:06.700159 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5d990325-a652-46f2-afb0-0a1c90268582 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:06.700608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5d990325-a652-46f2-afb0-0a1c90268582 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:06.701876 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5d990325-a652-46f2-afb0-0a1c90268582 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:06.702653 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5d990325-a652-46f2-afb0-0a1c90268582 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:06.834623 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5d990325-a652-46f2-afb0-0a1c90268582 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:06.842103 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5d990325-a652-46f2-afb0-0a1c90268582 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596" status: 200 len: 1367 microversion: 2.1 time: 0.152606 Jul 27 20:46:06.842666 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1932/3847] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:46:06 2022] GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:46:07.033411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-59ac9b27-ee3e-4b9c-864a-d030a361ac91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:07.034200 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-59ac9b27-ee3e-4b9c-864a-d030a361ac91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:07.040528 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-59ac9b27-ee3e-4b9c-864a-d030a361ac91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:07.040997 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-59ac9b27-ee3e-4b9c-864a-d030a361ac91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:07.041770 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-59ac9b27-ee3e-4b9c-864a-d030a361ac91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:07.042209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-59ac9b27-ee3e-4b9c-864a-d030a361ac91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:07.175043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-59ac9b27-ee3e-4b9c-864a-d030a361ac91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:07.182948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-59ac9b27-ee3e-4b9c-864a-d030a361ac91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:07.184445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-59ac9b27-ee3e-4b9c-864a-d030a361ac91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:07.185632 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-59ac9b27-ee3e-4b9c-864a-d030a361ac91 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1721 microversion: 2.20 time: 0.156158 Jul 27 20:46:07.186208 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1916/3848] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:07 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:07.863351 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bed83c87-594f-44bc-99a4-14bc7e6ef072 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:07.863970 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bed83c87-594f-44bc-99a4-14bc7e6ef072 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:07.870851 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bed83c87-594f-44bc-99a4-14bc7e6ef072 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:07.871034 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bed83c87-594f-44bc-99a4-14bc7e6ef072 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:07.871776 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bed83c87-594f-44bc-99a4-14bc7e6ef072 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:07.872212 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bed83c87-594f-44bc-99a4-14bc7e6ef072 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:08.003751 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bed83c87-594f-44bc-99a4-14bc7e6ef072 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:08.011618 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bed83c87-594f-44bc-99a4-14bc7e6ef072 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596" status: 200 len: 1367 microversion: 2.1 time: 0.152642 Jul 27 20:46:08.012196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1933/3849] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:46:07 2022] GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:46:08.211373 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-548a3525-e70e-4e38-b9c8-b36c3c885426 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:08.211981 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-548a3525-e70e-4e38-b9c8-b36c3c885426 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:08.214377 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:46:08.220462 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-548a3525-e70e-4e38-b9c8-b36c3c885426 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:08.220846 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-548a3525-e70e-4e38-b9c8-b36c3c885426 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:08.221628 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-548a3525-e70e-4e38-b9c8-b36c3c885426 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:08.222062 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-548a3525-e70e-4e38-b9c8-b36c3c885426 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:08.349281 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=8 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:46:08.353302 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-548a3525-e70e-4e38-b9c8-b36c3c885426 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:08.362272 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-548a3525-e70e-4e38-b9c8-b36c3c885426 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:08.363763 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-548a3525-e70e-4e38-b9c8-b36c3c885426 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:08.364926 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-548a3525-e70e-4e38-b9c8-b36c3c885426 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1721 microversion: 2.20 time: 0.157482 Jul 27 20:46:08.365502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1917/3850] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:08 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:09.033836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-92be3366-fc55-4e5c-ae69-3a906c36a9a5 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:09.034464 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-92be3366-fc55-4e5c-ae69-3a906c36a9a5 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:09.040997 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-92be3366-fc55-4e5c-ae69-3a906c36a9a5 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:09.041448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-92be3366-fc55-4e5c-ae69-3a906c36a9a5 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:09.042223 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-92be3366-fc55-4e5c-ae69-3a906c36a9a5 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:09.042662 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-92be3366-fc55-4e5c-ae69-3a906c36a9a5 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:09.176782 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-92be3366-fc55-4e5c-ae69-3a906c36a9a5 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:09.184168 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-92be3366-fc55-4e5c-ae69-3a906c36a9a5 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596" status: 200 len: 1367 microversion: 2.1 time: 0.155227 Jul 27 20:46:09.184727 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1934/3851] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:46:09 2022] GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:46:09.387499 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9c1f089f-d3e1-407a-94f2-8a20d918fcc5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:09.388116 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9c1f089f-d3e1-407a-94f2-8a20d918fcc5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:09.395175 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c1f089f-d3e1-407a-94f2-8a20d918fcc5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:09.395624 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c1f089f-d3e1-407a-94f2-8a20d918fcc5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:09.396392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c1f089f-d3e1-407a-94f2-8a20d918fcc5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:09.396830 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c1f089f-d3e1-407a-94f2-8a20d918fcc5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:09.528776 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9c1f089f-d3e1-407a-94f2-8a20d918fcc5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:09.537349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9c1f089f-d3e1-407a-94f2-8a20d918fcc5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:09.538835 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9c1f089f-d3e1-407a-94f2-8a20d918fcc5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:09.539972 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9c1f089f-d3e1-407a-94f2-8a20d918fcc5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1664 microversion: 2.20 time: 0.156501 Jul 27 20:46:09.540527 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1918/3852] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:09 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:09.562919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ddd8f0b3-a63b-4986-89fc-b09dd6df5419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f94ebfb6-9069-4250-8b11-e0a92570e09d"}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:46:09.565360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ddd8f0b3-a63b-4986-89fc-b09dd6df5419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:09.571330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddd8f0b3-a63b-4986-89fc-b09dd6df5419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:09.571787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddd8f0b3-a63b-4986-89fc-b09dd6df5419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:09.572555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddd8f0b3-a63b-4986-89fc-b09dd6df5419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:09.573030 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddd8f0b3-a63b-4986-89fc-b09dd6df5419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:09.836013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ddd8f0b3-a63b-4986-89fc-b09dd6df5419 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "POST /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.277493 Jul 27 20:46:09.836749 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1935/3853] 10.222.0.65 () {62 vars in 1364 bytes} [Wed Jul 27 20:46:09 2022] POST /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b/os-volume_attachments => generated 188 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 27 20:46:09.968156 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-13029f08-5879-44ae-87f0-2a962e0c3f5b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:09.968674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-13029f08-5879-44ae-87f0-2a962e0c3f5b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:09.974648 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13029f08-5879-44ae-87f0-2a962e0c3f5b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:09.975092 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13029f08-5879-44ae-87f0-2a962e0c3f5b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:09.975846 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13029f08-5879-44ae-87f0-2a962e0c3f5b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:09.976277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13029f08-5879-44ae-87f0-2a962e0c3f5b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:10.060249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-3b4e07c3-fcb5-4b6f-98ef-4c99ac0f1a06 req-461baaa3-aed9-4418-8b00-02d474e3430e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a25e07e9-eb88-4dc7-9833-108d25d57596", "name": "network-vif-plugged", "status": "completed", "tag": "17629eca-2b57-4d9b-b17b-66f54466cdd0"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:46:10.073464 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-3b4e07c3-fcb5-4b6f-98ef-4c99ac0f1a06 req-461baaa3-aed9-4418-8b00-02d474e3430e service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:10.073916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-3b4e07c3-fcb5-4b6f-98ef-4c99ac0f1a06 req-461baaa3-aed9-4418-8b00-02d474e3430e service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:10.086044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-3b4e07c3-fcb5-4b6f-98ef-4c99ac0f1a06 req-461baaa3-aed9-4418-8b00-02d474e3430e service nova] Creating event network-vif-plugged:17629eca-2b57-4d9b-b17b-66f54466cdd0 for instance a25e07e9-eb88-4dc7-9833-108d25d57596 on hv-cinder-79987 Jul 27 20:46:10.096267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-3b4e07c3-fcb5-4b6f-98ef-4c99ac0f1a06 req-461baaa3-aed9-4418-8b00-02d474e3430e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039578 Jul 27 20:46:10.097583 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1936/3854] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:46:10.206652 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0695ca52-f9d6-429e-8e88-1b092d8dd3b3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:10.207498 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0695ca52-f9d6-429e-8e88-1b092d8dd3b3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:10.214044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0695ca52-f9d6-429e-8e88-1b092d8dd3b3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:10.214943 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0695ca52-f9d6-429e-8e88-1b092d8dd3b3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:10.216058 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0695ca52-f9d6-429e-8e88-1b092d8dd3b3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:10.216678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0695ca52-f9d6-429e-8e88-1b092d8dd3b3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:10.276768 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-13029f08-5879-44ae-87f0-2a962e0c3f5b tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b/os-volume_attachments/f94ebfb6-9069-4250-8b11-e0a92570e09d" status: 202 len: 0 microversion: 2.20 time: 0.312648 Jul 27 20:46:10.277808 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1919/3855] 10.222.0.65 () {60 vars in 1457 bytes} [Wed Jul 27 20:46:09 2022] DELETE /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b/os-volume_attachments/f94ebfb6-9069-4250-8b11-e0a92570e09d => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:46:10.349715 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-476eef20-684d-4444-b277-342ffdd0ba71 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:46:10.350362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-476eef20-684d-4444-b277-342ffdd0ba71 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:10.357088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-476eef20-684d-4444-b277-342ffdd0ba71 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:10.357546 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-476eef20-684d-4444-b277-342ffdd0ba71 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:10.358608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-476eef20-684d-4444-b277-342ffdd0ba71 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:10.359363 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-476eef20-684d-4444-b277-342ffdd0ba71 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:10.378991 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0695ca52-f9d6-429e-8e88-1b092d8dd3b3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:10.386621 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0695ca52-f9d6-429e-8e88-1b092d8dd3b3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596" status: 200 len: 1367 microversion: 2.1 time: 0.184474 Jul 27 20:46:10.387777 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1937/3856] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:46:10 2022] GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:46:10.407679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-476eef20-684d-4444-b277-342ffdd0ba71 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117877) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 27 20:46:10.472927 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-476eef20-684d-4444-b277-342ffdd0ba71 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "POST /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b/action" status: 202 len: 0 microversion: 2.20 time: 0.127538 Jul 27 20:46:10.473555 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1920/3857] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Jul 27 20:46:10 2022] POST /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:46:10.481953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f3f06b78-7730-4398-869f-3586af734ff1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:10.482716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f3f06b78-7730-4398-869f-3586af734ff1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:10.489025 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f3f06b78-7730-4398-869f-3586af734ff1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:10.489489 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f3f06b78-7730-4398-869f-3586af734ff1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:10.490260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f3f06b78-7730-4398-869f-3586af734ff1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:10.490701 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f3f06b78-7730-4398-869f-3586af734ff1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:10.630490 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f3f06b78-7730-4398-869f-3586af734ff1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:10.638839 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f3f06b78-7730-4398-869f-3586af734ff1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:10.640707 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f3f06b78-7730-4398-869f-3586af734ff1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:10.642281 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f3f06b78-7730-4398-869f-3586af734ff1 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1672 microversion: 2.20 time: 0.164373 Jul 27 20:46:10.642834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1938/3858] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:10 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:11.409280 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5fc2615c-5b60-4b54-89da-bab53afb0a9e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:11.410157 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5fc2615c-5b60-4b54-89da-bab53afb0a9e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:11.416488 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5fc2615c-5b60-4b54-89da-bab53afb0a9e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:11.416946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5fc2615c-5b60-4b54-89da-bab53afb0a9e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:11.417747 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5fc2615c-5b60-4b54-89da-bab53afb0a9e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:11.418187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5fc2615c-5b60-4b54-89da-bab53afb0a9e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:11.557114 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5fc2615c-5b60-4b54-89da-bab53afb0a9e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:11.565435 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5fc2615c-5b60-4b54-89da-bab53afb0a9e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596" status: 200 len: 1367 microversion: 2.1 time: 0.161452 Jul 27 20:46:11.565999 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1921/3859] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:46:11 2022] GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:46:11.665391 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-553734ab-2287-4d58-b271-f26abde8ae5c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:11.666003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-553734ab-2287-4d58-b271-f26abde8ae5c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:11.673009 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-553734ab-2287-4d58-b271-f26abde8ae5c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:11.673455 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-553734ab-2287-4d58-b271-f26abde8ae5c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:11.674211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-553734ab-2287-4d58-b271-f26abde8ae5c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:11.674648 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-553734ab-2287-4d58-b271-f26abde8ae5c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:11.811147 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-553734ab-2287-4d58-b271-f26abde8ae5c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:11.821281 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-553734ab-2287-4d58-b271-f26abde8ae5c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:11.822807 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-553734ab-2287-4d58-b271-f26abde8ae5c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:11.823977 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-553734ab-2287-4d58-b271-f26abde8ae5c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.162457 Jul 27 20:46:11.824539 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1939/3860] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:11 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:12.123591 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-9b580876-7e21-4b94-9608-29370f96dbea req-4b35d6f5-b117-4b09-a3ec-764708bd82d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9989ae14-684b-494e-bc1d-df4a26faf42b", "name": "network-vif-unplugged", "status": "completed", "tag": "e3e29ab1-5d40-4baf-aa9a-dab68126df17"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:46:12.132892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-9b580876-7e21-4b94-9608-29370f96dbea req-4b35d6f5-b117-4b09-a3ec-764708bd82d7 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:12.133374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-9b580876-7e21-4b94-9608-29370f96dbea req-4b35d6f5-b117-4b09-a3ec-764708bd82d7 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:12.144664 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-9b580876-7e21-4b94-9608-29370f96dbea req-4b35d6f5-b117-4b09-a3ec-764708bd82d7 service nova] Creating event network-vif-unplugged:e3e29ab1-5d40-4baf-aa9a-dab68126df17 for instance 9989ae14-684b-494e-bc1d-df4a26faf42b on hv-cinder-79987 Jul 27 20:46:12.149996 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-9b580876-7e21-4b94-9608-29370f96dbea req-4b35d6f5-b117-4b09-a3ec-764708bd82d7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030130 Jul 27 20:46:12.150582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1922/3861] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:46:12.586669 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8f870738-655c-4602-934b-bb4724b3683b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:12.587312 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8f870738-655c-4602-934b-bb4724b3683b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:12.593521 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8f870738-655c-4602-934b-bb4724b3683b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:12.594177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8f870738-655c-4602-934b-bb4724b3683b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:12.594956 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8f870738-655c-4602-934b-bb4724b3683b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:12.595394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8f870738-655c-4602-934b-bb4724b3683b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:12.736688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8f870738-655c-4602-934b-bb4724b3683b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:12.744913 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8f870738-655c-4602-934b-bb4724b3683b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596" status: 200 len: 1557 microversion: 2.1 time: 0.162114 Jul 27 20:46:12.745513 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1940/3862] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:46:12 2022] GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:46:12.767359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-69cba733-7bdf-43d9-ae5d-202534ee5100 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:12.767983 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-69cba733-7bdf-43d9-ae5d-202534ee5100 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:12.775173 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-69cba733-7bdf-43d9-ae5d-202534ee5100 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:12.775621 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-69cba733-7bdf-43d9-ae5d-202534ee5100 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:12.776386 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-69cba733-7bdf-43d9-ae5d-202534ee5100 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:12.776816 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-69cba733-7bdf-43d9-ae5d-202534ee5100 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:12.797211 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:46:12.849878 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c529c6e5-b5b2-4871-912c-b67450b1c091 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:12.850520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c529c6e5-b5b2-4871-912c-b67450b1c091 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:12.857138 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c529c6e5-b5b2-4871-912c-b67450b1c091 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:12.857769 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c529c6e5-b5b2-4871-912c-b67450b1c091 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:12.859858 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c529c6e5-b5b2-4871-912c-b67450b1c091 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:12.860529 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c529c6e5-b5b2-4871-912c-b67450b1c091 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:12.927117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-69cba733-7bdf-43d9-ae5d-202534ee5100 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164626 Jul 27 20:46:12.927933 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1923/3863] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Jul 27 20:46:12 2022] GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:46:13.009782 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c529c6e5-b5b2-4871-912c-b67450b1c091 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:13.018884 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c529c6e5-b5b2-4871-912c-b67450b1c091 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:13.021192 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c529c6e5-b5b2-4871-912c-b67450b1c091 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:13.022475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c529c6e5-b5b2-4871-912c-b67450b1c091 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.177665 Jul 27 20:46:13.023125 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1941/3864] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:12 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:46:14.049567 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d8f2fa73-a421-430e-906c-d439147cca1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:14.050940 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d8f2fa73-a421-430e-906c-d439147cca1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:14.058699 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8f2fa73-a421-430e-906c-d439147cca1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:14.059152 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8f2fa73-a421-430e-906c-d439147cca1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:14.060183 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8f2fa73-a421-430e-906c-d439147cca1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:14.060788 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8f2fa73-a421-430e-906c-d439147cca1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:14.283683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-d3967328-8e87-454d-aa06-d07c2d941f9a req-ff8e3ab2-e117-4779-b18e-424df94e6666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a25e07e9-eb88-4dc7-9833-108d25d57596", "tag": "17629eca-2b57-4d9b-b17b-66f54466cdd0"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:46:14.289163 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:46:14.295230 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-d3967328-8e87-454d-aa06-d07c2d941f9a req-ff8e3ab2-e117-4779-b18e-424df94e6666 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:14.295999 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-d3967328-8e87-454d-aa06-d07c2d941f9a req-ff8e3ab2-e117-4779-b18e-424df94e6666 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:14.315821 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-d3967328-8e87-454d-aa06-d07c2d941f9a req-ff8e3ab2-e117-4779-b18e-424df94e6666 service nova] Creating event network-changed:17629eca-2b57-4d9b-b17b-66f54466cdd0 for instance a25e07e9-eb88-4dc7-9833-108d25d57596 on hv-cinder-79987 Jul 27 20:46:14.321313 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-d3967328-8e87-454d-aa06-d07c2d941f9a req-ff8e3ab2-e117-4779-b18e-424df94e6666 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042348 Jul 27 20:46:14.322556 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1942/3865] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:46:14.583532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d8f2fa73-a421-430e-906c-d439147cca1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:14.603903 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d8f2fa73-a421-430e-906c-d439147cca1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:14.605424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d8f2fa73-a421-430e-906c-d439147cca1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:14.606608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d8f2fa73-a421-430e-906c-d439147cca1a tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.563707 Jul 27 20:46:14.607143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1924/3866] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:14 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:15.697618 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e72786b2-1d5f-4969-bfd5-e0dda700e819 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:15.698345 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e72786b2-1d5f-4969-bfd5-e0dda700e819 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:15.706104 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e72786b2-1d5f-4969-bfd5-e0dda700e819 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:15.706555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e72786b2-1d5f-4969-bfd5-e0dda700e819 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:15.707329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e72786b2-1d5f-4969-bfd5-e0dda700e819 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:15.707768 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e72786b2-1d5f-4969-bfd5-e0dda700e819 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:15.712095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:46:15.856886 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e72786b2-1d5f-4969-bfd5-e0dda700e819 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:15.866256 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e72786b2-1d5f-4969-bfd5-e0dda700e819 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:15.867767 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e72786b2-1d5f-4969-bfd5-e0dda700e819 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:15.868999 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e72786b2-1d5f-4969-bfd5-e0dda700e819 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.178257 Jul 27 20:46:15.869525 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1943/3867] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:15 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:16.895652 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e4f983f9-dc9b-49fc-a8ef-951ef36a2807 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:16.896371 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e4f983f9-dc9b-49fc-a8ef-951ef36a2807 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:16.898935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:46:16.905226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4f983f9-dc9b-49fc-a8ef-951ef36a2807 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:16.906264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4f983f9-dc9b-49fc-a8ef-951ef36a2807 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:16.907111 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4f983f9-dc9b-49fc-a8ef-951ef36a2807 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:16.907560 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4f983f9-dc9b-49fc-a8ef-951ef36a2807 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:17.056541 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e4f983f9-dc9b-49fc-a8ef-951ef36a2807 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:17.065513 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e4f983f9-dc9b-49fc-a8ef-951ef36a2807 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:17.067461 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e4f983f9-dc9b-49fc-a8ef-951ef36a2807 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:17.068770 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e4f983f9-dc9b-49fc-a8ef-951ef36a2807 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.177038 Jul 27 20:46:17.078399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1925/3868] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:16 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:46:18.094595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0537dbc2-4f04-4998-93ca-a2fe3f074dd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:18.095306 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0537dbc2-4f04-4998-93ca-a2fe3f074dd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:18.102366 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0537dbc2-4f04-4998-93ca-a2fe3f074dd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:18.102844 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0537dbc2-4f04-4998-93ca-a2fe3f074dd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:18.103610 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0537dbc2-4f04-4998-93ca-a2fe3f074dd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:18.104059 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0537dbc2-4f04-4998-93ca-a2fe3f074dd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:18.240114 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0537dbc2-4f04-4998-93ca-a2fe3f074dd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:18.248084 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0537dbc2-4f04-4998-93ca-a2fe3f074dd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:18.249663 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0537dbc2-4f04-4998-93ca-a2fe3f074dd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:18.250976 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0537dbc2-4f04-4998-93ca-a2fe3f074dd3 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.160895 Jul 27 20:46:18.251687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1944/3869] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:18 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:19.275070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cee62851-6f7a-431c-a774-41310da959c5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:19.275725 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cee62851-6f7a-431c-a774-41310da959c5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:19.282829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cee62851-6f7a-431c-a774-41310da959c5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:19.283281 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cee62851-6f7a-431c-a774-41310da959c5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:19.284061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cee62851-6f7a-431c-a774-41310da959c5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:19.284501 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cee62851-6f7a-431c-a774-41310da959c5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:19.467283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cee62851-6f7a-431c-a774-41310da959c5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:19.476447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cee62851-6f7a-431c-a774-41310da959c5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:19.477991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cee62851-6f7a-431c-a774-41310da959c5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:19.479164 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cee62851-6f7a-431c-a774-41310da959c5 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.207986 Jul 27 20:46:19.479732 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1926/3870] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:19 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:20.503844 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f4a27c06-dcc6-4588-bde9-2aed0a53f2ad tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:20.504591 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f4a27c06-dcc6-4588-bde9-2aed0a53f2ad tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:20.511325 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f4a27c06-dcc6-4588-bde9-2aed0a53f2ad tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:20.511784 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f4a27c06-dcc6-4588-bde9-2aed0a53f2ad tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:20.512554 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f4a27c06-dcc6-4588-bde9-2aed0a53f2ad tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:20.513024 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f4a27c06-dcc6-4588-bde9-2aed0a53f2ad tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:20.656842 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f4a27c06-dcc6-4588-bde9-2aed0a53f2ad tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:20.665390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f4a27c06-dcc6-4588-bde9-2aed0a53f2ad tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:20.667217 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f4a27c06-dcc6-4588-bde9-2aed0a53f2ad tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:20.668654 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f4a27c06-dcc6-4588-bde9-2aed0a53f2ad tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.169318 Jul 27 20:46:20.679073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1945/3871] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:20 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:21.696060 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-34186a97-b764-48cc-8053-f4fa035a5200 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:21.696640 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-34186a97-b764-48cc-8053-f4fa035a5200 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:21.704125 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-34186a97-b764-48cc-8053-f4fa035a5200 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:21.704569 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-34186a97-b764-48cc-8053-f4fa035a5200 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:21.705361 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-34186a97-b764-48cc-8053-f4fa035a5200 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:21.705803 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-34186a97-b764-48cc-8053-f4fa035a5200 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:21.831779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-34186a97-b764-48cc-8053-f4fa035a5200 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:21.839636 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-34186a97-b764-48cc-8053-f4fa035a5200 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:21.841165 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-34186a97-b764-48cc-8053-f4fa035a5200 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:21.842322 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-34186a97-b764-48cc-8053-f4fa035a5200 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.150314 Jul 27 20:46:21.843447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1927/3872] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:21 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:22.866855 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-75af9b4e-50ac-45a8-9530-3d228fcf5553 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:22.867459 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-75af9b4e-50ac-45a8-9530-3d228fcf5553 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:22.874669 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-75af9b4e-50ac-45a8-9530-3d228fcf5553 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:22.875171 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-75af9b4e-50ac-45a8-9530-3d228fcf5553 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:22.875952 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-75af9b4e-50ac-45a8-9530-3d228fcf5553 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:22.876396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-75af9b4e-50ac-45a8-9530-3d228fcf5553 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:23.005908 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-75af9b4e-50ac-45a8-9530-3d228fcf5553 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:23.021344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-75af9b4e-50ac-45a8-9530-3d228fcf5553 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:23.022841 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-75af9b4e-50ac-45a8-9530-3d228fcf5553 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:23.024003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-75af9b4e-50ac-45a8-9530-3d228fcf5553 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.161155 Jul 27 20:46:23.024561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1946/3873] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:22 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:24.048006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e052905b-306b-49e3-90a5-e6d9fb6706a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:24.048605 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e052905b-306b-49e3-90a5-e6d9fb6706a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:24.055061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e052905b-306b-49e3-90a5-e6d9fb6706a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:24.055504 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e052905b-306b-49e3-90a5-e6d9fb6706a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:24.056255 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e052905b-306b-49e3-90a5-e6d9fb6706a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:24.056686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e052905b-306b-49e3-90a5-e6d9fb6706a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:24.187551 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e052905b-306b-49e3-90a5-e6d9fb6706a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:24.196180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e052905b-306b-49e3-90a5-e6d9fb6706a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:24.197704 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e052905b-306b-49e3-90a5-e6d9fb6706a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:24.198858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e052905b-306b-49e3-90a5-e6d9fb6706a4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.155155 Jul 27 20:46:24.199417 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1928/3874] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:24 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:25.224194 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-01e3c23d-a9e3-4c1c-9a5d-27257d320f73 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:25.224759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-01e3c23d-a9e3-4c1c-9a5d-27257d320f73 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:25.231171 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-01e3c23d-a9e3-4c1c-9a5d-27257d320f73 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:25.231618 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-01e3c23d-a9e3-4c1c-9a5d-27257d320f73 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:25.232368 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-01e3c23d-a9e3-4c1c-9a5d-27257d320f73 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:25.232803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-01e3c23d-a9e3-4c1c-9a5d-27257d320f73 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:25.392746 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-01e3c23d-a9e3-4c1c-9a5d-27257d320f73 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:25.400725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-01e3c23d-a9e3-4c1c-9a5d-27257d320f73 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:25.402287 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-01e3c23d-a9e3-4c1c-9a5d-27257d320f73 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:25.403452 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-01e3c23d-a9e3-4c1c-9a5d-27257d320f73 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.184018 Jul 27 20:46:25.404012 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1947/3875] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:25 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:26.427429 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-832217a6-6813-48cf-b7ca-bc12f4b65a8d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:26.428079 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-832217a6-6813-48cf-b7ca-bc12f4b65a8d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:26.434568 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-832217a6-6813-48cf-b7ca-bc12f4b65a8d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:26.435022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-832217a6-6813-48cf-b7ca-bc12f4b65a8d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:26.435784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-832217a6-6813-48cf-b7ca-bc12f4b65a8d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:26.436223 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-832217a6-6813-48cf-b7ca-bc12f4b65a8d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:26.566479 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-832217a6-6813-48cf-b7ca-bc12f4b65a8d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:26.576228 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-832217a6-6813-48cf-b7ca-bc12f4b65a8d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:26.580713 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-832217a6-6813-48cf-b7ca-bc12f4b65a8d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:26.580713 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-832217a6-6813-48cf-b7ca-bc12f4b65a8d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.157313 Jul 27 20:46:26.581362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1929/3876] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:26 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:46:27.604408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-dcb94d92-14a4-47f7-bc02-a1d5a34c6dc0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:27.605034 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-dcb94d92-14a4-47f7-bc02-a1d5a34c6dc0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:27.611721 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dcb94d92-14a4-47f7-bc02-a1d5a34c6dc0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:27.612680 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dcb94d92-14a4-47f7-bc02-a1d5a34c6dc0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:27.613463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dcb94d92-14a4-47f7-bc02-a1d5a34c6dc0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:27.613896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-dcb94d92-14a4-47f7-bc02-a1d5a34c6dc0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:27.741284 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-dcb94d92-14a4-47f7-bc02-a1d5a34c6dc0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:27.749135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-dcb94d92-14a4-47f7-bc02-a1d5a34c6dc0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:27.750655 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-dcb94d92-14a4-47f7-bc02-a1d5a34c6dc0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:27.751815 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-dcb94d92-14a4-47f7-bc02-a1d5a34c6dc0 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.151332 Jul 27 20:46:27.752379 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1948/3877] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:27 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:28.775451 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c41a33f9-1caf-4a8c-afad-1620464e97e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:28.776046 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c41a33f9-1caf-4a8c-afad-1620464e97e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:28.782551 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c41a33f9-1caf-4a8c-afad-1620464e97e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:28.783007 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c41a33f9-1caf-4a8c-afad-1620464e97e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:28.784275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c41a33f9-1caf-4a8c-afad-1620464e97e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:28.784711 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c41a33f9-1caf-4a8c-afad-1620464e97e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:28.913851 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c41a33f9-1caf-4a8c-afad-1620464e97e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:28.921649 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c41a33f9-1caf-4a8c-afad-1620464e97e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:28.923163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c41a33f9-1caf-4a8c-afad-1620464e97e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:28.924380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c41a33f9-1caf-4a8c-afad-1620464e97e4 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.152821 Jul 27 20:46:28.924926 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1930/3878] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:28 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:29.947510 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-27ec2e5b-0240-40ed-be52-1214f99d5795 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:29.948121 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-27ec2e5b-0240-40ed-be52-1214f99d5795 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:29.954842 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-27ec2e5b-0240-40ed-be52-1214f99d5795 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:29.955288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-27ec2e5b-0240-40ed-be52-1214f99d5795 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:29.956814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-27ec2e5b-0240-40ed-be52-1214f99d5795 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:29.957276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-27ec2e5b-0240-40ed-be52-1214f99d5795 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:30.086582 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-27ec2e5b-0240-40ed-be52-1214f99d5795 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:30.094653 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-27ec2e5b-0240-40ed-be52-1214f99d5795 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:30.096650 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-27ec2e5b-0240-40ed-be52-1214f99d5795 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:30.097844 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-27ec2e5b-0240-40ed-be52-1214f99d5795 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.154170 Jul 27 20:46:30.098395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1949/3879] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:29 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:31.120044 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6f374621-5301-4d8b-a562-5fe3b5d3dc49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:31.120652 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6f374621-5301-4d8b-a562-5fe3b5d3dc49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:31.127195 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f374621-5301-4d8b-a562-5fe3b5d3dc49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:31.127672 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f374621-5301-4d8b-a562-5fe3b5d3dc49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:31.128558 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f374621-5301-4d8b-a562-5fe3b5d3dc49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:31.129190 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f374621-5301-4d8b-a562-5fe3b5d3dc49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:31.266013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6f374621-5301-4d8b-a562-5fe3b5d3dc49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:31.274611 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6f374621-5301-4d8b-a562-5fe3b5d3dc49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:31.276123 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6f374621-5301-4d8b-a562-5fe3b5d3dc49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:31.277312 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6f374621-5301-4d8b-a562-5fe3b5d3dc49 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.161157 Jul 27 20:46:31.277870 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1931/3880] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:31 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:32.301034 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ddbf399c-8448-460c-86b2-71e6e7878605 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:32.301650 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ddbf399c-8448-460c-86b2-71e6e7878605 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:32.308210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddbf399c-8448-460c-86b2-71e6e7878605 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:32.308672 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddbf399c-8448-460c-86b2-71e6e7878605 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:32.309476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddbf399c-8448-460c-86b2-71e6e7878605 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:32.309923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ddbf399c-8448-460c-86b2-71e6e7878605 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:32.441958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ddbf399c-8448-460c-86b2-71e6e7878605 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:32.449845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ddbf399c-8448-460c-86b2-71e6e7878605 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:32.451354 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ddbf399c-8448-460c-86b2-71e6e7878605 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:32.452771 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ddbf399c-8448-460c-86b2-71e6e7878605 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.155805 Jul 27 20:46:32.453364 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1950/3881] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:32 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:33.476668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-aeac5f4a-214e-441d-9459-eb422fa57f13 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:33.477283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-aeac5f4a-214e-441d-9459-eb422fa57f13 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:33.483665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aeac5f4a-214e-441d-9459-eb422fa57f13 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:33.484112 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aeac5f4a-214e-441d-9459-eb422fa57f13 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:33.484866 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aeac5f4a-214e-441d-9459-eb422fa57f13 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:33.485390 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aeac5f4a-214e-441d-9459-eb422fa57f13 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:33.612827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aeac5f4a-214e-441d-9459-eb422fa57f13 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:33.620720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aeac5f4a-214e-441d-9459-eb422fa57f13 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:33.622265 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aeac5f4a-214e-441d-9459-eb422fa57f13 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:33.623398 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-aeac5f4a-214e-441d-9459-eb422fa57f13 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.150675 Jul 27 20:46:33.623959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1932/3882] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:33 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:34.647817 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bbb31f2e-b03f-4eb7-83a6-ed42788b0510 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:34.648439 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bbb31f2e-b03f-4eb7-83a6-ed42788b0510 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:34.655025 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bbb31f2e-b03f-4eb7-83a6-ed42788b0510 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:34.655482 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bbb31f2e-b03f-4eb7-83a6-ed42788b0510 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:34.656255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bbb31f2e-b03f-4eb7-83a6-ed42788b0510 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:34.656701 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bbb31f2e-b03f-4eb7-83a6-ed42788b0510 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:34.783245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bbb31f2e-b03f-4eb7-83a6-ed42788b0510 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:34.791883 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bbb31f2e-b03f-4eb7-83a6-ed42788b0510 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:34.793424 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bbb31f2e-b03f-4eb7-83a6-ed42788b0510 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:34.794613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bbb31f2e-b03f-4eb7-83a6-ed42788b0510 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.151411 Jul 27 20:46:34.795197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1951/3883] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:34 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:35.818510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5e405b2c-bf44-441e-87e0-2da50b6910ab tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:35.819104 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5e405b2c-bf44-441e-87e0-2da50b6910ab tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:35.825627 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e405b2c-bf44-441e-87e0-2da50b6910ab tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:35.826078 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e405b2c-bf44-441e-87e0-2da50b6910ab tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:35.826843 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e405b2c-bf44-441e-87e0-2da50b6910ab tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:35.827548 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e405b2c-bf44-441e-87e0-2da50b6910ab tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:35.964542 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5e405b2c-bf44-441e-87e0-2da50b6910ab tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:35.974434 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5e405b2c-bf44-441e-87e0-2da50b6910ab tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:35.975935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5e405b2c-bf44-441e-87e0-2da50b6910ab tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:35.977198 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5e405b2c-bf44-441e-87e0-2da50b6910ab tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.163142 Jul 27 20:46:35.977752 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1933/3884] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:35 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:36.999713 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-af323a86-127c-4742-9c3f-01917ae31bf7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:37.000349 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-af323a86-127c-4742-9c3f-01917ae31bf7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:37.007282 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-af323a86-127c-4742-9c3f-01917ae31bf7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:37.007736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-af323a86-127c-4742-9c3f-01917ae31bf7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:37.008499 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-af323a86-127c-4742-9c3f-01917ae31bf7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:37.008941 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-af323a86-127c-4742-9c3f-01917ae31bf7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:37.143771 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-af323a86-127c-4742-9c3f-01917ae31bf7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:37.151622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-af323a86-127c-4742-9c3f-01917ae31bf7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:37.153152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-af323a86-127c-4742-9c3f-01917ae31bf7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:37.154310 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-af323a86-127c-4742-9c3f-01917ae31bf7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.158592 Jul 27 20:46:37.154901 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1952/3885] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:36 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:38.152477 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-d4da83c2-1ea0-4412-b1bf-695cdf8291f9 req-b81e285d-d041-41e2-ad55-8fc2dddd2e4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9989ae14-684b-494e-bc1d-df4a26faf42b", "name": "network-vif-plugged", "status": "completed", "tag": "e3e29ab1-5d40-4baf-aa9a-dab68126df17"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:46:38.162583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-d4da83c2-1ea0-4412-b1bf-695cdf8291f9 req-b81e285d-d041-41e2-ad55-8fc2dddd2e4e service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:38.163092 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-d4da83c2-1ea0-4412-b1bf-695cdf8291f9 req-b81e285d-d041-41e2-ad55-8fc2dddd2e4e service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:38.177664 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-d4da83c2-1ea0-4412-b1bf-695cdf8291f9 req-b81e285d-d041-41e2-ad55-8fc2dddd2e4e service nova] Creating event network-vif-plugged:e3e29ab1-5d40-4baf-aa9a-dab68126df17 for instance 9989ae14-684b-494e-bc1d-df4a26faf42b on hv-cinder-79987 Jul 27 20:46:38.180503 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ebb529e7-b52c-45af-9bdc-2ec73e345f85 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:38.181202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ebb529e7-b52c-45af-9bdc-2ec73e345f85 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:38.183200 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-d4da83c2-1ea0-4412-b1bf-695cdf8291f9 req-b81e285d-d041-41e2-ad55-8fc2dddd2e4e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034819 Jul 27 20:46:38.184018 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1934/3886] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:46:38.188417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ebb529e7-b52c-45af-9bdc-2ec73e345f85 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:38.188954 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ebb529e7-b52c-45af-9bdc-2ec73e345f85 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:38.190521 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ebb529e7-b52c-45af-9bdc-2ec73e345f85 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:38.191032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ebb529e7-b52c-45af-9bdc-2ec73e345f85 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:38.327549 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ebb529e7-b52c-45af-9bdc-2ec73e345f85 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:38.338202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ebb529e7-b52c-45af-9bdc-2ec73e345f85 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:38.340170 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ebb529e7-b52c-45af-9bdc-2ec73e345f85 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:38.341561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ebb529e7-b52c-45af-9bdc-2ec73e345f85 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.165279 Jul 27 20:46:38.342135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1953/3887] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:38 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:46:39.368907 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bedec990-479a-44ce-a650-7df092f983c7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:39.369563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bedec990-479a-44ce-a650-7df092f983c7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:39.375933 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bedec990-479a-44ce-a650-7df092f983c7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:39.376385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bedec990-479a-44ce-a650-7df092f983c7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:39.377720 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bedec990-479a-44ce-a650-7df092f983c7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:39.378420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bedec990-479a-44ce-a650-7df092f983c7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:39.508578 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bedec990-479a-44ce-a650-7df092f983c7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:39.516366 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bedec990-479a-44ce-a650-7df092f983c7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:39.518041 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bedec990-479a-44ce-a650-7df092f983c7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:39.519500 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bedec990-479a-44ce-a650-7df092f983c7 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.155419 Jul 27 20:46:39.520060 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1935/3888] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:39 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 27 20:46:40.542800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f80e9f25-c87e-42d4-8209-7118cb4cc052 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:40.543460 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f80e9f25-c87e-42d4-8209-7118cb4cc052 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:40.550281 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f80e9f25-c87e-42d4-8209-7118cb4cc052 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:40.550744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f80e9f25-c87e-42d4-8209-7118cb4cc052 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:40.551536 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f80e9f25-c87e-42d4-8209-7118cb4cc052 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:40.552089 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f80e9f25-c87e-42d4-8209-7118cb4cc052 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:40.687324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f80e9f25-c87e-42d4-8209-7118cb4cc052 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:40.696407 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f80e9f25-c87e-42d4-8209-7118cb4cc052 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:40.698229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f80e9f25-c87e-42d4-8209-7118cb4cc052 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:40.699664 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f80e9f25-c87e-42d4-8209-7118cb4cc052 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1730 microversion: 2.20 time: 0.160791 Jul 27 20:46:40.700443 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1954/3889] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:40 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:46:41.723817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-868386d8-2ae9-40f5-930c-4683a28ffebf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:46:41.724407 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-868386d8-2ae9-40f5-930c-4683a28ffebf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:46:41.731025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-868386d8-2ae9-40f5-930c-4683a28ffebf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:41.731464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-868386d8-2ae9-40f5-930c-4683a28ffebf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:41.732602 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-868386d8-2ae9-40f5-930c-4683a28ffebf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:46:41.733419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-868386d8-2ae9-40f5-930c-4683a28ffebf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:46:41.867666 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-868386d8-2ae9-40f5-930c-4683a28ffebf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:41.875717 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-868386d8-2ae9-40f5-930c-4683a28ffebf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:41.878096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-868386d8-2ae9-40f5-930c-4683a28ffebf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:46:41.879156 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-868386d8-2ae9-40f5-930c-4683a28ffebf tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1717 microversion: 2.20 time: 0.159591 Jul 27 20:46:41.879712 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1936/3890] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:46:41 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:47:29.459457 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f0504366-f688-4f30-8833-ab1d96beac0d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:29.460088 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f0504366-f688-4f30-8833-ab1d96beac0d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:29.462213 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=25 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:47:29.463062 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=70 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:47:29.469408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0504366-f688-4f30-8833-ab1d96beac0d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:29.469885 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0504366-f688-4f30-8833-ab1d96beac0d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:29.470673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0504366-f688-4f30-8833-ab1d96beac0d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:29.471108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f0504366-f688-4f30-8833-ab1d96beac0d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:29.494769 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f0504366-f688-4f30-8833-ab1d96beac0d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596/ips" status: 200 len: 150 microversion: 2.1 time: 0.039717 Jul 27 20:47:29.495322 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1955/3891] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Jul 27 20:47:29 2022] GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:47:30.854881 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b3a3b504-33e7-49e8-b47b-3431ebfeeff9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "374df824-0ba6-4e9a-b612-ae4aedfce4bf"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:47:30.857235 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b3a3b504-33e7-49e8-b47b-3431ebfeeff9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:30.859495 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=23 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:47:30.860138 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=75 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:47:30.866052 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3a3b504-33e7-49e8-b47b-3431ebfeeff9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:30.866502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3a3b504-33e7-49e8-b47b-3431ebfeeff9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:30.867258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3a3b504-33e7-49e8-b47b-3431ebfeeff9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:30.867690 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3a3b504-33e7-49e8-b47b-3431ebfeeff9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:31.125514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b3a3b504-33e7-49e8-b47b-3431ebfeeff9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "POST /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274261 Jul 27 20:47:31.126121 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1937/3892] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Jul 27 20:47:30 2022] POST /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:47:37.401683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8ce330a1-2a2c-47d3-8770-7fd1beecbb65 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:37.403931 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8ce330a1-2a2c-47d3-8770-7fd1beecbb65 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:37.410871 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8ce330a1-2a2c-47d3-8770-7fd1beecbb65 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:37.411337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8ce330a1-2a2c-47d3-8770-7fd1beecbb65 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:37.412110 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8ce330a1-2a2c-47d3-8770-7fd1beecbb65 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:37.412554 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8ce330a1-2a2c-47d3-8770-7fd1beecbb65 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:37.441609 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8ce330a1-2a2c-47d3-8770-7fd1beecbb65 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044164 Jul 27 20:47:37.442163 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1956/3893] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Jul 27 20:47:37 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:47:37.508149 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b2bb3f44-04ec-4bed-98f7-86977ad4af56 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:37.508721 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b2bb3f44-04ec-4bed-98f7-86977ad4af56 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:37.515231 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b2bb3f44-04ec-4bed-98f7-86977ad4af56 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:37.515683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b2bb3f44-04ec-4bed-98f7-86977ad4af56 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:37.516472 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b2bb3f44-04ec-4bed-98f7-86977ad4af56 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:37.517093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b2bb3f44-04ec-4bed-98f7-86977ad4af56 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:37.542990 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b2bb3f44-04ec-4bed-98f7-86977ad4af56 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:47:37.616843 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b2bb3f44-04ec-4bed-98f7-86977ad4af56 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 204 len: 0 microversion: 2.20 time: 0.114002 Jul 27 20:47:37.617393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1938/3894] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Jul 27 20:47:37 2022] DELETE /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 27 20:47:37.625666 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0dd9aa33-4c96-41ba-8812-c9f01d14423f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:37.626278 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0dd9aa33-4c96-41ba-8812-c9f01d14423f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:37.632928 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0dd9aa33-4c96-41ba-8812-c9f01d14423f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:37.633405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0dd9aa33-4c96-41ba-8812-c9f01d14423f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:37.634168 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0dd9aa33-4c96-41ba-8812-c9f01d14423f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:37.634607 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0dd9aa33-4c96-41ba-8812-c9f01d14423f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:37.764288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0dd9aa33-4c96-41ba-8812-c9f01d14423f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:47:37.774760 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0dd9aa33-4c96-41ba-8812-c9f01d14423f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:47:37.776428 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0dd9aa33-4c96-41ba-8812-c9f01d14423f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:47:37.777787 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0dd9aa33-4c96-41ba-8812-c9f01d14423f tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.155987 Jul 27 20:47:37.778348 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1957/3895] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:47:37 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:47:38.802884 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b6484b49-4d37-4e1e-9076-33869b439797 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:38.803581 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b6484b49-4d37-4e1e-9076-33869b439797 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:38.811280 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6484b49-4d37-4e1e-9076-33869b439797 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:38.811672 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6484b49-4d37-4e1e-9076-33869b439797 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:38.812457 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6484b49-4d37-4e1e-9076-33869b439797 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:38.812892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6484b49-4d37-4e1e-9076-33869b439797 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:38.941902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b6484b49-4d37-4e1e-9076-33869b439797 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:47:38.949685 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b6484b49-4d37-4e1e-9076-33869b439797 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:47:38.951172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b6484b49-4d37-4e1e-9076-33869b439797 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:47:38.952607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b6484b49-4d37-4e1e-9076-33869b439797 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.154761 Jul 27 20:47:38.953177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1939/3896] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:47:38 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:47:39.712861 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-96195b0f-5c2f-4c4c-ba9d-225689c00a81 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Action: 'create', calling method: .version_select at 0x7fc7f0250c10>, body: {"keypair": {"name": "tempest-keypair-1902534094", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZNN1dMrMRuB7dr4ijhp7zgV3PG46C/2aA4pi3qdJP0yfyraNwPBrB4Z12LwBRTisU/XX5fkMoYscMvTE9Hq0CZ2RfcuCjCl1b0WfTcMzrx2BD5rj/L585uKvrIzDQsYQ=="}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:47:39.729315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-96195b0f-5c2f-4c4c-ba9d-225689c00a81 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Getting quotas for project 6a1fbeedf5134a5a9432e42a35e1d955. Resources: {'key_pairs'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:47:39.733167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-96195b0f-5c2f-4c4c-ba9d-225689c00a81 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Getting quotas for user 30051341684845938161bb5ec0680d68 and project 6a1fbeedf5134a5a9432e42a35e1d955. Resources: {'key_pairs'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:47:39.755911 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-96195b0f-5c2f-4c4c-ba9d-225689c00a81 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046774 Jul 27 20:47:39.756687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1958/3897] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Jul 27 20:47:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:47:39.976817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-05475e14-b2da-4e94-967f-d699e42b61ac tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:39.977580 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-05475e14-b2da-4e94-967f-d699e42b61ac tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:39.984129 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05475e14-b2da-4e94-967f-d699e42b61ac tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:39.984583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05475e14-b2da-4e94-967f-d699e42b61ac tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:39.985382 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05475e14-b2da-4e94-967f-d699e42b61ac tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:39.985853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05475e14-b2da-4e94-967f-d699e42b61ac tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:40.284315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-05475e14-b2da-4e94-967f-d699e42b61ac tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:47:40.294233 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-05475e14-b2da-4e94-967f-d699e42b61ac tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:47:40.296683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-05475e14-b2da-4e94-967f-d699e42b61ac tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b734a345bfe5483d9a5a1e35d89c935b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec01b599458b451e8d04a428c1c33513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:47:40.298121 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-05475e14-b2da-4e94-967f-d699e42b61ac tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 200 len: 1723 microversion: 2.20 time: 0.325771 Jul 27 20:47:40.298683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1940/3898] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:47:39 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 1723 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 27 20:47:40.625046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-23fe507d-759d-4fba-8925-34d7d4333b1a req-827c4d25-9d9e-45e1-9b84-0678bfff6f7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9989ae14-684b-494e-bc1d-df4a26faf42b", "name": "network-vif-deleted", "tag": "e3e29ab1-5d40-4baf-aa9a-dab68126df17"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:47:40.639921 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-23fe507d-759d-4fba-8925-34d7d4333b1a req-827c4d25-9d9e-45e1-9b84-0678bfff6f7d service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:40.640713 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-23fe507d-759d-4fba-8925-34d7d4333b1a req-827c4d25-9d9e-45e1-9b84-0678bfff6f7d service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:40.653305 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-23fe507d-759d-4fba-8925-34d7d4333b1a req-827c4d25-9d9e-45e1-9b84-0678bfff6f7d service nova] Creating event network-vif-deleted:e3e29ab1-5d40-4baf-aa9a-dab68126df17 for instance 9989ae14-684b-494e-bc1d-df4a26faf42b on hv-cinder-79987 Jul 27 20:47:40.658862 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-23fe507d-759d-4fba-8925-34d7d4333b1a req-827c4d25-9d9e-45e1-9b84-0678bfff6f7d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037708 Jul 27 20:47:40.659947 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1959/3899] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:47:41.322774 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4464d371-839f-4c60-b7bb-e251c52a7d5d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:41.323376 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4464d371-839f-4c60-b7bb-e251c52a7d5d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:41.330494 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4464d371-839f-4c60-b7bb-e251c52a7d5d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:41.330948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4464d371-839f-4c60-b7bb-e251c52a7d5d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:41.332266 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4464d371-839f-4c60-b7bb-e251c52a7d5d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:41.333081 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4464d371-839f-4c60-b7bb-e251c52a7d5d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:41.346877 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-4464d371-839f-4c60-b7bb-e251c52a7d5d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] HTTP exception thrown: Instance 9989ae14-684b-494e-bc1d-df4a26faf42b could not be found. Jul 27 20:47:41.349577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4464d371-839f-4c60-b7bb-e251c52a7d5d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Request method failure captured: Jul 27 20:47:41.349577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b HTTP/1.1 Jul 27 20:47:41.349577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:47:41.349577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:47:41.349577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:47:41.349577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:47:41.349577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:47:41.349577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:47:41.349577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:47:41.349577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:47:41.349577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4ZszolpoHLv4ymfn-jDIXXwrtat6zA6fU8pUvlIxQFFvg2akujyL-RcTkc0AHUPtL9FfHVEqLLG1P3QFKYKGA6GTuRef7uYyPgJ3tvotGw9j0tfDvIc-GZxx3Nrm1QaM2Jm97CejtJa-hGoo2CtA1AtsmrF2YR6vqcqJ-OZzLMovey0 Jul 27 20:47:41.349577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:47:41.349577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:47:41.349577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:47:41.349577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:47:41.349577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 20:47:41.349577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:47:41.349577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:47:41.349577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:47:41.349577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:47:41.349577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:47:41.349577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:47:41.351305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec01b599458b451e8d04a428c1c33513", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:47:41.351305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:47:41.351305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:47:41.351305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:47:41.351305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:47:41.351305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:47:41.351305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:47:41.351305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: b734a345bfe5483d9a5a1e35d89c935b Jul 27 20:47:41.351305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:47:41.351305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:47:41.351305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Instance 9989ae14-684b-494e-bc1d-df4a26faf42b could not be found. Jul 27 20:47:41.351305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'id': '9989ae14-684b-494e-bc1d-df4a26faf42b'} Jul 27 20:47:41.352278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:47:41.352278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:47:41.352278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:47:41.352278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:47:41.352278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:47:41.352278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:47:41.352278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:47:41.352278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:47:41.352278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:47:41.352278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:47:41.352278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9989ae14-684b-494e-bc1d-df4a26faf42b could not be found. Jul 27 20:47:41.352278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:41.352278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:47:41.352278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:41.352278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:47:41.352278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:47:41.352278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:47:41.352278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:47:41.352278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:47:41.352278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:47:41.353791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:47:41.353791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:47:41.353791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:47:41.353791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:47:41.353791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:47:41.353791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:47:41.353791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:47:41.353791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9989ae14-684b-494e-bc1d-df4a26faf42b could not be found. Jul 27 20:47:41.353791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:41.353791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:47:41.353791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:41.353791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:47:41.353791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:47:41.353791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:47:41.353791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:47:41.353791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:47:41.353791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9989ae14-684b-494e-bc1d-df4a26faf42b could not be found. Jul 27 20:47:41.353791 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:41.355099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4464d371-839f-4c60-b7bb-e251c52a7d5d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Returning 404 to user: Instance 9989ae14-684b-494e-bc1d-df4a26faf42b could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:47:41.355099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4464d371-839f-4c60-b7bb-e251c52a7d5d tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 404 len: 111 microversion: 2.20 time: 0.032195 Jul 27 20:47:41.355280 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1941/3900] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:47:41 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 27 20:47:41.360429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3e94744f-f5b7-44ee-8cc9-efa7f5d6c501 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '.version_select at 0x7fc7eadc8310>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:41.386263 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3e94744f-f5b7-44ee-8cc9-efa7f5d6c501 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2055010840" status: 204 len: 0 microversion: 2.20 time: 0.029775 Jul 27 20:47:41.386859 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1960/3901] 10.222.0.65 () {60 vars in 1262 bytes} [Wed Jul 27 20:47:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2055010840 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 27 20:47:41.631669 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-11e529e3-e72b-4f06-ae35-135b92c134cd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1590537630", "imageRef": "fb689bea-534a-4aac-bec3-8f55591dba58", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3e92f9c-ddde-4f3c-bca6-344bcb620cac"}], "security_groups": [{"name": "tempest-securitygroup--1300765749"}], "key_name": "tempest-keypair-1902534094", "user_data": "}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:47:41.811873 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-11e529e3-e72b-4f06-ae35-135b92c134cd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] validate_networks() for [('a3e92f9c-ddde-4f3c-bca6-344bcb620cac', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:47:42.386469 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-11e529e3-e72b-4f06-ae35-135b92c134cd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:47:42.387063 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-11e529e3-e72b-4f06-ae35-135b92c134cd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:47:42.387361 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-11e529e3-e72b-4f06-ae35-135b92c134cd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:47:42.387843 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-11e529e3-e72b-4f06-ae35-135b92c134cd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:47:42.388265 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-11e529e3-e72b-4f06-ae35-135b92c134cd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:47:42.398618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11e529e3-e72b-4f06-ae35-135b92c134cd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:42.399082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11e529e3-e72b-4f06-ae35-135b92c134cd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:42.399945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11e529e3-e72b-4f06-ae35-135b92c134cd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:42.400414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11e529e3-e72b-4f06-ae35-135b92c134cd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:42.418974 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-11e529e3-e72b-4f06-ae35-135b92c134cd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Getting quotas for project 6a1fbeedf5134a5a9432e42a35e1d955. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:47:42.421539 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-11e529e3-e72b-4f06-ae35-135b92c134cd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Getting quotas for user 30051341684845938161bb5ec0680d68 and project 6a1fbeedf5134a5a9432e42a35e1d955. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:47:42.432817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-11e529e3-e72b-4f06-ae35-135b92c134cd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:47:42.435103 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-11e529e3-e72b-4f06-ae35-135b92c134cd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb689bea-534a-4aac-bec3-8f55591dba58',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:47:42.483853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-11e529e3-e72b-4f06-ae35-135b92c134cd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.856463 Jul 27 20:47:42.484491 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1942/3902] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Jul 27 20:47:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:47:42.495636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e794c04e-df53-43b1-9ab5-1c60c513fdd6 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:42.496451 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e794c04e-df53-43b1-9ab5-1c60c513fdd6 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:42.557476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e794c04e-df53-43b1-9ab5-1c60c513fdd6 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:47:42.565580 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e794c04e-df53-43b1-9ab5-1c60c513fdd6 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801" status: 200 len: 1242 microversion: 2.1 time: 0.074193 Jul 27 20:47:42.566816 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1961/3903] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:47:42 2022] GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801 => generated 1242 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:47:43.499970 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ba67a3b6-609f-4259-806c-aafb17ceba25 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:43.500458 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ba67a3b6-609f-4259-806c-aafb17ceba25 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:43.507421 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba67a3b6-609f-4259-806c-aafb17ceba25 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:43.507874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba67a3b6-609f-4259-806c-aafb17ceba25 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:43.508636 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba67a3b6-609f-4259-806c-aafb17ceba25 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:43.509110 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba67a3b6-609f-4259-806c-aafb17ceba25 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:43.522497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-ba67a3b6-609f-4259-806c-aafb17ceba25 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] HTTP exception thrown: Instance 9989ae14-684b-494e-bc1d-df4a26faf42b could not be found. Jul 27 20:47:43.524027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ba67a3b6-609f-4259-806c-aafb17ceba25 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Request method failure captured: Jul 27 20:47:43.524027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b HTTP/1.1 Jul 27 20:47:43.524027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:47:43.524027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:47:43.524027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:47:43.524027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:47:43.524027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:47:43.524027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:47:43.524027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:47:43.524027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:47:43.524027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4ZszolpoHLv4ymfn-jDIXXwrtat6zA6fU8pUvlIxQFFvg2akujyL-RcTkc0AHUPtL9FfHVEqLLG1P3QFKYKGA6GTuRef7uYyPgJ3tvotGw9j0tfDvIc-GZxx3Nrm1QaM2Jm97CejtJa-hGoo2CtA1AtsmrF2YR6vqcqJ-OZzLMovey0 Jul 27 20:47:43.524027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:47:43.524027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:47:43.524027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:47:43.524027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:47:43.524027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 20:47:43.524027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:47:43.524027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:47:43.524027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:47:43.524027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:47:43.524027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:47:43.524027 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:47:43.525904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec01b599458b451e8d04a428c1c33513", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:47:43.525904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:47:43.525904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:47:43.525904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:47:43.525904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:47:43.525904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:47:43.525904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:47:43.525904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: b734a345bfe5483d9a5a1e35d89c935b Jul 27 20:47:43.525904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:47:43.525904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:47:43.525904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Instance 9989ae14-684b-494e-bc1d-df4a26faf42b could not be found. Jul 27 20:47:43.525904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'id': '9989ae14-684b-494e-bc1d-df4a26faf42b'} Jul 27 20:47:43.529773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:47:43.529773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:47:43.529773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:47:43.529773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:47:43.529773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:47:43.529773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:47:43.529773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:47:43.529773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:47:43.529773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:47:43.529773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:47:43.529773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9989ae14-684b-494e-bc1d-df4a26faf42b could not be found. Jul 27 20:47:43.529773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:43.529773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:47:43.529773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:43.529773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:47:43.529773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:47:43.529773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:47:43.529773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:47:43.529773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:47:43.529773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:47:43.531414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:47:43.531414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 20:47:43.531414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 20:47:43.531414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 20:47:43.531414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 20:47:43.531414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:47:43.531414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:47:43.531414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:47:43.531414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:47:43.531414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9989ae14-684b-494e-bc1d-df4a26faf42b could not be found. Jul 27 20:47:43.531414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:43.531414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:47:43.531414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:43.531414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:47:43.531414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:47:43.531414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:47:43.531414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:47:43.531414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:47:43.531414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9989ae14-684b-494e-bc1d-df4a26faf42b could not be found. Jul 27 20:47:43.531414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:43.533071 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ba67a3b6-609f-4259-806c-aafb17ceba25 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Returning 404 to user: Instance 9989ae14-684b-494e-bc1d-df4a26faf42b could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:47:43.533071 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ba67a3b6-609f-4259-806c-aafb17ceba25 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 404 len: 111 microversion: 2.20 time: 0.029894 Jul 27 20:47:43.533071 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1943/3904] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Jul 27 20:47:43 2022] DELETE /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:47:43.533707 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-de5019f8-9159-4c62-9222-83a03846ad0c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:43.534327 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-de5019f8-9159-4c62-9222-83a03846ad0c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: 9989ae14-684b-494e-bc1d-df4a26faf42b] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:43.541639 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-de5019f8-9159-4c62-9222-83a03846ad0c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:43.542096 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-de5019f8-9159-4c62-9222-83a03846ad0c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:43.542866 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-de5019f8-9159-4c62-9222-83a03846ad0c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:43.543311 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-de5019f8-9159-4c62-9222-83a03846ad0c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:43.556629 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-de5019f8-9159-4c62-9222-83a03846ad0c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] HTTP exception thrown: Instance 9989ae14-684b-494e-bc1d-df4a26faf42b could not be found. Jul 27 20:47:43.558334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-de5019f8-9159-4c62-9222-83a03846ad0c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Request method failure captured: Jul 27 20:47:43.558334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b HTTP/1.1 Jul 27 20:47:43.558334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:47:43.558334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:47:43.558334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:47:43.558334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:47:43.558334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:47:43.558334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:47:43.558334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:47:43.558334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:47:43.558334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4ZszolpoHLv4ymfn-jDIXXwrtat6zA6fU8pUvlIxQFFvg2akujyL-RcTkc0AHUPtL9FfHVEqLLG1P3QFKYKGA6GTuRef7uYyPgJ3tvotGw9j0tfDvIc-GZxx3Nrm1QaM2Jm97CejtJa-hGoo2CtA1AtsmrF2YR6vqcqJ-OZzLMovey0 Jul 27 20:47:43.558334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:47:43.558334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:47:43.558334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:47:43.558334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:47:43.558334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 20:47:43.558334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:47:43.558334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:47:43.558334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:47:43.558334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:47:43.558334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:47:43.558334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:47:43.560314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec01b599458b451e8d04a428c1c33513", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:47:43.560314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:47:43.560314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:47:43.560314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:47:43.560314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:47:43.560314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:47:43.560314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:47:43.560314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: b734a345bfe5483d9a5a1e35d89c935b Jul 27 20:47:43.560314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:47:43.560314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:47:43.560314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Instance 9989ae14-684b-494e-bc1d-df4a26faf42b could not be found. Jul 27 20:47:43.560314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'id': '9989ae14-684b-494e-bc1d-df4a26faf42b'} Jul 27 20:47:43.561511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:47:43.561511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:47:43.561511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:47:43.561511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:47:43.561511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:47:43.561511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:47:43.561511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:47:43.561511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:47:43.561511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:47:43.561511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:47:43.561511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9989ae14-684b-494e-bc1d-df4a26faf42b could not be found. Jul 27 20:47:43.561511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:47:43.561511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:47:43.561511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:47:43.561511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:47:43.561511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:47:43.561511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:47:43.561511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:47:43.561511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:47:43.561511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:47:43.563405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:47:43.563405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:47:43.563405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:47:43.563405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:47:43.563405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:47:43.563405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:47:43.563405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:47:43.563405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9989ae14-684b-494e-bc1d-df4a26faf42b could not be found. Jul 27 20:47:43.563405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:47:43.563405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:47:43.563405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:47:43.563405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:47:43.563405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:47:43.563405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:47:43.563405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:47:43.563405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:47:43.563405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9989ae14-684b-494e-bc1d-df4a26faf42b could not be found. Jul 27 20:47:43.563405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:47:43.564858 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-de5019f8-9159-4c62-9222-83a03846ad0c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Returning 404 to user: Instance 9989ae14-684b-494e-bc1d-df4a26faf42b could not be found. {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:47:43.564858 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-de5019f8-9159-4c62-9222-83a03846ad0c tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b" status: 404 len: 111 microversion: 2.20 time: 0.029767 Jul 27 20:47:43.564858 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1962/3905] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:47:43 2022] GET /compute/v2.1/servers/9989ae14-684b-494e-bc1d-df4a26faf42b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 27 20:47:43.586982 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b8cfeff3-e7c2-4eee-9d54-b17f68ecdf3b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:43.587630 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b8cfeff3-e7c2-4eee-9d54-b17f68ecdf3b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:43.593598 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b8cfeff3-e7c2-4eee-9d54-b17f68ecdf3b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:43.594040 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b8cfeff3-e7c2-4eee-9d54-b17f68ecdf3b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:43.594827 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b8cfeff3-e7c2-4eee-9d54-b17f68ecdf3b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:43.595248 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b8cfeff3-e7c2-4eee-9d54-b17f68ecdf3b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:43.673718 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b8cfeff3-e7c2-4eee-9d54-b17f68ecdf3b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:47:43.683318 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b8cfeff3-e7c2-4eee-9d54-b17f68ecdf3b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801" status: 200 len: 1294 microversion: 2.1 time: 0.100091 Jul 27 20:47:43.684333 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1944/3906] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:47:43 2022] GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801 => generated 1294 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:47:44.716360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9b132065-8798-4bfa-8a72-a177279e8e9d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:44.717162 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9b132065-8798-4bfa-8a72-a177279e8e9d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:44.728644 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9b132065-8798-4bfa-8a72-a177279e8e9d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:44.729290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9b132065-8798-4bfa-8a72-a177279e8e9d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:44.729447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4dd71f98-ea19-435e-aee2-f769a2d4da94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:44.730011 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4dd71f98-ea19-435e-aee2-f769a2d4da94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:44.730658 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9b132065-8798-4bfa-8a72-a177279e8e9d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:44.731333 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9b132065-8798-4bfa-8a72-a177279e8e9d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:44.738907 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4dd71f98-ea19-435e-aee2-f769a2d4da94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:44.739360 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4dd71f98-ea19-435e-aee2-f769a2d4da94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:44.740161 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4dd71f98-ea19-435e-aee2-f769a2d4da94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:44.740603 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4dd71f98-ea19-435e-aee2-f769a2d4da94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:44.754590 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-4dd71f98-ea19-435e-aee2-f769a2d4da94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] HTTP exception thrown: Instance d725356e-73a3-486b-b590-0324916667ff could not be found. Jul 27 20:47:44.756163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4dd71f98-ea19-435e-aee2-f769a2d4da94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Request method failure captured: Jul 27 20:47:44.756163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff HTTP/1.1 Jul 27 20:47:44.756163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:47:44.756163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:47:44.756163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:47:44.756163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:47:44.756163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:47:44.756163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:47:44.756163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:47:44.756163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:47:44.756163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4ZszolpoHLv4ymfn-jDIXXwrtat6zA6fU8pUvlIxQFFvg2akujyL-RcTkc0AHUPtL9FfHVEqLLG1P3QFKYKGA6GTuRef7uYyPgJ3tvotGw9j0tfDvIc-GZxx3Nrm1QaM2Jm97CejtJa-hGoo2CtA1AtsmrF2YR6vqcqJ-OZzLMovey0 Jul 27 20:47:44.756163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:47:44.756163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:47:44.756163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:47:44.756163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:47:44.756163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 20:47:44.756163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:47:44.756163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:47:44.756163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:47:44.756163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:47:44.756163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:47:44.756163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:47:44.758099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec01b599458b451e8d04a428c1c33513", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:47:44.758099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:47:44.758099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:47:44.758099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:47:44.758099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:47:44.758099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:47:44.758099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:47:44.758099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: b734a345bfe5483d9a5a1e35d89c935b Jul 27 20:47:44.758099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:47:44.758099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:47:44.758099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Instance d725356e-73a3-486b-b590-0324916667ff could not be found. Jul 27 20:47:44.758099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'id': 'd725356e-73a3-486b-b590-0324916667ff'} Jul 27 20:47:44.758954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:47:44.758954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:47:44.758954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:47:44.758954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:47:44.758954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:47:44.758954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:47:44.758954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:47:44.758954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:47:44.758954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:47:44.758954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:47:44.758954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d725356e-73a3-486b-b590-0324916667ff could not be found. Jul 27 20:47:44.758954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:44.758954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:47:44.758954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:44.758954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:47:44.758954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:47:44.758954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:47:44.758954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:47:44.758954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:47:44.758954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:47:44.760357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:47:44.760357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 20:47:44.760357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 20:47:44.760357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 20:47:44.760357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 20:47:44.760357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:47:44.760357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:47:44.760357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:47:44.760357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:47:44.760357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d725356e-73a3-486b-b590-0324916667ff could not be found. Jul 27 20:47:44.760357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:44.760357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:47:44.760357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:44.760357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:47:44.760357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:47:44.760357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:47:44.760357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:47:44.760357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:47:44.760357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d725356e-73a3-486b-b590-0324916667ff could not be found. Jul 27 20:47:44.760357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:44.761885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4dd71f98-ea19-435e-aee2-f769a2d4da94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Returning 404 to user: Instance d725356e-73a3-486b-b590-0324916667ff could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:47:44.761885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4dd71f98-ea19-435e-aee2-f769a2d4da94 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 404 len: 111 microversion: 2.20 time: 0.032125 Jul 27 20:47:44.761885 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1945/3907] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Jul 27 20:47:44 2022] DELETE /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 27 20:47:44.766798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8666498a-d74d-457c-8f05-83d798414f99 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:44.767523 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8666498a-d74d-457c-8f05-83d798414f99 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] [instance: d725356e-73a3-486b-b590-0324916667ff] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:44.774226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8666498a-d74d-457c-8f05-83d798414f99 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:44.774678 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8666498a-d74d-457c-8f05-83d798414f99 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:44.775461 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8666498a-d74d-457c-8f05-83d798414f99 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:44.775906 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8666498a-d74d-457c-8f05-83d798414f99 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:44.791892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-8666498a-d74d-457c-8f05-83d798414f99 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] HTTP exception thrown: Instance d725356e-73a3-486b-b590-0324916667ff could not be found. Jul 27 20:47:44.793646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8666498a-d74d-457c-8f05-83d798414f99 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Request method failure captured: Jul 27 20:47:44.793646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff HTTP/1.1 Jul 27 20:47:44.793646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:47:44.793646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:47:44.793646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:47:44.793646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:47:44.793646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:47:44.793646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:47:44.793646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:47:44.793646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:47:44.793646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4ZszolpoHLv4ymfn-jDIXXwrtat6zA6fU8pUvlIxQFFvg2akujyL-RcTkc0AHUPtL9FfHVEqLLG1P3QFKYKGA6GTuRef7uYyPgJ3tvotGw9j0tfDvIc-GZxx3Nrm1QaM2Jm97CejtJa-hGoo2CtA1AtsmrF2YR6vqcqJ-OZzLMovey0 Jul 27 20:47:44.793646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:47:44.793646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:47:44.793646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:47:44.793646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:47:44.793646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Openstack-Nova-Api-Version: 2.20 Jul 27 20:47:44.793646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:47:44.793646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:47:44.793646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:47:44.793646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:47:44.793646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:47:44.793646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:47:44.795213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ec01b599458b451e8d04a428c1c33513", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ec01b599458b451e8d04a428c1c33513"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:47:44.795213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:47:44.795213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: ec01b599458b451e8d04a428c1c33513 Jul 27 20:47:44.795213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2075321023 Jul 27 20:47:44.795213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:47:44.795213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:47:44.795213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:47:44.795213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: b734a345bfe5483d9a5a1e35d89c935b Jul 27 20:47:44.795213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2075321023-project Jul 27 20:47:44.795213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:47:44.795213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Instance d725356e-73a3-486b-b590-0324916667ff could not be found. Jul 27 20:47:44.795213 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'id': 'd725356e-73a3-486b-b590-0324916667ff'} Jul 27 20:47:44.796553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:47:44.796553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:47:44.796553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:47:44.796553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:47:44.796553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:47:44.796553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:47:44.796553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:47:44.796553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:47:44.796553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:47:44.796553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:47:44.796553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d725356e-73a3-486b-b590-0324916667ff could not be found. Jul 27 20:47:44.796553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:44.796553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:47:44.796553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:44.796553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:47:44.796553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:47:44.796553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:47:44.796553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:47:44.796553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:47:44.796553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:47:44.798083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:47:44.798083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:47:44.798083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:47:44.798083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:47:44.798083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:47:44.798083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:47:44.798083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:47:44.798083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d725356e-73a3-486b-b590-0324916667ff could not be found. Jul 27 20:47:44.798083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:44.798083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:47:44.798083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:44.798083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:47:44.798083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:47:44.798083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:47:44.798083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:47:44.798083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:47:44.798083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d725356e-73a3-486b-b590-0324916667ff could not be found. Jul 27 20:47:44.798083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:44.799518 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8666498a-d74d-457c-8f05-83d798414f99 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] Returning 404 to user: Instance d725356e-73a3-486b-b590-0324916667ff could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:47:44.799518 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8666498a-d74d-457c-8f05-83d798414f99 tempest-AttachVolumeShelveTestJSON-2075321023 tempest-AttachVolumeShelveTestJSON-2075321023-project] 10.222.0.65 "GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff" status: 404 len: 111 microversion: 2.20 time: 0.032066 Jul 27 20:47:44.799518 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1946/3908] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Jul 27 20:47:44 2022] GET /compute/v2.1/servers/d725356e-73a3-486b-b590-0324916667ff => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:47:44.900743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9b132065-8798-4bfa-8a72-a177279e8e9d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:47:44.908562 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9b132065-8798-4bfa-8a72-a177279e8e9d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801" status: 200 len: 1368 microversion: 2.1 time: 0.206938 Jul 27 20:47:44.909169 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1963/3909] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:47:44 2022] GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801 => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:47:45.932264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6078fe43-4ba6-4513-b131-262ba72d9fff tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:45.933156 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6078fe43-4ba6-4513-b131-262ba72d9fff tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:45.941945 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6078fe43-4ba6-4513-b131-262ba72d9fff tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:45.942387 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6078fe43-4ba6-4513-b131-262ba72d9fff tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:45.943411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6078fe43-4ba6-4513-b131-262ba72d9fff tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:45.943938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6078fe43-4ba6-4513-b131-262ba72d9fff tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:46.056094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-0ddab906-5c27-4d0e-b899-98596b94ab13 req-9313f9a3-cf35-414b-9413-96b7e3aed02e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a8f2d6b-aa7f-486c-95dd-4134388ea801", "tag": "9af05df8-144b-4d6c-8306-f3d82146ca74"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:47:46.070441 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-0ddab906-5c27-4d0e-b899-98596b94ab13 req-9313f9a3-cf35-414b-9413-96b7e3aed02e service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:46.071012 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-0ddab906-5c27-4d0e-b899-98596b94ab13 req-9313f9a3-cf35-414b-9413-96b7e3aed02e service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:46.084753 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-0ddab906-5c27-4d0e-b899-98596b94ab13 req-9313f9a3-cf35-414b-9413-96b7e3aed02e service nova] Creating event network-changed:9af05df8-144b-4d6c-8306-f3d82146ca74 for instance 6a8f2d6b-aa7f-486c-95dd-4134388ea801 on hv-cinder-79987 Jul 27 20:47:46.090609 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-0ddab906-5c27-4d0e-b899-98596b94ab13 req-9313f9a3-cf35-414b-9413-96b7e3aed02e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038255 Jul 27 20:47:46.091591 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1964/3910] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:47:46.199580 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6078fe43-4ba6-4513-b131-262ba72d9fff tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:47:46.207754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6078fe43-4ba6-4513-b131-262ba72d9fff tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801" status: 200 len: 1368 microversion: 2.1 time: 0.280694 Jul 27 20:47:46.208304 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1947/3911] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:47:45 2022] GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801 => generated 1368 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:47:47.229946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-07e28463-ae4b-47fe-bf26-04829eea5022 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:47.230779 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-07e28463-ae4b-47fe-bf26-04829eea5022 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:47.237270 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-07e28463-ae4b-47fe-bf26-04829eea5022 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:47.237777 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-07e28463-ae4b-47fe-bf26-04829eea5022 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:47.238636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-07e28463-ae4b-47fe-bf26-04829eea5022 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:47.239071 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-07e28463-ae4b-47fe-bf26-04829eea5022 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:47.374123 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-07e28463-ae4b-47fe-bf26-04829eea5022 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:47:47.382127 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-07e28463-ae4b-47fe-bf26-04829eea5022 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801" status: 200 len: 1368 microversion: 2.1 time: 0.156794 Jul 27 20:47:47.393006 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1965/3912] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:47:47 2022] GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:47:48.404216 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-73a733f3-6a06-4bec-9a2e-2976395dc535 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:48.404938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-73a733f3-6a06-4bec-9a2e-2976395dc535 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:48.412043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73a733f3-6a06-4bec-9a2e-2976395dc535 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:48.412560 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73a733f3-6a06-4bec-9a2e-2976395dc535 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:48.413419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73a733f3-6a06-4bec-9a2e-2976395dc535 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:48.413998 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73a733f3-6a06-4bec-9a2e-2976395dc535 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:48.564091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-73a733f3-6a06-4bec-9a2e-2976395dc535 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:47:48.572075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-73a733f3-6a06-4bec-9a2e-2976395dc535 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801" status: 200 len: 1368 microversion: 2.1 time: 0.171581 Jul 27 20:47:48.573203 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1948/3913] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:47:48 2022] GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:47:49.593772 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9fb99cb8-4fd8-4808-9743-611486e9c6be tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:49.594418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9fb99cb8-4fd8-4808-9743-611486e9c6be tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:49.601477 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9fb99cb8-4fd8-4808-9743-611486e9c6be tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:49.601987 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9fb99cb8-4fd8-4808-9743-611486e9c6be tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:49.602791 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9fb99cb8-4fd8-4808-9743-611486e9c6be tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:49.603236 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9fb99cb8-4fd8-4808-9743-611486e9c6be tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:49.739782 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9fb99cb8-4fd8-4808-9743-611486e9c6be tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:47:49.747246 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9fb99cb8-4fd8-4808-9743-611486e9c6be tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801" status: 200 len: 1368 microversion: 2.1 time: 0.157298 Jul 27 20:47:49.747811 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1966/3914] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:47:49 2022] GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:47:50.170320 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9174e3f9-79fc-44ec-94d9-7196522367ce tempest-VolumesGetTestJSON-378130101 tempest-VolumesGetTestJSON-378130101-project] Action: 'create', calling method: .version_select at 0x7fc7f005f940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-931251855", "metadata": {"Type": "work"}}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:47:50.458821 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9174e3f9-79fc-44ec-94d9-7196522367ce tempest-VolumesGetTestJSON-378130101 tempest-VolumesGetTestJSON-378130101-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.414362 Jul 27 20:47:50.459627 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1949/3915] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Jul 27 20:47:50 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 416 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 27 20:47:50.472521 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7e38fd5d-f660-4c6a-a035-c63f38af8210 tempest-VolumesGetTestJSON-378130101 tempest-VolumesGetTestJSON-378130101-project] Calling method '.version_select at 0x7fc7eaf80a60>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:50.521455 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7e38fd5d-f660-4c6a-a035-c63f38af8210 tempest-VolumesGetTestJSON-378130101 tempest-VolumesGetTestJSON-378130101-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/700f602f-d033-4d00-99d7-b7386155e825" status: 200 len: 352 microversion: 2.1 time: 0.053383 Jul 27 20:47:50.522267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1967/3916] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Jul 27 20:47:50 2022] GET /compute/v2.1/os-volumes/700f602f-d033-4d00-99d7-b7386155e825 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:47:50.767866 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2488ddf2-eeaf-4e7e-aa18-cbede939f0bc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:50.768398 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2488ddf2-eeaf-4e7e-aa18-cbede939f0bc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:50.774861 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2488ddf2-eeaf-4e7e-aa18-cbede939f0bc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:50.775315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2488ddf2-eeaf-4e7e-aa18-cbede939f0bc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:50.776079 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2488ddf2-eeaf-4e7e-aa18-cbede939f0bc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:50.776529 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2488ddf2-eeaf-4e7e-aa18-cbede939f0bc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:50.902521 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2488ddf2-eeaf-4e7e-aa18-cbede939f0bc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:47:50.910327 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2488ddf2-eeaf-4e7e-aa18-cbede939f0bc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801" status: 200 len: 1368 microversion: 2.1 time: 0.146481 Jul 27 20:47:50.910876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1950/3917] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:47:50 2022] GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:47:51.536918 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e7dcd971-01a5-48d2-b1ba-95e3a13e4f64 tempest-VolumesGetTestJSON-378130101 tempest-VolumesGetTestJSON-378130101-project] Calling method '.version_select at 0x7fc7f0250670>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:51.592588 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e7dcd971-01a5-48d2-b1ba-95e3a13e4f64 tempest-VolumesGetTestJSON-378130101 tempest-VolumesGetTestJSON-378130101-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/700f602f-d033-4d00-99d7-b7386155e825" status: 200 len: 353 microversion: 2.1 time: 0.060704 Jul 27 20:47:51.593288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1968/3918] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Jul 27 20:47:51 2022] GET /compute/v2.1/os-volumes/700f602f-d033-4d00-99d7-b7386155e825 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:47:51.606251 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-04fa009b-d490-4887-83ff-5f4a52f2a641 tempest-VolumesGetTestJSON-378130101 tempest-VolumesGetTestJSON-378130101-project] Calling method '.version_select at 0x7fc7eae11f70>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:51.652778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-04fa009b-d490-4887-83ff-5f4a52f2a641 tempest-VolumesGetTestJSON-378130101 tempest-VolumesGetTestJSON-378130101-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/700f602f-d033-4d00-99d7-b7386155e825" status: 200 len: 353 microversion: 2.1 time: 0.050206 Jul 27 20:47:51.653450 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1951/3919] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Jul 27 20:47:51 2022] GET /compute/v2.1/os-volumes/700f602f-d033-4d00-99d7-b7386155e825 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:47:51.671775 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3c7d0fab-b305-4a79-a0e8-d0206855a8b5 tempest-VolumesGetTestJSON-378130101 tempest-VolumesGetTestJSON-378130101-project] Calling method '.version_select at 0x7fc7eaefd3a0>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:51.732509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3c7d0fab-b305-4a79-a0e8-d0206855a8b5 tempest-VolumesGetTestJSON-378130101 tempest-VolumesGetTestJSON-378130101-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/700f602f-d033-4d00-99d7-b7386155e825" status: 202 len: 0 microversion: 2.1 time: 0.064371 Jul 27 20:47:51.733097 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1969/3920] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Jul 27 20:47:51 2022] DELETE /compute/v2.1/os-volumes/700f602f-d033-4d00-99d7-b7386155e825 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:47:51.741128 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-951bd9ac-e1fc-4199-839f-7d8da86e4279 tempest-VolumesGetTestJSON-378130101 tempest-VolumesGetTestJSON-378130101-project] Calling method '.version_select at 0x7fc7f0503ee0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:51.791279 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-951bd9ac-e1fc-4199-839f-7d8da86e4279 tempest-VolumesGetTestJSON-378130101 tempest-VolumesGetTestJSON-378130101-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/700f602f-d033-4d00-99d7-b7386155e825" status: 200 len: 352 microversion: 2.1 time: 0.053988 Jul 27 20:47:51.791847 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1952/3921] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Jul 27 20:47:51 2022] GET /compute/v2.1/os-volumes/700f602f-d033-4d00-99d7-b7386155e825 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:47:51.931003 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f7557345-3ba1-4f6f-aeb3-5223ecbca68e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:51.931619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f7557345-3ba1-4f6f-aeb3-5223ecbca68e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:51.937522 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f7557345-3ba1-4f6f-aeb3-5223ecbca68e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:51.937981 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f7557345-3ba1-4f6f-aeb3-5223ecbca68e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:51.938736 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f7557345-3ba1-4f6f-aeb3-5223ecbca68e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:51.939180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f7557345-3ba1-4f6f-aeb3-5223ecbca68e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:52.077412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f7557345-3ba1-4f6f-aeb3-5223ecbca68e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:47:52.085199 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f7557345-3ba1-4f6f-aeb3-5223ecbca68e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801" status: 200 len: 1368 microversion: 2.1 time: 0.157984 Jul 27 20:47:52.085778 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1970/3922] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:47:51 2022] GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:47:52.802117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:47:52.803255 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=6 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:47:52.807820 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-be90aee3-83e4-46d6-852b-852b768fe56a tempest-VolumesGetTestJSON-378130101 tempest-VolumesGetTestJSON-378130101-project] Calling method '.version_select at 0x7fc7eae14ca0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:52.838378 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-be90aee3-83e4-46d6-852b-852b768fe56a tempest-VolumesGetTestJSON-378130101 tempest-VolumesGetTestJSON-378130101-project] HTTP exception thrown: Volume 700f602f-d033-4d00-99d7-b7386155e825 could not be found. Jul 27 20:47:52.840464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-be90aee3-83e4-46d6-852b-852b768fe56a tempest-VolumesGetTestJSON-378130101 tempest-VolumesGetTestJSON-378130101-project] Request method failure captured: Jul 27 20:47:52.840464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/os-volumes/700f602f-d033-4d00-99d7-b7386155e825 HTTP/1.1 Jul 27 20:47:52.840464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:47:52.840464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:47:52.840464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:47:52.840464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:47:52.840464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:47:52.840464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:47:52.840464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:47:52.840464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:47:52.840464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4aR1F33vVLCfmWq7AGgUcXR_N07bHw9oA28GQa__DicPq4rGUwcpBNjQendXcWKfKQBC_scMx7g5_KJCRVD_9ne7ksSq1dHYJlsjmIhQm-xeL1FJKWJUuZhS_UmsRJC1BkMgqc-Jbkt70Q6lUdLky3PtU5psr54vJNGTso3H2hPflJs Jul 27 20:47:52.840464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:47:52.840464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:47:52.840464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:47:52.840464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:47:52.840464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:47:52.840464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:47:52.840464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: 4ab10a5809ed4b3eab991d540b6e5ab0 Jul 27 20:47:52.840464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-VolumesGetTestJSON-378130101 Jul 27 20:47:52.840464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:47:52.840464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:47:52.842287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4ab10a5809ed4b3eab991d540b6e5ab0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4ab10a5809ed4b3eab991d540b6e5ab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4ab10a5809ed4b3eab991d540b6e5ab0", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4ab10a5809ed4b3eab991d540b6e5ab0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:47:52.842287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-VolumesGetTestJSON-378130101 Jul 27 20:47:52.842287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 4ab10a5809ed4b3eab991d540b6e5ab0 Jul 27 20:47:52.842287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-VolumesGetTestJSON-378130101 Jul 27 20:47:52.842287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-VolumesGetTestJSON-378130101-project Jul 27 20:47:52.842287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:47:52.842287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:47:52.842287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: 1982c1753d544a89bdee471d329aefde Jul 27 20:47:52.842287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-VolumesGetTestJSON-378130101-project Jul 27 20:47:52.842287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: Jul 27 20:47:52.842287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Volume 700f602f-d033-4d00-99d7-b7386155e825 could not be found. Jul 27 20:47:52.842287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'id': '700f602f-d033-4d00-99d7-b7386155e825'} Jul 27 20:47:52.842287 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:47:52.843324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:47:52.843324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:47:52.843324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:47:52.843324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 20:47:52.843324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 20:47:52.843324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 20:47:52.843324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 20:47:52.843324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 20:47:52.843324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 20:47:52.843324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 20:47:52.843324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 20:47:52.843324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:47:52.843324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:47:52.843324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:47:52.843324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:47:52.843324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 700f602f-d033-4d00-99d7-b7386155e825 could not be found. (HTTP 404) (Request-ID: req-b75a8960-c443-4b38-a5c8-27f1091f3829) Jul 27 20:47:52.843324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:52.843324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:47:52.843324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:52.844798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:47:52.844798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 27 20:47:52.844798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 27 20:47:52.844798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 27 20:47:52.844798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 27 20:47:52.844798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 27 20:47:52.844798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 27 20:47:52.844798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 27 20:47:52.844798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 27 20:47:52.844798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 27 20:47:52.844798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 27 20:47:52.844798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 27 20:47:52.844798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 27 20:47:52.844798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 27 20:47:52.844798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 27 20:47:52.844798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 27 20:47:52.844798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 27 20:47:52.844798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 27 20:47:52.844798 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 27 20:47:52.846374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 27 20:47:52.846374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 27 20:47:52.846374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 27 20:47:52.846374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 27 20:47:52.846374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 700f602f-d033-4d00-99d7-b7386155e825 could not be found. Jul 27 20:47:52.846374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:52.846374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:47:52.846374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:52.846374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:47:52.846374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:47:52.846374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:47:52.846374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:47:52.846374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:47:52.846374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 27 20:47:52.846374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 27 20:47:52.846374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:47:52.846374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:47:52.846374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 27 20:47:52.846374 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:47:52.848942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 700f602f-d033-4d00-99d7-b7386155e825 could not be found. Jul 27 20:47:52.848942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:52.848942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:47:52.848942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:52.848942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:47:52.848942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:47:52.848942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:47:52.848942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:47:52.848942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:47:52.848942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 700f602f-d033-4d00-99d7-b7386155e825 could not be found. Jul 27 20:47:52.848942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:47:52.848942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-be90aee3-83e4-46d6-852b-852b768fe56a tempest-VolumesGetTestJSON-378130101 tempest-VolumesGetTestJSON-378130101-project] Returning 404 to user: Volume 700f602f-d033-4d00-99d7-b7386155e825 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:47:52.848942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-be90aee3-83e4-46d6-852b-852b768fe56a tempest-VolumesGetTestJSON-378130101 tempest-VolumesGetTestJSON-378130101-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/700f602f-d033-4d00-99d7-b7386155e825" status: 404 len: 109 microversion: 2.1 time: 0.040890 Jul 27 20:47:52.848942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1953/3923] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Jul 27 20:47:52 2022] GET /compute/v2.1/os-volumes/700f602f-d033-4d00-99d7-b7386155e825 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:47:53.106510 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3d38d7a5-5dbe-48f1-8fca-6494f8adaddd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:53.113519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3d38d7a5-5dbe-48f1-8fca-6494f8adaddd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:53.117728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=6 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:47:53.121907 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3d38d7a5-5dbe-48f1-8fca-6494f8adaddd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:53.122761 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3d38d7a5-5dbe-48f1-8fca-6494f8adaddd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:53.123779 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3d38d7a5-5dbe-48f1-8fca-6494f8adaddd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:53.124394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3d38d7a5-5dbe-48f1-8fca-6494f8adaddd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:53.313641 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3d38d7a5-5dbe-48f1-8fca-6494f8adaddd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:47:53.322754 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3d38d7a5-5dbe-48f1-8fca-6494f8adaddd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801" status: 200 len: 1368 microversion: 2.1 time: 0.220444 Jul 27 20:47:53.323446 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1971/3924] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:47:53 2022] GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:47:54.345448 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c5bd3c2f-9128-47cf-a242-5a42f39295bb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:54.346061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c5bd3c2f-9128-47cf-a242-5a42f39295bb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:54.352706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5bd3c2f-9128-47cf-a242-5a42f39295bb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:54.353969 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5bd3c2f-9128-47cf-a242-5a42f39295bb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:54.355159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5bd3c2f-9128-47cf-a242-5a42f39295bb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:54.355603 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5bd3c2f-9128-47cf-a242-5a42f39295bb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:54.506048 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c5bd3c2f-9128-47cf-a242-5a42f39295bb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:47:54.514073 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c5bd3c2f-9128-47cf-a242-5a42f39295bb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801" status: 200 len: 1368 microversion: 2.1 time: 0.172795 Jul 27 20:47:54.514899 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1954/3925] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:47:54 2022] GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:47:54.545230 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-11764b39-7dbf-4dc5-823b-7ce5857ad659 req-dd3cf148-f8e3-4b88-8ae4-189dc2f5c62f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8f2d6b-aa7f-486c-95dd-4134388ea801", "name": "network-vif-plugged", "status": "completed", "tag": "9af05df8-144b-4d6c-8306-f3d82146ca74"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:47:54.558120 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-11764b39-7dbf-4dc5-823b-7ce5857ad659 req-dd3cf148-f8e3-4b88-8ae4-189dc2f5c62f service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:54.558561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-11764b39-7dbf-4dc5-823b-7ce5857ad659 req-dd3cf148-f8e3-4b88-8ae4-189dc2f5c62f service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:54.571053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-11764b39-7dbf-4dc5-823b-7ce5857ad659 req-dd3cf148-f8e3-4b88-8ae4-189dc2f5c62f service nova] Creating event network-vif-plugged:9af05df8-144b-4d6c-8306-f3d82146ca74 for instance 6a8f2d6b-aa7f-486c-95dd-4134388ea801 on hv-cinder-79987 Jul 27 20:47:54.576108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-11764b39-7dbf-4dc5-823b-7ce5857ad659 req-dd3cf148-f8e3-4b88-8ae4-189dc2f5c62f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035643 Jul 27 20:47:54.577153 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1972/3926] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:47:55.535025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cd5deeea-9021-4e6a-a364-ad027c6dc671 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:55.535894 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cd5deeea-9021-4e6a-a364-ad027c6dc671 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:55.542542 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd5deeea-9021-4e6a-a364-ad027c6dc671 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:55.543001 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd5deeea-9021-4e6a-a364-ad027c6dc671 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:55.543781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd5deeea-9021-4e6a-a364-ad027c6dc671 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:55.544222 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd5deeea-9021-4e6a-a364-ad027c6dc671 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:55.693010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cd5deeea-9021-4e6a-a364-ad027c6dc671 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:47:55.701085 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cd5deeea-9021-4e6a-a364-ad027c6dc671 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801" status: 200 len: 1368 microversion: 2.1 time: 0.170649 Jul 27 20:47:55.701652 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1955/3927] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:47:55 2022] GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:47:56.723949 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b11e414d-b1a1-4966-a7fb-a852197b7bb4 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:56.724657 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b11e414d-b1a1-4966-a7fb-a852197b7bb4 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:56.731295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b11e414d-b1a1-4966-a7fb-a852197b7bb4 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:56.731756 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b11e414d-b1a1-4966-a7fb-a852197b7bb4 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:56.732529 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b11e414d-b1a1-4966-a7fb-a852197b7bb4 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:56.733261 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b11e414d-b1a1-4966-a7fb-a852197b7bb4 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:56.872089 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b11e414d-b1a1-4966-a7fb-a852197b7bb4 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:47:56.881818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b11e414d-b1a1-4966-a7fb-a852197b7bb4 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801" status: 200 len: 1559 microversion: 2.1 time: 0.163151 Jul 27 20:47:56.883551 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1973/3928] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:47:56 2022] GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:47:56.903760 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e2c42448-5598-44f6-b0b0-7e01b84c1325 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:47:56.904318 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e2c42448-5598-44f6-b0b0-7e01b84c1325 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:47:56.911025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2c42448-5598-44f6-b0b0-7e01b84c1325 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:56.911474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2c42448-5598-44f6-b0b0-7e01b84c1325 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:56.912243 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2c42448-5598-44f6-b0b0-7e01b84c1325 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:56.912675 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2c42448-5598-44f6-b0b0-7e01b84c1325 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:56.997242 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e2c42448-5598-44f6-b0b0-7e01b84c1325 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097103 Jul 27 20:47:56.998058 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1956/3929] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Jul 27 20:47:56 2022] GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:47:57.986988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-b114fd3e-704b-4ba1-bd50-29492ad11206 req-e69584be-c813-4069-a5f3-0fc6335b9487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a8f2d6b-aa7f-486c-95dd-4134388ea801", "tag": "9af05df8-144b-4d6c-8306-f3d82146ca74"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:47:57.999982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-b114fd3e-704b-4ba1-bd50-29492ad11206 req-e69584be-c813-4069-a5f3-0fc6335b9487 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:47:58.000663 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-b114fd3e-704b-4ba1-bd50-29492ad11206 req-e69584be-c813-4069-a5f3-0fc6335b9487 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:47:58.013810 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-b114fd3e-704b-4ba1-bd50-29492ad11206 req-e69584be-c813-4069-a5f3-0fc6335b9487 service nova] Creating event network-changed:9af05df8-144b-4d6c-8306-f3d82146ca74 for instance 6a8f2d6b-aa7f-486c-95dd-4134388ea801 on hv-cinder-79987 Jul 27 20:47:58.019636 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-b114fd3e-704b-4ba1-bd50-29492ad11206 req-e69584be-c813-4069-a5f3-0fc6335b9487 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036436 Jul 27 20:47:58.020632 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1974/3930] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:48:16.953560 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:48:16.954311 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:48:16.958231 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f02a6873-788f-4dc6-861e-2df6c31f703e tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-252358697", "imageRef": "fb689bea-534a-4aac-bec3-8f55591dba58", "flavorRef": "452", "networks": [{"uuid": "27ab865f-f371-44cf-b1e3-ad43d3c4f6ef"}]}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:48:17.011844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-f02a6873-788f-4dc6-861e-2df6c31f703e tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] validate_networks() for [('27ab865f-f371-44cf-b1e3-ad43d3c4f6ef', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:48:17.359147 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-f02a6873-788f-4dc6-861e-2df6c31f703e tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:48:17.359614 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-f02a6873-788f-4dc6-861e-2df6c31f703e tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:48:17.360092 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-f02a6873-788f-4dc6-861e-2df6c31f703e tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:48:17.360505 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-f02a6873-788f-4dc6-861e-2df6c31f703e tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:48:17.360920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-f02a6873-788f-4dc6-861e-2df6c31f703e tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:48:17.370102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f02a6873-788f-4dc6-861e-2df6c31f703e tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:17.370546 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f02a6873-788f-4dc6-861e-2df6c31f703e tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:17.371338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f02a6873-788f-4dc6-861e-2df6c31f703e tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:17.371774 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f02a6873-788f-4dc6-861e-2df6c31f703e tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:17.390006 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-f02a6873-788f-4dc6-861e-2df6c31f703e tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Getting quotas for project 8d82269eab684311b711fc582aca274c. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:48:17.393773 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-f02a6873-788f-4dc6-861e-2df6c31f703e tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Getting quotas for user fa6d303e3fbc42b3b6ed98e373c8675b and project 8d82269eab684311b711fc582aca274c. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:48:17.404610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f02a6873-788f-4dc6-861e-2df6c31f703e tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:48:17.406772 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f02a6873-788f-4dc6-861e-2df6c31f703e tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: b3efd415-e2e6-428a-90f9-a334efd38e82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb689bea-534a-4aac-bec3-8f55591dba58',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:48:17.452873 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f02a6873-788f-4dc6-861e-2df6c31f703e tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.500639 Jul 27 20:48:17.453568 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1957/3931] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Jul 27 20:48:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:48:17.465273 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-62eea860-45c8-431f-80fc-1a3a1b871f9b tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:17.465973 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-62eea860-45c8-431f-80fc-1a3a1b871f9b tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: b3efd415-e2e6-428a-90f9-a334efd38e82] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:17.470618 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:48:17.471429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=62 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:48:17.526858 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-62eea860-45c8-431f-80fc-1a3a1b871f9b tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:17.533744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-62eea860-45c8-431f-80fc-1a3a1b871f9b tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82" status: 200 len: 1213 microversion: 2.1 time: 0.072971 Jul 27 20:48:17.534314 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1975/3932] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:17 2022] GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82 => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:18.555192 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-906beb7e-f897-4e66-9734-2f4eabdf4506 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:18.556476 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-906beb7e-f897-4e66-9734-2f4eabdf4506 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: b3efd415-e2e6-428a-90f9-a334efd38e82] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:18.564426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-906beb7e-f897-4e66-9734-2f4eabdf4506 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:18.564979 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-906beb7e-f897-4e66-9734-2f4eabdf4506 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:18.565823 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-906beb7e-f897-4e66-9734-2f4eabdf4506 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:18.566350 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-906beb7e-f897-4e66-9734-2f4eabdf4506 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:18.640224 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-906beb7e-f897-4e66-9734-2f4eabdf4506 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:18.650190 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-906beb7e-f897-4e66-9734-2f4eabdf4506 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82" status: 200 len: 1273 microversion: 2.1 time: 0.098910 Jul 27 20:48:18.650838 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1958/3933] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:18 2022] GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82 => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:19.671871 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4792b651-ad52-446d-af7d-1be65ea047ea tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:19.672536 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4792b651-ad52-446d-af7d-1be65ea047ea tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: b3efd415-e2e6-428a-90f9-a334efd38e82] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:19.679421 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4792b651-ad52-446d-af7d-1be65ea047ea tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:19.679877 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4792b651-ad52-446d-af7d-1be65ea047ea tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:19.681346 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4792b651-ad52-446d-af7d-1be65ea047ea tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:19.681810 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4792b651-ad52-446d-af7d-1be65ea047ea tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:19.813864 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4792b651-ad52-446d-af7d-1be65ea047ea tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:19.822013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4792b651-ad52-446d-af7d-1be65ea047ea tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82" status: 200 len: 1313 microversion: 2.1 time: 0.153883 Jul 27 20:48:19.822600 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1976/3934] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:19 2022] GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:20.079399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-b72c3e63-c701-4560-bf4b-4513fee9f9fb req-3e04071d-9e5f-405f-8146-c95ba71f7fab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3efd415-e2e6-428a-90f9-a334efd38e82", "tag": "2905bfb2-a5bf-4e4e-bc75-d2625724b73f"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:48:20.090342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-b72c3e63-c701-4560-bf4b-4513fee9f9fb req-3e04071d-9e5f-405f-8146-c95ba71f7fab service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:20.090785 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-b72c3e63-c701-4560-bf4b-4513fee9f9fb req-3e04071d-9e5f-405f-8146-c95ba71f7fab service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:20.106262 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-b72c3e63-c701-4560-bf4b-4513fee9f9fb req-3e04071d-9e5f-405f-8146-c95ba71f7fab service nova] Creating event network-changed:2905bfb2-a5bf-4e4e-bc75-d2625724b73f for instance b3efd415-e2e6-428a-90f9-a334efd38e82 on hv-cinder-79987 Jul 27 20:48:20.110914 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-b72c3e63-c701-4560-bf4b-4513fee9f9fb req-3e04071d-9e5f-405f-8146-c95ba71f7fab service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035441 Jul 27 20:48:20.111503 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1959/3935] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:48:20.843544 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0238b2cd-c732-4009-903f-a31079535c71 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:20.844103 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0238b2cd-c732-4009-903f-a31079535c71 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: b3efd415-e2e6-428a-90f9-a334efd38e82] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:20.850493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0238b2cd-c732-4009-903f-a31079535c71 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:20.850952 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0238b2cd-c732-4009-903f-a31079535c71 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:20.851710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0238b2cd-c732-4009-903f-a31079535c71 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:20.852152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0238b2cd-c732-4009-903f-a31079535c71 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:20.979447 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0238b2cd-c732-4009-903f-a31079535c71 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:20.986795 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0238b2cd-c732-4009-903f-a31079535c71 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82" status: 200 len: 1313 microversion: 2.1 time: 0.147169 Jul 27 20:48:20.987353 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1977/3936] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:20 2022] GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:22.016433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2d5106b8-66ae-4300-b65d-2cff38fb4a7d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:22.017193 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2d5106b8-66ae-4300-b65d-2cff38fb4a7d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: b3efd415-e2e6-428a-90f9-a334efd38e82] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:22.023462 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d5106b8-66ae-4300-b65d-2cff38fb4a7d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:22.023952 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d5106b8-66ae-4300-b65d-2cff38fb4a7d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:22.024771 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d5106b8-66ae-4300-b65d-2cff38fb4a7d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:22.025392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d5106b8-66ae-4300-b65d-2cff38fb4a7d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:22.159960 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2d5106b8-66ae-4300-b65d-2cff38fb4a7d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:22.167843 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2d5106b8-66ae-4300-b65d-2cff38fb4a7d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82" status: 200 len: 1313 microversion: 2.1 time: 0.156058 Jul 27 20:48:22.168423 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1960/3937] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:22 2022] GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:23.098680 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:48:23.099332 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:48:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:48:23.188686 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9ea85487-c4c7-4077-a353-0ee7c3631e69 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:23.189332 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9ea85487-c4c7-4077-a353-0ee7c3631e69 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: b3efd415-e2e6-428a-90f9-a334efd38e82] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:23.195864 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ea85487-c4c7-4077-a353-0ee7c3631e69 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:23.196326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ea85487-c4c7-4077-a353-0ee7c3631e69 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:23.197127 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ea85487-c4c7-4077-a353-0ee7c3631e69 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:23.197617 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9ea85487-c4c7-4077-a353-0ee7c3631e69 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:23.325318 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9ea85487-c4c7-4077-a353-0ee7c3631e69 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:23.333131 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9ea85487-c4c7-4077-a353-0ee7c3631e69 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82" status: 200 len: 1313 microversion: 2.1 time: 0.148267 Jul 27 20:48:23.333698 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1978/3938] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:23 2022] GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:24.354853 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d21bf889-a970-4d95-bffb-004c29974041 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:24.355417 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d21bf889-a970-4d95-bffb-004c29974041 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: b3efd415-e2e6-428a-90f9-a334efd38e82] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:24.362068 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d21bf889-a970-4d95-bffb-004c29974041 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:24.362515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d21bf889-a970-4d95-bffb-004c29974041 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:24.363275 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d21bf889-a970-4d95-bffb-004c29974041 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:24.363711 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d21bf889-a970-4d95-bffb-004c29974041 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:24.493726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d21bf889-a970-4d95-bffb-004c29974041 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:24.501864 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d21bf889-a970-4d95-bffb-004c29974041 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82" status: 200 len: 1313 microversion: 2.1 time: 0.150945 Jul 27 20:48:24.502428 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1961/3939] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:24 2022] GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:25.523475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7f9d4874-39f2-4161-9844-6710a95964ee tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:25.524089 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7f9d4874-39f2-4161-9844-6710a95964ee tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: b3efd415-e2e6-428a-90f9-a334efd38e82] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:25.531247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7f9d4874-39f2-4161-9844-6710a95964ee tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:25.531725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7f9d4874-39f2-4161-9844-6710a95964ee tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:25.532485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7f9d4874-39f2-4161-9844-6710a95964ee tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:25.532925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7f9d4874-39f2-4161-9844-6710a95964ee tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:25.668172 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7f9d4874-39f2-4161-9844-6710a95964ee tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:25.675674 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7f9d4874-39f2-4161-9844-6710a95964ee tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82" status: 200 len: 1313 microversion: 2.1 time: 0.156026 Jul 27 20:48:25.676240 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1979/3940] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:25 2022] GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:26.685359 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-be643dbc-a07b-4589-a824-e564e6654f63 req-20faefb1-333a-4bf7-ad69-f6379590e844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3efd415-e2e6-428a-90f9-a334efd38e82", "name": "network-vif-plugged", "status": "completed", "tag": "2905bfb2-a5bf-4e4e-bc75-d2625724b73f"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:48:26.696380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-be643dbc-a07b-4589-a824-e564e6654f63 req-20faefb1-333a-4bf7-ad69-f6379590e844 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:26.696813 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-be643dbc-a07b-4589-a824-e564e6654f63 req-20faefb1-333a-4bf7-ad69-f6379590e844 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:26.699013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6d55ce85-e4a6-4f07-bc11-780eb45bffeb tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:26.699662 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6d55ce85-e4a6-4f07-bc11-780eb45bffeb tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: b3efd415-e2e6-428a-90f9-a334efd38e82] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:26.706642 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d55ce85-e4a6-4f07-bc11-780eb45bffeb tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:26.707104 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d55ce85-e4a6-4f07-bc11-780eb45bffeb tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:26.707904 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d55ce85-e4a6-4f07-bc11-780eb45bffeb tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:26.708351 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d55ce85-e4a6-4f07-bc11-780eb45bffeb tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:26.710472 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-be643dbc-a07b-4589-a824-e564e6654f63 req-20faefb1-333a-4bf7-ad69-f6379590e844 service nova] Creating event network-vif-plugged:2905bfb2-a5bf-4e4e-bc75-d2625724b73f for instance b3efd415-e2e6-428a-90f9-a334efd38e82 on hv-cinder-79987 Jul 27 20:48:26.716191 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-be643dbc-a07b-4589-a824-e564e6654f63 req-20faefb1-333a-4bf7-ad69-f6379590e844 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034670 Jul 27 20:48:26.716996 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1962/3941] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:48:26.841023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6d55ce85-e4a6-4f07-bc11-780eb45bffeb tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:26.848585 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6d55ce85-e4a6-4f07-bc11-780eb45bffeb tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82" status: 200 len: 1313 microversion: 2.1 time: 0.155693 Jul 27 20:48:26.849430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1980/3942] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:26 2022] GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:26.972852 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:48:26.973030 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:48:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:48:27.867102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:48:27.867874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=6 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:48:27.873408 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-00c409d9-4c49-49da-b648-9fdc0713d6b6 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:27.874112 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-00c409d9-4c49-49da-b648-9fdc0713d6b6 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: b3efd415-e2e6-428a-90f9-a334efd38e82] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:27.881169 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00c409d9-4c49-49da-b648-9fdc0713d6b6 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:27.881638 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00c409d9-4c49-49da-b648-9fdc0713d6b6 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:27.882382 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00c409d9-4c49-49da-b648-9fdc0713d6b6 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:27.882838 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00c409d9-4c49-49da-b648-9fdc0713d6b6 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:28.017975 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-00c409d9-4c49-49da-b648-9fdc0713d6b6 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:28.025508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-00c409d9-4c49-49da-b648-9fdc0713d6b6 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82" status: 200 len: 1313 microversion: 2.1 time: 0.159105 Jul 27 20:48:28.026079 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1963/3943] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:27 2022] GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:29.046124 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-202267df-b14a-44e4-9ea0-83a65f3e6b41 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:29.046747 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-202267df-b14a-44e4-9ea0-83a65f3e6b41 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: b3efd415-e2e6-428a-90f9-a334efd38e82] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:29.049163 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=2 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:48:29.058111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-202267df-b14a-44e4-9ea0-83a65f3e6b41 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:29.058558 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-202267df-b14a-44e4-9ea0-83a65f3e6b41 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:29.059324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-202267df-b14a-44e4-9ea0-83a65f3e6b41 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:29.059942 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-202267df-b14a-44e4-9ea0-83a65f3e6b41 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:29.195780 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-202267df-b14a-44e4-9ea0-83a65f3e6b41 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:29.204106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-202267df-b14a-44e4-9ea0-83a65f3e6b41 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82" status: 200 len: 1498 microversion: 2.1 time: 0.161821 Jul 27 20:48:29.204673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1981/3944] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:29 2022] GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82 => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:29.695514 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c860cdbf-c6ee-4c92-996f-99382eadc2c9 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:29.696040 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c860cdbf-c6ee-4c92-996f-99382eadc2c9 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: b3efd415-e2e6-428a-90f9-a334efd38e82] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:29.703457 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c860cdbf-c6ee-4c92-996f-99382eadc2c9 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:29.703906 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c860cdbf-c6ee-4c92-996f-99382eadc2c9 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:29.704666 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c860cdbf-c6ee-4c92-996f-99382eadc2c9 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:29.705140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c860cdbf-c6ee-4c92-996f-99382eadc2c9 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:29.729876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c860cdbf-c6ee-4c92-996f-99382eadc2c9 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: b3efd415-e2e6-428a-90f9-a334efd38e82] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:48:29.802727 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c860cdbf-c6ee-4c92-996f-99382eadc2c9 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82" status: 204 len: 0 microversion: 2.1 time: 0.110719 Jul 27 20:48:29.803404 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1964/3945] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 20:48:29 2022] DELETE /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:48:29.812516 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-28f7bbd9-68bd-43d8-8f9b-0045c5002ac4 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:29.813165 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-28f7bbd9-68bd-43d8-8f9b-0045c5002ac4 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: b3efd415-e2e6-428a-90f9-a334efd38e82] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:29.819166 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-28f7bbd9-68bd-43d8-8f9b-0045c5002ac4 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:29.819620 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-28f7bbd9-68bd-43d8-8f9b-0045c5002ac4 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:29.820380 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-28f7bbd9-68bd-43d8-8f9b-0045c5002ac4 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:29.820824 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-28f7bbd9-68bd-43d8-8f9b-0045c5002ac4 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:29.946388 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-28f7bbd9-68bd-43d8-8f9b-0045c5002ac4 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:29.954233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-28f7bbd9-68bd-43d8-8f9b-0045c5002ac4 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82" status: 200 len: 1504 microversion: 2.1 time: 0.145532 Jul 27 20:48:29.954799 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1982/3946] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:29 2022] GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82 => generated 1504 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:30.976557 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0618e70b-5824-44c9-ad89-1c75e1604dcf tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:30.977285 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0618e70b-5824-44c9-ad89-1c75e1604dcf tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: b3efd415-e2e6-428a-90f9-a334efd38e82] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:30.983775 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0618e70b-5824-44c9-ad89-1c75e1604dcf tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:30.984223 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0618e70b-5824-44c9-ad89-1c75e1604dcf tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:30.985015 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0618e70b-5824-44c9-ad89-1c75e1604dcf tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:30.985456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0618e70b-5824-44c9-ad89-1c75e1604dcf tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:31.121421 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0618e70b-5824-44c9-ad89-1c75e1604dcf tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:31.128952 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0618e70b-5824-44c9-ad89-1c75e1604dcf tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82" status: 200 len: 1504 microversion: 2.1 time: 0.156589 Jul 27 20:48:31.129532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1965/3947] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:30 2022] GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:31.872786 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-01617bef-934a-42df-8a6e-7e76672c4cef req-2fb19d3f-eca6-4871-8ce0-e575e0c95494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3efd415-e2e6-428a-90f9-a334efd38e82", "name": "network-vif-deleted", "tag": "2905bfb2-a5bf-4e4e-bc75-d2625724b73f"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:48:31.883274 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-01617bef-934a-42df-8a6e-7e76672c4cef req-2fb19d3f-eca6-4871-8ce0-e575e0c95494 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:31.883757 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-01617bef-934a-42df-8a6e-7e76672c4cef req-2fb19d3f-eca6-4871-8ce0-e575e0c95494 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:31.895568 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-01617bef-934a-42df-8a6e-7e76672c4cef req-2fb19d3f-eca6-4871-8ce0-e575e0c95494 service nova] Creating event network-vif-deleted:2905bfb2-a5bf-4e4e-bc75-d2625724b73f for instance b3efd415-e2e6-428a-90f9-a334efd38e82 on hv-cinder-79987 Jul 27 20:48:31.901760 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-01617bef-934a-42df-8a6e-7e76672c4cef req-2fb19d3f-eca6-4871-8ce0-e575e0c95494 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033360 Jul 27 20:48:31.903099 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1983/3948] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:48:32.150892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b5281d57-be88-46d4-89ec-9789c979c69c tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:32.151559 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b5281d57-be88-46d4-89ec-9789c979c69c tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: b3efd415-e2e6-428a-90f9-a334efd38e82] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:32.158105 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b5281d57-be88-46d4-89ec-9789c979c69c tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:32.158552 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b5281d57-be88-46d4-89ec-9789c979c69c tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:32.159310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b5281d57-be88-46d4-89ec-9789c979c69c tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:32.159742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b5281d57-be88-46d4-89ec-9789c979c69c tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:32.191286 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b5281d57-be88-46d4-89ec-9789c979c69c tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:32.191739 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b5281d57-be88-46d4-89ec-9789c979c69c tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:32.192188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-b5281d57-be88-46d4-89ec-9789c979c69c tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lazy-loading 'fault' on Instance uuid b3efd415-e2e6-428a-90f9-a334efd38e82 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:48:32.233582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b5281d57-be88-46d4-89ec-9789c979c69c tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:32.240881 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b5281d57-be88-46d4-89ec-9789c979c69c tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82" status: 200 len: 1303 microversion: 2.1 time: 0.094342 Jul 27 20:48:32.241467 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1966/3949] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:32 2022] GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:33.263414 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1444c536-e22b-4fca-ae50-0378889c7bc4 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:33.264176 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1444c536-e22b-4fca-ae50-0378889c7bc4 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: b3efd415-e2e6-428a-90f9-a334efd38e82] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:33.270707 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1444c536-e22b-4fca-ae50-0378889c7bc4 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:33.271147 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1444c536-e22b-4fca-ae50-0378889c7bc4 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:33.271916 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1444c536-e22b-4fca-ae50-0378889c7bc4 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:33.272359 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1444c536-e22b-4fca-ae50-0378889c7bc4 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:33.286166 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-1444c536-e22b-4fca-ae50-0378889c7bc4 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] HTTP exception thrown: Instance b3efd415-e2e6-428a-90f9-a334efd38e82 could not be found. Jul 27 20:48:33.287800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1444c536-e22b-4fca-ae50-0378889c7bc4 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Request method failure captured: Jul 27 20:48:33.287800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82 HTTP/1.1 Jul 27 20:48:33.287800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:48:33.287800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:48:33.287800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:48:33.287800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:48:33.287800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:48:33.287800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:48:33.287800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:48:33.287800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:48:33.287800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4aSPGFOmah8PHN833VbkW8LGVQV8YLYfLp03Z08MqdNhjHXaczLqDhoi3A5Vgk93LPHFzEyoV_PaF9Mr3P5FuOP44bDZl2giA9yFjzo982m_os5qXyCodf14oGkXAXfIWqyeuTPiwNNlqS7BcasJo9lNJR2JU3le-kYHK-NHLqKJRVg Jul 27 20:48:33.287800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:48:33.287800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:48:33.287800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:48:33.287800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:48:33.287800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:48:33.287800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:48:33.287800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 8d82269eab684311b711fc582aca274c Jul 27 20:48:33.287800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-VolumesActionsTest-723284975 Jul 27 20:48:33.287800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:48:33.287800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:48:33.289711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d82269eab684311b711fc582aca274c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8d82269eab684311b711fc582aca274c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8d82269eab684311b711fc582aca274c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d82269eab684311b711fc582aca274c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:48:33.289711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-VolumesActionsTest-723284975 Jul 27 20:48:33.289711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 8d82269eab684311b711fc582aca274c Jul 27 20:48:33.289711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-VolumesActionsTest-723284975 Jul 27 20:48:33.289711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-VolumesActionsTest-723284975-project Jul 27 20:48:33.289711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:48:33.289711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:48:33.289711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: fa6d303e3fbc42b3b6ed98e373c8675b Jul 27 20:48:33.289711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-VolumesActionsTest-723284975-project Jul 27 20:48:33.289711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:48:33.289711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Instance b3efd415-e2e6-428a-90f9-a334efd38e82 could not be found. Jul 27 20:48:33.289711 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'id': 'b3efd415-e2e6-428a-90f9-a334efd38e82'} Jul 27 20:48:33.290809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:48:33.290809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:48:33.290809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:48:33.290809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:48:33.290809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:48:33.290809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:48:33.290809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:48:33.290809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:48:33.290809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:48:33.290809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:48:33.290809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3efd415-e2e6-428a-90f9-a334efd38e82 could not be found. Jul 27 20:48:33.290809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:48:33.290809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:48:33.290809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:48:33.290809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:48:33.290809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:48:33.290809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:48:33.290809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:48:33.290809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:48:33.290809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:48:33.292845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:48:33.292845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:48:33.292845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:48:33.292845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:48:33.292845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:48:33.292845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:48:33.292845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:48:33.292845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3efd415-e2e6-428a-90f9-a334efd38e82 could not be found. Jul 27 20:48:33.292845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:48:33.292845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:48:33.292845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:48:33.292845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:48:33.292845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:48:33.292845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:48:33.292845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:48:33.292845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:48:33.292845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3efd415-e2e6-428a-90f9-a334efd38e82 could not be found. Jul 27 20:48:33.292845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:48:33.294279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1444c536-e22b-4fca-ae50-0378889c7bc4 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Returning 404 to user: Instance b3efd415-e2e6-428a-90f9-a334efd38e82 could not be found. {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:48:33.294279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1444c536-e22b-4fca-ae50-0378889c7bc4 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82" status: 404 len: 111 microversion: 2.1 time: 0.030907 Jul 27 20:48:33.294279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1984/3950] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:33 2022] GET /compute/v2.1/servers/b3efd415-e2e6-428a-90f9-a334efd38e82 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:48:33.340051 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-966440c8-8df9-408c-9e7e-48140cd6a986 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1188457339", "imageRef": "fb689bea-534a-4aac-bec3-8f55591dba58", "flavorRef": "452", "networks": [{"uuid": "27ab865f-f371-44cf-b1e3-ad43d3c4f6ef"}]}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:48:33.393349 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-966440c8-8df9-408c-9e7e-48140cd6a986 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] validate_networks() for [('27ab865f-f371-44cf-b1e3-ad43d3c4f6ef', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:48:33.735538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-966440c8-8df9-408c-9e7e-48140cd6a986 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:48:33.736015 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-966440c8-8df9-408c-9e7e-48140cd6a986 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:48:33.736639 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-966440c8-8df9-408c-9e7e-48140cd6a986 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:48:33.737143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-966440c8-8df9-408c-9e7e-48140cd6a986 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:48:33.737549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-966440c8-8df9-408c-9e7e-48140cd6a986 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:48:33.746879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-966440c8-8df9-408c-9e7e-48140cd6a986 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:33.747318 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-966440c8-8df9-408c-9e7e-48140cd6a986 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:33.748091 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-966440c8-8df9-408c-9e7e-48140cd6a986 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:33.748522 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-966440c8-8df9-408c-9e7e-48140cd6a986 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:33.764510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-966440c8-8df9-408c-9e7e-48140cd6a986 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Getting quotas for project 8d82269eab684311b711fc582aca274c. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:48:33.768294 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-966440c8-8df9-408c-9e7e-48140cd6a986 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Getting quotas for user fa6d303e3fbc42b3b6ed98e373c8675b and project 8d82269eab684311b711fc582aca274c. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:48:33.779802 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-966440c8-8df9-408c-9e7e-48140cd6a986 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:48:33.782047 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-966440c8-8df9-408c-9e7e-48140cd6a986 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb689bea-534a-4aac-bec3-8f55591dba58',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:48:33.826707 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-966440c8-8df9-408c-9e7e-48140cd6a986 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.490996 Jul 27 20:48:33.827645 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1967/3951] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Jul 27 20:48:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:48:33.839212 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f97718c6-d7bc-4c0e-b9e3-51424d76e323 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:33.839836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f97718c6-d7bc-4c0e-b9e3-51424d76e323 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:33.892989 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f97718c6-d7bc-4c0e-b9e3-51424d76e323 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:33.899603 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f97718c6-d7bc-4c0e-b9e3-51424d76e323 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626" status: 200 len: 1214 microversion: 2.1 time: 0.065023 Jul 27 20:48:33.903466 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1985/3952] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:33 2022] GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:34.921453 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-04108abf-26f2-4f51-8640-37f4ce524008 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:34.922075 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-04108abf-26f2-4f51-8640-37f4ce524008 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:34.929423 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04108abf-26f2-4f51-8640-37f4ce524008 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:34.929881 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04108abf-26f2-4f51-8640-37f4ce524008 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:34.930653 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04108abf-26f2-4f51-8640-37f4ce524008 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:34.931092 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04108abf-26f2-4f51-8640-37f4ce524008 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:35.032985 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-04108abf-26f2-4f51-8640-37f4ce524008 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:35.040497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-04108abf-26f2-4f51-8640-37f4ce524008 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626" status: 200 len: 1272 microversion: 2.1 time: 0.123499 Jul 27 20:48:35.041411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1968/3953] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:34 2022] GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 => generated 1272 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:36.063520 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-45202395-6173-4870-8b36-996abdc09ddf tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:36.064385 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-45202395-6173-4870-8b36-996abdc09ddf tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:36.071665 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-45202395-6173-4870-8b36-996abdc09ddf tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:36.072855 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-45202395-6173-4870-8b36-996abdc09ddf tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:36.074063 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-45202395-6173-4870-8b36-996abdc09ddf tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:36.074514 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-45202395-6173-4870-8b36-996abdc09ddf tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:36.166138 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-c901ffaf-635a-4198-9e3a-2b94d9c9ddf3 req-33c93129-9da0-44a4-9a28-9da06962af58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f6d60eb-c3e9-4044-b4f1-cb67b0e28626", "tag": "873e655b-4c60-4d2f-a6da-74b61fda7cba"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:48:36.177701 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-c901ffaf-635a-4198-9e3a-2b94d9c9ddf3 req-33c93129-9da0-44a4-9a28-9da06962af58 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:36.178575 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-c901ffaf-635a-4198-9e3a-2b94d9c9ddf3 req-33c93129-9da0-44a4-9a28-9da06962af58 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:36.198117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-c901ffaf-635a-4198-9e3a-2b94d9c9ddf3 req-33c93129-9da0-44a4-9a28-9da06962af58 service nova] Creating event network-changed:873e655b-4c60-4d2f-a6da-74b61fda7cba for instance 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 on hv-cinder-79987 Jul 27 20:48:36.203057 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-c901ffaf-635a-4198-9e3a-2b94d9c9ddf3 req-33c93129-9da0-44a4-9a28-9da06962af58 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041531 Jul 27 20:48:36.203662 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1969/3954] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:48:36.229889 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-45202395-6173-4870-8b36-996abdc09ddf tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:36.237657 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-45202395-6173-4870-8b36-996abdc09ddf tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626" status: 200 len: 1314 microversion: 2.1 time: 0.178025 Jul 27 20:48:36.238229 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1986/3955] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:36 2022] GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:37.260269 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-33ba5b29-a57a-4ea2-a51a-68015485f3e3 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:37.260953 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-33ba5b29-a57a-4ea2-a51a-68015485f3e3 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:37.267105 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33ba5b29-a57a-4ea2-a51a-68015485f3e3 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:37.267546 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33ba5b29-a57a-4ea2-a51a-68015485f3e3 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:37.268292 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33ba5b29-a57a-4ea2-a51a-68015485f3e3 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:37.268719 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33ba5b29-a57a-4ea2-a51a-68015485f3e3 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:37.401759 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-33ba5b29-a57a-4ea2-a51a-68015485f3e3 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:37.409305 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-33ba5b29-a57a-4ea2-a51a-68015485f3e3 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626" status: 200 len: 1314 microversion: 2.1 time: 0.153781 Jul 27 20:48:37.409863 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1970/3956] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:37 2022] GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:38.430837 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-576b4354-dc41-4fe5-91b3-29e381addf98 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:38.432129 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-576b4354-dc41-4fe5-91b3-29e381addf98 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:38.438562 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-576b4354-dc41-4fe5-91b3-29e381addf98 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:38.439010 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-576b4354-dc41-4fe5-91b3-29e381addf98 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:38.439769 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-576b4354-dc41-4fe5-91b3-29e381addf98 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:38.440205 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-576b4354-dc41-4fe5-91b3-29e381addf98 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:38.572402 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-576b4354-dc41-4fe5-91b3-29e381addf98 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:38.580072 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-576b4354-dc41-4fe5-91b3-29e381addf98 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626" status: 200 len: 1314 microversion: 2.1 time: 0.153058 Jul 27 20:48:38.580635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1987/3957] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:38 2022] GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:39.600848 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-36494926-5977-4a38-87ee-6cca954088c1 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:39.601486 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-36494926-5977-4a38-87ee-6cca954088c1 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:39.608372 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-36494926-5977-4a38-87ee-6cca954088c1 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:39.608821 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-36494926-5977-4a38-87ee-6cca954088c1 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:39.609626 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-36494926-5977-4a38-87ee-6cca954088c1 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:39.610058 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-36494926-5977-4a38-87ee-6cca954088c1 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:39.742591 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-36494926-5977-4a38-87ee-6cca954088c1 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:39.750201 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-36494926-5977-4a38-87ee-6cca954088c1 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626" status: 200 len: 1314 microversion: 2.1 time: 0.153255 Jul 27 20:48:39.750754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1971/3958] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:39 2022] GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:40.771099 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-292a1b4a-b998-4d96-a735-a31d99feb5d5 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:40.771716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-292a1b4a-b998-4d96-a735-a31d99feb5d5 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:40.778206 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-292a1b4a-b998-4d96-a735-a31d99feb5d5 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:40.778660 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-292a1b4a-b998-4d96-a735-a31d99feb5d5 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:40.779429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-292a1b4a-b998-4d96-a735-a31d99feb5d5 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:40.779874 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-292a1b4a-b998-4d96-a735-a31d99feb5d5 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:40.912389 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-292a1b4a-b998-4d96-a735-a31d99feb5d5 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:40.920467 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-292a1b4a-b998-4d96-a735-a31d99feb5d5 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626" status: 200 len: 1314 microversion: 2.1 time: 0.153135 Jul 27 20:48:40.921052 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1988/3959] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:40 2022] GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:41.942322 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fd3b8b03-a687-4d43-8eba-241d03ebbfa3 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:41.942961 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fd3b8b03-a687-4d43-8eba-241d03ebbfa3 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:41.950090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fd3b8b03-a687-4d43-8eba-241d03ebbfa3 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:41.950539 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fd3b8b03-a687-4d43-8eba-241d03ebbfa3 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:41.951293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fd3b8b03-a687-4d43-8eba-241d03ebbfa3 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:41.951970 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fd3b8b03-a687-4d43-8eba-241d03ebbfa3 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:42.080248 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fd3b8b03-a687-4d43-8eba-241d03ebbfa3 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:42.087598 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fd3b8b03-a687-4d43-8eba-241d03ebbfa3 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626" status: 200 len: 1314 microversion: 2.1 time: 0.149113 Jul 27 20:48:42.088357 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1972/3960] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:41 2022] GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:42.769261 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-42ca31e6-ccca-4174-b799-5257bc72f5da req-c0fbbedb-4b77-4ae0-8467-9ec44ab2df8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f6d60eb-c3e9-4044-b4f1-cb67b0e28626", "name": "network-vif-plugged", "status": "completed", "tag": "873e655b-4c60-4d2f-a6da-74b61fda7cba"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:48:42.780409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-42ca31e6-ccca-4174-b799-5257bc72f5da req-c0fbbedb-4b77-4ae0-8467-9ec44ab2df8a service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:42.780924 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-42ca31e6-ccca-4174-b799-5257bc72f5da req-c0fbbedb-4b77-4ae0-8467-9ec44ab2df8a service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:42.793295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-42ca31e6-ccca-4174-b799-5257bc72f5da req-c0fbbedb-4b77-4ae0-8467-9ec44ab2df8a service nova] Creating event network-vif-plugged:873e655b-4c60-4d2f-a6da-74b61fda7cba for instance 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 on hv-cinder-79987 Jul 27 20:48:42.798306 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-42ca31e6-ccca-4174-b799-5257bc72f5da req-c0fbbedb-4b77-4ae0-8467-9ec44ab2df8a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032818 Jul 27 20:48:42.799086 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1989/3961] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:48:43.109412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ee0eb31e-5571-44e3-843a-d396f14b6d46 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:43.110025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ee0eb31e-5571-44e3-843a-d396f14b6d46 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:43.116478 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee0eb31e-5571-44e3-843a-d396f14b6d46 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:43.116928 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee0eb31e-5571-44e3-843a-d396f14b6d46 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:43.117728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee0eb31e-5571-44e3-843a-d396f14b6d46 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:43.118169 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee0eb31e-5571-44e3-843a-d396f14b6d46 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:43.244529 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ee0eb31e-5571-44e3-843a-d396f14b6d46 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:43.251991 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ee0eb31e-5571-44e3-843a-d396f14b6d46 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626" status: 200 len: 1314 microversion: 2.1 time: 0.146453 Jul 27 20:48:43.252549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1973/3962] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:43 2022] GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:44.273592 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0bee00bf-518f-49cc-9fa7-0d8644609c03 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:44.274322 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0bee00bf-518f-49cc-9fa7-0d8644609c03 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:44.277454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=2 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:48:44.283357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0bee00bf-518f-49cc-9fa7-0d8644609c03 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:44.283747 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0bee00bf-518f-49cc-9fa7-0d8644609c03 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:44.284499 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0bee00bf-518f-49cc-9fa7-0d8644609c03 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:44.284933 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0bee00bf-518f-49cc-9fa7-0d8644609c03 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:44.421731 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0bee00bf-518f-49cc-9fa7-0d8644609c03 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:44.431572 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0bee00bf-518f-49cc-9fa7-0d8644609c03 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626" status: 200 len: 1314 microversion: 2.1 time: 0.162138 Jul 27 20:48:44.432144 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1990/3963] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:44 2022] GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:45.453170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d453f3ae-169c-4592-b3a9-b5e6e1c9c681 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:45.453784 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d453f3ae-169c-4592-b3a9-b5e6e1c9c681 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:45.455778 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:48:45.456466 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=6 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:48:45.462654 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d453f3ae-169c-4592-b3a9-b5e6e1c9c681 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:45.463107 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d453f3ae-169c-4592-b3a9-b5e6e1c9c681 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:45.464534 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d453f3ae-169c-4592-b3a9-b5e6e1c9c681 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:45.465106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d453f3ae-169c-4592-b3a9-b5e6e1c9c681 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:45.693148 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d453f3ae-169c-4592-b3a9-b5e6e1c9c681 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:45.696469 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:48:45.702657 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d453f3ae-169c-4592-b3a9-b5e6e1c9c681 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626" status: 200 len: 1498 microversion: 2.1 time: 0.253590 Jul 27 20:48:45.703223 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1974/3964] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:45 2022] GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 => generated 1498 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:46.239755 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-57211045-ee15-44c2-88ec-187d7f245d58 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:46.240370 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-57211045-ee15-44c2-88ec-187d7f245d58 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:46.248469 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-57211045-ee15-44c2-88ec-187d7f245d58 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:46.248982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-57211045-ee15-44c2-88ec-187d7f245d58 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:46.249773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-57211045-ee15-44c2-88ec-187d7f245d58 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:46.250215 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-57211045-ee15-44c2-88ec-187d7f245d58 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:46.275275 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-57211045-ee15-44c2-88ec-187d7f245d58 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626] Going to try to terminate instance {{(pid=117876) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:48:46.355075 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-57211045-ee15-44c2-88ec-187d7f245d58 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626" status: 204 len: 0 microversion: 2.1 time: 0.118318 Jul 27 20:48:46.355767 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1991/3965] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 20:48:46 2022] DELETE /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:48:46.364425 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5d51ff6b-3bbc-4e0a-a48e-13146ae4ba72 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:46.365068 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5d51ff6b-3bbc-4e0a-a48e-13146ae4ba72 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:46.371933 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d51ff6b-3bbc-4e0a-a48e-13146ae4ba72 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:46.372379 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d51ff6b-3bbc-4e0a-a48e-13146ae4ba72 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:46.373173 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d51ff6b-3bbc-4e0a-a48e-13146ae4ba72 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:46.373608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d51ff6b-3bbc-4e0a-a48e-13146ae4ba72 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:46.739381 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5d51ff6b-3bbc-4e0a-a48e-13146ae4ba72 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:46.747462 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5d51ff6b-3bbc-4e0a-a48e-13146ae4ba72 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626" status: 200 len: 1504 microversion: 2.1 time: 0.387406 Jul 27 20:48:46.748043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1975/3966] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:46 2022] GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 => generated 1504 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:47.769037 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-20c5d141-c248-490a-933f-f1544421ab14 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:47.769746 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-20c5d141-c248-490a-933f-f1544421ab14 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:47.772075 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:48:47.777455 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-20c5d141-c248-490a-933f-f1544421ab14 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:47.778554 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-20c5d141-c248-490a-933f-f1544421ab14 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:47.779495 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-20c5d141-c248-490a-933f-f1544421ab14 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:47.780245 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-20c5d141-c248-490a-933f-f1544421ab14 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:47.785823 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:48:47.910836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-20c5d141-c248-490a-933f-f1544421ab14 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:47.918399 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-20c5d141-c248-490a-933f-f1544421ab14 tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626" status: 200 len: 1504 microversion: 2.1 time: 0.153573 Jul 27 20:48:47.918967 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1992/3967] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:47 2022] GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:48.468608 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-52417249-41c0-4008-bdd8-ded5b061da6c req-64aa8915-865b-4e79-8278-2b2b70a64392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f6d60eb-c3e9-4044-b4f1-cb67b0e28626", "name": "network-vif-deleted", "tag": "873e655b-4c60-4d2f-a6da-74b61fda7cba"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:48:48.474005 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:48:48.481176 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-52417249-41c0-4008-bdd8-ded5b061da6c req-64aa8915-865b-4e79-8278-2b2b70a64392 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:48.481770 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-52417249-41c0-4008-bdd8-ded5b061da6c req-64aa8915-865b-4e79-8278-2b2b70a64392 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:48.497860 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-52417249-41c0-4008-bdd8-ded5b061da6c req-64aa8915-865b-4e79-8278-2b2b70a64392 service nova] Creating event network-vif-deleted:873e655b-4c60-4d2f-a6da-74b61fda7cba for instance 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 on hv-cinder-79987 Jul 27 20:48:48.503257 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-52417249-41c0-4008-bdd8-ded5b061da6c req-64aa8915-865b-4e79-8278-2b2b70a64392 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038395 Jul 27 20:48:48.503844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1976/3968] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:48:48.939684 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6d63e4bd-d531-49d5-84f4-468907e0005d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:48.940929 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6d63e4bd-d531-49d5-84f4-468907e0005d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:48.947431 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d63e4bd-d531-49d5-84f4-468907e0005d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:48.947948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d63e4bd-d531-49d5-84f4-468907e0005d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:48.948836 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d63e4bd-d531-49d5-84f4-468907e0005d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:48.949322 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d63e4bd-d531-49d5-84f4-468907e0005d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:48.982500 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d63e4bd-d531-49d5-84f4-468907e0005d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:48.982960 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6d63e4bd-d531-49d5-84f4-468907e0005d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:48.983412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.objects.instance [None req-6d63e4bd-d531-49d5-84f4-468907e0005d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lazy-loading 'fault' on Instance uuid 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 {{(pid=117876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:48:49.037687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6d63e4bd-d531-49d5-84f4-468907e0005d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa6d303e3fbc42b3b6ed98e373c8675b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d82269eab684311b711fc582aca274c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:48:49.045273 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6d63e4bd-d531-49d5-84f4-468907e0005d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626" status: 200 len: 1304 microversion: 2.1 time: 0.109456 Jul 27 20:48:49.045851 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1993/3969] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:48 2022] GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:48:50.067411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a89ff279-123c-4732-b58a-af4a2647a17d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:48:50.068251 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a89ff279-123c-4732-b58a-af4a2647a17d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] [instance: 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:48:50.075005 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a89ff279-123c-4732-b58a-af4a2647a17d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:50.075468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a89ff279-123c-4732-b58a-af4a2647a17d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:50.076235 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a89ff279-123c-4732-b58a-af4a2647a17d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:48:50.076681 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a89ff279-123c-4732-b58a-af4a2647a17d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:48:50.091714 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-a89ff279-123c-4732-b58a-af4a2647a17d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] HTTP exception thrown: Instance 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 could not be found. Jul 27 20:48:50.093385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a89ff279-123c-4732-b58a-af4a2647a17d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Request method failure captured: Jul 27 20:48:50.093385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 HTTP/1.1 Jul 27 20:48:50.093385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:48:50.093385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:48:50.093385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:48:50.093385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:48:50.093385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:48:50.093385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:48:50.093385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:48:50.093385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:48:50.093385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4aSPGFOmah8PHN833VbkW8LGVQV8YLYfLp03Z08MqdNhjHXaczLqDhoi3A5Vgk93LPHFzEyoV_PaF9Mr3P5FuOP44bDZl2giA9yFjzo982m_os5qXyCodf14oGkXAXfIWqyeuTPiwNNlqS7BcasJo9lNJR2JU3le-kYHK-NHLqKJRVg Jul 27 20:48:50.093385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:48:50.093385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:48:50.093385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:48:50.093385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:48:50.093385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:48:50.093385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:48:50.093385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: 8d82269eab684311b711fc582aca274c Jul 27 20:48:50.093385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-VolumesActionsTest-723284975 Jul 27 20:48:50.093385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:48:50.093385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:48:50.095162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d82269eab684311b711fc582aca274c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8d82269eab684311b711fc582aca274c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8d82269eab684311b711fc582aca274c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d82269eab684311b711fc582aca274c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:48:50.095162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-VolumesActionsTest-723284975 Jul 27 20:48:50.095162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 8d82269eab684311b711fc582aca274c Jul 27 20:48:50.095162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-VolumesActionsTest-723284975 Jul 27 20:48:50.095162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-VolumesActionsTest-723284975-project Jul 27 20:48:50.095162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:48:50.095162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:48:50.095162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: fa6d303e3fbc42b3b6ed98e373c8675b Jul 27 20:48:50.095162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-VolumesActionsTest-723284975-project Jul 27 20:48:50.095162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:48:50.095162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Instance 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 could not be found. Jul 27 20:48:50.095162 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'id': '9f6d60eb-c3e9-4044-b4f1-cb67b0e28626'} Jul 27 20:48:50.096283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:48:50.096283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:48:50.096283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:48:50.096283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:48:50.096283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:48:50.096283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:48:50.096283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:48:50.096283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:48:50.096283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:48:50.096283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:48:50.096283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 could not be found. Jul 27 20:48:50.096283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:48:50.096283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:48:50.096283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:48:50.096283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:48:50.096283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:48:50.096283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:48:50.096283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:48:50.096283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:48:50.096283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:48:50.098013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:48:50.098013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:48:50.098013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:48:50.098013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:48:50.098013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:48:50.098013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:48:50.098013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:48:50.098013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 could not be found. Jul 27 20:48:50.098013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:48:50.098013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:48:50.098013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:48:50.098013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:48:50.098013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:48:50.098013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:48:50.098013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:48:50.098013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:48:50.098013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 could not be found. Jul 27 20:48:50.098013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:48:50.099706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a89ff279-123c-4732-b58a-af4a2647a17d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] Returning 404 to user: Instance 9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:48:50.099706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a89ff279-123c-4732-b58a-af4a2647a17d tempest-VolumesActionsTest-723284975 tempest-VolumesActionsTest-723284975-project] 10.222.0.65 "GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626" status: 404 len: 111 microversion: 2.1 time: 0.032368 Jul 27 20:48:50.099706 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1977/3970] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:48:50 2022] GET /compute/v2.1/servers/9f6d60eb-c3e9-4044-b4f1-cb67b0e28626 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:49:24.523869 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-18ebc8bc-04d0-484b-8726-d55831d258bc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:24.524504 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-18ebc8bc-04d0-484b-8726-d55831d258bc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:24.528610 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=5 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:49:24.529283 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=13 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:49:24.534901 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-18ebc8bc-04d0-484b-8726-d55831d258bc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:24.535357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-18ebc8bc-04d0-484b-8726-d55831d258bc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:24.536125 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-18ebc8bc-04d0-484b-8726-d55831d258bc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:24.536569 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-18ebc8bc-04d0-484b-8726-d55831d258bc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:24.559257 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-18ebc8bc-04d0-484b-8726-d55831d258bc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801/ips" status: 200 len: 151 microversion: 2.1 time: 0.039440 Jul 27 20:49:24.559821 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1994/3971] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Jul 27 20:49:24 2022] GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:49:24.572803 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-52c36fe7-1f26-4226-9457-6062de97ac37 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "374df824-0ba6-4e9a-b612-ae4aedfce4bf"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:49:24.575153 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-52c36fe7-1f26-4226-9457-6062de97ac37 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:24.577702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:49:24.578331 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=10 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:49:24.584433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-52c36fe7-1f26-4226-9457-6062de97ac37 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:24.584882 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-52c36fe7-1f26-4226-9457-6062de97ac37 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:24.585689 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-52c36fe7-1f26-4226-9457-6062de97ac37 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:24.586145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-52c36fe7-1f26-4226-9457-6062de97ac37 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:24.664302 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-52c36fe7-1f26-4226-9457-6062de97ac37 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] HTTP exception thrown: Invalid volume: volume 374df824-0ba6-4e9a-b612-ae4aedfce4bf is already attached to instances: a25e07e9-eb88-4dc7-9833-108d25d57596 Jul 27 20:49:24.666310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-52c36fe7-1f26-4226-9457-6062de97ac37 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Request method failure captured: Jul 27 20:49:24.666310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: POST /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801/os-volume_attachments HTTP/1.1 Jul 27 20:49:24.666310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:49:24.666310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:49:24.666310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:49:24.666310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 74 Jul 27 20:49:24.666310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:49:24.666310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:49:24.666310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:49:24.666310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:49:24.666310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4aQDgaYQvYIu8Qo0cRbAVWzvY8Dy9GGrZ0HavYCr3wNvgVR2I9Irzc5X_0xRA4MDwtX2JjjvjYYuHwC7Mrh_yi9kIBmZG5-_lltvQDXb5DZDOaE2MSmiAXjFqiUVxXiijuz7iXdho2ln6dfnWOlCMnhNkamPt7HXOo0ngwRoFADP5jE Jul 27 20:49:24.666310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:49:24.666310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:49:24.666310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:49:24.666310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:49:24.666310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:49:24.666310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:49:24.666310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:49:24.666310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:49:24.666310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:49:24.666310 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:49:24.668177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6a1fbeedf5134a5a9432e42a35e1d955", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:49:24.668177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:49:24.668177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:49:24.668177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:49:24.668177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:49:24.668177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:49:24.668177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:49:24.668177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: 30051341684845938161bb5ec0680d68 Jul 27 20:49:24.668177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:49:24.668177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Jul 27 20:49:24.668177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {"volumeAttachment": {"volumeId": "374df824-0ba6-4e9a-b612-ae4aedfce4bf"}} Jul 27 20:49:24.668177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:49:24.670145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Invalid volume: volume 374df824-0ba6-4e9a-b612-ae4aedfce4bf is already attached to instances: a25e07e9-eb88-4dc7-9833-108d25d57596 Jul 27 20:49:24.670145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'server_id': '6a8f2d6b-aa7f-486c-95dd-4134388ea801', 'body': {'volumeAttachment': {'volumeId': '374df824-0ba6-4e9a-b612-ae4aedfce4bf'}}} Jul 27 20:49:24.670145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:49:24.670145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:49:24.670145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 20:49:24.670145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 20:49:24.670145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:49:24.670145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:49:24.670145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:49:24.670145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:49:24.670145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 27 20:49:24.670145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 27 20:49:24.670145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 27 20:49:24.670145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 27 20:49:24.670145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 374df824-0ba6-4e9a-b612-ae4aedfce4bf is already attached to instances: a25e07e9-eb88-4dc7-9833-108d25d57596 Jul 27 20:49:24.670145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:49:24.670145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:49:24.670145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:49:24.670145 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:49:24.671832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:49:24.671832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:49:24.671832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:49:24.671832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:49:24.671832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:49:24.671832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:49:24.671832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 20:49:24.671832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 20:49:24.671832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 20:49:24.671832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 20:49:24.671832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 20:49:24.671832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 20:49:24.671832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 27 20:49:24.671832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:49:24.671832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 374df824-0ba6-4e9a-b612-ae4aedfce4bf is already attached to instances: a25e07e9-eb88-4dc7-9833-108d25d57596 Jul 27 20:49:24.671832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:49:24.671832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:49:24.671832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:49:24.671832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:49:24.671832 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:49:24.673582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:49:24.673582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:49:24.673582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:49:24.673582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 374df824-0ba6-4e9a-b612-ae4aedfce4bf is already attached to instances: a25e07e9-eb88-4dc7-9833-108d25d57596 Jul 27 20:49:24.673582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:49:24.673582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-52c36fe7-1f26-4226-9457-6062de97ac37 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Returning 400 to user: Invalid volume: volume 374df824-0ba6-4e9a-b612-ae4aedfce4bf is already attached to instances: a25e07e9-eb88-4dc7-9833-108d25d57596 {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:49:24.673582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-52c36fe7-1f26-4226-9457-6062de97ac37 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "POST /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099661 Jul 27 20:49:24.673582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1978/3972] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Jul 27 20:49:24 2022] POST /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:49:24.676543 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e5d36b0e-3090-46df-9b0b-7ad5ee5758ea tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:24.677059 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e5d36b0e-3090-46df-9b0b-7ad5ee5758ea tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:24.683335 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e5d36b0e-3090-46df-9b0b-7ad5ee5758ea tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:24.683781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e5d36b0e-3090-46df-9b0b-7ad5ee5758ea tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:24.684532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e5d36b0e-3090-46df-9b0b-7ad5ee5758ea tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:24.684980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e5d36b0e-3090-46df-9b0b-7ad5ee5758ea tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:24.709800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e5d36b0e-3090-46df-9b0b-7ad5ee5758ea tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] Going to try to terminate instance {{(pid=117876) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:49:24.786184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e5d36b0e-3090-46df-9b0b-7ad5ee5758ea tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801" status: 204 len: 0 microversion: 2.1 time: 0.113070 Jul 27 20:49:24.786688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1995/3973] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 20:49:24 2022] DELETE /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:49:24.794848 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ade5970b-8ee2-4add-a010-81abcbe145eb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:24.795468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ade5970b-8ee2-4add-a010-81abcbe145eb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:24.801447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ade5970b-8ee2-4add-a010-81abcbe145eb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:24.801893 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ade5970b-8ee2-4add-a010-81abcbe145eb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:24.802652 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ade5970b-8ee2-4add-a010-81abcbe145eb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:24.803093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ade5970b-8ee2-4add-a010-81abcbe145eb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:24.937935 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ade5970b-8ee2-4add-a010-81abcbe145eb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:24.945507 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ade5970b-8ee2-4add-a010-81abcbe145eb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801" status: 200 len: 1684 microversion: 2.1 time: 0.154417 Jul 27 20:49:24.946464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1979/3974] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:24 2022] GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:25.968538 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9648732e-f11e-4f3f-b03c-c0f088c63e4f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:25.969328 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9648732e-f11e-4f3f-b03c-c0f088c63e4f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:25.975708 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9648732e-f11e-4f3f-b03c-c0f088c63e4f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:25.976162 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9648732e-f11e-4f3f-b03c-c0f088c63e4f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:25.976930 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9648732e-f11e-4f3f-b03c-c0f088c63e4f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:25.977394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9648732e-f11e-4f3f-b03c-c0f088c63e4f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:26.109648 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-9648732e-f11e-4f3f-b03c-c0f088c63e4f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:26.117035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9648732e-f11e-4f3f-b03c-c0f088c63e4f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801" status: 200 len: 1684 microversion: 2.1 time: 0.152687 Jul 27 20:49:26.117595 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1996/3975] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:25 2022] GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:27.138391 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-77a0594c-0b12-4d66-a131-aa9f219806f4 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:27.138979 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-77a0594c-0b12-4d66-a131-aa9f219806f4 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:27.145178 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-77a0594c-0b12-4d66-a131-aa9f219806f4 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:27.145621 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-77a0594c-0b12-4d66-a131-aa9f219806f4 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:27.146376 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-77a0594c-0b12-4d66-a131-aa9f219806f4 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:27.146809 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-77a0594c-0b12-4d66-a131-aa9f219806f4 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:27.360316 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-77a0594c-0b12-4d66-a131-aa9f219806f4 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:27.370038 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-77a0594c-0b12-4d66-a131-aa9f219806f4 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801" status: 200 len: 1684 microversion: 2.1 time: 0.235662 Jul 27 20:49:27.370619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1980/3976] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:27 2022] GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801 => generated 1684 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:27.642077 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-058df1f4-f358-4beb-9e98-0aa47aac204b req-0ed7c869-ec96-4226-8b27-b984d9d83305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8f2d6b-aa7f-486c-95dd-4134388ea801", "name": "network-vif-deleted", "tag": "9af05df8-144b-4d6c-8306-f3d82146ca74"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:49:27.656417 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-058df1f4-f358-4beb-9e98-0aa47aac204b req-0ed7c869-ec96-4226-8b27-b984d9d83305 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:27.656786 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-058df1f4-f358-4beb-9e98-0aa47aac204b req-0ed7c869-ec96-4226-8b27-b984d9d83305 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:27.675279 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-058df1f4-f358-4beb-9e98-0aa47aac204b req-0ed7c869-ec96-4226-8b27-b984d9d83305 service nova] Creating event network-vif-deleted:9af05df8-144b-4d6c-8306-f3d82146ca74 for instance 6a8f2d6b-aa7f-486c-95dd-4134388ea801 on hv-cinder-79987 Jul 27 20:49:27.680930 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-058df1f4-f358-4beb-9e98-0aa47aac204b req-0ed7c869-ec96-4226-8b27-b984d9d83305 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042406 Jul 27 20:49:27.681935 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1997/3977] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:49:28.391200 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-76e99791-2530-4ace-b30e-1a068e74cbaa tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:28.391787 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-76e99791-2530-4ace-b30e-1a068e74cbaa tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:28.398222 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76e99791-2530-4ace-b30e-1a068e74cbaa tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:28.398665 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76e99791-2530-4ace-b30e-1a068e74cbaa tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:28.399428 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76e99791-2530-4ace-b30e-1a068e74cbaa tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:28.400531 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76e99791-2530-4ace-b30e-1a068e74cbaa tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:28.414726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-76e99791-2530-4ace-b30e-1a068e74cbaa tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] HTTP exception thrown: Instance 6a8f2d6b-aa7f-486c-95dd-4134388ea801 could not be found. Jul 27 20:49:28.417634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-76e99791-2530-4ace-b30e-1a068e74cbaa tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Request method failure captured: Jul 27 20:49:28.417634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801 HTTP/1.1 Jul 27 20:49:28.417634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:49:28.417634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:49:28.417634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:49:28.417634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:49:28.417634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:49:28.417634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:49:28.417634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:49:28.417634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:49:28.417634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4aQDgaYQvYIu8Qo0cRbAVWzvY8Dy9GGrZ0HavYCr3wNvgVR2I9Irzc5X_0xRA4MDwtX2JjjvjYYuHwC7Mrh_yi9kIBmZG5-_lltvQDXb5DZDOaE2MSmiAXjFqiUVxXiijuz7iXdho2ln6dfnWOlCMnhNkamPt7HXOo0ngwRoFADP5jE Jul 27 20:49:28.417634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:49:28.417634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:49:28.417634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:49:28.417634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:49:28.417634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:49:28.417634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:49:28.417634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:49:28.417634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:49:28.417634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:49:28.417634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:49:28.419510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6a1fbeedf5134a5a9432e42a35e1d955", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:49:28.419510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:49:28.419510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:49:28.419510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:49:28.419510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:49:28.419510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:49:28.419510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:49:28.419510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: 30051341684845938161bb5ec0680d68 Jul 27 20:49:28.419510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:49:28.419510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:49:28.419510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Instance 6a8f2d6b-aa7f-486c-95dd-4134388ea801 could not be found. Jul 27 20:49:28.419510 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'id': '6a8f2d6b-aa7f-486c-95dd-4134388ea801'} Jul 27 20:49:28.420533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:49:28.420533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:49:28.420533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:49:28.420533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:49:28.420533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:49:28.420533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:49:28.420533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:49:28.420533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:49:28.420533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:49:28.420533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:49:28.420533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a8f2d6b-aa7f-486c-95dd-4134388ea801 could not be found. Jul 27 20:49:28.420533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:49:28.420533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:49:28.420533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:49:28.420533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:49:28.420533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:49:28.420533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:49:28.420533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:49:28.420533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:49:28.420533 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:49:28.422042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:49:28.422042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:49:28.422042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:49:28.422042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:49:28.422042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:49:28.422042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:49:28.422042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:49:28.422042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a8f2d6b-aa7f-486c-95dd-4134388ea801 could not be found. Jul 27 20:49:28.422042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:49:28.422042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:49:28.422042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:49:28.422042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:49:28.422042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:49:28.422042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:49:28.422042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:49:28.422042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:49:28.422042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a8f2d6b-aa7f-486c-95dd-4134388ea801 could not be found. Jul 27 20:49:28.422042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:49:28.423358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-76e99791-2530-4ace-b30e-1a068e74cbaa tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Returning 404 to user: Instance 6a8f2d6b-aa7f-486c-95dd-4134388ea801 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:49:28.423358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-76e99791-2530-4ace-b30e-1a068e74cbaa tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801" status: 404 len: 111 microversion: 2.1 time: 0.031699 Jul 27 20:49:28.423358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1981/3978] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:28 2022] GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:49:28.429269 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-08dacffc-bd05-438f-9220-4b4be71b39de tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '.version_select at 0x7fc7f00fe9d0>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:28.450512 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-08dacffc-bd05-438f-9220-4b4be71b39de tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902534094" status: 202 len: 0 microversion: 2.1 time: 0.025423 Jul 27 20:49:28.451104 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1998/3979] 10.222.0.65 () {58 vars in 1221 bytes} [Wed Jul 27 20:49:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902534094 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:49:29.372032 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7a9087b5-7ea9-4c71-af1f-9678c3d93207 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:29.372525 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7a9087b5-7ea9-4c71-af1f-9678c3d93207 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:29.378528 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a9087b5-7ea9-4c71-af1f-9678c3d93207 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:29.378975 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a9087b5-7ea9-4c71-af1f-9678c3d93207 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:29.379736 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a9087b5-7ea9-4c71-af1f-9678c3d93207 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:29.380173 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a9087b5-7ea9-4c71-af1f-9678c3d93207 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:29.458961 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-7a9087b5-7ea9-4c71-af1f-9678c3d93207 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lazy-loading 'services' on Instance uuid a25e07e9-eb88-4dc7-9833-108d25d57596 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:49:29.528177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7a9087b5-7ea9-4c71-af1f-9678c3d93207 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596/os-volume_attachments/374df824-0ba6-4e9a-b612-ae4aedfce4bf" status: 202 len: 0 microversion: 2.1 time: 0.159962 Jul 27 20:49:29.528823 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1982/3980] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Jul 27 20:49:29 2022] DELETE /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596/os-volume_attachments/374df824-0ba6-4e9a-b612-ae4aedfce4bf => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:49:29.537827 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4c732dd2-b176-4d3a-99e0-dd0fa9167775 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:29.540117 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4c732dd2-b176-4d3a-99e0-dd0fa9167775 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:29.547310 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4c732dd2-b176-4d3a-99e0-dd0fa9167775 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:29.547911 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4c732dd2-b176-4d3a-99e0-dd0fa9167775 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:29.548768 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4c732dd2-b176-4d3a-99e0-dd0fa9167775 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:29.549327 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4c732dd2-b176-4d3a-99e0-dd0fa9167775 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:29.580036 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4c732dd2-b176-4d3a-99e0-dd0fa9167775 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046605 Jul 27 20:49:29.580604 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 1999/3981] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:49:29 2022] GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:49:30.592896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6c9caeb3-d2bb-4000-8c62-c9c73ee72bfd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:30.595392 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6c9caeb3-d2bb-4000-8c62-c9c73ee72bfd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:30.601740 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c9caeb3-d2bb-4000-8c62-c9c73ee72bfd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:30.602194 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c9caeb3-d2bb-4000-8c62-c9c73ee72bfd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:30.603478 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c9caeb3-d2bb-4000-8c62-c9c73ee72bfd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:30.603921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c9caeb3-d2bb-4000-8c62-c9c73ee72bfd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:30.632684 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6c9caeb3-d2bb-4000-8c62-c9c73ee72bfd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044700 Jul 27 20:49:30.633279 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1983/3982] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:49:30 2022] GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 20:49:30.693872 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0dd764fb-583b-40b9-8f04-9f34fc2caf90 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:30.694372 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0dd764fb-583b-40b9-8f04-9f34fc2caf90 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:30.700999 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0dd764fb-583b-40b9-8f04-9f34fc2caf90 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:30.701452 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0dd764fb-583b-40b9-8f04-9f34fc2caf90 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:30.702479 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0dd764fb-583b-40b9-8f04-9f34fc2caf90 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:30.702926 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0dd764fb-583b-40b9-8f04-9f34fc2caf90 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:30.727198 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0dd764fb-583b-40b9-8f04-9f34fc2caf90 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Going to try to terminate instance {{(pid=117876) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:49:30.800377 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0dd764fb-583b-40b9-8f04-9f34fc2caf90 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596" status: 204 len: 0 microversion: 2.1 time: 0.110068 Jul 27 20:49:30.801166 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2000/3983] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 20:49:30 2022] DELETE /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:49:30.812989 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6fb71e8b-a5d7-46c6-8674-c6966e7caa46 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:30.814226 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6fb71e8b-a5d7-46c6-8674-c6966e7caa46 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:30.822887 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6fb71e8b-a5d7-46c6-8674-c6966e7caa46 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:30.823338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6fb71e8b-a5d7-46c6-8674-c6966e7caa46 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:30.824240 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6fb71e8b-a5d7-46c6-8674-c6966e7caa46 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:30.824598 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6fb71e8b-a5d7-46c6-8674-c6966e7caa46 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:30.958979 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6fb71e8b-a5d7-46c6-8674-c6966e7caa46 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:30.967008 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6fb71e8b-a5d7-46c6-8674-c6966e7caa46 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596" status: 200 len: 1682 microversion: 2.1 time: 0.161057 Jul 27 20:49:30.967580 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1984/3984] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:30 2022] GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:31.990850 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-44fec2d5-3c67-4bf0-a272-066667cad222 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:31.991555 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-44fec2d5-3c67-4bf0-a272-066667cad222 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:31.998598 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-44fec2d5-3c67-4bf0-a272-066667cad222 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:31.999044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-44fec2d5-3c67-4bf0-a272-066667cad222 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:31.999849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-44fec2d5-3c67-4bf0-a272-066667cad222 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:32.000287 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-44fec2d5-3c67-4bf0-a272-066667cad222 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:32.131086 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-44fec2d5-3c67-4bf0-a272-066667cad222 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:32.139378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-44fec2d5-3c67-4bf0-a272-066667cad222 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596" status: 200 len: 1682 microversion: 2.1 time: 0.152750 Jul 27 20:49:32.139945 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2001/3985] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:31 2022] GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:33.161331 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a45d51be-f70a-4b31-8178-6197c092a8cd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:33.161958 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a45d51be-f70a-4b31-8178-6197c092a8cd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:33.169388 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a45d51be-f70a-4b31-8178-6197c092a8cd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:33.169956 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a45d51be-f70a-4b31-8178-6197c092a8cd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:33.170729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a45d51be-f70a-4b31-8178-6197c092a8cd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:33.171167 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a45d51be-f70a-4b31-8178-6197c092a8cd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:33.402759 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a45d51be-f70a-4b31-8178-6197c092a8cd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:33.410068 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a45d51be-f70a-4b31-8178-6197c092a8cd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596" status: 200 len: 1682 microversion: 2.1 time: 0.252688 Jul 27 20:49:33.410637 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1985/3986] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:33 2022] GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596 => generated 1682 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:33.833701 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-86ee16b7-fd0c-4ac3-9c12-de68058b5abd req-1b1c60e5-acf9-4116-8b51-c941d260bbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a25e07e9-eb88-4dc7-9833-108d25d57596", "name": "network-vif-deleted", "tag": "17629eca-2b57-4d9b-b17b-66f54466cdd0"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:49:33.846203 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-86ee16b7-fd0c-4ac3-9c12-de68058b5abd req-1b1c60e5-acf9-4116-8b51-c941d260bbb2 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:33.847274 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-86ee16b7-fd0c-4ac3-9c12-de68058b5abd req-1b1c60e5-acf9-4116-8b51-c941d260bbb2 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:33.860142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-86ee16b7-fd0c-4ac3-9c12-de68058b5abd req-1b1c60e5-acf9-4116-8b51-c941d260bbb2 service nova] Creating event network-vif-deleted:17629eca-2b57-4d9b-b17b-66f54466cdd0 for instance a25e07e9-eb88-4dc7-9833-108d25d57596 on hv-cinder-79987 Jul 27 20:49:33.866171 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-86ee16b7-fd0c-4ac3-9c12-de68058b5abd req-1b1c60e5-acf9-4116-8b51-c941d260bbb2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041143 Jul 27 20:49:33.866766 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2002/3987] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:49:34.432168 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ab1cb4a3-9419-483c-a145-9beca7338a98 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:34.432786 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ab1cb4a3-9419-483c-a145-9beca7338a98 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:34.439454 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab1cb4a3-9419-483c-a145-9beca7338a98 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:34.439904 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab1cb4a3-9419-483c-a145-9beca7338a98 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:34.440674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab1cb4a3-9419-483c-a145-9beca7338a98 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:34.441187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab1cb4a3-9419-483c-a145-9beca7338a98 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:34.455718 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-ab1cb4a3-9419-483c-a145-9beca7338a98 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] HTTP exception thrown: Instance a25e07e9-eb88-4dc7-9833-108d25d57596 could not be found. Jul 27 20:49:34.457440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ab1cb4a3-9419-483c-a145-9beca7338a98 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Request method failure captured: Jul 27 20:49:34.457440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596 HTTP/1.1 Jul 27 20:49:34.457440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:49:34.457440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:49:34.457440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:49:34.457440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:49:34.457440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:49:34.457440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:49:34.457440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:49:34.457440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:49:34.457440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4aQDgaYQvYIu8Qo0cRbAVWzvY8Dy9GGrZ0HavYCr3wNvgVR2I9Irzc5X_0xRA4MDwtX2JjjvjYYuHwC7Mrh_yi9kIBmZG5-_lltvQDXb5DZDOaE2MSmiAXjFqiUVxXiijuz7iXdho2ln6dfnWOlCMnhNkamPt7HXOo0ngwRoFADP5jE Jul 27 20:49:34.457440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:49:34.457440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:49:34.457440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:49:34.457440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:49:34.457440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:49:34.457440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:49:34.457440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:49:34.457440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:49:34.457440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:49:34.457440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:49:34.459308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6a1fbeedf5134a5a9432e42a35e1d955", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:49:34.459308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:49:34.459308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:49:34.459308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:49:34.459308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:49:34.459308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:49:34.459308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:49:34.459308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: 30051341684845938161bb5ec0680d68 Jul 27 20:49:34.459308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:49:34.459308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:49:34.459308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Instance a25e07e9-eb88-4dc7-9833-108d25d57596 could not be found. Jul 27 20:49:34.459308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'id': 'a25e07e9-eb88-4dc7-9833-108d25d57596'} Jul 27 20:49:34.460277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:49:34.460277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:49:34.460277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:49:34.460277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:49:34.460277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:49:34.460277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:49:34.460277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:49:34.460277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:49:34.460277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:49:34.460277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:49:34.460277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a25e07e9-eb88-4dc7-9833-108d25d57596 could not be found. Jul 27 20:49:34.460277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:49:34.460277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:49:34.460277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:49:34.460277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:49:34.460277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:49:34.460277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:49:34.460277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:49:34.460277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:49:34.460277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:49:34.462020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:49:34.462020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:49:34.462020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:49:34.462020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:49:34.462020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:49:34.462020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:49:34.462020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:49:34.462020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a25e07e9-eb88-4dc7-9833-108d25d57596 could not be found. Jul 27 20:49:34.462020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:49:34.462020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:49:34.462020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:49:34.462020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:49:34.462020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:49:34.462020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:49:34.462020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:49:34.462020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:49:34.462020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a25e07e9-eb88-4dc7-9833-108d25d57596 could not be found. Jul 27 20:49:34.462020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:49:34.463667 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ab1cb4a3-9419-483c-a145-9beca7338a98 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Returning 404 to user: Instance a25e07e9-eb88-4dc7-9833-108d25d57596 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:49:34.463667 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ab1cb4a3-9419-483c-a145-9beca7338a98 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596" status: 404 len: 111 microversion: 2.1 time: 0.031199 Jul 27 20:49:34.463667 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1986/3988] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:34 2022] GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:49:34.468956 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-fd495f8e-f616-4166-8118-54acc151c17f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '.version_select at 0x7fc7f0123160>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:34.489224 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-fd495f8e-f616-4166-8118-54acc151c17f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1145877817" status: 202 len: 0 microversion: 2.1 time: 0.024394 Jul 27 20:49:34.489814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2003/3989] 10.222.0.65 () {58 vars in 1221 bytes} [Wed Jul 27 20:49:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1145877817 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 27 20:49:35.132942 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ba228031-5a95-4ab3-99c3-7dba31830f7d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Action: 'create', calling method: .version_select at 0x7fc7eae7c820>, body: {"keypair": {"name": "tempest-keypair-401278068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLGM8zkG5S12GbNH4BGAqBf3sdMoe/4YYUROX9cx4gmeLIGak+G4B6aEBZJflUmIvz2sQcpHo4eJYLUouJSdajLsYkWEvIi0gGIFpayHFR/O+hY+P3a5U4TZ+m+SN89vg=="}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:49:35.148799 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-ba228031-5a95-4ab3-99c3-7dba31830f7d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Getting quotas for project 6a1fbeedf5134a5a9432e42a35e1d955. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:49:35.153445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-ba228031-5a95-4ab3-99c3-7dba31830f7d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Getting quotas for user 30051341684845938161bb5ec0680d68 and project 6a1fbeedf5134a5a9432e42a35e1d955. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:49:35.177429 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ba228031-5a95-4ab3-99c3-7dba31830f7d tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048505 Jul 27 20:49:35.178234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1987/3990] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Jul 27 20:49:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:49:36.493365 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e8981ca4-1d47-4162-84c6-cf5144b80c95 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-812447389", "imageRef": "fb689bea-534a-4aac-bec3-8f55591dba58", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3e92f9c-ddde-4f3c-bca6-344bcb620cac"}], "security_groups": [{"name": "tempest-securitygroup--1786130097"}], "key_name": "tempest-keypair-401278068", "user_data": "}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:49:36.598431 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.network.neutron [None req-e8981ca4-1d47-4162-84c6-cf5144b80c95 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] validate_networks() for [('a3e92f9c-ddde-4f3c-bca6-344bcb620cac', None, None, None, None, None)] {{(pid=117876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:49:37.064383 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-e8981ca4-1d47-4162-84c6-cf5144b80c95 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Flavor limits 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:49:37.064845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-e8981ca4-1d47-4162-84c6-cf5144b80c95 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Image limits 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:49:37.065359 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-e8981ca4-1d47-4162-84c6-cf5144b80c95 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Flavor pref 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:49:37.065780 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-e8981ca4-1d47-4162-84c6-cf5144b80c95 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Image pref 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:49:37.066203 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-e8981ca4-1d47-4162-84c6-cf5144b80c95 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:49:37.075372 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8981ca4-1d47-4162-84c6-cf5144b80c95 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:37.075830 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8981ca4-1d47-4162-84c6-cf5144b80c95 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:37.076896 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8981ca4-1d47-4162-84c6-cf5144b80c95 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:37.077380 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e8981ca4-1d47-4162-84c6-cf5144b80c95 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:37.094712 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-e8981ca4-1d47-4162-84c6-cf5144b80c95 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Getting quotas for project 6a1fbeedf5134a5a9432e42a35e1d955. Resources: {'cores', 'instances', 'ram'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:49:37.098620 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-e8981ca4-1d47-4162-84c6-cf5144b80c95 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Getting quotas for user 30051341684845938161bb5ec0680d68 and project 6a1fbeedf5134a5a9432e42a35e1d955. Resources: {'cores', 'instances', 'ram'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:49:37.110291 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e8981ca4-1d47-4162-84c6-cf5144b80c95 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Going to run 1 instances... {{(pid=117876) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:49:37.112658 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e8981ca4-1d47-4162-84c6-cf5144b80c95 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb689bea-534a-4aac-bec3-8f55591dba58',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:49:37.160340 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e8981ca4-1d47-4162-84c6-cf5144b80c95 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.672001 Jul 27 20:49:37.161013 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2004/3991] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Jul 27 20:49:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:49:37.173082 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-adb05694-6777-4eb6-80cd-e652b37951cc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:37.173693 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-adb05694-6777-4eb6-80cd-e652b37951cc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:37.229948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-adb05694-6777-4eb6-80cd-e652b37951cc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:37.238338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-adb05694-6777-4eb6-80cd-e652b37951cc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762" status: 200 len: 1240 microversion: 2.1 time: 0.069818 Jul 27 20:49:37.238905 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1988/3992] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:37 2022] GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:38.259366 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0b1820c6-03a0-41ab-baab-d2458ece5e2b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:38.260120 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0b1820c6-03a0-41ab-baab-d2458ece5e2b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:38.268414 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b1820c6-03a0-41ab-baab-d2458ece5e2b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:38.268867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b1820c6-03a0-41ab-baab-d2458ece5e2b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:38.269683 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b1820c6-03a0-41ab-baab-d2458ece5e2b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:38.270126 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0b1820c6-03a0-41ab-baab-d2458ece5e2b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:38.336870 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0b1820c6-03a0-41ab-baab-d2458ece5e2b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:38.345469 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0b1820c6-03a0-41ab-baab-d2458ece5e2b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762" status: 200 len: 1298 microversion: 2.1 time: 0.090171 Jul 27 20:49:38.346050 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2005/3993] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:38 2022] GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762 => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:39.366410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-05201636-f1e6-4795-a2a6-e28265d15b20 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:39.367030 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-05201636-f1e6-4795-a2a6-e28265d15b20 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:39.373820 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05201636-f1e6-4795-a2a6-e28265d15b20 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:39.374278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05201636-f1e6-4795-a2a6-e28265d15b20 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:39.375053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05201636-f1e6-4795-a2a6-e28265d15b20 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:39.375494 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05201636-f1e6-4795-a2a6-e28265d15b20 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:39.594888 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-05201636-f1e6-4795-a2a6-e28265d15b20 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:39.603513 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-05201636-f1e6-4795-a2a6-e28265d15b20 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762" status: 200 len: 1366 microversion: 2.1 time: 0.240690 Jul 27 20:49:39.604406 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1989/3994] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:39 2022] GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:39.827137 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-59738678-d896-4233-9f66-89781b6c596f req-9a0e1855-e982-404f-9ccc-6582cc98f138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbdc2ac3-9ac5-4627-9b67-af2f3857a762", "tag": "cb0c31c1-74eb-4d3e-a5a8-5a833a37afec"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:49:39.841409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-59738678-d896-4233-9f66-89781b6c596f req-9a0e1855-e982-404f-9ccc-6582cc98f138 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:39.841767 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-59738678-d896-4233-9f66-89781b6c596f req-9a0e1855-e982-404f-9ccc-6582cc98f138 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:39.856518 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-59738678-d896-4233-9f66-89781b6c596f req-9a0e1855-e982-404f-9ccc-6582cc98f138 service nova] Creating event network-changed:cb0c31c1-74eb-4d3e-a5a8-5a833a37afec for instance fbdc2ac3-9ac5-4627-9b67-af2f3857a762 on hv-cinder-79987 Jul 27 20:49:39.861768 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-59738678-d896-4233-9f66-89781b6c596f req-9a0e1855-e982-404f-9ccc-6582cc98f138 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043436 Jul 27 20:49:39.862387 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2006/3995] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:49:40.624620 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bc0e3dcc-3591-4399-bd7c-e06d5ebf78f8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:40.625188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bc0e3dcc-3591-4399-bd7c-e06d5ebf78f8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:40.631652 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc0e3dcc-3591-4399-bd7c-e06d5ebf78f8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:40.632100 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc0e3dcc-3591-4399-bd7c-e06d5ebf78f8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:40.632859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc0e3dcc-3591-4399-bd7c-e06d5ebf78f8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:40.633325 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc0e3dcc-3591-4399-bd7c-e06d5ebf78f8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:40.764179 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bc0e3dcc-3591-4399-bd7c-e06d5ebf78f8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:40.771501 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bc0e3dcc-3591-4399-bd7c-e06d5ebf78f8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762" status: 200 len: 1366 microversion: 2.1 time: 0.150883 Jul 27 20:49:40.772051 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1990/3996] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:40 2022] GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:41.792507 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-bdc5b062-9b2e-4a07-bb70-58e6a661c5bd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:41.793259 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-bdc5b062-9b2e-4a07-bb70-58e6a661c5bd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:41.799364 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bdc5b062-9b2e-4a07-bb70-58e6a661c5bd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:41.799809 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bdc5b062-9b2e-4a07-bb70-58e6a661c5bd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:41.800559 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bdc5b062-9b2e-4a07-bb70-58e6a661c5bd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:41.801015 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-bdc5b062-9b2e-4a07-bb70-58e6a661c5bd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:41.936722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-bdc5b062-9b2e-4a07-bb70-58e6a661c5bd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:41.944135 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-bdc5b062-9b2e-4a07-bb70-58e6a661c5bd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762" status: 200 len: 1366 microversion: 2.1 time: 0.156296 Jul 27 20:49:41.944707 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2007/3997] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:41 2022] GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:42.965293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-af3f0b2b-55f8-478e-8184-83e3cb4223f9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:42.965931 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-af3f0b2b-55f8-478e-8184-83e3cb4223f9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:42.972426 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af3f0b2b-55f8-478e-8184-83e3cb4223f9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:42.972878 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af3f0b2b-55f8-478e-8184-83e3cb4223f9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:42.973686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af3f0b2b-55f8-478e-8184-83e3cb4223f9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:42.974124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af3f0b2b-55f8-478e-8184-83e3cb4223f9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:43.112218 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-af3f0b2b-55f8-478e-8184-83e3cb4223f9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:43.120613 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-af3f0b2b-55f8-478e-8184-83e3cb4223f9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762" status: 200 len: 1366 microversion: 2.1 time: 0.159322 Jul 27 20:49:43.121209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1991/3998] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:42 2022] GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:44.141810 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5aa475cf-cbd3-472b-94eb-e2b1484478ef tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:44.142421 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5aa475cf-cbd3-472b-94eb-e2b1484478ef tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:44.148918 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5aa475cf-cbd3-472b-94eb-e2b1484478ef tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:44.149409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5aa475cf-cbd3-472b-94eb-e2b1484478ef tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:44.150311 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5aa475cf-cbd3-472b-94eb-e2b1484478ef tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:44.151324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5aa475cf-cbd3-472b-94eb-e2b1484478ef tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:44.283246 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5aa475cf-cbd3-472b-94eb-e2b1484478ef tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:44.290664 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5aa475cf-cbd3-472b-94eb-e2b1484478ef tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762" status: 200 len: 1366 microversion: 2.1 time: 0.152731 Jul 27 20:49:44.291813 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2008/3999] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:44 2022] GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:45.053754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-3626e752-3bd7-4708-8199-3fa3759ff47d req-a05e3982-f608-442f-9cf0-bd6bff1451bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbdc2ac3-9ac5-4627-9b67-af2f3857a762", "name": "network-vif-plugged", "status": "completed", "tag": "cb0c31c1-74eb-4d3e-a5a8-5a833a37afec"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:49:45.064250 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-3626e752-3bd7-4708-8199-3fa3759ff47d req-a05e3982-f608-442f-9cf0-bd6bff1451bd service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:45.064718 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-3626e752-3bd7-4708-8199-3fa3759ff47d req-a05e3982-f608-442f-9cf0-bd6bff1451bd service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:45.077555 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-3626e752-3bd7-4708-8199-3fa3759ff47d req-a05e3982-f608-442f-9cf0-bd6bff1451bd service nova] Creating event network-vif-plugged:cb0c31c1-74eb-4d3e-a5a8-5a833a37afec for instance fbdc2ac3-9ac5-4627-9b67-af2f3857a762 on hv-cinder-79987 Jul 27 20:49:45.082725 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-3626e752-3bd7-4708-8199-3fa3759ff47d req-a05e3982-f608-442f-9cf0-bd6bff1451bd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032686 Jul 27 20:49:45.083331 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1992/4000] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:49:45.311925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b260a3eb-375b-4a64-91e3-fa4259e3a28c tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:45.312542 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b260a3eb-375b-4a64-91e3-fa4259e3a28c tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:45.319352 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b260a3eb-375b-4a64-91e3-fa4259e3a28c tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:45.319798 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b260a3eb-375b-4a64-91e3-fa4259e3a28c tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:45.320561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b260a3eb-375b-4a64-91e3-fa4259e3a28c tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:45.321023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b260a3eb-375b-4a64-91e3-fa4259e3a28c tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:45.447434 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b260a3eb-375b-4a64-91e3-fa4259e3a28c tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:45.455155 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b260a3eb-375b-4a64-91e3-fa4259e3a28c tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762" status: 200 len: 1366 microversion: 2.1 time: 0.147168 Jul 27 20:49:45.455723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2009/4001] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:45 2022] GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:46.477783 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f89ff15a-f438-4346-8654-a338896c5502 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:46.478489 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f89ff15a-f438-4346-8654-a338896c5502 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:46.485738 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f89ff15a-f438-4346-8654-a338896c5502 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:46.486195 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f89ff15a-f438-4346-8654-a338896c5502 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:46.486962 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f89ff15a-f438-4346-8654-a338896c5502 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:46.487403 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f89ff15a-f438-4346-8654-a338896c5502 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:46.616181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f89ff15a-f438-4346-8654-a338896c5502 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:46.624281 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f89ff15a-f438-4346-8654-a338896c5502 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762" status: 200 len: 1366 microversion: 2.1 time: 0.151844 Jul 27 20:49:46.624856 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1993/4002] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:46 2022] GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:47.645603 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8a3068d5-e887-46b0-80cd-18e405845f15 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:47.646330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8a3068d5-e887-46b0-80cd-18e405845f15 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:47.648715 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=2 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:49:47.649385 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=6 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:49:47.657199 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8a3068d5-e887-46b0-80cd-18e405845f15 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:47.657653 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8a3068d5-e887-46b0-80cd-18e405845f15 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:47.658493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8a3068d5-e887-46b0-80cd-18e405845f15 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:47.658930 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8a3068d5-e887-46b0-80cd-18e405845f15 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:47.794817 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8a3068d5-e887-46b0-80cd-18e405845f15 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:49:47.802257 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8a3068d5-e887-46b0-80cd-18e405845f15 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762" status: 200 len: 1557 microversion: 2.1 time: 0.160499 Jul 27 20:49:47.802818 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2010/4003] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:49:47 2022] GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:49:47.823468 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6125746c-e4b8-436d-8e7f-052b812567c8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:49:47.824108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6125746c-e4b8-436d-8e7f-052b812567c8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:49:47.826100 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=6 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:49:47.831597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6125746c-e4b8-436d-8e7f-052b812567c8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:47.832041 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6125746c-e4b8-436d-8e7f-052b812567c8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:47.832799 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6125746c-e4b8-436d-8e7f-052b812567c8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:47.833270 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6125746c-e4b8-436d-8e7f-052b812567c8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:47.921490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6125746c-e4b8-436d-8e7f-052b812567c8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102192 Jul 27 20:49:47.922080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1994/4004] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Jul 27 20:49:47 2022] GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:49:48.844091 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-64661516-3031-4516-98d0-a619849900c9 req-52543469-12a0-480f-8e6f-874ca68296c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbdc2ac3-9ac5-4627-9b67-af2f3857a762", "tag": "cb0c31c1-74eb-4d3e-a5a8-5a833a37afec"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:49:48.854035 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-64661516-3031-4516-98d0-a619849900c9 req-52543469-12a0-480f-8e6f-874ca68296c0 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:49:48.855092 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-64661516-3031-4516-98d0-a619849900c9 req-52543469-12a0-480f-8e6f-874ca68296c0 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:49:48.868212 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-64661516-3031-4516-98d0-a619849900c9 req-52543469-12a0-480f-8e6f-874ca68296c0 service nova] Creating event network-changed:cb0c31c1-74eb-4d3e-a5a8-5a833a37afec for instance fbdc2ac3-9ac5-4627-9b67-af2f3857a762 on hv-cinder-79987 Jul 27 20:49:48.873424 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-64661516-3031-4516-98d0-a619849900c9 req-52543469-12a0-480f-8e6f-874ca68296c0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033030 Jul 27 20:49:48.874553 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2011/4005] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:51:04.072921 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:51:04.074390 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:51:04.242963 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c15af8a0-4718-4f14-b060-e071738d72e9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:04.243508 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c15af8a0-4718-4f14-b060-e071738d72e9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:04.249473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c15af8a0-4718-4f14-b060-e071738d72e9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:04.249919 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c15af8a0-4718-4f14-b060-e071738d72e9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:04.250667 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c15af8a0-4718-4f14-b060-e071738d72e9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:04.251100 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c15af8a0-4718-4f14-b060-e071738d72e9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:04.273540 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c15af8a0-4718-4f14-b060-e071738d72e9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762/ips" status: 200 len: 151 microversion: 2.1 time: 0.202466 Jul 27 20:51:04.274013 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1995/4006] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Jul 27 20:51:04 2022] GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762/ips => generated 151 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:51:05.195148 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:51:05.195877 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:51:05.200517 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-59b86bfc-b41c-4880-b137-016c86879fd1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:05.201072 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-59b86bfc-b41c-4880-b137-016c86879fd1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:05.210309 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-59b86bfc-b41c-4880-b137-016c86879fd1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:05.210757 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-59b86bfc-b41c-4880-b137-016c86879fd1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:05.211526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-59b86bfc-b41c-4880-b137-016c86879fd1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:05.212476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-59b86bfc-b41c-4880-b137-016c86879fd1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:05.240196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-59b86bfc-b41c-4880-b137-016c86879fd1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Going to try to terminate instance {{(pid=117876) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:51:05.314821 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-59b86bfc-b41c-4880-b137-016c86879fd1 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "DELETE /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 204 len: 0 microversion: 2.1 time: 0.121483 Jul 27 20:51:05.315363 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2012/4007] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 20:51:05 2022] DELETE /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:51:05.323876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dee87b69-ecfb-4f75-959f-c1c163207b2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:05.324509 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dee87b69-ecfb-4f75-959f-c1c163207b2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:05.331209 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dee87b69-ecfb-4f75-959f-c1c163207b2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:05.331656 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dee87b69-ecfb-4f75-959f-c1c163207b2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:05.332410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dee87b69-ecfb-4f75-959f-c1c163207b2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:05.332848 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dee87b69-ecfb-4f75-959f-c1c163207b2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:05.533313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dee87b69-ecfb-4f75-959f-c1c163207b2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:05.540795 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dee87b69-ecfb-4f75-959f-c1c163207b2a tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1505 microversion: 2.1 time: 0.221215 Jul 27 20:51:05.541418 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1996/4008] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:05 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1505 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:05.607151 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f122d649-df07-4180-b43f-52a256a710ac tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "013ea335-7071-4c0f-a685-d09f35b00ff6"}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:51:05.609606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f122d649-df07-4180-b43f-52a256a710ac tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:05.615519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f122d649-df07-4180-b43f-52a256a710ac tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:05.615981 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f122d649-df07-4180-b43f-52a256a710ac tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:05.616751 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f122d649-df07-4180-b43f-52a256a710ac tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:05.617227 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f122d649-df07-4180-b43f-52a256a710ac tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:05.935278 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f122d649-df07-4180-b43f-52a256a710ac tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "POST /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332359 Jul 27 20:51:05.935873 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2013/4009] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Jul 27 20:51:05 2022] POST /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:51:06.561881 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-04d35eab-39c5-4340-9e46-fa81df39be38 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:06.562485 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-04d35eab-39c5-4340-9e46-fa81df39be38 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:06.568895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04d35eab-39c5-4340-9e46-fa81df39be38 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:06.569393 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04d35eab-39c5-4340-9e46-fa81df39be38 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:06.570158 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04d35eab-39c5-4340-9e46-fa81df39be38 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:06.570598 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04d35eab-39c5-4340-9e46-fa81df39be38 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:06.782264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-04d35eab-39c5-4340-9e46-fa81df39be38 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:06.789811 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-04d35eab-39c5-4340-9e46-fa81df39be38 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 200 len: 1505 microversion: 2.1 time: 0.231761 Jul 27 20:51:06.790464 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1997/4010] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:06 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 1505 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:06.975067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-a35ab1cb-600f-4fbf-8f3f-2a772a7ad4d7 req-acf5a4ad-cdd3-48a1-ab99-8097605841d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72605170-2987-4669-ac91-425028a572f9", "name": "network-vif-deleted", "tag": "43f1be02-78dc-4f7e-a834-fc4c4494971d"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:51:06.988893 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-a35ab1cb-600f-4fbf-8f3f-2a772a7ad4d7 req-acf5a4ad-cdd3-48a1-ab99-8097605841d9 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:06.989378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-a35ab1cb-600f-4fbf-8f3f-2a772a7ad4d7 req-acf5a4ad-cdd3-48a1-ab99-8097605841d9 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:07.001271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-a35ab1cb-600f-4fbf-8f3f-2a772a7ad4d7 req-acf5a4ad-cdd3-48a1-ab99-8097605841d9 service nova] Creating event network-vif-deleted:43f1be02-78dc-4f7e-a834-fc4c4494971d for instance 72605170-2987-4669-ac91-425028a572f9 on hv-cinder-79987 Jul 27 20:51:07.006720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-a35ab1cb-600f-4fbf-8f3f-2a772a7ad4d7 req-acf5a4ad-cdd3-48a1-ab99-8097605841d9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097400 Jul 27 20:51:07.007576 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2014/4011] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:51:07.812754 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-396bf48d-3405-40bf-bcbc-69c620932d5d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:07.813407 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-396bf48d-3405-40bf-bcbc-69c620932d5d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: 72605170-2987-4669-ac91-425028a572f9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:07.819840 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-396bf48d-3405-40bf-bcbc-69c620932d5d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:07.820293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-396bf48d-3405-40bf-bcbc-69c620932d5d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:07.821144 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-396bf48d-3405-40bf-bcbc-69c620932d5d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:07.821735 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-396bf48d-3405-40bf-bcbc-69c620932d5d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:07.835740 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-396bf48d-3405-40bf-bcbc-69c620932d5d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] HTTP exception thrown: Instance 72605170-2987-4669-ac91-425028a572f9 could not be found. Jul 27 20:51:07.837399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-396bf48d-3405-40bf-bcbc-69c620932d5d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Request method failure captured: Jul 27 20:51:07.837399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 HTTP/1.1 Jul 27 20:51:07.837399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:51:07.837399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:51:07.837399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:51:07.837399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:51:07.837399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:51:07.837399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:51:07.837399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:51:07.837399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:51:07.837399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4Zs1w1g_5EBOAJHGXZvQfsbeerbcd37lKRD5mUkafMdHZAX3P44SwOy9NISSA8Lh2nFLwJ2io24pgRqnG4EvPMR-HJKAS2sxbES-VziDHtkha7CtqVpqP38PRAt1Y6btPfnsUjV-NLhIZjiSnTrYjlnZs4PaFMjmKlQulWMSRQRQQCg Jul 27 20:51:07.837399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:51:07.837399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:51:07.837399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:51:07.837399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:51:07.837399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:51:07.837399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:51:07.837399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: 1626b826d47a47429a947fa36ace64e4 Jul 27 20:51:07.837399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:51:07.837399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:51:07.837399 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:51:07.839483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1626b826d47a47429a947fa36ace64e4", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:51:07.839483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:51:07.839483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 1626b826d47a47429a947fa36ace64e4 Jul 27 20:51:07.839483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:51:07.839483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-ServerRescueNegativeTestJSON-2064775453-project Jul 27 20:51:07.839483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:51:07.839483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:51:07.839483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: a48eaef4d70b4116bd307374d819bca6 Jul 27 20:51:07.839483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2064775453-project Jul 27 20:51:07.839483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:51:07.839483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Instance 72605170-2987-4669-ac91-425028a572f9 could not be found. Jul 27 20:51:07.839483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'id': '72605170-2987-4669-ac91-425028a572f9'} Jul 27 20:51:07.842817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:51:07.842817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:51:07.842817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:51:07.842817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:51:07.842817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:51:07.842817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:51:07.842817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:51:07.842817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:51:07.842817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:51:07.842817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:51:07.842817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72605170-2987-4669-ac91-425028a572f9 could not be found. Jul 27 20:51:07.842817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:51:07.842817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:51:07.842817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:51:07.842817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:51:07.842817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:51:07.842817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:51:07.842817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:51:07.842817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:51:07.842817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:51:07.844037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:51:07.844037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:51:07.844037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:51:07.844037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:51:07.844037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:51:07.844037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:51:07.844037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:51:07.844037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72605170-2987-4669-ac91-425028a572f9 could not be found. Jul 27 20:51:07.844037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:51:07.844037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:51:07.844037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:51:07.844037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:51:07.844037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:51:07.844037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:51:07.844037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:51:07.844037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:51:07.844037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72605170-2987-4669-ac91-425028a572f9 could not be found. Jul 27 20:51:07.844037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:51:07.845147 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-396bf48d-3405-40bf-bcbc-69c620932d5d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Returning 404 to user: Instance 72605170-2987-4669-ac91-425028a572f9 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:51:07.845147 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-396bf48d-3405-40bf-bcbc-69c620932d5d tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9" status: 404 len: 111 microversion: 2.1 time: 0.030624 Jul 27 20:51:07.845147 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1998/4012] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:07 2022] GET /compute/v2.1/servers/72605170-2987-4669-ac91-425028a572f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:51:07.848661 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ce7e7d53-c955-4445-889e-be37cd091567 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:07.849273 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ce7e7d53-c955-4445-889e-be37cd091567 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:07.856222 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ce7e7d53-c955-4445-889e-be37cd091567 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:07.856679 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ce7e7d53-c955-4445-889e-be37cd091567 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:07.857479 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ce7e7d53-c955-4445-889e-be37cd091567 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:07.857922 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ce7e7d53-c955-4445-889e-be37cd091567 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:07.882242 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ce7e7d53-c955-4445-889e-be37cd091567 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Going to try to terminate instance {{(pid=117876) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:51:07.963173 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ce7e7d53-c955-4445-889e-be37cd091567 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 204 len: 0 microversion: 2.1 time: 0.118136 Jul 27 20:51:07.963786 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2015/4013] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 20:51:07 2022] DELETE /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:51:07.971653 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c8983ad2-41e1-4573-a5c6-a19f699c9e41 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:07.972257 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c8983ad2-41e1-4573-a5c6-a19f699c9e41 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:07.978270 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c8983ad2-41e1-4573-a5c6-a19f699c9e41 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:07.979108 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c8983ad2-41e1-4573-a5c6-a19f699c9e41 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:07.979861 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c8983ad2-41e1-4573-a5c6-a19f699c9e41 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:07.980299 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c8983ad2-41e1-4573-a5c6-a19f699c9e41 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:08.110902 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c8983ad2-41e1-4573-a5c6-a19f699c9e41 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:08.118491 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c8983ad2-41e1-4573-a5c6-a19f699c9e41 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1521 microversion: 2.1 time: 0.150593 Jul 27 20:51:08.119722 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1999/4014] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:07 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:09.140556 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-700d5125-ee84-4ce0-b965-a3906a2cb228 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:09.141287 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-700d5125-ee84-4ce0-b965-a3906a2cb228 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:09.147948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-700d5125-ee84-4ce0-b965-a3906a2cb228 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:09.148545 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-700d5125-ee84-4ce0-b965-a3906a2cb228 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:09.149358 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-700d5125-ee84-4ce0-b965-a3906a2cb228 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:09.149810 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-700d5125-ee84-4ce0-b965-a3906a2cb228 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:09.292735 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-700d5125-ee84-4ce0-b965-a3906a2cb228 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a48eaef4d70b4116bd307374d819bca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1626b826d47a47429a947fa36ace64e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:09.300155 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-700d5125-ee84-4ce0-b965-a3906a2cb228 tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 200 len: 1521 microversion: 2.1 time: 0.163988 Jul 27 20:51:09.300879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2016/4015] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:09 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:09.551601 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-7c4c916a-73c5-4d7c-96cc-62b5a20be738 req-8dd5858a-467b-408e-95cb-aef6e9ff7e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea33250b-8fd3-4d34-97cb-cde5923b7a67", "name": "network-vif-deleted", "tag": "694f60ee-1590-4b2a-bed2-b28fde5be035"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:51:09.564212 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-7c4c916a-73c5-4d7c-96cc-62b5a20be738 req-8dd5858a-467b-408e-95cb-aef6e9ff7e99 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:09.564740 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-7c4c916a-73c5-4d7c-96cc-62b5a20be738 req-8dd5858a-467b-408e-95cb-aef6e9ff7e99 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:09.577375 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-7c4c916a-73c5-4d7c-96cc-62b5a20be738 req-8dd5858a-467b-408e-95cb-aef6e9ff7e99 service nova] Creating event network-vif-deleted:694f60ee-1590-4b2a-bed2-b28fde5be035 for instance ea33250b-8fd3-4d34-97cb-cde5923b7a67 on hv-cinder-79987 Jul 27 20:51:09.582731 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-7c4c916a-73c5-4d7c-96cc-62b5a20be738 req-8dd5858a-467b-408e-95cb-aef6e9ff7e99 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034945 Jul 27 20:51:09.583346 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2000/4016] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:51:10.321515 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2d7bfe86-c6e5-47bc-ad72-500e25ffd46f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:10.322180 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2d7bfe86-c6e5-47bc-ad72-500e25ffd46f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] [instance: ea33250b-8fd3-4d34-97cb-cde5923b7a67] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:10.329142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d7bfe86-c6e5-47bc-ad72-500e25ffd46f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:10.329597 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d7bfe86-c6e5-47bc-ad72-500e25ffd46f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:10.330364 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d7bfe86-c6e5-47bc-ad72-500e25ffd46f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:10.330806 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d7bfe86-c6e5-47bc-ad72-500e25ffd46f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:10.344664 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-2d7bfe86-c6e5-47bc-ad72-500e25ffd46f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] HTTP exception thrown: Instance ea33250b-8fd3-4d34-97cb-cde5923b7a67 could not be found. Jul 27 20:51:10.346334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2d7bfe86-c6e5-47bc-ad72-500e25ffd46f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Request method failure captured: Jul 27 20:51:10.346334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 HTTP/1.1 Jul 27 20:51:10.346334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:51:10.346334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:51:10.346334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:51:10.346334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:51:10.346334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:51:10.346334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:51:10.346334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:51:10.346334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:51:10.346334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4Zs1w1g_5EBOAJHGXZvQfsbeerbcd37lKRD5mUkafMdHZAX3P44SwOy9NISSA8Lh2nFLwJ2io24pgRqnG4EvPMR-HJKAS2sxbES-VziDHtkha7CtqVpqP38PRAt1Y6btPfnsUjV-NLhIZjiSnTrYjlnZs4PaFMjmKlQulWMSRQRQQCg Jul 27 20:51:10.346334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:51:10.346334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:51:10.346334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:51:10.346334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:51:10.346334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:51:10.346334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:51:10.346334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 1626b826d47a47429a947fa36ace64e4 Jul 27 20:51:10.346334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:51:10.346334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:51:10.346334 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:51:10.347570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1626b826d47a47429a947fa36ace64e4", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1626b826d47a47429a947fa36ace64e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:51:10.347570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:51:10.347570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 1626b826d47a47429a947fa36ace64e4 Jul 27 20:51:10.347570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2064775453 Jul 27 20:51:10.347570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-ServerRescueNegativeTestJSON-2064775453-project Jul 27 20:51:10.347570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:51:10.347570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:51:10.347570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: a48eaef4d70b4116bd307374d819bca6 Jul 27 20:51:10.347570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2064775453-project Jul 27 20:51:10.347570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:51:10.347570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Instance ea33250b-8fd3-4d34-97cb-cde5923b7a67 could not be found. Jul 27 20:51:10.347570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'id': 'ea33250b-8fd3-4d34-97cb-cde5923b7a67'} Jul 27 20:51:10.348271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:51:10.348271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:51:10.348271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:51:10.348271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:51:10.348271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:51:10.348271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:51:10.348271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:51:10.348271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:51:10.348271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:51:10.348271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:51:10.348271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea33250b-8fd3-4d34-97cb-cde5923b7a67 could not be found. Jul 27 20:51:10.348271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:51:10.348271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:51:10.348271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:51:10.348271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:51:10.348271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:51:10.348271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:51:10.348271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:51:10.348271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:51:10.348271 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:51:10.349396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:51:10.349396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:51:10.349396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:51:10.349396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:51:10.349396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:51:10.349396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:51:10.349396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:51:10.349396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea33250b-8fd3-4d34-97cb-cde5923b7a67 could not be found. Jul 27 20:51:10.349396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:51:10.349396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:51:10.349396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:51:10.349396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:51:10.349396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:51:10.349396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:51:10.349396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:51:10.349396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:51:10.349396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea33250b-8fd3-4d34-97cb-cde5923b7a67 could not be found. Jul 27 20:51:10.349396 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:51:10.350305 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2d7bfe86-c6e5-47bc-ad72-500e25ffd46f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] Returning 404 to user: Instance ea33250b-8fd3-4d34-97cb-cde5923b7a67 could not be found. {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:51:10.350305 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2d7bfe86-c6e5-47bc-ad72-500e25ffd46f tempest-ServerRescueNegativeTestJSON-2064775453 tempest-ServerRescueNegativeTestJSON-2064775453-project] 10.222.0.65 "GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67" status: 404 len: 111 microversion: 2.1 time: 0.030130 Jul 27 20:51:10.350305 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2017/4017] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:10 2022] GET /compute/v2.1/servers/ea33250b-8fd3-4d34-97cb-cde5923b7a67 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:51:13.528051 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f2b4eeee-216d-4804-9af5-098dc7302b42 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "013ea335-7071-4c0f-a685-d09f35b00ff6"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:51:13.530449 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f2b4eeee-216d-4804-9af5-098dc7302b42 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:13.538879 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f2b4eeee-216d-4804-9af5-098dc7302b42 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:13.539332 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f2b4eeee-216d-4804-9af5-098dc7302b42 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:13.540166 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f2b4eeee-216d-4804-9af5-098dc7302b42 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:13.540605 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f2b4eeee-216d-4804-9af5-098dc7302b42 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:13.624324 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-f2b4eeee-216d-4804-9af5-098dc7302b42 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] HTTP exception thrown: Invalid volume: volume 013ea335-7071-4c0f-a685-d09f35b00ff6 is already attached to instances: fbdc2ac3-9ac5-4627-9b67-af2f3857a762 Jul 27 20:51:13.626187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f2b4eeee-216d-4804-9af5-098dc7302b42 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Request method failure captured: Jul 27 20:51:13.626187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: POST /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762/os-volume_attachments HTTP/1.1 Jul 27 20:51:13.626187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:51:13.626187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:51:13.626187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:51:13.626187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 74 Jul 27 20:51:13.626187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:51:13.626187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:51:13.626187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:51:13.626187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:51:13.626187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4aQDgaYQvYIu8Qo0cRbAVWzvY8Dy9GGrZ0HavYCr3wNvgVR2I9Irzc5X_0xRA4MDwtX2JjjvjYYuHwC7Mrh_yi9kIBmZG5-_lltvQDXb5DZDOaE2MSmiAXjFqiUVxXiijuz7iXdho2ln6dfnWOlCMnhNkamPt7HXOo0ngwRoFADP5jE Jul 27 20:51:13.626187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:51:13.626187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:51:13.626187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:51:13.626187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:51:13.626187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:51:13.626187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:51:13.626187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:51:13.626187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:51:13.626187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:51:13.626187 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:51:13.627536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6a1fbeedf5134a5a9432e42a35e1d955", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:51:13.627536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:51:13.627536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:51:13.627536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:51:13.627536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:51:13.627536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:51:13.627536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:51:13.627536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: 30051341684845938161bb5ec0680d68 Jul 27 20:51:13.627536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:51:13.627536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Jul 27 20:51:13.627536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {"volumeAttachment": {"volumeId": "013ea335-7071-4c0f-a685-d09f35b00ff6"}} Jul 27 20:51:13.627536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:51:13.628345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Invalid volume: volume 013ea335-7071-4c0f-a685-d09f35b00ff6 is already attached to instances: fbdc2ac3-9ac5-4627-9b67-af2f3857a762 Jul 27 20:51:13.628345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'server_id': 'fbdc2ac3-9ac5-4627-9b67-af2f3857a762', 'body': {'volumeAttachment': {'volumeId': '013ea335-7071-4c0f-a685-d09f35b00ff6'}}} Jul 27 20:51:13.628345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:51:13.628345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:51:13.628345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 27 20:51:13.628345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 27 20:51:13.628345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 27 20:51:13.628345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 27 20:51:13.628345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 27 20:51:13.628345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 27 20:51:13.628345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 27 20:51:13.628345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 27 20:51:13.628345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 27 20:51:13.628345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 27 20:51:13.628345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 013ea335-7071-4c0f-a685-d09f35b00ff6 is already attached to instances: fbdc2ac3-9ac5-4627-9b67-af2f3857a762 Jul 27 20:51:13.628345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:51:13.628345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:51:13.628345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:51:13.628345 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:51:13.629538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:51:13.629538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:51:13.629538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:51:13.629538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:51:13.629538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:51:13.629538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:51:13.629538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 20:51:13.629538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 20:51:13.629538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 20:51:13.629538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 20:51:13.629538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 27 20:51:13.629538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 27 20:51:13.629538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 27 20:51:13.629538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 27 20:51:13.629538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 013ea335-7071-4c0f-a685-d09f35b00ff6 is already attached to instances: fbdc2ac3-9ac5-4627-9b67-af2f3857a762 Jul 27 20:51:13.629538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:51:13.629538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:51:13.629538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:51:13.629538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:51:13.629538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:51:13.630723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:51:13.630723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:51:13.630723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:51:13.630723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 013ea335-7071-4c0f-a685-d09f35b00ff6 is already attached to instances: fbdc2ac3-9ac5-4627-9b67-af2f3857a762 Jul 27 20:51:13.630723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:51:13.630723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f2b4eeee-216d-4804-9af5-098dc7302b42 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Returning 400 to user: Invalid volume: volume 013ea335-7071-4c0f-a685-d09f35b00ff6 is already attached to instances: fbdc2ac3-9ac5-4627-9b67-af2f3857a762 {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:51:13.630723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f2b4eeee-216d-4804-9af5-098dc7302b42 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "POST /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110792 Jul 27 20:51:13.630723 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2001/4018] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Jul 27 20:51:13 2022] POST /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 27 20:51:13.693441 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-80afd139-9658-440e-82d5-240fe08830bf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:13.694008 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-80afd139-9658-440e-82d5-240fe08830bf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:13.700985 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-80afd139-9658-440e-82d5-240fe08830bf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:13.701774 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-80afd139-9658-440e-82d5-240fe08830bf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:13.702601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-80afd139-9658-440e-82d5-240fe08830bf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:13.703105 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-80afd139-9658-440e-82d5-240fe08830bf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:13.799430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.objects.instance [None req-80afd139-9658-440e-82d5-240fe08830bf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lazy-loading 'services' on Instance uuid fbdc2ac3-9ac5-4627-9b67-af2f3857a762 {{(pid=117876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:51:13.875162 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-80afd139-9658-440e-82d5-240fe08830bf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "DELETE /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762/os-volume_attachments/013ea335-7071-4c0f-a685-d09f35b00ff6" status: 202 len: 0 microversion: 2.1 time: 0.185399 Jul 27 20:51:13.875884 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2018/4019] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Jul 27 20:51:13 2022] DELETE /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762/os-volume_attachments/013ea335-7071-4c0f-a685-d09f35b00ff6 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:51:13.885847 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3e25333f-bdcc-4e68-afd1-ce183f1923c5 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:13.888198 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3e25333f-bdcc-4e68-afd1-ce183f1923c5 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:13.894619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e25333f-bdcc-4e68-afd1-ce183f1923c5 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:13.895134 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e25333f-bdcc-4e68-afd1-ce183f1923c5 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:13.896157 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e25333f-bdcc-4e68-afd1-ce183f1923c5 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:13.896488 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e25333f-bdcc-4e68-afd1-ce183f1923c5 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:13.941005 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3e25333f-bdcc-4e68-afd1-ce183f1923c5 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060549 Jul 27 20:51:13.941718 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2002/4020] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:51:13 2022] GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:51:14.954745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-1871bc22-e58a-4117-921f-d3ce8df755df tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:14.957079 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-1871bc22-e58a-4117-921f-d3ce8df755df tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:14.964158 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1871bc22-e58a-4117-921f-d3ce8df755df tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:14.964589 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1871bc22-e58a-4117-921f-d3ce8df755df tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:14.965553 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1871bc22-e58a-4117-921f-d3ce8df755df tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:14.965989 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-1871bc22-e58a-4117-921f-d3ce8df755df tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:14.995398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-1871bc22-e58a-4117-921f-d3ce8df755df tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045153 Jul 27 20:51:14.996200 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2019/4021] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:51:14 2022] GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 20:51:15.058646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e01f9b21-8869-48a2-9dcd-e23163d1d3e2 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:15.059273 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e01f9b21-8869-48a2-9dcd-e23163d1d3e2 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:15.066147 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e01f9b21-8869-48a2-9dcd-e23163d1d3e2 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:15.066690 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e01f9b21-8869-48a2-9dcd-e23163d1d3e2 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:15.067661 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e01f9b21-8869-48a2-9dcd-e23163d1d3e2 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:15.068112 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e01f9b21-8869-48a2-9dcd-e23163d1d3e2 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:15.096133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e01f9b21-8869-48a2-9dcd-e23163d1d3e2 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:51:15.176347 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e01f9b21-8869-48a2-9dcd-e23163d1d3e2 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "DELETE /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762" status: 204 len: 0 microversion: 2.1 time: 0.121673 Jul 27 20:51:15.180189 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2003/4022] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 20:51:15 2022] DELETE /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:51:15.188226 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-149976fb-5c64-4096-a1d7-ef8d8b05bb57 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:15.188847 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-149976fb-5c64-4096-a1d7-ef8d8b05bb57 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:15.195167 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-149976fb-5c64-4096-a1d7-ef8d8b05bb57 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:15.197889 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-149976fb-5c64-4096-a1d7-ef8d8b05bb57 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:15.198723 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-149976fb-5c64-4096-a1d7-ef8d8b05bb57 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:15.199173 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-149976fb-5c64-4096-a1d7-ef8d8b05bb57 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:15.336032 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-149976fb-5c64-4096-a1d7-ef8d8b05bb57 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:15.343949 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-149976fb-5c64-4096-a1d7-ef8d8b05bb57 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762" status: 200 len: 1682 microversion: 2.1 time: 0.161446 Jul 27 20:51:15.344517 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2020/4023] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:15 2022] GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:16.366603 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-aa1e4ed9-ddf4-41d2-babb-870a528316c0 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:16.367222 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-aa1e4ed9-ddf4-41d2-babb-870a528316c0 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:16.373814 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa1e4ed9-ddf4-41d2-babb-870a528316c0 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:16.374264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa1e4ed9-ddf4-41d2-babb-870a528316c0 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:16.375030 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa1e4ed9-ddf4-41d2-babb-870a528316c0 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:16.375467 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa1e4ed9-ddf4-41d2-babb-870a528316c0 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:16.505436 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aa1e4ed9-ddf4-41d2-babb-870a528316c0 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:16.514473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-aa1e4ed9-ddf4-41d2-babb-870a528316c0 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762" status: 200 len: 1682 microversion: 2.1 time: 0.152128 Jul 27 20:51:16.515083 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2004/4024] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:16 2022] GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:17.537104 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-da19d409-8992-40fc-84ae-7a30fe7e7d88 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:17.537850 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-da19d409-8992-40fc-84ae-7a30fe7e7d88 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:17.545300 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-da19d409-8992-40fc-84ae-7a30fe7e7d88 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:17.546069 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-da19d409-8992-40fc-84ae-7a30fe7e7d88 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:17.547444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-da19d409-8992-40fc-84ae-7a30fe7e7d88 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:17.549252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-da19d409-8992-40fc-84ae-7a30fe7e7d88 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:17.704589 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-da19d409-8992-40fc-84ae-7a30fe7e7d88 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:17.712322 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-da19d409-8992-40fc-84ae-7a30fe7e7d88 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762" status: 200 len: 1682 microversion: 2.1 time: 0.179683 Jul 27 20:51:17.714081 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2021/4025] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:17 2022] GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762 => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:18.244523 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-0b807aa1-485e-4502-9111-a4596c8ed8d4 req-ba8c1088-f01f-4ee6-85af-9c1b45c8d72a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbdc2ac3-9ac5-4627-9b67-af2f3857a762", "name": "network-vif-deleted", "tag": "cb0c31c1-74eb-4d3e-a5a8-5a833a37afec"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:51:18.257261 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-0b807aa1-485e-4502-9111-a4596c8ed8d4 req-ba8c1088-f01f-4ee6-85af-9c1b45c8d72a service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:18.257624 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-0b807aa1-485e-4502-9111-a4596c8ed8d4 req-ba8c1088-f01f-4ee6-85af-9c1b45c8d72a service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:18.269369 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-0b807aa1-485e-4502-9111-a4596c8ed8d4 req-ba8c1088-f01f-4ee6-85af-9c1b45c8d72a service nova] Creating event network-vif-deleted:cb0c31c1-74eb-4d3e-a5a8-5a833a37afec for instance fbdc2ac3-9ac5-4627-9b67-af2f3857a762 on hv-cinder-79987 Jul 27 20:51:18.274249 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-0b807aa1-485e-4502-9111-a4596c8ed8d4 req-ba8c1088-f01f-4ee6-85af-9c1b45c8d72a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034870 Jul 27 20:51:18.274829 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2005/4026] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:51:18.735795 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-47163923-44c7-494f-9e22-aec8c1c69809 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:18.736630 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-47163923-44c7-494f-9e22-aec8c1c69809 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:18.745154 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-47163923-44c7-494f-9e22-aec8c1c69809 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:18.745616 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-47163923-44c7-494f-9e22-aec8c1c69809 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:18.746399 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-47163923-44c7-494f-9e22-aec8c1c69809 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:18.746849 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-47163923-44c7-494f-9e22-aec8c1c69809 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:18.786504 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-47163923-44c7-494f-9e22-aec8c1c69809 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:18.786981 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-47163923-44c7-494f-9e22-aec8c1c69809 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:18.787440 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.objects.instance [None req-47163923-44c7-494f-9e22-aec8c1c69809 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lazy-loading 'fault' on Instance uuid fbdc2ac3-9ac5-4627-9b67-af2f3857a762 {{(pid=117876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:51:18.835461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-47163923-44c7-494f-9e22-aec8c1c69809 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:18.845328 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-47163923-44c7-494f-9e22-aec8c1c69809 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762" status: 200 len: 1330 microversion: 2.1 time: 0.114036 Jul 27 20:51:18.845897 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2022/4027] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:18 2022] GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762 => generated 1330 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:19.868268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-17198799-70dc-49e3-b863-0f15cacf59f3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:19.868889 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-17198799-70dc-49e3-b863-0f15cacf59f3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:19.875475 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-17198799-70dc-49e3-b863-0f15cacf59f3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:19.875923 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-17198799-70dc-49e3-b863-0f15cacf59f3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:19.876710 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-17198799-70dc-49e3-b863-0f15cacf59f3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:19.877177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-17198799-70dc-49e3-b863-0f15cacf59f3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:19.892636 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-17198799-70dc-49e3-b863-0f15cacf59f3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] HTTP exception thrown: Instance fbdc2ac3-9ac5-4627-9b67-af2f3857a762 could not be found. Jul 27 20:51:19.894364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-17198799-70dc-49e3-b863-0f15cacf59f3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Request method failure captured: Jul 27 20:51:19.894364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762 HTTP/1.1 Jul 27 20:51:19.894364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:51:19.894364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:51:19.894364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:51:19.894364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:51:19.894364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:51:19.894364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:51:19.894364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:51:19.894364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:51:19.894364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4aQDgaYQvYIu8Qo0cRbAVWzvY8Dy9GGrZ0HavYCr3wNvgVR2I9Irzc5X_0xRA4MDwtX2JjjvjYYuHwC7Mrh_yi9kIBmZG5-_lltvQDXb5DZDOaE2MSmiAXjFqiUVxXiijuz7iXdho2ln6dfnWOlCMnhNkamPt7HXOo0ngwRoFADP5jE Jul 27 20:51:19.894364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:51:19.894364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:51:19.894364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:51:19.894364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:51:19.894364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:51:19.894364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:51:19.894364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:51:19.894364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:51:19.894364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:51:19.894364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:51:19.895703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6a1fbeedf5134a5a9432e42a35e1d955", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:51:19.895703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:51:19.895703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:51:19.895703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:51:19.895703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:51:19.895703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:51:19.895703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:51:19.895703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: 30051341684845938161bb5ec0680d68 Jul 27 20:51:19.895703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:51:19.895703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:51:19.895703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Instance fbdc2ac3-9ac5-4627-9b67-af2f3857a762 could not be found. Jul 27 20:51:19.895703 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'id': 'fbdc2ac3-9ac5-4627-9b67-af2f3857a762'} Jul 27 20:51:19.896412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:51:19.896412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:51:19.896412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:51:19.896412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:51:19.896412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:51:19.896412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:51:19.896412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:51:19.896412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:51:19.896412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:51:19.896412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:51:19.896412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbdc2ac3-9ac5-4627-9b67-af2f3857a762 could not be found. Jul 27 20:51:19.896412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:51:19.896412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:51:19.896412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:51:19.896412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:51:19.896412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:51:19.896412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:51:19.896412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:51:19.896412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:51:19.896412 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:51:19.897663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:51:19.897663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:51:19.897663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:51:19.897663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:51:19.897663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:51:19.897663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:51:19.897663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:51:19.897663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbdc2ac3-9ac5-4627-9b67-af2f3857a762 could not be found. Jul 27 20:51:19.897663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:51:19.897663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:51:19.897663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:51:19.897663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:51:19.897663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:51:19.897663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:51:19.897663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:51:19.897663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:51:19.897663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbdc2ac3-9ac5-4627-9b67-af2f3857a762 could not be found. Jul 27 20:51:19.897663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:51:19.898913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-17198799-70dc-49e3-b863-0f15cacf59f3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Returning 404 to user: Instance fbdc2ac3-9ac5-4627-9b67-af2f3857a762 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:51:19.898913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-17198799-70dc-49e3-b863-0f15cacf59f3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762" status: 404 len: 111 microversion: 2.1 time: 0.032266 Jul 27 20:51:19.898913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2006/4028] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:19 2022] GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:51:19.905494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b57c67c9-1f0c-438a-bddb-63479e6266f5 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '.version_select at 0x7fc7f0211a60>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:19.923029 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b57c67c9-1f0c-438a-bddb-63479e6266f5 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-401278068" status: 202 len: 0 microversion: 2.1 time: 0.022097 Jul 27 20:51:19.923606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2023/4029] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Jul 27 20:51:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-401278068 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:51:20.546625 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-579f9b73-bc42-4aa9-ad61-8f6ac22f19b9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Action: 'create', calling method: .version_select at 0x7fc7eae8f790>, body: {"keypair": {"name": "tempest-keypair-1509619940", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkPFegrMRxMB/ySa9BYHpRlkrqm71J5k5rPc4eTqUi6QDf5qDC8srZHHNyLQlIYWNEuGirvrZoGlhczMygnzGmLdgA82EUSlsxpaJ/WPCtgcVylZb6e1ArwRXZabJRXuQ=="}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:51:20.562375 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-579f9b73-bc42-4aa9-ad61-8f6ac22f19b9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Getting quotas for project 6a1fbeedf5134a5a9432e42a35e1d955. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:51:20.566246 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-579f9b73-bc42-4aa9-ad61-8f6ac22f19b9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Getting quotas for user 30051341684845938161bb5ec0680d68 and project 6a1fbeedf5134a5a9432e42a35e1d955. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:51:20.587644 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-579f9b73-bc42-4aa9-ad61-8f6ac22f19b9 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045705 Jul 27 20:51:20.588241 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2007/4030] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Jul 27 20:51:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:51:21.854942 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-affe43d1-0470-49b1-ac34-2df3e2d6422e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-114855307", "imageRef": "fb689bea-534a-4aac-bec3-8f55591dba58", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3e92f9c-ddde-4f3c-bca6-344bcb620cac"}], "security_groups": [{"name": "tempest-securitygroup--151252647"}], "key_name": "tempest-keypair-1509619940", "user_data": "}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:51:21.965346 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.network.neutron [None req-affe43d1-0470-49b1-ac34-2df3e2d6422e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] validate_networks() for [('a3e92f9c-ddde-4f3c-bca6-344bcb620cac', None, None, None, None, None)] {{(pid=117876) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:51:22.365351 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-affe43d1-0470-49b1-ac34-2df3e2d6422e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Flavor limits 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:51:22.365774 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-affe43d1-0470-49b1-ac34-2df3e2d6422e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Image limits 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:51:22.366247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-affe43d1-0470-49b1-ac34-2df3e2d6422e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Flavor pref 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:51:22.366654 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-affe43d1-0470-49b1-ac34-2df3e2d6422e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Image pref 0:0:0 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:51:22.367063 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.virt.hardware [None req-affe43d1-0470-49b1-ac34-2df3e2d6422e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117876) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:51:22.376191 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-affe43d1-0470-49b1-ac34-2df3e2d6422e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:22.376634 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-affe43d1-0470-49b1-ac34-2df3e2d6422e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:22.377452 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-affe43d1-0470-49b1-ac34-2df3e2d6422e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:22.377888 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-affe43d1-0470-49b1-ac34-2df3e2d6422e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:22.397067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-affe43d1-0470-49b1-ac34-2df3e2d6422e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Getting quotas for project 6a1fbeedf5134a5a9432e42a35e1d955. Resources: {'cores', 'instances', 'ram'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:51:22.401085 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-affe43d1-0470-49b1-ac34-2df3e2d6422e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Getting quotas for user 30051341684845938161bb5ec0680d68 and project 6a1fbeedf5134a5a9432e42a35e1d955. Resources: {'cores', 'instances', 'ram'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:51:22.413154 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-affe43d1-0470-49b1-ac34-2df3e2d6422e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Going to run 1 instances... {{(pid=117876) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:51:22.415458 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-affe43d1-0470-49b1-ac34-2df3e2d6422e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fb689bea-534a-4aac-bec3-8f55591dba58',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117876) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:51:22.462343 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-affe43d1-0470-49b1-ac34-2df3e2d6422e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.612419 Jul 27 20:51:22.463242 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2024/4031] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Jul 27 20:51:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:51:22.474679 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-40ba5134-5b8e-4537-880c-dfa14822e985 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:22.475298 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-40ba5134-5b8e-4537-880c-dfa14822e985 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:22.529499 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-40ba5134-5b8e-4537-880c-dfa14822e985 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:22.536102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-40ba5134-5b8e-4537-880c-dfa14822e985 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 200 len: 1241 microversion: 2.1 time: 0.065327 Jul 27 20:51:22.536662 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2008/4032] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:22 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:23.559134 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0043c9ae-85de-4b50-bb9e-ae5eb37b8c7f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:23.560114 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0043c9ae-85de-4b50-bb9e-ae5eb37b8c7f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:23.638177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0043c9ae-85de-4b50-bb9e-ae5eb37b8c7f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:23.646515 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0043c9ae-85de-4b50-bb9e-ae5eb37b8c7f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 200 len: 1241 microversion: 2.1 time: 0.093319 Jul 27 20:51:23.647899 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2025/4033] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:23 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:24.667974 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7d084e36-57b4-4e91-be81-a964c9ea34b0 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:24.668586 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7d084e36-57b4-4e91-be81-a964c9ea34b0 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:24.721380 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7d084e36-57b4-4e91-be81-a964c9ea34b0 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:24.727972 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7d084e36-57b4-4e91-be81-a964c9ea34b0 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 200 len: 1241 microversion: 2.1 time: 0.064587 Jul 27 20:51:24.728538 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2009/4034] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:24 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:25.749733 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-235a6d95-d5e5-4b33-8f95-a5d26c8b8171 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:25.750348 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-235a6d95-d5e5-4b33-8f95-a5d26c8b8171 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:25.805838 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-235a6d95-d5e5-4b33-8f95-a5d26c8b8171 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:25.812556 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-235a6d95-d5e5-4b33-8f95-a5d26c8b8171 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 200 len: 1241 microversion: 2.1 time: 0.066739 Jul 27 20:51:25.813157 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2026/4035] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:25 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:26.834198 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-80a8120b-29f1-4c34-b965-4fd9d0dbd962 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:26.834821 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-80a8120b-29f1-4c34-b965-4fd9d0dbd962 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:26.842876 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80a8120b-29f1-4c34-b965-4fd9d0dbd962 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:26.843330 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80a8120b-29f1-4c34-b965-4fd9d0dbd962 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:26.844095 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80a8120b-29f1-4c34-b965-4fd9d0dbd962 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:26.844537 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80a8120b-29f1-4c34-b965-4fd9d0dbd962 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:26.903270 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-80a8120b-29f1-4c34-b965-4fd9d0dbd962 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:26.910715 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-80a8120b-29f1-4c34-b965-4fd9d0dbd962 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 200 len: 1245 microversion: 2.1 time: 0.080357 Jul 27 20:51:26.911276 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2010/4036] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:26 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:27.933917 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-138a7eee-fbc5-4d70-8957-a03c0a7fcf12 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:27.934546 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-138a7eee-fbc5-4d70-8957-a03c0a7fcf12 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:27.941261 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-138a7eee-fbc5-4d70-8957-a03c0a7fcf12 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:27.941712 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-138a7eee-fbc5-4d70-8957-a03c0a7fcf12 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:27.942533 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-138a7eee-fbc5-4d70-8957-a03c0a7fcf12 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:27.942961 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-138a7eee-fbc5-4d70-8957-a03c0a7fcf12 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:28.005281 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-138a7eee-fbc5-4d70-8957-a03c0a7fcf12 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:28.008745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:51:28.013928 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-138a7eee-fbc5-4d70-8957-a03c0a7fcf12 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 200 len: 1299 microversion: 2.1 time: 0.084732 Jul 27 20:51:28.014503 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2027/4037] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:27 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:29.035745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b36de122-3965-4e0b-9aaf-9d09763fdd2f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:29.036421 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b36de122-3965-4e0b-9aaf-9d09763fdd2f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:29.043666 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b36de122-3965-4e0b-9aaf-9d09763fdd2f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:29.044180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b36de122-3965-4e0b-9aaf-9d09763fdd2f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:29.045140 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b36de122-3965-4e0b-9aaf-9d09763fdd2f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:29.045724 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b36de122-3965-4e0b-9aaf-9d09763fdd2f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:29.246072 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b36de122-3965-4e0b-9aaf-9d09763fdd2f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:29.255215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b36de122-3965-4e0b-9aaf-9d09763fdd2f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 200 len: 1366 microversion: 2.1 time: 0.223883 Jul 27 20:51:29.255864 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2011/4038] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:29 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:29.352209 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-dee2f9f1-0b83-4397-9542-e36e00f588f1 req-f56163f1-fd67-4f09-83ca-84073de32be4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67afd366-7c9e-4104-8498-93e44a4153c9", "tag": "2ff298d2-1932-46c9-bdab-ad426c08a989"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:51:29.365137 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-dee2f9f1-0b83-4397-9542-e36e00f588f1 req-f56163f1-fd67-4f09-83ca-84073de32be4 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:29.365824 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-dee2f9f1-0b83-4397-9542-e36e00f588f1 req-f56163f1-fd67-4f09-83ca-84073de32be4 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:29.379535 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-dee2f9f1-0b83-4397-9542-e36e00f588f1 req-f56163f1-fd67-4f09-83ca-84073de32be4 service nova] Creating event network-changed:2ff298d2-1932-46c9-bdab-ad426c08a989 for instance 67afd366-7c9e-4104-8498-93e44a4153c9 on hv-cinder-79987 Jul 27 20:51:29.384590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-dee2f9f1-0b83-4397-9542-e36e00f588f1 req-f56163f1-fd67-4f09-83ca-84073de32be4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038778 Jul 27 20:51:29.385237 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2028/4039] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:51:30.278553 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1cfee1d9-d209-4fc6-a884-db7f3f5620cf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:30.279273 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1cfee1d9-d209-4fc6-a884-db7f3f5620cf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:30.286077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cfee1d9-d209-4fc6-a884-db7f3f5620cf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:30.286531 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cfee1d9-d209-4fc6-a884-db7f3f5620cf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:30.287333 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cfee1d9-d209-4fc6-a884-db7f3f5620cf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:30.290607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cfee1d9-d209-4fc6-a884-db7f3f5620cf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:30.430183 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1cfee1d9-d209-4fc6-a884-db7f3f5620cf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:30.438458 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1cfee1d9-d209-4fc6-a884-db7f3f5620cf tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 200 len: 1366 microversion: 2.1 time: 0.164674 Jul 27 20:51:30.439035 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2012/4040] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:30 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:31.462357 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-51d81a19-87c7-4dfb-851e-869b124e4e68 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:31.463064 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-51d81a19-87c7-4dfb-851e-869b124e4e68 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:31.469728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-51d81a19-87c7-4dfb-851e-869b124e4e68 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:31.470187 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-51d81a19-87c7-4dfb-851e-869b124e4e68 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:31.470958 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-51d81a19-87c7-4dfb-851e-869b124e4e68 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:31.471408 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-51d81a19-87c7-4dfb-851e-869b124e4e68 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:31.608044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-51d81a19-87c7-4dfb-851e-869b124e4e68 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:31.616276 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-51d81a19-87c7-4dfb-851e-869b124e4e68 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 200 len: 1366 microversion: 2.1 time: 0.158570 Jul 27 20:51:31.616857 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2029/4041] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:31 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:32.637977 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-12762da8-d6e6-465c-9e19-636f4862588f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:32.638591 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-12762da8-d6e6-465c-9e19-636f4862588f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:32.644934 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12762da8-d6e6-465c-9e19-636f4862588f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:32.645411 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12762da8-d6e6-465c-9e19-636f4862588f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:32.646172 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12762da8-d6e6-465c-9e19-636f4862588f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:32.646617 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12762da8-d6e6-465c-9e19-636f4862588f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:32.783354 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-12762da8-d6e6-465c-9e19-636f4862588f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:32.790834 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-12762da8-d6e6-465c-9e19-636f4862588f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 200 len: 1366 microversion: 2.1 time: 0.157068 Jul 27 20:51:32.791400 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2013/4042] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:32 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:33.811814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-733a2cf9-72e9-4f28-b319-e726f8ade71e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:33.812366 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-733a2cf9-72e9-4f28-b319-e726f8ade71e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:33.814348 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=2 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:51:33.820309 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-733a2cf9-72e9-4f28-b319-e726f8ade71e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:33.820775 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-733a2cf9-72e9-4f28-b319-e726f8ade71e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:33.821570 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-733a2cf9-72e9-4f28-b319-e726f8ade71e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:33.822016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-733a2cf9-72e9-4f28-b319-e726f8ade71e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:33.955712 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-733a2cf9-72e9-4f28-b319-e726f8ade71e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:33.963165 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-733a2cf9-72e9-4f28-b319-e726f8ade71e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 200 len: 1366 microversion: 2.1 time: 0.155303 Jul 27 20:51:33.963721 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2030/4043] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:33 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:34.983598 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5c480bc5-0647-45a1-bcbf-1ee148dff460 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:34.984210 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5c480bc5-0647-45a1-bcbf-1ee148dff460 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:34.986627 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=8 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:51:34.987432 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:51:34.992822 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c480bc5-0647-45a1-bcbf-1ee148dff460 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:34.993302 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c480bc5-0647-45a1-bcbf-1ee148dff460 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:34.994062 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c480bc5-0647-45a1-bcbf-1ee148dff460 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:34.994497 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c480bc5-0647-45a1-bcbf-1ee148dff460 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:34.998303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:51:35.128597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5c480bc5-0647-45a1-bcbf-1ee148dff460 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:35.136186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5c480bc5-0647-45a1-bcbf-1ee148dff460 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 200 len: 1366 microversion: 2.1 time: 0.156463 Jul 27 20:51:35.136740 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2014/4044] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:34 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:35.811885 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=10 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:51:35.815753 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-dd62bf6b-3156-4f73-9e8e-ac8746ae4c0d req-901d5cc8-8791-43f5-90f6-c4d206c702ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67afd366-7c9e-4104-8498-93e44a4153c9", "name": "network-vif-plugged", "status": "completed", "tag": "2ff298d2-1932-46c9-bdab-ad426c08a989"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:51:35.820612 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:51:35.827011 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-dd62bf6b-3156-4f73-9e8e-ac8746ae4c0d req-901d5cc8-8791-43f5-90f6-c4d206c702ae service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:35.827465 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-dd62bf6b-3156-4f73-9e8e-ac8746ae4c0d req-901d5cc8-8791-43f5-90f6-c4d206c702ae service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:35.839062 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-dd62bf6b-3156-4f73-9e8e-ac8746ae4c0d req-901d5cc8-8791-43f5-90f6-c4d206c702ae service nova] Creating event network-vif-plugged:2ff298d2-1932-46c9-bdab-ad426c08a989 for instance 67afd366-7c9e-4104-8498-93e44a4153c9 on hv-cinder-79987 Jul 27 20:51:35.845224 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-dd62bf6b-3156-4f73-9e8e-ac8746ae4c0d req-901d5cc8-8791-43f5-90f6-c4d206c702ae service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168614 Jul 27 20:51:35.845812 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2031/4045] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:51:36.157729 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-43621ac6-85af-401d-a2f0-65705f47c77b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:36.158335 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-43621ac6-85af-401d-a2f0-65705f47c77b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:36.165122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43621ac6-85af-401d-a2f0-65705f47c77b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:36.165601 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43621ac6-85af-401d-a2f0-65705f47c77b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:36.166518 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43621ac6-85af-401d-a2f0-65705f47c77b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:36.166957 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43621ac6-85af-401d-a2f0-65705f47c77b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:36.298982 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-43621ac6-85af-401d-a2f0-65705f47c77b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:36.306431 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-43621ac6-85af-401d-a2f0-65705f47c77b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 200 len: 1366 microversion: 2.1 time: 0.152489 Jul 27 20:51:36.306983 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2015/4046] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:36 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:37.328247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-766673e6-8983-4bb8-9ce3-68d0ccdb2038 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:37.328880 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-766673e6-8983-4bb8-9ce3-68d0ccdb2038 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:37.335942 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-766673e6-8983-4bb8-9ce3-68d0ccdb2038 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:37.336390 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-766673e6-8983-4bb8-9ce3-68d0ccdb2038 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:37.337186 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-766673e6-8983-4bb8-9ce3-68d0ccdb2038 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:37.337624 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-766673e6-8983-4bb8-9ce3-68d0ccdb2038 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:37.465690 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-766673e6-8983-4bb8-9ce3-68d0ccdb2038 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:37.472921 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-766673e6-8983-4bb8-9ce3-68d0ccdb2038 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 200 len: 1366 microversion: 2.1 time: 0.149637 Jul 27 20:51:37.473499 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2032/4047] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:37 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:38.493810 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6adc215d-5367-4d99-8919-64493f660c44 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:38.494417 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6adc215d-5367-4d99-8919-64493f660c44 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:38.501090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6adc215d-5367-4d99-8919-64493f660c44 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:38.501536 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6adc215d-5367-4d99-8919-64493f660c44 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:38.502284 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6adc215d-5367-4d99-8919-64493f660c44 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:38.502714 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6adc215d-5367-4d99-8919-64493f660c44 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:38.637362 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6adc215d-5367-4d99-8919-64493f660c44 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:38.645385 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6adc215d-5367-4d99-8919-64493f660c44 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 200 len: 1366 microversion: 2.1 time: 0.155309 Jul 27 20:51:38.645954 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2016/4048] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:38 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:39.666021 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-0f29ffcc-727a-45ca-9f0b-b6cb2986e6d6 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:39.666640 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-0f29ffcc-727a-45ca-9f0b-b6cb2986e6d6 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:39.673834 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0f29ffcc-727a-45ca-9f0b-b6cb2986e6d6 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:39.674288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0f29ffcc-727a-45ca-9f0b-b6cb2986e6d6 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:39.675053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0f29ffcc-727a-45ca-9f0b-b6cb2986e6d6 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:39.675494 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-0f29ffcc-727a-45ca-9f0b-b6cb2986e6d6 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:39.808026 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-0f29ffcc-727a-45ca-9f0b-b6cb2986e6d6 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:39.815685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-0f29ffcc-727a-45ca-9f0b-b6cb2986e6d6 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 200 len: 1366 microversion: 2.1 time: 0.153542 Jul 27 20:51:39.816255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2033/4049] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:39 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:40.837438 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b50eeaa9-51c9-4d14-b20b-e5083895b83e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:40.838043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b50eeaa9-51c9-4d14-b20b-e5083895b83e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:40.845337 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b50eeaa9-51c9-4d14-b20b-e5083895b83e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:40.845781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b50eeaa9-51c9-4d14-b20b-e5083895b83e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:40.846530 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b50eeaa9-51c9-4d14-b20b-e5083895b83e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:40.846965 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b50eeaa9-51c9-4d14-b20b-e5083895b83e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:40.973344 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b50eeaa9-51c9-4d14-b20b-e5083895b83e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:40.980603 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b50eeaa9-51c9-4d14-b20b-e5083895b83e tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 200 len: 1366 microversion: 2.1 time: 0.146981 Jul 27 20:51:40.981834 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2017/4050] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:40 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:42.000862 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-f2cdda63-1fb8-4edc-bbf1-92cbb2e0efb4 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:42.001495 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-f2cdda63-1fb8-4edc-bbf1-92cbb2e0efb4 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:42.007878 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2cdda63-1fb8-4edc-bbf1-92cbb2e0efb4 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:42.008326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2cdda63-1fb8-4edc-bbf1-92cbb2e0efb4 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:42.009108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2cdda63-1fb8-4edc-bbf1-92cbb2e0efb4 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:42.009545 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-f2cdda63-1fb8-4edc-bbf1-92cbb2e0efb4 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:42.140137 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-f2cdda63-1fb8-4edc-bbf1-92cbb2e0efb4 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:42.147484 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-f2cdda63-1fb8-4edc-bbf1-92cbb2e0efb4 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 200 len: 1366 microversion: 2.1 time: 0.150516 Jul 27 20:51:42.148039 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2034/4051] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:41 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:43.169802 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8d4e2095-007e-459a-84a0-5b1e66bb4cc3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:43.170467 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8d4e2095-007e-459a-84a0-5b1e66bb4cc3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:43.177291 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d4e2095-007e-459a-84a0-5b1e66bb4cc3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:43.177743 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d4e2095-007e-459a-84a0-5b1e66bb4cc3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:43.178513 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d4e2095-007e-459a-84a0-5b1e66bb4cc3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:43.178961 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d4e2095-007e-459a-84a0-5b1e66bb4cc3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:43.311903 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8d4e2095-007e-459a-84a0-5b1e66bb4cc3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:51:43.319461 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8d4e2095-007e-459a-84a0-5b1e66bb4cc3 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 200 len: 1557 microversion: 2.1 time: 0.154702 Jul 27 20:51:43.320025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2018/4052] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:51:43 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:51:43.341217 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c19edcd3-78d2-41ab-b2e8-078e175dcbfd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:51:43.341698 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c19edcd3-78d2-41ab-b2e8-078e175dcbfd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:51:43.348023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c19edcd3-78d2-41ab-b2e8-078e175dcbfd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:43.348476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c19edcd3-78d2-41ab-b2e8-078e175dcbfd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:43.349270 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c19edcd3-78d2-41ab-b2e8-078e175dcbfd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:43.349710 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c19edcd3-78d2-41ab-b2e8-078e175dcbfd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:43.425596 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c19edcd3-78d2-41ab-b2e8-078e175dcbfd tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088703 Jul 27 20:51:43.426204 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2035/4053] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Jul 27 20:51:43 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:51:44.687298 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-a5619ea2-79f3-4ac9-87b6-ca89f77a5bf5 req-91c1a5d9-7383-445b-b07d-b1908dffcddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67afd366-7c9e-4104-8498-93e44a4153c9", "tag": "2ff298d2-1932-46c9-bdab-ad426c08a989"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:51:44.696636 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-a5619ea2-79f3-4ac9-87b6-ca89f77a5bf5 req-91c1a5d9-7383-445b-b07d-b1908dffcddb service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:51:44.697103 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-a5619ea2-79f3-4ac9-87b6-ca89f77a5bf5 req-91c1a5d9-7383-445b-b07d-b1908dffcddb service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:51:44.708648 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-a5619ea2-79f3-4ac9-87b6-ca89f77a5bf5 req-91c1a5d9-7383-445b-b07d-b1908dffcddb service nova] Creating event network-changed:2ff298d2-1932-46c9-bdab-ad426c08a989 for instance 67afd366-7c9e-4104-8498-93e44a4153c9 on hv-cinder-79987 Jul 27 20:51:44.713694 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-a5619ea2-79f3-4ac9-87b6-ca89f77a5bf5 req-91c1a5d9-7383-445b-b07d-b1908dffcddb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091799 Jul 27 20:51:44.714303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2019/4054] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:51:47.329874 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:51:47.330472 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:51:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:53:23.109259 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:53:23.109873 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:53:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:53:26.984306 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:53:26.984876 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:53:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:53:38.325213 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ebd3bde3-5295-4d69-bab2-3c6f09163f30] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 27 20:53:38.325817 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=9 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:53:38.326393 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=38 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:53:38.330895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-389178c4-d76c-4336-9806-c092012ec71f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:38.331387 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-389178c4-d76c-4336-9806-c092012ec71f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:38.338599 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-389178c4-d76c-4336-9806-c092012ec71f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:38.339077 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-389178c4-d76c-4336-9806-c092012ec71f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:38.339837 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-389178c4-d76c-4336-9806-c092012ec71f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:38.340277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-389178c4-d76c-4336-9806-c092012ec71f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:38.363624 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-389178c4-d76c-4336-9806-c092012ec71f tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9/ips" status: 200 len: 151 microversion: 2.1 time: 0.040345 Jul 27 20:53:38.364179 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2036/4055] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Jul 27 20:53:38 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:53:43.905166 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR oslo.messaging._drivers.impl_rabbit [-] [90651035-8aed-4abb-a7ee-04ffff40ad61] AMQP server on 10.222.0.65:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 27 20:53:43.905166 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=11 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:53:43.905166 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=31 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:53:43.905733 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fc29b3c0-8dc1-4779-b89d-526ed4d40e34 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "303589c7-50e7-46d8-ad7b-79624d52a38b"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:53:43.908413 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fc29b3c0-8dc1-4779-b89d-526ed4d40e34 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:43.918743 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc29b3c0-8dc1-4779-b89d-526ed4d40e34 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:43.919188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc29b3c0-8dc1-4779-b89d-526ed4d40e34 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:43.919951 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc29b3c0-8dc1-4779-b89d-526ed4d40e34 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:43.920378 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc29b3c0-8dc1-4779-b89d-526ed4d40e34 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:44.906781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] [90651035-8aed-4abb-a7ee-04ffff40ad61] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 44894. Jul 27 20:53:45.025663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fc29b3c0-8dc1-4779-b89d-526ed4d40e34 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "POST /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.129347 Jul 27 20:53:45.026313 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2020/4056] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Jul 27 20:53:43 2022] POST /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9/os-volume_attachments => generated 194 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:53:52.660335 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-05b86f65-5c72-4e97-8585-a298196176ff tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:52.660861 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-05b86f65-5c72-4e97-8585-a298196176ff tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:52.664016 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=2 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:53:52.664716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=4 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:53:52.672356 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-05b86f65-5c72-4e97-8585-a298196176ff tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:52.673133 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-05b86f65-5c72-4e97-8585-a298196176ff tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:52.673921 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-05b86f65-5c72-4e97-8585-a298196176ff tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:52.674360 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-05b86f65-5c72-4e97-8585-a298196176ff tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:52.690994 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] [ebd3bde3-5295-4d69-bab2-3c6f09163f30] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 45004. Jul 27 20:53:52.768399 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.objects.instance [None req-05b86f65-5c72-4e97-8585-a298196176ff tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lazy-loading 'services' on Instance uuid 67afd366-7c9e-4104-8498-93e44a4153c9 {{(pid=117876) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:53:52.841584 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-05b86f65-5c72-4e97-8585-a298196176ff tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "DELETE /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9/os-volume_attachments/303589c7-50e7-46d8-ad7b-79624d52a38b" status: 202 len: 0 microversion: 2.1 time: 0.184968 Jul 27 20:53:52.842378 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2037/4057] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Jul 27 20:53:52 2022] DELETE /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9/os-volume_attachments/303589c7-50e7-46d8-ad7b-79624d52a38b => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:53:52.852352 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3475ea29-efb7-4e52-9739-6713a881a954 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:52.854728 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3475ea29-efb7-4e52-9739-6713a881a954 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:52.860955 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3475ea29-efb7-4e52-9739-6713a881a954 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:52.861435 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3475ea29-efb7-4e52-9739-6713a881a954 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:52.862420 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3475ea29-efb7-4e52-9739-6713a881a954 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:52.862866 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3475ea29-efb7-4e52-9739-6713a881a954 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:52.896176 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3475ea29-efb7-4e52-9739-6713a881a954 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049419 Jul 27 20:53:52.896724 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2021/4058] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:53:52 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:53:53.910177 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-db6eeb09-623f-4251-b09d-1107a4f15e57 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:53.912604 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-db6eeb09-623f-4251-b09d-1107a4f15e57 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:53.919952 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-db6eeb09-623f-4251-b09d-1107a4f15e57 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:53.920406 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-db6eeb09-623f-4251-b09d-1107a4f15e57 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:53.921247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-db6eeb09-623f-4251-b09d-1107a4f15e57 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:53.921694 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-db6eeb09-623f-4251-b09d-1107a4f15e57 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:53.952870 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-db6eeb09-623f-4251-b09d-1107a4f15e57 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047097 Jul 27 20:53:53.953461 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2038/4059] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:53:53 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:53:54.966164 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5f020e27-7436-462e-abe2-3fa93e56072a tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:54.969092 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5f020e27-7436-462e-abe2-3fa93e56072a tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:54.976604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5f020e27-7436-462e-abe2-3fa93e56072a tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:54.977084 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5f020e27-7436-462e-abe2-3fa93e56072a tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:54.977855 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5f020e27-7436-462e-abe2-3fa93e56072a tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:54.978293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5f020e27-7436-462e-abe2-3fa93e56072a tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:55.007898 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5f020e27-7436-462e-abe2-3fa93e56072a tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045798 Jul 27 20:53:55.008451 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2022/4060] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Jul 27 20:53:54 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 27 20:53:55.070459 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-68d789e9-3ffe-494b-8373-357b6f58ff71 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:55.070971 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-68d789e9-3ffe-494b-8373-357b6f58ff71 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:55.077507 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-68d789e9-3ffe-494b-8373-357b6f58ff71 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:55.078050 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-68d789e9-3ffe-494b-8373-357b6f58ff71 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:55.078960 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-68d789e9-3ffe-494b-8373-357b6f58ff71 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:55.079724 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-68d789e9-3ffe-494b-8373-357b6f58ff71 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:55.109053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-68d789e9-3ffe-494b-8373-357b6f58ff71 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Going to try to terminate instance {{(pid=117876) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:53:55.188249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-68d789e9-3ffe-494b-8373-357b6f58ff71 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "DELETE /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 204 len: 0 microversion: 2.1 time: 0.121475 Jul 27 20:53:55.189073 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2039/4061] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 20:53:55 2022] DELETE /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:53:55.198405 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f404977d-6ff3-4830-82c4-2968c1710f5b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:55.199117 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f404977d-6ff3-4830-82c4-2968c1710f5b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:55.205372 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f404977d-6ff3-4830-82c4-2968c1710f5b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:55.205824 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f404977d-6ff3-4830-82c4-2968c1710f5b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:55.206585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f404977d-6ff3-4830-82c4-2968c1710f5b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:55.207024 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f404977d-6ff3-4830-82c4-2968c1710f5b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:55.336482 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f404977d-6ff3-4830-82c4-2968c1710f5b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:55.343943 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f404977d-6ff3-4830-82c4-2968c1710f5b tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 200 len: 1682 microversion: 2.1 time: 0.150396 Jul 27 20:53:55.353061 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2023/4062] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:55 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:56.365726 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2d89b335-f1e5-4864-887b-84d7c0032797 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:56.366519 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2d89b335-f1e5-4864-887b-84d7c0032797 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:56.372906 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d89b335-f1e5-4864-887b-84d7c0032797 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:56.373394 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d89b335-f1e5-4864-887b-84d7c0032797 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:56.374160 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d89b335-f1e5-4864-887b-84d7c0032797 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:56.374605 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2d89b335-f1e5-4864-887b-84d7c0032797 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:56.515071 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2d89b335-f1e5-4864-887b-84d7c0032797 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:56.523247 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2d89b335-f1e5-4864-887b-84d7c0032797 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 200 len: 1682 microversion: 2.1 time: 0.161238 Jul 27 20:53:56.523800 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2040/4063] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:56 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:57.544070 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-82576219-0877-45fa-a8fd-333c0f6d9b20 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:57.544675 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-82576219-0877-45fa-a8fd-333c0f6d9b20 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:57.551246 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82576219-0877-45fa-a8fd-333c0f6d9b20 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:57.551686 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82576219-0877-45fa-a8fd-333c0f6d9b20 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:57.552438 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82576219-0877-45fa-a8fd-333c0f6d9b20 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:57.552867 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82576219-0877-45fa-a8fd-333c0f6d9b20 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:57.793948 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-82576219-0877-45fa-a8fd-333c0f6d9b20 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:57.801331 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-82576219-0877-45fa-a8fd-333c0f6d9b20 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 200 len: 1682 microversion: 2.1 time: 0.261117 Jul 27 20:53:57.801883 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2024/4064] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:57 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 1682 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:58.309657 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-ff81bd60-0fed-418c-a41f-73546a701547 req-8a16d537-b17f-4855-a6ed-d313c9ad7259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67afd366-7c9e-4104-8498-93e44a4153c9", "name": "network-vif-deleted", "tag": "2ff298d2-1932-46c9-bdab-ad426c08a989"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:53:58.320165 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-ff81bd60-0fed-418c-a41f-73546a701547 req-8a16d537-b17f-4855-a6ed-d313c9ad7259 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:58.320722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-ff81bd60-0fed-418c-a41f-73546a701547 req-8a16d537-b17f-4855-a6ed-d313c9ad7259 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:58.335580 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-ff81bd60-0fed-418c-a41f-73546a701547 req-8a16d537-b17f-4855-a6ed-d313c9ad7259 service nova] Creating event network-vif-deleted:2ff298d2-1932-46c9-bdab-ad426c08a989 for instance 67afd366-7c9e-4104-8498-93e44a4153c9 on hv-cinder-79987 Jul 27 20:53:58.340803 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-ff81bd60-0fed-418c-a41f-73546a701547 req-8a16d537-b17f-4855-a6ed-d313c9ad7259 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034747 Jul 27 20:53:58.341667 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2041/4065] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 20:53:58.824167 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-008f4d1f-c715-4601-972a-93b7ef50a7a0 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:58.825425 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-008f4d1f-c715-4601-972a-93b7ef50a7a0 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:58.832565 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-008f4d1f-c715-4601-972a-93b7ef50a7a0 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:58.833303 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-008f4d1f-c715-4601-972a-93b7ef50a7a0 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:58.834206 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-008f4d1f-c715-4601-972a-93b7ef50a7a0 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:58.835474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-008f4d1f-c715-4601-972a-93b7ef50a7a0 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:58.868440 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-008f4d1f-c715-4601-972a-93b7ef50a7a0 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:58.869122 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-008f4d1f-c715-4601-972a-93b7ef50a7a0 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:58.869713 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-008f4d1f-c715-4601-972a-93b7ef50a7a0 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lazy-loading 'fault' on Instance uuid 67afd366-7c9e-4104-8498-93e44a4153c9 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 27 20:53:58.918911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-008f4d1f-c715-4601-972a-93b7ef50a7a0 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30051341684845938161bb5ec0680d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a1fbeedf5134a5a9432e42a35e1d955', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:53:58.925983 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-008f4d1f-c715-4601-972a-93b7ef50a7a0 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 200 len: 1331 microversion: 2.1 time: 0.106840 Jul 27 20:53:58.926566 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2025/4066] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:58 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:53:59.947718 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-362f4d40-6bb4-4c3d-b2bc-5046f26ca1cb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:53:59.948420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-362f4d40-6bb4-4c3d-b2bc-5046f26ca1cb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:53:59.954892 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-362f4d40-6bb4-4c3d-b2bc-5046f26ca1cb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:59.955340 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-362f4d40-6bb4-4c3d-b2bc-5046f26ca1cb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:59.956098 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-362f4d40-6bb4-4c3d-b2bc-5046f26ca1cb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:53:59.956537 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-362f4d40-6bb4-4c3d-b2bc-5046f26ca1cb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:53:59.970038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-362f4d40-6bb4-4c3d-b2bc-5046f26ca1cb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] HTTP exception thrown: Instance 67afd366-7c9e-4104-8498-93e44a4153c9 could not be found. Jul 27 20:53:59.971614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-362f4d40-6bb4-4c3d-b2bc-5046f26ca1cb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Request method failure captured: Jul 27 20:53:59.971614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 HTTP/1.1 Jul 27 20:53:59.971614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:53:59.971614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:53:59.971614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:53:59.971614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:53:59.971614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:53:59.971614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:53:59.971614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:53:59.971614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:53:59.971614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4aQDgaYQvYIu8Qo0cRbAVWzvY8Dy9GGrZ0HavYCr3wNvgVR2I9Irzc5X_0xRA4MDwtX2JjjvjYYuHwC7Mrh_yi9kIBmZG5-_lltvQDXb5DZDOaE2MSmiAXjFqiUVxXiijuz7iXdho2ln6dfnWOlCMnhNkamPt7HXOo0ngwRoFADP5jE Jul 27 20:53:59.971614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:53:59.971614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:53:59.971614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:53:59.971614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:53:59.971614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:53:59.971614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:53:59.971614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:53:59.971614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:53:59.971614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:53:59.971614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:53:59.973038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6a1fbeedf5134a5a9432e42a35e1d955", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:53:59.973038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:53:59.973038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:53:59.973038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:53:59.973038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:53:59.973038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:53:59.973038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:53:59.973038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: 30051341684845938161bb5ec0680d68 Jul 27 20:53:59.973038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:53:59.973038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:53:59.973038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Instance 67afd366-7c9e-4104-8498-93e44a4153c9 could not be found. Jul 27 20:53:59.973038 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'id': '67afd366-7c9e-4104-8498-93e44a4153c9'} Jul 27 20:53:59.973814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:53:59.973814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:53:59.973814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:53:59.973814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:53:59.973814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:53:59.973814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:53:59.973814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:53:59.973814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:53:59.973814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:53:59.973814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:53:59.973814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67afd366-7c9e-4104-8498-93e44a4153c9 could not be found. Jul 27 20:53:59.973814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:53:59.973814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:53:59.973814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:53:59.973814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:53:59.973814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:53:59.973814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:53:59.973814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:53:59.973814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:53:59.973814 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:53:59.975142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:53:59.975142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:53:59.975142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:53:59.975142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:53:59.975142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:53:59.975142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:53:59.975142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:53:59.975142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67afd366-7c9e-4104-8498-93e44a4153c9 could not be found. Jul 27 20:53:59.975142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:53:59.975142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:53:59.975142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:53:59.975142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:53:59.975142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:53:59.975142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:53:59.975142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:53:59.975142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:53:59.975142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67afd366-7c9e-4104-8498-93e44a4153c9 could not be found. Jul 27 20:53:59.975142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:53:59.976936 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-362f4d40-6bb4-4c3d-b2bc-5046f26ca1cb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Returning 404 to user: Instance 67afd366-7c9e-4104-8498-93e44a4153c9 could not be found. {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:53:59.976936 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-362f4d40-6bb4-4c3d-b2bc-5046f26ca1cb tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 404 len: 111 microversion: 2.1 time: 0.029912 Jul 27 20:53:59.976936 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2042/4067] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:53:59 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:53:59.982384 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d55da845-8c10-486c-a268-93e6d5458575 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '.version_select at 0x7fc7eaee48b0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:54:00.004079 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d55da845-8c10-486c-a268-93e6d5458575 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1509619940" status: 202 len: 0 microversion: 2.1 time: 0.025352 Jul 27 20:54:00.004645 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2026/4068] 10.222.0.65 () {58 vars in 1221 bytes} [Wed Jul 27 20:53:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1509619940 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 20:54:01.744729 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-df40f060-564e-4c2b-9ba3-4431c792ff92 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:54:01.745239 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-df40f060-564e-4c2b-9ba3-4431c792ff92 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:54:01.751638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-df40f060-564e-4c2b-9ba3-4431c792ff92 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:01.752092 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-df40f060-564e-4c2b-9ba3-4431c792ff92 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:01.752858 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-df40f060-564e-4c2b-9ba3-4431c792ff92 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:01.753329 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-df40f060-564e-4c2b-9ba3-4431c792ff92 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:01.766534 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-df40f060-564e-4c2b-9ba3-4431c792ff92 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] HTTP exception thrown: Instance 67afd366-7c9e-4104-8498-93e44a4153c9 could not be found. Jul 27 20:54:01.768053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-df40f060-564e-4c2b-9ba3-4431c792ff92 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Request method failure captured: Jul 27 20:54:01.768053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: DELETE /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 HTTP/1.1 Jul 27 20:54:01.768053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:54:01.768053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:54:01.768053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:54:01.768053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:54:01.768053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:54:01.768053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:54:01.768053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:54:01.768053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:54:01.768053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4aQDgaYQvYIu8Qo0cRbAVWzvY8Dy9GGrZ0HavYCr3wNvgVR2I9Irzc5X_0xRA4MDwtX2JjjvjYYuHwC7Mrh_yi9kIBmZG5-_lltvQDXb5DZDOaE2MSmiAXjFqiUVxXiijuz7iXdho2ln6dfnWOlCMnhNkamPt7HXOo0ngwRoFADP5jE Jul 27 20:54:01.768053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:54:01.768053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:54:01.768053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:54:01.768053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:54:01.768053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:54:01.768053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:54:01.768053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:54:01.768053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:54:01.768053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:54:01.768053 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:54:01.769398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6a1fbeedf5134a5a9432e42a35e1d955", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:54:01.769398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:54:01.769398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:54:01.769398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:54:01.769398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:54:01.769398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:54:01.769398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:54:01.769398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: 30051341684845938161bb5ec0680d68 Jul 27 20:54:01.769398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:54:01.769398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:54:01.769398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Instance 67afd366-7c9e-4104-8498-93e44a4153c9 could not be found. Jul 27 20:54:01.769398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'id': '67afd366-7c9e-4104-8498-93e44a4153c9'} Jul 27 20:54:01.770067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:54:01.770067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:54:01.770067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:54:01.770067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:54:01.770067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:54:01.770067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:54:01.770067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:54:01.770067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:54:01.770067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:54:01.770067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:54:01.770067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67afd366-7c9e-4104-8498-93e44a4153c9 could not be found. Jul 27 20:54:01.770067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:54:01.770067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:54:01.770067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:54:01.770067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:54:01.770067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:54:01.770067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:54:01.770067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:54:01.770067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:54:01.770067 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:54:01.771087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:54:01.771087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 20:54:01.771087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 20:54:01.771087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 20:54:01.771087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 20:54:01.771087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:54:01.771087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:54:01.771087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:54:01.771087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:54:01.771087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67afd366-7c9e-4104-8498-93e44a4153c9 could not be found. Jul 27 20:54:01.771087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:54:01.771087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:54:01.771087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:54:01.771087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:54:01.771087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:54:01.771087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:54:01.771087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:54:01.771087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:54:01.771087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67afd366-7c9e-4104-8498-93e44a4153c9 could not be found. Jul 27 20:54:01.771087 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:54:01.772113 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-df40f060-564e-4c2b-9ba3-4431c792ff92 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Returning 404 to user: Instance 67afd366-7c9e-4104-8498-93e44a4153c9 could not be found. {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:54:01.772113 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-df40f060-564e-4c2b-9ba3-4431c792ff92 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "DELETE /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 404 len: 111 microversion: 2.1 time: 0.029095 Jul 27 20:54:01.772113 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2043/4069] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 20:54:01 2022] DELETE /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:54:01.778402 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e7600643-b787-4456-a619-5307076c1176 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:54:01.779020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e7600643-b787-4456-a619-5307076c1176 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 67afd366-7c9e-4104-8498-93e44a4153c9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:54:01.785591 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7600643-b787-4456-a619-5307076c1176 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:01.786043 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7600643-b787-4456-a619-5307076c1176 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:01.786804 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7600643-b787-4456-a619-5307076c1176 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:01.787246 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7600643-b787-4456-a619-5307076c1176 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:01.802512 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-e7600643-b787-4456-a619-5307076c1176 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] HTTP exception thrown: Instance 67afd366-7c9e-4104-8498-93e44a4153c9 could not be found. Jul 27 20:54:01.804833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e7600643-b787-4456-a619-5307076c1176 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Request method failure captured: Jul 27 20:54:01.804833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 HTTP/1.1 Jul 27 20:54:01.804833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:54:01.804833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:54:01.804833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:54:01.804833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:54:01.804833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:54:01.804833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:54:01.804833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:54:01.804833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:54:01.804833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4aQDgaYQvYIu8Qo0cRbAVWzvY8Dy9GGrZ0HavYCr3wNvgVR2I9Irzc5X_0xRA4MDwtX2JjjvjYYuHwC7Mrh_yi9kIBmZG5-_lltvQDXb5DZDOaE2MSmiAXjFqiUVxXiijuz7iXdho2ln6dfnWOlCMnhNkamPt7HXOo0ngwRoFADP5jE Jul 27 20:54:01.804833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:54:01.804833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:54:01.804833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:54:01.804833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:54:01.804833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:54:01.804833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:54:01.804833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:54:01.804833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:54:01.804833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:54:01.804833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:54:01.806282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6a1fbeedf5134a5a9432e42a35e1d955", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:54:01.806282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:54:01.806282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:54:01.806282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:54:01.806282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:54:01.806282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:54:01.806282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:54:01.806282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: 30051341684845938161bb5ec0680d68 Jul 27 20:54:01.806282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:54:01.806282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:54:01.806282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Instance 67afd366-7c9e-4104-8498-93e44a4153c9 could not be found. Jul 27 20:54:01.806282 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'id': '67afd366-7c9e-4104-8498-93e44a4153c9'} Jul 27 20:54:01.807021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:54:01.807021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:54:01.807021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:54:01.807021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:54:01.807021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:54:01.807021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:54:01.807021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:54:01.807021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:54:01.807021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:54:01.807021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:54:01.807021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67afd366-7c9e-4104-8498-93e44a4153c9 could not be found. Jul 27 20:54:01.807021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:54:01.807021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:54:01.807021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:54:01.807021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:54:01.807021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:54:01.807021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:54:01.807021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:54:01.807021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:54:01.807021 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:54:01.808053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:54:01.808053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:54:01.808053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:54:01.808053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:54:01.808053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:54:01.808053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:54:01.808053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:54:01.808053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67afd366-7c9e-4104-8498-93e44a4153c9 could not be found. Jul 27 20:54:01.808053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:54:01.808053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:54:01.808053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:54:01.808053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:54:01.808053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:54:01.808053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:54:01.808053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:54:01.808053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:54:01.808053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67afd366-7c9e-4104-8498-93e44a4153c9 could not be found. Jul 27 20:54:01.808053 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:54:01.809010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e7600643-b787-4456-a619-5307076c1176 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Returning 404 to user: Instance 67afd366-7c9e-4104-8498-93e44a4153c9 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:54:01.809010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e7600643-b787-4456-a619-5307076c1176 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9" status: 404 len: 111 microversion: 2.1 time: 0.032104 Jul 27 20:54:01.809010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2027/4070] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:54:01 2022] GET /compute/v2.1/servers/67afd366-7c9e-4104-8498-93e44a4153c9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 20:54:02.943221 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-aba425a4-4e1f-4171-9119-106f89c9feb8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:54:02.943722 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-aba425a4-4e1f-4171-9119-106f89c9feb8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:54:02.951093 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aba425a4-4e1f-4171-9119-106f89c9feb8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:02.951478 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aba425a4-4e1f-4171-9119-106f89c9feb8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:02.952234 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aba425a4-4e1f-4171-9119-106f89c9feb8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:02.952669 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-aba425a4-4e1f-4171-9119-106f89c9feb8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:02.966379 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-aba425a4-4e1f-4171-9119-106f89c9feb8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] HTTP exception thrown: Instance fbdc2ac3-9ac5-4627-9b67-af2f3857a762 could not be found. Jul 27 20:54:02.967895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-aba425a4-4e1f-4171-9119-106f89c9feb8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Request method failure captured: Jul 27 20:54:02.967895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: DELETE /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762 HTTP/1.1 Jul 27 20:54:02.967895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:54:02.967895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:54:02.967895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:54:02.967895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:54:02.967895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:54:02.967895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:54:02.967895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:54:02.967895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:54:02.967895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4aQDgaYQvYIu8Qo0cRbAVWzvY8Dy9GGrZ0HavYCr3wNvgVR2I9Irzc5X_0xRA4MDwtX2JjjvjYYuHwC7Mrh_yi9kIBmZG5-_lltvQDXb5DZDOaE2MSmiAXjFqiUVxXiijuz7iXdho2ln6dfnWOlCMnhNkamPt7HXOo0ngwRoFADP5jE Jul 27 20:54:02.967895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:54:02.967895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:54:02.967895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:54:02.967895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:54:02.967895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:54:02.967895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:54:02.967895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:54:02.967895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:54:02.967895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:54:02.967895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:54:02.969290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6a1fbeedf5134a5a9432e42a35e1d955", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:54:02.969290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:54:02.969290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:54:02.969290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:54:02.969290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:54:02.969290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:54:02.969290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:54:02.969290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: 30051341684845938161bb5ec0680d68 Jul 27 20:54:02.969290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:54:02.969290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:54:02.969290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Instance fbdc2ac3-9ac5-4627-9b67-af2f3857a762 could not be found. Jul 27 20:54:02.969290 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'id': 'fbdc2ac3-9ac5-4627-9b67-af2f3857a762'} Jul 27 20:54:02.970046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:54:02.970046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:54:02.970046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:54:02.970046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:54:02.970046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:54:02.970046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:54:02.970046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:54:02.970046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:54:02.970046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:54:02.970046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:54:02.970046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbdc2ac3-9ac5-4627-9b67-af2f3857a762 could not be found. Jul 27 20:54:02.970046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:54:02.970046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:54:02.970046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:54:02.970046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:54:02.970046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:54:02.970046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:54:02.970046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:54:02.970046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:54:02.970046 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:54:02.971339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:54:02.971339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 20:54:02.971339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 20:54:02.971339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 20:54:02.971339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 20:54:02.971339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:54:02.971339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:54:02.971339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:54:02.971339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:54:02.971339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbdc2ac3-9ac5-4627-9b67-af2f3857a762 could not be found. Jul 27 20:54:02.971339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:54:02.971339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:54:02.971339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:54:02.971339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:54:02.971339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:54:02.971339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:54:02.971339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:54:02.971339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:54:02.971339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbdc2ac3-9ac5-4627-9b67-af2f3857a762 could not be found. Jul 27 20:54:02.971339 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:54:02.972923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-aba425a4-4e1f-4171-9119-106f89c9feb8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Returning 404 to user: Instance fbdc2ac3-9ac5-4627-9b67-af2f3857a762 could not be found. {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:54:02.972923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-aba425a4-4e1f-4171-9119-106f89c9feb8 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "DELETE /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762" status: 404 len: 111 microversion: 2.1 time: 0.029828 Jul 27 20:54:02.972923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2044/4071] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 20:54:02 2022] DELETE /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:54:02.977634 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-143cd440-a329-452b-811a-b7ccecab24ca tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:54:02.978247 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-143cd440-a329-452b-811a-b7ccecab24ca tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: fbdc2ac3-9ac5-4627-9b67-af2f3857a762] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:54:02.984692 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-143cd440-a329-452b-811a-b7ccecab24ca tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:02.985253 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-143cd440-a329-452b-811a-b7ccecab24ca tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:02.986017 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-143cd440-a329-452b-811a-b7ccecab24ca tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:02.986525 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-143cd440-a329-452b-811a-b7ccecab24ca tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:03.000350 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-143cd440-a329-452b-811a-b7ccecab24ca tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] HTTP exception thrown: Instance fbdc2ac3-9ac5-4627-9b67-af2f3857a762 could not be found. Jul 27 20:54:03.001916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-143cd440-a329-452b-811a-b7ccecab24ca tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Request method failure captured: Jul 27 20:54:03.001916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762 HTTP/1.1 Jul 27 20:54:03.001916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:54:03.001916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:54:03.001916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:54:03.001916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:54:03.001916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:54:03.001916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:54:03.001916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:54:03.001916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:54:03.001916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4aQDgaYQvYIu8Qo0cRbAVWzvY8Dy9GGrZ0HavYCr3wNvgVR2I9Irzc5X_0xRA4MDwtX2JjjvjYYuHwC7Mrh_yi9kIBmZG5-_lltvQDXb5DZDOaE2MSmiAXjFqiUVxXiijuz7iXdho2ln6dfnWOlCMnhNkamPt7HXOo0ngwRoFADP5jE Jul 27 20:54:03.001916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:54:03.001916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:54:03.001916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:54:03.001916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:54:03.001916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:54:03.001916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:54:03.001916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:54:03.001916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:54:03.001916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:54:03.001916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:54:03.003419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6a1fbeedf5134a5a9432e42a35e1d955", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:54:03.003419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:54:03.003419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:54:03.003419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:54:03.003419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:54:03.003419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:54:03.003419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:54:03.003419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: 30051341684845938161bb5ec0680d68 Jul 27 20:54:03.003419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:54:03.003419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:54:03.003419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Instance fbdc2ac3-9ac5-4627-9b67-af2f3857a762 could not be found. Jul 27 20:54:03.003419 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'id': 'fbdc2ac3-9ac5-4627-9b67-af2f3857a762'} Jul 27 20:54:03.004186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:54:03.004186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:54:03.004186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:54:03.004186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:54:03.004186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:54:03.004186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:54:03.004186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:54:03.004186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:54:03.004186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:54:03.004186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:54:03.004186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbdc2ac3-9ac5-4627-9b67-af2f3857a762 could not be found. Jul 27 20:54:03.004186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:54:03.004186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:54:03.004186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:54:03.004186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:54:03.004186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:54:03.004186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:54:03.004186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:54:03.004186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:54:03.004186 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:54:03.005264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:54:03.005264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:54:03.005264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:54:03.005264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:54:03.005264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:54:03.005264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:54:03.005264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:54:03.005264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbdc2ac3-9ac5-4627-9b67-af2f3857a762 could not be found. Jul 27 20:54:03.005264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:54:03.005264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:54:03.005264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:54:03.005264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:54:03.005264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:54:03.005264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:54:03.005264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:54:03.005264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:54:03.005264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbdc2ac3-9ac5-4627-9b67-af2f3857a762 could not be found. Jul 27 20:54:03.005264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:54:03.006371 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-143cd440-a329-452b-811a-b7ccecab24ca tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Returning 404 to user: Instance fbdc2ac3-9ac5-4627-9b67-af2f3857a762 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:54:03.006371 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-143cd440-a329-452b-811a-b7ccecab24ca tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762" status: 404 len: 111 microversion: 2.1 time: 0.029553 Jul 27 20:54:03.006371 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2028/4072] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:54:02 2022] GET /compute/v2.1/servers/fbdc2ac3-9ac5-4627-9b67-af2f3857a762 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:54:03.012388 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9245985e-e0b0-4ff2-8da6-c53205ec7abc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:54:03.012895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-9245985e-e0b0-4ff2-8da6-c53205ec7abc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:54:03.018886 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9245985e-e0b0-4ff2-8da6-c53205ec7abc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:03.019345 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9245985e-e0b0-4ff2-8da6-c53205ec7abc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:03.020106 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9245985e-e0b0-4ff2-8da6-c53205ec7abc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:03.020557 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-9245985e-e0b0-4ff2-8da6-c53205ec7abc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:03.034108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-9245985e-e0b0-4ff2-8da6-c53205ec7abc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] HTTP exception thrown: Instance 6a8f2d6b-aa7f-486c-95dd-4134388ea801 could not be found. Jul 27 20:54:03.035622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9245985e-e0b0-4ff2-8da6-c53205ec7abc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Request method failure captured: Jul 27 20:54:03.035622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: DELETE /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801 HTTP/1.1 Jul 27 20:54:03.035622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:54:03.035622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:54:03.035622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:54:03.035622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:54:03.035622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:54:03.035622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:54:03.035622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:54:03.035622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:54:03.035622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4aQDgaYQvYIu8Qo0cRbAVWzvY8Dy9GGrZ0HavYCr3wNvgVR2I9Irzc5X_0xRA4MDwtX2JjjvjYYuHwC7Mrh_yi9kIBmZG5-_lltvQDXb5DZDOaE2MSmiAXjFqiUVxXiijuz7iXdho2ln6dfnWOlCMnhNkamPt7HXOo0ngwRoFADP5jE Jul 27 20:54:03.035622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:54:03.035622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:54:03.035622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:54:03.035622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:54:03.035622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:54:03.035622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:54:03.035622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:54:03.035622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:54:03.035622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:54:03.035622 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:54:03.036728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6a1fbeedf5134a5a9432e42a35e1d955", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:54:03.036728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:54:03.036728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:54:03.036728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:54:03.036728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:54:03.036728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:54:03.036728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:54:03.036728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: 30051341684845938161bb5ec0680d68 Jul 27 20:54:03.036728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:54:03.036728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:54:03.036728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Instance 6a8f2d6b-aa7f-486c-95dd-4134388ea801 could not be found. Jul 27 20:54:03.036728 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'id': '6a8f2d6b-aa7f-486c-95dd-4134388ea801'} Jul 27 20:54:03.037400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:54:03.037400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:54:03.037400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:54:03.037400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:54:03.037400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:54:03.037400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:54:03.037400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:54:03.037400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:54:03.037400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:54:03.037400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:54:03.037400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a8f2d6b-aa7f-486c-95dd-4134388ea801 could not be found. Jul 27 20:54:03.037400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:54:03.037400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:54:03.037400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:54:03.037400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:54:03.037400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:54:03.037400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:54:03.037400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:54:03.037400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:54:03.037400 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:54:03.038673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:54:03.038673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 20:54:03.038673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 20:54:03.038673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 20:54:03.038673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 20:54:03.038673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:54:03.038673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:54:03.038673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:54:03.038673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:54:03.038673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a8f2d6b-aa7f-486c-95dd-4134388ea801 could not be found. Jul 27 20:54:03.038673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:54:03.038673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:54:03.038673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:54:03.038673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:54:03.038673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:54:03.038673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:54:03.038673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:54:03.038673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:54:03.038673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a8f2d6b-aa7f-486c-95dd-4134388ea801 could not be found. Jul 27 20:54:03.038673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:54:03.040017 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-9245985e-e0b0-4ff2-8da6-c53205ec7abc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Returning 404 to user: Instance 6a8f2d6b-aa7f-486c-95dd-4134388ea801 could not be found. {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:54:03.040017 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-9245985e-e0b0-4ff2-8da6-c53205ec7abc tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801" status: 404 len: 111 microversion: 2.1 time: 0.028397 Jul 27 20:54:03.040017 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2045/4073] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 20:54:03 2022] DELETE /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:54:03.045250 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-af484871-0783-49dc-99b4-ebd955345716 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:54:03.045856 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-af484871-0783-49dc-99b4-ebd955345716 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: 6a8f2d6b-aa7f-486c-95dd-4134388ea801] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:54:03.051813 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af484871-0783-49dc-99b4-ebd955345716 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:03.052253 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af484871-0783-49dc-99b4-ebd955345716 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:03.053028 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af484871-0783-49dc-99b4-ebd955345716 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:03.053999 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af484871-0783-49dc-99b4-ebd955345716 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:03.067067 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-af484871-0783-49dc-99b4-ebd955345716 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] HTTP exception thrown: Instance 6a8f2d6b-aa7f-486c-95dd-4134388ea801 could not be found. Jul 27 20:54:03.068535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-af484871-0783-49dc-99b4-ebd955345716 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Request method failure captured: Jul 27 20:54:03.068535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801 HTTP/1.1 Jul 27 20:54:03.068535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:54:03.068535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:54:03.068535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:54:03.068535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:54:03.068535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:54:03.068535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:54:03.068535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:54:03.068535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:54:03.068535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4aQDgaYQvYIu8Qo0cRbAVWzvY8Dy9GGrZ0HavYCr3wNvgVR2I9Irzc5X_0xRA4MDwtX2JjjvjYYuHwC7Mrh_yi9kIBmZG5-_lltvQDXb5DZDOaE2MSmiAXjFqiUVxXiijuz7iXdho2ln6dfnWOlCMnhNkamPt7HXOo0ngwRoFADP5jE Jul 27 20:54:03.068535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:54:03.068535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:54:03.068535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:54:03.068535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:54:03.068535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:54:03.068535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:54:03.068535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:54:03.068535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:54:03.068535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:54:03.068535 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:54:03.070604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6a1fbeedf5134a5a9432e42a35e1d955", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:54:03.070604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:54:03.070604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:54:03.070604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:54:03.070604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:54:03.070604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:54:03.070604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:54:03.070604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: 30051341684845938161bb5ec0680d68 Jul 27 20:54:03.070604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:54:03.070604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:54:03.070604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Instance 6a8f2d6b-aa7f-486c-95dd-4134388ea801 could not be found. Jul 27 20:54:03.070604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'id': '6a8f2d6b-aa7f-486c-95dd-4134388ea801'} Jul 27 20:54:03.071549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:54:03.071549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:54:03.071549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:54:03.071549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:54:03.071549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:54:03.071549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:54:03.071549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:54:03.071549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:54:03.071549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:54:03.071549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:54:03.071549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a8f2d6b-aa7f-486c-95dd-4134388ea801 could not be found. Jul 27 20:54:03.071549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:54:03.071549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:54:03.071549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:54:03.071549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:54:03.071549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:54:03.071549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:54:03.071549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:54:03.071549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:54:03.071549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:54:03.072913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:54:03.072913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:54:03.072913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:54:03.072913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:54:03.072913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:54:03.072913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:54:03.072913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:54:03.072913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a8f2d6b-aa7f-486c-95dd-4134388ea801 could not be found. Jul 27 20:54:03.072913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:54:03.072913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:54:03.072913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:54:03.072913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:54:03.072913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:54:03.072913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:54:03.072913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:54:03.072913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:54:03.072913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a8f2d6b-aa7f-486c-95dd-4134388ea801 could not be found. Jul 27 20:54:03.072913 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:54:03.074726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-af484871-0783-49dc-99b4-ebd955345716 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Returning 404 to user: Instance 6a8f2d6b-aa7f-486c-95dd-4134388ea801 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:54:03.074726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-af484871-0783-49dc-99b4-ebd955345716 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801" status: 404 len: 111 microversion: 2.1 time: 0.029262 Jul 27 20:54:03.074726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2029/4074] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:54:03 2022] GET /compute/v2.1/servers/6a8f2d6b-aa7f-486c-95dd-4134388ea801 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 27 20:54:04.207080 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c989dd33-bf77-4f90-89be-62642bc29426 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:54:04.207585 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c989dd33-bf77-4f90-89be-62642bc29426 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:54:04.214060 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c989dd33-bf77-4f90-89be-62642bc29426 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:04.214510 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c989dd33-bf77-4f90-89be-62642bc29426 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:04.215386 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c989dd33-bf77-4f90-89be-62642bc29426 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:04.215830 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c989dd33-bf77-4f90-89be-62642bc29426 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:04.229571 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-c989dd33-bf77-4f90-89be-62642bc29426 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] HTTP exception thrown: Instance a25e07e9-eb88-4dc7-9833-108d25d57596 could not be found. Jul 27 20:54:04.231095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c989dd33-bf77-4f90-89be-62642bc29426 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Request method failure captured: Jul 27 20:54:04.231095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: DELETE /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596 HTTP/1.1 Jul 27 20:54:04.231095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:54:04.231095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:54:04.231095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:54:04.231095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:54:04.231095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:54:04.231095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:54:04.231095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:54:04.231095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:54:04.231095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4aQDgaYQvYIu8Qo0cRbAVWzvY8Dy9GGrZ0HavYCr3wNvgVR2I9Irzc5X_0xRA4MDwtX2JjjvjYYuHwC7Mrh_yi9kIBmZG5-_lltvQDXb5DZDOaE2MSmiAXjFqiUVxXiijuz7iXdho2ln6dfnWOlCMnhNkamPt7HXOo0ngwRoFADP5jE Jul 27 20:54:04.231095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:54:04.231095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:54:04.231095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:54:04.231095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:54:04.231095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:54:04.231095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:54:04.231095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:54:04.231095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:54:04.231095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:54:04.231095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:54:04.232267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6a1fbeedf5134a5a9432e42a35e1d955", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:54:04.232267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:54:04.232267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:54:04.232267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:54:04.232267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:54:04.232267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:54:04.232267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:54:04.232267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: 30051341684845938161bb5ec0680d68 Jul 27 20:54:04.232267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:54:04.232267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:54:04.232267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Instance a25e07e9-eb88-4dc7-9833-108d25d57596 could not be found. Jul 27 20:54:04.232267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'id': 'a25e07e9-eb88-4dc7-9833-108d25d57596'} Jul 27 20:54:04.232895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:54:04.232895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:54:04.232895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:54:04.232895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:54:04.232895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:54:04.232895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:54:04.232895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:54:04.232895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:54:04.232895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:54:04.232895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:54:04.232895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a25e07e9-eb88-4dc7-9833-108d25d57596 could not be found. Jul 27 20:54:04.232895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:54:04.232895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:54:04.232895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:54:04.232895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:54:04.232895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:54:04.232895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:54:04.232895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:54:04.232895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:54:04.232895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:54:04.234454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:54:04.234454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 20:54:04.234454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 20:54:04.234454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 20:54:04.234454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 20:54:04.234454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:54:04.234454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:54:04.234454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:54:04.234454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:54:04.234454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a25e07e9-eb88-4dc7-9833-108d25d57596 could not be found. Jul 27 20:54:04.234454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:54:04.234454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:54:04.234454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:54:04.234454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:54:04.234454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:54:04.234454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:54:04.234454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:54:04.234454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:54:04.234454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a25e07e9-eb88-4dc7-9833-108d25d57596 could not be found. Jul 27 20:54:04.234454 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:54:04.235947 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c989dd33-bf77-4f90-89be-62642bc29426 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Returning 404 to user: Instance a25e07e9-eb88-4dc7-9833-108d25d57596 could not be found. {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:54:04.235947 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c989dd33-bf77-4f90-89be-62642bc29426 tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596" status: 404 len: 111 microversion: 2.1 time: 0.029470 Jul 27 20:54:04.235947 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2046/4075] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 20:54:04 2022] DELETE /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:54:04.240604 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-648e57e4-a88d-4587-9fdf-38afc57d78de tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:54:04.241896 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-648e57e4-a88d-4587-9fdf-38afc57d78de tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] [instance: a25e07e9-eb88-4dc7-9833-108d25d57596] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:54:04.248264 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-648e57e4-a88d-4587-9fdf-38afc57d78de tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:04.248713 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-648e57e4-a88d-4587-9fdf-38afc57d78de tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:04.249506 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-648e57e4-a88d-4587-9fdf-38afc57d78de tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:04.249944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-648e57e4-a88d-4587-9fdf-38afc57d78de tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:04.263099 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-648e57e4-a88d-4587-9fdf-38afc57d78de tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] HTTP exception thrown: Instance a25e07e9-eb88-4dc7-9833-108d25d57596 could not be found. Jul 27 20:54:04.264593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-648e57e4-a88d-4587-9fdf-38afc57d78de tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Request method failure captured: Jul 27 20:54:04.264593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596 HTTP/1.1 Jul 27 20:54:04.264593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 20:54:04.264593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 20:54:04.264593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 20:54:04.264593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 20:54:04.264593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 20:54:04.264593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 20:54:04.264593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 20:54:04.264593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 20:54:04.264593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4aQDgaYQvYIu8Qo0cRbAVWzvY8Dy9GGrZ0HavYCr3wNvgVR2I9Irzc5X_0xRA4MDwtX2JjjvjYYuHwC7Mrh_yi9kIBmZG5-_lltvQDXb5DZDOaE2MSmiAXjFqiUVxXiijuz7iXdho2ln6dfnWOlCMnhNkamPt7HXOo0ngwRoFADP5jE Jul 27 20:54:04.264593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 20:54:04.264593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 20:54:04.264593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 20:54:04.264593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 20:54:04.264593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 20:54:04.264593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 20:54:04.264593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:54:04.264593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:54:04.264593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 20:54:04.264593 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 20:54:04.265959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6a1fbeedf5134a5a9432e42a35e1d955", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6a1fbeedf5134a5a9432e42a35e1d955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:54:04.265959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:54:04.265959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 6a1fbeedf5134a5a9432e42a35e1d955 Jul 27 20:54:04.265959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-662100477 Jul 27 20:54:04.265959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:54:04.265959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 20:54:04.265959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 20:54:04.265959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: 30051341684845938161bb5ec0680d68 Jul 27 20:54:04.265959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeNegativeTest-662100477-project Jul 27 20:54:04.265959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 20:54:04.265959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Instance a25e07e9-eb88-4dc7-9833-108d25d57596 could not be found. Jul 27 20:54:04.265959 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'id': 'a25e07e9-eb88-4dc7-9833-108d25d57596'} Jul 27 20:54:04.266793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:54:04.266793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:54:04.266793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:54:04.266793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:54:04.266793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:54:04.266793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:54:04.266793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:54:04.266793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:54:04.266793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:54:04.266793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:54:04.266793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a25e07e9-eb88-4dc7-9833-108d25d57596 could not be found. Jul 27 20:54:04.266793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:54:04.266793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:54:04.266793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:54:04.266793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:54:04.266793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:54:04.266793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:54:04.266793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:54:04.266793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:54:04.266793 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:54:04.268143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:54:04.268143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:54:04.268143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:54:04.268143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:54:04.268143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:54:04.268143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:54:04.268143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:54:04.268143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a25e07e9-eb88-4dc7-9833-108d25d57596 could not be found. Jul 27 20:54:04.268143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:54:04.268143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:54:04.268143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:54:04.268143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:54:04.268143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:54:04.268143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:54:04.268143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:54:04.268143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:54:04.268143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a25e07e9-eb88-4dc7-9833-108d25d57596 could not be found. Jul 27 20:54:04.268143 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 20:54:04.269283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-648e57e4-a88d-4587-9fdf-38afc57d78de tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] Returning 404 to user: Instance a25e07e9-eb88-4dc7-9833-108d25d57596 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:54:04.269283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-648e57e4-a88d-4587-9fdf-38afc57d78de tempest-AttachVolumeNegativeTest-662100477 tempest-AttachVolumeNegativeTest-662100477-project] 10.222.0.65 "GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596" status: 404 len: 111 microversion: 2.1 time: 0.029120 Jul 27 20:54:04.269283 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2030/4076] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:54:04 2022] GET /compute/v2.1/servers/a25e07e9-eb88-4dc7-9833-108d25d57596 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:54:28.338212 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:54:28.339871 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:54:28.543673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2251197b-5b9a-4886-bfde-2ed0e454f032 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Action: 'create', calling method: .version_select at 0x7fc7f388fd30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-796992677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtTNcHLg/pJDdPHrFs+Zl3VgBxAtops2fGvzJdXSklXvQvajgxjAj/bwLj0fSV4wm5vKi4FypDAk+skwAR0FP0j3UL6KNSiGY+2HwYWDnCcQ8v+OdOFwXMb5a/PlXUIWA=="}} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:54:28.560103 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-2251197b-5b9a-4886-bfde-2ed0e454f032 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Getting quotas for project c51423871031456a80da2d9d0c74bc62. Resources: {'key_pairs'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:54:28.565128 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.quota [None req-2251197b-5b9a-4886-bfde-2ed0e454f032 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Getting quotas for user 060f4e9543a5456897d5217676cb93a6 and project c51423871031456a80da2d9d0c74bc62. Resources: {'key_pairs'} {{(pid=117876) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:54:28.594476 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2251197b-5b9a-4886-bfde-2ed0e454f032 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.261836 Jul 27 20:54:28.595255 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2047/4077] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Jul 27 20:54:28 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:54:57.891017 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fd11ed61-e870-4e14-b2d7-e02218dafeb0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-180025698", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-796992677", "security_groups": [{"name": "tempest-secgroup-smoke-1666106124"}], "block_device_mapping_v2": [{"uuid": "5e5f7706-12f3-44c3-a4b4-66abdc574c2e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3825a3db-7c3e-4367-8761-ebb2cee02683"}]}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:54:57.900889 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:54:57.902088 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:54:58.009197 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-fd11ed61-e870-4e14-b2d7-e02218dafeb0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] validate_networks() for [('3825a3db-7c3e-4367-8761-ebb2cee02683', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:54:58.465161 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-fd11ed61-e870-4e14-b2d7-e02218dafeb0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:54:58.465588 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-fd11ed61-e870-4e14-b2d7-e02218dafeb0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:54:58.466063 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-fd11ed61-e870-4e14-b2d7-e02218dafeb0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:54:58.466479 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-fd11ed61-e870-4e14-b2d7-e02218dafeb0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:54:58.466894 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-fd11ed61-e870-4e14-b2d7-e02218dafeb0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:54:58.475801 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fd11ed61-e870-4e14-b2d7-e02218dafeb0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:58.476252 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fd11ed61-e870-4e14-b2d7-e02218dafeb0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:58.477085 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fd11ed61-e870-4e14-b2d7-e02218dafeb0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:54:58.477526 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fd11ed61-e870-4e14-b2d7-e02218dafeb0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:54:58.494050 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-fd11ed61-e870-4e14-b2d7-e02218dafeb0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Getting quotas for project c51423871031456a80da2d9d0c74bc62. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:54:58.498188 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-fd11ed61-e870-4e14-b2d7-e02218dafeb0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Getting quotas for user 060f4e9543a5456897d5217676cb93a6 and project c51423871031456a80da2d9d0c74bc62. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:54:58.558494 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fd11ed61-e870-4e14-b2d7-e02218dafeb0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:54:58.560687 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fd11ed61-e870-4e14-b2d7-e02218dafeb0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e5f7706-12f3-44c3-a4b4-66abdc574c2e',volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:54:58.684915 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fd11ed61-e870-4e14-b2d7-e02218dafeb0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [dfe7407c-6edc-47bb-af3d-ba0764446d05] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 27 20:54:59.692662 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [None req-fd11ed61-e870-4e14-b2d7-e02218dafeb0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [dfe7407c-6edc-47bb-af3d-ba0764446d05] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 46020. Jul 27 20:54:59.697626 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fd11ed61-e870-4e14-b2d7-e02218dafeb0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.810426 Jul 27 20:54:59.698387 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2031/4078] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Jul 27 20:54:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:54:59.709982 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b2d60619-f365-44b1-b8eb-6b6cb789d0b6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:54:59.710606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b2d60619-f365-44b1-b8eb-6b6cb789d0b6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:54:59.712777 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=4 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:54:59.714076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:54:59.766953 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b2d60619-f365-44b1-b8eb-6b6cb789d0b6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:54:59.774516 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b2d60619-f365-44b1-b8eb-6b6cb789d0b6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 200 len: 1093 microversion: 2.1 time: 0.068738 Jul 27 20:54:59.775062 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2048/4079] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:54:59 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:00.795576 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c538db4b-0507-484c-88f4-15c1d5087491 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:00.796198 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c538db4b-0507-484c-88f4-15c1d5087491 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:00.847726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c538db4b-0507-484c-88f4-15c1d5087491 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:00.854920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c538db4b-0507-484c-88f4-15c1d5087491 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 200 len: 1093 microversion: 2.1 time: 0.063825 Jul 27 20:55:00.855473 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2032/4080] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:00 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:01.875490 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d98932d9-a860-452f-9fa9-f867c446872a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:01.876111 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d98932d9-a860-452f-9fa9-f867c446872a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:01.934791 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d98932d9-a860-452f-9fa9-f867c446872a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:01.941966 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d98932d9-a860-452f-9fa9-f867c446872a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 200 len: 1093 microversion: 2.1 time: 0.070275 Jul 27 20:55:01.942529 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2049/4081] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:01 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:02.963246 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d1e909a7-ea94-4003-93b6-3b67226c66ad tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:02.964532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d1e909a7-ea94-4003-93b6-3b67226c66ad tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:03.018171 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d1e909a7-ea94-4003-93b6-3b67226c66ad tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:03.024950 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d1e909a7-ea94-4003-93b6-3b67226c66ad tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 200 len: 1093 microversion: 2.1 time: 0.065772 Jul 27 20:55:03.025549 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2033/4082] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:02 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:04.046533 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-260f47c9-a733-42a1-91e0-fa47d0baff21 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:04.047143 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-260f47c9-a733-42a1-91e0-fa47d0baff21 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:04.054089 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-260f47c9-a733-42a1-91e0-fa47d0baff21 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:04.054538 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-260f47c9-a733-42a1-91e0-fa47d0baff21 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:04.055291 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-260f47c9-a733-42a1-91e0-fa47d0baff21 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:04.055730 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-260f47c9-a733-42a1-91e0-fa47d0baff21 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:04.116385 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-260f47c9-a733-42a1-91e0-fa47d0baff21 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:04.124673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-260f47c9-a733-42a1-91e0-fa47d0baff21 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 200 len: 1143 microversion: 2.1 time: 0.082025 Jul 27 20:55:04.125265 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2050/4083] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:04 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:05.146485 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0c0583e3-52e4-4f71-9404-147c71d9f74b tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:05.147452 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0c0583e3-52e4-4f71-9404-147c71d9f74b tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:05.155253 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c0583e3-52e4-4f71-9404-147c71d9f74b tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:05.155705 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c0583e3-52e4-4f71-9404-147c71d9f74b tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:05.156545 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c0583e3-52e4-4f71-9404-147c71d9f74b tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:05.157024 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c0583e3-52e4-4f71-9404-147c71d9f74b tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:05.291369 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0c0583e3-52e4-4f71-9404-147c71d9f74b tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:05.299807 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0c0583e3-52e4-4f71-9404-147c71d9f74b tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 200 len: 1209 microversion: 2.1 time: 0.157038 Jul 27 20:55:05.300652 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2034/4084] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:05 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 1209 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:06.322210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8b6f7b6e-e422-41d5-b8a5-1dff502cef99 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:06.322882 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8b6f7b6e-e422-41d5-b8a5-1dff502cef99 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:06.331145 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8b6f7b6e-e422-41d5-b8a5-1dff502cef99 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:06.331838 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8b6f7b6e-e422-41d5-b8a5-1dff502cef99 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:06.332619 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8b6f7b6e-e422-41d5-b8a5-1dff502cef99 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:06.333362 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-8b6f7b6e-e422-41d5-b8a5-1dff502cef99 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:06.401702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-4f40bdac-5337-46c8-b768-05f430681ba2 req-7cca8b44-5c3a-4674-939e-5266baac4ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1077c395-be7e-470e-b920-20e6115709bb", "tag": "9c424416-5e93-470b-af6c-82155ea9fe28"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:55:06.422180 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-4f40bdac-5337-46c8-b768-05f430681ba2 req-7cca8b44-5c3a-4674-939e-5266baac4ca2 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:06.422628 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-4f40bdac-5337-46c8-b768-05f430681ba2 req-7cca8b44-5c3a-4674-939e-5266baac4ca2 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:06.452001 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-4f40bdac-5337-46c8-b768-05f430681ba2 req-7cca8b44-5c3a-4674-939e-5266baac4ca2 service nova] Creating event network-changed:9c424416-5e93-470b-af6c-82155ea9fe28 for instance 1077c395-be7e-470e-b920-20e6115709bb on hv-cinder-79987 Jul 27 20:55:06.457895 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-4f40bdac-5337-46c8-b768-05f430681ba2 req-7cca8b44-5c3a-4674-939e-5266baac4ca2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060548 Jul 27 20:55:06.458700 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2035/4085] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:55:06.507501 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8b6f7b6e-e422-41d5-b8a5-1dff502cef99 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:06.517068 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8b6f7b6e-e422-41d5-b8a5-1dff502cef99 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 200 len: 1265 microversion: 2.1 time: 0.198703 Jul 27 20:55:06.517651 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2051/4086] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:06 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:07.539244 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f77dfd7d-5722-4ad4-a187-54a6344429dc tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:07.539968 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f77dfd7d-5722-4ad4-a187-54a6344429dc tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:07.547229 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f77dfd7d-5722-4ad4-a187-54a6344429dc tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:07.547674 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f77dfd7d-5722-4ad4-a187-54a6344429dc tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:07.548421 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f77dfd7d-5722-4ad4-a187-54a6344429dc tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:07.548850 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f77dfd7d-5722-4ad4-a187-54a6344429dc tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:07.678551 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f77dfd7d-5722-4ad4-a187-54a6344429dc tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:07.686255 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f77dfd7d-5722-4ad4-a187-54a6344429dc tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 200 len: 1265 microversion: 2.1 time: 0.151202 Jul 27 20:55:07.686817 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2036/4087] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:07 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:08.707150 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e1c0e870-bc01-4841-91fd-792f866f7774 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:08.707765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e1c0e870-bc01-4841-91fd-792f866f7774 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:08.715125 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1c0e870-bc01-4841-91fd-792f866f7774 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:08.715573 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1c0e870-bc01-4841-91fd-792f866f7774 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:08.716328 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1c0e870-bc01-4841-91fd-792f866f7774 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:08.716766 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e1c0e870-bc01-4841-91fd-792f866f7774 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:08.851891 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e1c0e870-bc01-4841-91fd-792f866f7774 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:08.859308 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e1c0e870-bc01-4841-91fd-792f866f7774 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 200 len: 1265 microversion: 2.1 time: 0.156318 Jul 27 20:55:08.859866 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2052/4088] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:08 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:09.879799 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-76dde869-7bab-42b1-86b7-ac387aba7a83 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:09.880408 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-76dde869-7bab-42b1-86b7-ac387aba7a83 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:09.882365 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:55:09.888765 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76dde869-7bab-42b1-86b7-ac387aba7a83 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:09.889232 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76dde869-7bab-42b1-86b7-ac387aba7a83 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:09.889990 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76dde869-7bab-42b1-86b7-ac387aba7a83 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:09.890424 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-76dde869-7bab-42b1-86b7-ac387aba7a83 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:10.026454 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-76dde869-7bab-42b1-86b7-ac387aba7a83 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:10.033837 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-76dde869-7bab-42b1-86b7-ac387aba7a83 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 200 len: 1265 microversion: 2.1 time: 0.158056 Jul 27 20:55:10.034389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2037/4089] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:09 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:11.054426 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-18ea7bf0-94df-4f9f-a096-10ed24c0038a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:11.055042 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-18ea7bf0-94df-4f9f-a096-10ed24c0038a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:11.062159 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-18ea7bf0-94df-4f9f-a096-10ed24c0038a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:11.062608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-18ea7bf0-94df-4f9f-a096-10ed24c0038a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:11.063361 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-18ea7bf0-94df-4f9f-a096-10ed24c0038a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:11.063797 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-18ea7bf0-94df-4f9f-a096-10ed24c0038a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:11.191805 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-18ea7bf0-94df-4f9f-a096-10ed24c0038a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:11.199546 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-18ea7bf0-94df-4f9f-a096-10ed24c0038a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 200 len: 1265 microversion: 2.1 time: 0.148982 Jul 27 20:55:11.200109 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2053/4090] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:11 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:12.220671 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4412038c-3dd5-47e9-8d92-308da0c50122 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:12.221323 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4412038c-3dd5-47e9-8d92-308da0c50122 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:12.227709 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4412038c-3dd5-47e9-8d92-308da0c50122 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:12.228159 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4412038c-3dd5-47e9-8d92-308da0c50122 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:12.228919 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4412038c-3dd5-47e9-8d92-308da0c50122 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:12.230005 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4412038c-3dd5-47e9-8d92-308da0c50122 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:12.362371 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4412038c-3dd5-47e9-8d92-308da0c50122 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:12.369743 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4412038c-3dd5-47e9-8d92-308da0c50122 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 200 len: 1265 microversion: 2.1 time: 0.152877 Jul 27 20:55:12.370315 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2038/4091] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:12 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:13.389943 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-09e6d3c6-f38a-4fb7-884e-5d062f6737a0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:13.390566 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-09e6d3c6-f38a-4fb7-884e-5d062f6737a0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:13.392418 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=4 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:55:13.398323 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-09e6d3c6-f38a-4fb7-884e-5d062f6737a0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:13.398769 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-09e6d3c6-f38a-4fb7-884e-5d062f6737a0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:13.399533 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-09e6d3c6-f38a-4fb7-884e-5d062f6737a0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:13.399968 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-09e6d3c6-f38a-4fb7-884e-5d062f6737a0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:13.528788 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-09e6d3c6-f38a-4fb7-884e-5d062f6737a0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:13.536210 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-09e6d3c6-f38a-4fb7-884e-5d062f6737a0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 200 len: 1265 microversion: 2.1 time: 0.150291 Jul 27 20:55:13.536768 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2054/4092] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:13 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:14.557968 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-27ad9b1c-aec6-47df-8972-f930dd992ff3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:14.558619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-27ad9b1c-aec6-47df-8972-f930dd992ff3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:14.560382 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=10 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:55:14.566016 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-27ad9b1c-aec6-47df-8972-f930dd992ff3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:14.566469 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-27ad9b1c-aec6-47df-8972-f930dd992ff3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:14.567228 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-27ad9b1c-aec6-47df-8972-f930dd992ff3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:14.567670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-27ad9b1c-aec6-47df-8972-f930dd992ff3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:14.701368 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-27ad9b1c-aec6-47df-8972-f930dd992ff3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:14.709107 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-27ad9b1c-aec6-47df-8972-f930dd992ff3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 200 len: 1265 microversion: 2.1 time: 0.155451 Jul 27 20:55:14.709657 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2039/4093] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:14 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:15.729566 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ecfff0c9-844c-4b76-b643-259015bcba48 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:15.730178 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ecfff0c9-844c-4b76-b643-259015bcba48 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:15.736635 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ecfff0c9-844c-4b76-b643-259015bcba48 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:15.737113 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ecfff0c9-844c-4b76-b643-259015bcba48 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:15.737864 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ecfff0c9-844c-4b76-b643-259015bcba48 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:15.738293 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ecfff0c9-844c-4b76-b643-259015bcba48 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:15.869878 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ecfff0c9-844c-4b76-b643-259015bcba48 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:15.877296 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ecfff0c9-844c-4b76-b643-259015bcba48 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 200 len: 1265 microversion: 2.1 time: 0.151560 Jul 27 20:55:15.877858 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2055/4094] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:15 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:16.898067 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-22565feb-d83e-40d4-8a71-894bc7a889df tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:16.898668 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-22565feb-d83e-40d4-8a71-894bc7a889df tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:16.905152 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-22565feb-d83e-40d4-8a71-894bc7a889df tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:16.905620 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-22565feb-d83e-40d4-8a71-894bc7a889df tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:16.906384 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-22565feb-d83e-40d4-8a71-894bc7a889df tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:16.906820 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-22565feb-d83e-40d4-8a71-894bc7a889df tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:17.047373 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-22565feb-d83e-40d4-8a71-894bc7a889df tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:17.054687 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-22565feb-d83e-40d4-8a71-894bc7a889df tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 200 len: 1265 microversion: 2.1 time: 0.160599 Jul 27 20:55:17.055273 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2040/4095] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:16 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:18.077168 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6e1f11a6-bc31-4e01-ad4b-78f5f7a3ae7e tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:18.077781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6e1f11a6-bc31-4e01-ad4b-78f5f7a3ae7e tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:18.085231 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6e1f11a6-bc31-4e01-ad4b-78f5f7a3ae7e tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:18.085725 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6e1f11a6-bc31-4e01-ad4b-78f5f7a3ae7e tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:18.086839 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6e1f11a6-bc31-4e01-ad4b-78f5f7a3ae7e tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:18.087366 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6e1f11a6-bc31-4e01-ad4b-78f5f7a3ae7e tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:18.241860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6e1f11a6-bc31-4e01-ad4b-78f5f7a3ae7e tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:18.252840 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6e1f11a6-bc31-4e01-ad4b-78f5f7a3ae7e tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 200 len: 1265 microversion: 2.1 time: 0.180619 Jul 27 20:55:18.253781 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2056/4096] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:18 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:18.914215 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-26bdc6a3-edd0-406a-923f-88a0b5c76a5c req-ce1b3b16-d566-4f40-b8df-fab0d2e14eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1077c395-be7e-470e-b920-20e6115709bb", "name": "network-vif-plugged", "status": "completed", "tag": "9c424416-5e93-470b-af6c-82155ea9fe28"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:55:18.924340 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-26bdc6a3-edd0-406a-923f-88a0b5c76a5c req-ce1b3b16-d566-4f40-b8df-fab0d2e14eff service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:18.924811 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-26bdc6a3-edd0-406a-923f-88a0b5c76a5c req-ce1b3b16-d566-4f40-b8df-fab0d2e14eff service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:18.937401 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-26bdc6a3-edd0-406a-923f-88a0b5c76a5c req-ce1b3b16-d566-4f40-b8df-fab0d2e14eff service nova] Creating event network-vif-plugged:9c424416-5e93-470b-af6c-82155ea9fe28 for instance 1077c395-be7e-470e-b920-20e6115709bb on hv-cinder-79987 Jul 27 20:55:18.942741 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-26bdc6a3-edd0-406a-923f-88a0b5c76a5c req-ce1b3b16-d566-4f40-b8df-fab0d2e14eff service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032095 Jul 27 20:55:18.943526 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2041/4097] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:55:19.275051 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-48431709-ba90-4945-a9b5-a8b9269c3faa tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:19.275679 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-48431709-ba90-4945-a9b5-a8b9269c3faa tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:19.282196 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48431709-ba90-4945-a9b5-a8b9269c3faa tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:19.282654 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48431709-ba90-4945-a9b5-a8b9269c3faa tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:19.283423 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48431709-ba90-4945-a9b5-a8b9269c3faa tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:19.283867 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-48431709-ba90-4945-a9b5-a8b9269c3faa tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:19.423078 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-48431709-ba90-4945-a9b5-a8b9269c3faa tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:19.430429 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-48431709-ba90-4945-a9b5-a8b9269c3faa tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 200 len: 1265 microversion: 2.1 time: 0.159242 Jul 27 20:55:19.431024 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2057/4098] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:19 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:20.453447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-707f88ae-a539-484c-92cd-8d32887050c8 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:20.454148 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-707f88ae-a539-484c-92cd-8d32887050c8 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:20.460619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-707f88ae-a539-484c-92cd-8d32887050c8 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:20.461106 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-707f88ae-a539-484c-92cd-8d32887050c8 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:20.461861 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-707f88ae-a539-484c-92cd-8d32887050c8 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:20.462301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-707f88ae-a539-484c-92cd-8d32887050c8 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:20.602848 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-707f88ae-a539-484c-92cd-8d32887050c8 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:20.610609 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-707f88ae-a539-484c-92cd-8d32887050c8 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 200 len: 1265 microversion: 2.1 time: 0.162626 Jul 27 20:55:20.611174 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2042/4099] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:20 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:21.631643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a62739a4-86c6-4a0d-822e-0c2feb70f14c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:21.632267 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a62739a4-86c6-4a0d-822e-0c2feb70f14c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:21.639663 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a62739a4-86c6-4a0d-822e-0c2feb70f14c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:21.640119 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a62739a4-86c6-4a0d-822e-0c2feb70f14c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:21.640887 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a62739a4-86c6-4a0d-822e-0c2feb70f14c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:21.641355 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a62739a4-86c6-4a0d-822e-0c2feb70f14c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:21.770704 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a62739a4-86c6-4a0d-822e-0c2feb70f14c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:21.778945 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a62739a4-86c6-4a0d-822e-0c2feb70f14c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 200 len: 1451 microversion: 2.1 time: 0.151165 Jul 27 20:55:21.779511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2058/4100] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:21 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:21.798849 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6cb71fe7-d152-4977-9da1-a2580e710937 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:55:21.799451 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6cb71fe7-d152-4977-9da1-a2580e710937 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:55:21.806164 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6cb71fe7-d152-4977-9da1-a2580e710937 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:21.806585 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6cb71fe7-d152-4977-9da1-a2580e710937 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:21.807333 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6cb71fe7-d152-4977-9da1-a2580e710937 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:21.807762 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6cb71fe7-d152-4977-9da1-a2580e710937 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:21.936118 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6cb71fe7-d152-4977-9da1-a2580e710937 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:55:21.943822 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6cb71fe7-d152-4977-9da1-a2580e710937 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 200 len: 1451 microversion: 2.1 time: 0.148753 Jul 27 20:55:21.944402 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2043/4101] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:55:21 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:55:23.869228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-b7bcad08-1ceb-48ad-be8c-0c90f16e28f8 req-c9afe97d-7130-4af9-8e31-ce3e706bcb1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1077c395-be7e-470e-b920-20e6115709bb", "tag": "9c424416-5e93-470b-af6c-82155ea9fe28"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:55:23.879412 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-b7bcad08-1ceb-48ad-be8c-0c90f16e28f8 req-c9afe97d-7130-4af9-8e31-ce3e706bcb1a service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:55:23.879861 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-b7bcad08-1ceb-48ad-be8c-0c90f16e28f8 req-c9afe97d-7130-4af9-8e31-ce3e706bcb1a service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:55:23.891157 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-b7bcad08-1ceb-48ad-be8c-0c90f16e28f8 req-c9afe97d-7130-4af9-8e31-ce3e706bcb1a service nova] Creating event network-changed:9c424416-5e93-470b-af6c-82155ea9fe28 for instance 1077c395-be7e-470e-b920-20e6115709bb on hv-cinder-79987 Jul 27 20:55:23.896330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-b7bcad08-1ceb-48ad-be8c-0c90f16e28f8 req-c9afe97d-7130-4af9-8e31-ce3e706bcb1a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030795 Jul 27 20:55:23.896901 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2059/4102] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:56:43.117234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:56:43.117730 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 20:56:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:56:46.992761 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 20:56:46.993385 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 20:56:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 20:57:37.522454 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:57:37.523200 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=54 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:57:37.527049 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-49804b79-3231-4c6e-9b07-972d8b869475 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:57:37.527545 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-49804b79-3231-4c6e-9b07-972d8b869475 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:57:37.535072 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49804b79-3231-4c6e-9b07-972d8b869475 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:37.535520 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49804b79-3231-4c6e-9b07-972d8b869475 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:37.536278 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49804b79-3231-4c6e-9b07-972d8b869475 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:37.536709 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49804b79-3231-4c6e-9b07-972d8b869475 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:37.563726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-49804b79-3231-4c6e-9b07-972d8b869475 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 20:57:37.639863 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-49804b79-3231-4c6e-9b07-972d8b869475 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "DELETE /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 204 len: 0 microversion: 2.1 time: 0.118964 Jul 27 20:57:37.640471 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2044/4103] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 20:57:37 2022] DELETE /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 20:57:37.649608 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=28 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:57:37.650638 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=56 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:57:37.655475 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-26fe65e5-734f-4a4b-9f20-174c4c22e713 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:57:37.656179 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-26fe65e5-734f-4a4b-9f20-174c4c22e713 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:57:37.663697 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-26fe65e5-734f-4a4b-9f20-174c4c22e713 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:37.664152 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-26fe65e5-734f-4a4b-9f20-174c4c22e713 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:37.664919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-26fe65e5-734f-4a4b-9f20-174c4c22e713 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:37.665397 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-26fe65e5-734f-4a4b-9f20-174c4c22e713 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:37.929734 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-26fe65e5-734f-4a4b-9f20-174c4c22e713 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:57:37.937157 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-26fe65e5-734f-4a4b-9f20-174c4c22e713 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 200 len: 1576 microversion: 2.1 time: 0.289834 Jul 27 20:57:37.937707 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2060/4104] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:57:37 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 1576 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:57:38.958886 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2c63e5cb-0657-4db4-8ae6-d2311849e068 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:57:38.959848 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2c63e5cb-0657-4db4-8ae6-d2311849e068 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:57:38.966327 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c63e5cb-0657-4db4-8ae6-d2311849e068 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:38.966777 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c63e5cb-0657-4db4-8ae6-d2311849e068 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:38.967539 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c63e5cb-0657-4db4-8ae6-d2311849e068 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:38.967976 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c63e5cb-0657-4db4-8ae6-d2311849e068 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:39.159417 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2c63e5cb-0657-4db4-8ae6-d2311849e068 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:57:39.166833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2c63e5cb-0657-4db4-8ae6-d2311849e068 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 200 len: 1576 microversion: 2.1 time: 0.212154 Jul 27 20:57:39.167390 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2045/4105] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:57:38 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 1576 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:57:40.188673 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-297d6a69-18d9-45b1-a479-2e5459bd81b6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:57:40.189379 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-297d6a69-18d9-45b1-a479-2e5459bd81b6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:57:40.196015 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-297d6a69-18d9-45b1-a479-2e5459bd81b6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:40.196474 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-297d6a69-18d9-45b1-a479-2e5459bd81b6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:40.197273 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-297d6a69-18d9-45b1-a479-2e5459bd81b6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:40.197720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-297d6a69-18d9-45b1-a479-2e5459bd81b6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:40.259847 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-297d6a69-18d9-45b1-a479-2e5459bd81b6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:57:40.267330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-297d6a69-18d9-45b1-a479-2e5459bd81b6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 200 len: 1508 microversion: 2.1 time: 0.082684 Jul 27 20:57:40.268395 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2061/4106] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:57:40 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 1508 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:57:40.405548 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-25f109fb-17c7-4341-8d14-90d819ada350 req-d581af11-ee87-483b-8317-46206bc761c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1077c395-be7e-470e-b920-20e6115709bb", "name": "network-vif-deleted", "tag": "9c424416-5e93-470b-af6c-82155ea9fe28"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:57:40.416037 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-25f109fb-17c7-4341-8d14-90d819ada350 req-d581af11-ee87-483b-8317-46206bc761c1 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:40.416494 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-25f109fb-17c7-4341-8d14-90d819ada350 req-d581af11-ee87-483b-8317-46206bc761c1 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:40.428709 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-25f109fb-17c7-4341-8d14-90d819ada350 req-d581af11-ee87-483b-8317-46206bc761c1 service nova] Creating event network-vif-deleted:9c424416-5e93-470b-af6c-82155ea9fe28 for instance 1077c395-be7e-470e-b920-20e6115709bb on hv-cinder-79987 Jul 27 20:57:40.434833 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-25f109fb-17c7-4341-8d14-90d819ada350 req-d581af11-ee87-483b-8317-46206bc761c1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098575 Jul 27 20:57:40.435375 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2046/4107] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:57:41.290509 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ca82d94b-896e-49a4-a56c-b47ade48abba tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:57:41.291129 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ca82d94b-896e-49a4-a56c-b47ade48abba tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:57:41.304513 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ca82d94b-896e-49a4-a56c-b47ade48abba tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:41.304988 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ca82d94b-896e-49a4-a56c-b47ade48abba tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:41.305784 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ca82d94b-896e-49a4-a56c-b47ade48abba tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:41.306228 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ca82d94b-896e-49a4-a56c-b47ade48abba tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:41.320411 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-ca82d94b-896e-49a4-a56c-b47ade48abba tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] HTTP exception thrown: Instance 1077c395-be7e-470e-b920-20e6115709bb could not be found. Jul 27 20:57:41.322122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ca82d94b-896e-49a4-a56c-b47ade48abba tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Request method failure captured: Jul 27 20:57:41.322122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb HTTP/1.1 Jul 27 20:57:41.322122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 20:57:41.322122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 20:57:41.322122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 20:57:41.322122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 20:57:41.322122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 20:57:41.322122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 20:57:41.322122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 20:57:41.322122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 20:57:41.322122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4aX-KFD9EgXLURpJbENnJJwOT82xpw2ijhy7cbDTNGRLiN1SgmJTC2Vu4LdOR4OhGek_HWlXJx7Q651nlP8LdO4InzbTmtvMcr0BUDtd62TV7SjCdBx6jVrit9mt4jBjVU6H7feDrBWXaqLoS782HwG9dmHmxAfTZyqTCS8qOOxhGxo Jul 27 20:57:41.322122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 20:57:41.322122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 20:57:41.322122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 20:57:41.322122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 20:57:41.322122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 20:57:41.322122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 20:57:41.322122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: c51423871031456a80da2d9d0c74bc62 Jul 27 20:57:41.322122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-TestVolumeBootPattern-580770462 Jul 27 20:57:41.322122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 20:57:41.322122 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 20:57:41.323444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c51423871031456a80da2d9d0c74bc62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c51423871031456a80da2d9d0c74bc62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c51423871031456a80da2d9d0c74bc62", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c51423871031456a80da2d9d0c74bc62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 20:57:41.323444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-TestVolumeBootPattern-580770462 Jul 27 20:57:41.323444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: c51423871031456a80da2d9d0c74bc62 Jul 27 20:57:41.323444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-TestVolumeBootPattern-580770462 Jul 27 20:57:41.323444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-TestVolumeBootPattern-580770462-project Jul 27 20:57:41.323444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 20:57:41.323444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 20:57:41.323444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: 060f4e9543a5456897d5217676cb93a6 Jul 27 20:57:41.323444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-TestVolumeBootPattern-580770462-project Jul 27 20:57:41.323444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 20:57:41.323444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Instance 1077c395-be7e-470e-b920-20e6115709bb could not be found. Jul 27 20:57:41.323444 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'id': '1077c395-be7e-470e-b920-20e6115709bb'} Jul 27 20:57:41.324184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 20:57:41.324184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:57:41.324184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 20:57:41.324184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 20:57:41.324184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 20:57:41.324184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 20:57:41.324184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 20:57:41.324184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 20:57:41.324184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 20:57:41.324184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 20:57:41.324184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1077c395-be7e-470e-b920-20e6115709bb could not be found. Jul 27 20:57:41.324184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:57:41.324184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:57:41.324184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:57:41.324184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:57:41.324184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:57:41.324184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:57:41.324184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 20:57:41.324184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 20:57:41.324184 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 20:57:41.325315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 20:57:41.325315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 20:57:41.325315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 20:57:41.325315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 20:57:41.325315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 20:57:41.325315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 20:57:41.325315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 20:57:41.325315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1077c395-be7e-470e-b920-20e6115709bb could not be found. Jul 27 20:57:41.325315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:57:41.325315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 20:57:41.325315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:57:41.325315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 20:57:41.325315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 20:57:41.325315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 20:57:41.325315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 20:57:41.325315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 20:57:41.325315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1077c395-be7e-470e-b920-20e6115709bb could not be found. Jul 27 20:57:41.325315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 20:57:41.326278 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ca82d94b-896e-49a4-a56c-b47ade48abba tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Returning 404 to user: Instance 1077c395-be7e-470e-b920-20e6115709bb could not be found. {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 20:57:41.326278 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ca82d94b-896e-49a4-a56c-b47ade48abba tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 404 len: 111 microversion: 2.1 time: 0.036988 Jul 27 20:57:41.326278 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2062/4108] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:57:41 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 20:57:41.374920 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d4e474af-7328-45ee-9935-bca5890196a3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-735409061", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-796992677", "security_groups": [{"name": "tempest-secgroup-smoke-1666106124"}], "block_device_mapping_v2": [{"uuid": "5e5f7706-12f3-44c3-a4b4-66abdc574c2e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3825a3db-7c3e-4367-8761-ebb2cee02683"}]}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:57:41.497100 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-d4e474af-7328-45ee-9935-bca5890196a3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] validate_networks() for [('3825a3db-7c3e-4367-8761-ebb2cee02683', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 20:57:41.872200 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-d4e474af-7328-45ee-9935-bca5890196a3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 20:57:41.872617 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-d4e474af-7328-45ee-9935-bca5890196a3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 20:57:41.873124 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-d4e474af-7328-45ee-9935-bca5890196a3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 20:57:41.873551 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-d4e474af-7328-45ee-9935-bca5890196a3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 20:57:41.873957 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-d4e474af-7328-45ee-9935-bca5890196a3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 20:57:41.883338 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4e474af-7328-45ee-9935-bca5890196a3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:41.883777 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4e474af-7328-45ee-9935-bca5890196a3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:41.884556 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4e474af-7328-45ee-9935-bca5890196a3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:41.885016 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4e474af-7328-45ee-9935-bca5890196a3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:41.901566 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-d4e474af-7328-45ee-9935-bca5890196a3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Getting quotas for project c51423871031456a80da2d9d0c74bc62. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 20:57:41.905456 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-d4e474af-7328-45ee-9935-bca5890196a3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Getting quotas for user 060f4e9543a5456897d5217676cb93a6 and project c51423871031456a80da2d9d0c74bc62. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 20:57:41.963327 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d4e474af-7328-45ee-9935-bca5890196a3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 20:57:41.965563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d4e474af-7328-45ee-9935-bca5890196a3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: c4219e0b-e130-49d6-8b80-4f7b179fb299] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e5f7706-12f3-44c3-a4b4-66abdc574c2e',volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 20:57:42.092607 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d4e474af-7328-45ee-9935-bca5890196a3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.722281 Jul 27 20:57:42.093277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2047/4109] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Jul 27 20:57:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 20:57:42.104581 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6246db63-6457-4958-8d65-33311b01e568 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:57:42.105222 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6246db63-6457-4958-8d65-33311b01e568 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: c4219e0b-e130-49d6-8b80-4f7b179fb299] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:57:42.158504 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6246db63-6457-4958-8d65-33311b01e568 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:57:42.165211 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6246db63-6457-4958-8d65-33311b01e568 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299" status: 200 len: 1093 microversion: 2.1 time: 0.064452 Jul 27 20:57:42.165763 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2063/4110] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:57:42 2022] GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:57:43.186522 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d25b3fc4-684b-4ffb-aedd-000c03c89088 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:57:43.187133 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d25b3fc4-684b-4ffb-aedd-000c03c89088 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: c4219e0b-e130-49d6-8b80-4f7b179fb299] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:57:43.194015 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d25b3fc4-684b-4ffb-aedd-000c03c89088 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:43.194469 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d25b3fc4-684b-4ffb-aedd-000c03c89088 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:43.195246 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d25b3fc4-684b-4ffb-aedd-000c03c89088 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:43.195684 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d25b3fc4-684b-4ffb-aedd-000c03c89088 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:43.273772 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d25b3fc4-684b-4ffb-aedd-000c03c89088 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:57:43.282177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d25b3fc4-684b-4ffb-aedd-000c03c89088 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299" status: 200 len: 1199 microversion: 2.1 time: 0.099933 Jul 27 20:57:43.293173 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2048/4111] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:57:43 2022] GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299 => generated 1199 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:57:44.305441 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-d7c294c1-1cac-423f-aa23-5c45a7ebacae tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:57:44.306050 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-d7c294c1-1cac-423f-aa23-5c45a7ebacae tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: c4219e0b-e130-49d6-8b80-4f7b179fb299] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:57:44.313039 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d7c294c1-1cac-423f-aa23-5c45a7ebacae tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:44.313493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d7c294c1-1cac-423f-aa23-5c45a7ebacae tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:44.314256 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d7c294c1-1cac-423f-aa23-5c45a7ebacae tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:44.314743 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-d7c294c1-1cac-423f-aa23-5c45a7ebacae tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:44.463436 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-d7c294c1-1cac-423f-aa23-5c45a7ebacae tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:57:44.471315 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-d7c294c1-1cac-423f-aa23-5c45a7ebacae tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299" status: 200 len: 1265 microversion: 2.1 time: 0.169608 Jul 27 20:57:44.472610 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2064/4112] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:57:44 2022] GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:57:44.609322 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-635a94c9-e77f-4fa2-ab3a-dcfe3116ebc2 req-790558ff-5fd6-4e78-9be4-3f420e87308a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4219e0b-e130-49d6-8b80-4f7b179fb299", "tag": "05284f9a-fbdb-4b8f-939b-1d6b6a0f1b1e"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:57:44.621858 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-635a94c9-e77f-4fa2-ab3a-dcfe3116ebc2 req-790558ff-5fd6-4e78-9be4-3f420e87308a service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:44.622358 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-635a94c9-e77f-4fa2-ab3a-dcfe3116ebc2 req-790558ff-5fd6-4e78-9be4-3f420e87308a service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:44.635524 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-635a94c9-e77f-4fa2-ab3a-dcfe3116ebc2 req-790558ff-5fd6-4e78-9be4-3f420e87308a service nova] Creating event network-changed:05284f9a-fbdb-4b8f-939b-1d6b6a0f1b1e for instance c4219e0b-e130-49d6-8b80-4f7b179fb299 on hv-cinder-79987 Jul 27 20:57:44.640916 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-635a94c9-e77f-4fa2-ab3a-dcfe3116ebc2 req-790558ff-5fd6-4e78-9be4-3f420e87308a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035195 Jul 27 20:57:44.642245 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2049/4113] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:57:45.493565 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-6de2f49a-b83a-496d-8d7f-081e5c4d6699 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:57:45.494182 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-6de2f49a-b83a-496d-8d7f-081e5c4d6699 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: c4219e0b-e130-49d6-8b80-4f7b179fb299] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:57:45.500590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6de2f49a-b83a-496d-8d7f-081e5c4d6699 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:45.501075 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6de2f49a-b83a-496d-8d7f-081e5c4d6699 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:45.501831 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6de2f49a-b83a-496d-8d7f-081e5c4d6699 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:45.502268 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-6de2f49a-b83a-496d-8d7f-081e5c4d6699 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:45.631516 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-6de2f49a-b83a-496d-8d7f-081e5c4d6699 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:57:45.639118 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-6de2f49a-b83a-496d-8d7f-081e5c4d6699 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299" status: 200 len: 1265 microversion: 2.1 time: 0.149420 Jul 27 20:57:45.639674 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2065/4114] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:57:45 2022] GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:57:46.661197 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b05a287e-2b53-4ba5-85d5-2a11c68e96ed tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:57:46.661923 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b05a287e-2b53-4ba5-85d5-2a11c68e96ed tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: c4219e0b-e130-49d6-8b80-4f7b179fb299] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:57:46.668039 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b05a287e-2b53-4ba5-85d5-2a11c68e96ed tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:46.668490 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b05a287e-2b53-4ba5-85d5-2a11c68e96ed tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:46.669260 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b05a287e-2b53-4ba5-85d5-2a11c68e96ed tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:46.669693 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b05a287e-2b53-4ba5-85d5-2a11c68e96ed tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:46.801563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b05a287e-2b53-4ba5-85d5-2a11c68e96ed tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:57:46.808875 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b05a287e-2b53-4ba5-85d5-2a11c68e96ed tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299" status: 200 len: 1265 microversion: 2.1 time: 0.152947 Jul 27 20:57:46.809493 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2050/4115] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:57:46 2022] GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:57:47.829770 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4d7b04a2-0b5a-4568-b80b-13ae30792824 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:57:47.830442 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4d7b04a2-0b5a-4568-b80b-13ae30792824 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: c4219e0b-e130-49d6-8b80-4f7b179fb299] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:57:47.838022 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4d7b04a2-0b5a-4568-b80b-13ae30792824 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:47.838481 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4d7b04a2-0b5a-4568-b80b-13ae30792824 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:47.839248 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4d7b04a2-0b5a-4568-b80b-13ae30792824 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:47.839692 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4d7b04a2-0b5a-4568-b80b-13ae30792824 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:47.968980 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4d7b04a2-0b5a-4568-b80b-13ae30792824 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:57:47.976424 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4d7b04a2-0b5a-4568-b80b-13ae30792824 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299" status: 200 len: 1265 microversion: 2.1 time: 0.150496 Jul 27 20:57:47.977010 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2066/4116] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:57:47 2022] GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:57:48.997353 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-51e0459e-34b1-47c1-95cd-64a1f26f1e37 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:57:48.997971 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-51e0459e-34b1-47c1-95cd-64a1f26f1e37 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: c4219e0b-e130-49d6-8b80-4f7b179fb299] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:57:49.004457 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-51e0459e-34b1-47c1-95cd-64a1f26f1e37 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:49.004905 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-51e0459e-34b1-47c1-95cd-64a1f26f1e37 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:49.005694 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-51e0459e-34b1-47c1-95cd-64a1f26f1e37 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:49.006134 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-51e0459e-34b1-47c1-95cd-64a1f26f1e37 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:49.142644 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-51e0459e-34b1-47c1-95cd-64a1f26f1e37 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:57:49.151096 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-51e0459e-34b1-47c1-95cd-64a1f26f1e37 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299" status: 200 len: 1265 microversion: 2.1 time: 0.157530 Jul 27 20:57:49.151678 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2051/4117] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:57:48 2022] GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:57:50.173493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-c165299e-2fc9-44e3-8e3e-99344195995a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:57:50.174137 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-c165299e-2fc9-44e3-8e3e-99344195995a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: c4219e0b-e130-49d6-8b80-4f7b179fb299] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:57:50.180613 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c165299e-2fc9-44e3-8e3e-99344195995a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:50.181108 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c165299e-2fc9-44e3-8e3e-99344195995a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:50.181876 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c165299e-2fc9-44e3-8e3e-99344195995a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:50.182320 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-c165299e-2fc9-44e3-8e3e-99344195995a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:50.313705 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-c165299e-2fc9-44e3-8e3e-99344195995a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:57:50.321541 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-c165299e-2fc9-44e3-8e3e-99344195995a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299" status: 200 len: 1265 microversion: 2.1 time: 0.151915 Jul 27 20:57:50.322092 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2067/4118] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:57:50 2022] GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:57:51.347974 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c460dda8-d086-467e-9dfd-e6eabf646b2a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:57:51.348583 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c460dda8-d086-467e-9dfd-e6eabf646b2a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: c4219e0b-e130-49d6-8b80-4f7b179fb299] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:57:51.355292 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c460dda8-d086-467e-9dfd-e6eabf646b2a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:51.355746 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c460dda8-d086-467e-9dfd-e6eabf646b2a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:51.356506 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c460dda8-d086-467e-9dfd-e6eabf646b2a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:51.356938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c460dda8-d086-467e-9dfd-e6eabf646b2a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:51.491582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c460dda8-d086-467e-9dfd-e6eabf646b2a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:57:51.499080 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c460dda8-d086-467e-9dfd-e6eabf646b2a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299" status: 200 len: 1265 microversion: 2.1 time: 0.159822 Jul 27 20:57:51.499663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2052/4119] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:57:51 2022] GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:57:52.519977 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7772855e-ec10-424c-a7fd-4fa8a5c73a7a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:57:52.520594 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7772855e-ec10-424c-a7fd-4fa8a5c73a7a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: c4219e0b-e130-49d6-8b80-4f7b179fb299] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:57:52.522928 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=2 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:57:52.528708 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7772855e-ec10-424c-a7fd-4fa8a5c73a7a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:52.529203 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7772855e-ec10-424c-a7fd-4fa8a5c73a7a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:52.529976 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7772855e-ec10-424c-a7fd-4fa8a5c73a7a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:52.530420 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7772855e-ec10-424c-a7fd-4fa8a5c73a7a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:52.660956 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7772855e-ec10-424c-a7fd-4fa8a5c73a7a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:57:52.668385 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7772855e-ec10-424c-a7fd-4fa8a5c73a7a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299" status: 200 len: 1265 microversion: 2.1 time: 0.152228 Jul 27 20:57:52.668948 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2068/4120] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:57:52 2022] GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:57:53.689789 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b9236889-a3f7-42eb-b93a-c194d61501bc tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:57:53.690980 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b9236889-a3f7-42eb-b93a-c194d61501bc tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: c4219e0b-e130-49d6-8b80-4f7b179fb299] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:57:53.692938 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:57:53.693618 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=6 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 20:57:53.700428 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b9236889-a3f7-42eb-b93a-c194d61501bc tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:53.700877 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b9236889-a3f7-42eb-b93a-c194d61501bc tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:53.701732 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b9236889-a3f7-42eb-b93a-c194d61501bc tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:53.702197 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b9236889-a3f7-42eb-b93a-c194d61501bc tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:53.838545 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b9236889-a3f7-42eb-b93a-c194d61501bc tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:57:53.845958 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b9236889-a3f7-42eb-b93a-c194d61501bc tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299" status: 200 len: 1265 microversion: 2.1 time: 0.159993 Jul 27 20:57:53.846512 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2053/4121] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:57:53 2022] GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:57:54.867463 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-e73f7c1a-0f64-4b6c-9b52-43df5e4c92ef tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:57:54.868104 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-e73f7c1a-0f64-4b6c-9b52-43df5e4c92ef tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: c4219e0b-e130-49d6-8b80-4f7b179fb299] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:57:54.875023 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e73f7c1a-0f64-4b6c-9b52-43df5e4c92ef tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:54.875486 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e73f7c1a-0f64-4b6c-9b52-43df5e4c92ef tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:54.876268 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e73f7c1a-0f64-4b6c-9b52-43df5e4c92ef tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:54.876745 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-e73f7c1a-0f64-4b6c-9b52-43df5e4c92ef tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:55.015492 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-e73f7c1a-0f64-4b6c-9b52-43df5e4c92ef tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:57:55.023768 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-e73f7c1a-0f64-4b6c-9b52-43df5e4c92ef tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299" status: 200 len: 1265 microversion: 2.1 time: 0.160138 Jul 27 20:57:55.024330 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2069/4122] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:57:54 2022] GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:57:55.632378 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-f96eac4e-fe58-4c42-8ff7-698f2da1526c req-9169b297-56d9-4903-b5c9-1a523728f053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4219e0b-e130-49d6-8b80-4f7b179fb299", "name": "network-vif-plugged", "status": "completed", "tag": "05284f9a-fbdb-4b8f-939b-1d6b6a0f1b1e"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:57:55.641794 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-f96eac4e-fe58-4c42-8ff7-698f2da1526c req-9169b297-56d9-4903-b5c9-1a523728f053 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:55.642238 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-f96eac4e-fe58-4c42-8ff7-698f2da1526c req-9169b297-56d9-4903-b5c9-1a523728f053 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:55.654156 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-f96eac4e-fe58-4c42-8ff7-698f2da1526c req-9169b297-56d9-4903-b5c9-1a523728f053 service nova] Creating event network-vif-plugged:05284f9a-fbdb-4b8f-939b-1d6b6a0f1b1e for instance c4219e0b-e130-49d6-8b80-4f7b179fb299 on hv-cinder-79987 Jul 27 20:57:55.659389 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-f96eac4e-fe58-4c42-8ff7-698f2da1526c req-9169b297-56d9-4903-b5c9-1a523728f053 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122025 Jul 27 20:57:55.660348 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2054/4123] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 20:57:56.045239 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4071e985-ea04-4da9-84b6-319b9f8cc7e6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:57:56.045860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-4071e985-ea04-4da9-84b6-319b9f8cc7e6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: c4219e0b-e130-49d6-8b80-4f7b179fb299] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:57:56.053071 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4071e985-ea04-4da9-84b6-319b9f8cc7e6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:56.053561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4071e985-ea04-4da9-84b6-319b9f8cc7e6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:56.054328 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4071e985-ea04-4da9-84b6-319b9f8cc7e6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:56.054772 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-4071e985-ea04-4da9-84b6-319b9f8cc7e6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:56.186327 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-4071e985-ea04-4da9-84b6-319b9f8cc7e6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:57:56.193738 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4071e985-ea04-4da9-84b6-319b9f8cc7e6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299" status: 200 len: 1265 microversion: 2.1 time: 0.152482 Jul 27 20:57:56.194307 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2070/4124] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:57:56 2022] GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:57:57.215943 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-718186c6-572c-4b0b-9684-4572143acfb2 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:57:57.216656 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-718186c6-572c-4b0b-9684-4572143acfb2 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: c4219e0b-e130-49d6-8b80-4f7b179fb299] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:57:57.222792 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-718186c6-572c-4b0b-9684-4572143acfb2 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:57.223234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-718186c6-572c-4b0b-9684-4572143acfb2 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:57.223981 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-718186c6-572c-4b0b-9684-4572143acfb2 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:57.224410 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-718186c6-572c-4b0b-9684-4572143acfb2 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:57.357992 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-718186c6-572c-4b0b-9684-4572143acfb2 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:57:57.366015 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-718186c6-572c-4b0b-9684-4572143acfb2 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299" status: 200 len: 1265 microversion: 2.1 time: 0.154716 Jul 27 20:57:57.366577 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2055/4125] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:57:57 2022] GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:57:58.387202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-98276674-ee82-434d-a2d1-4ef2e726f6e6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:57:58.387819 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-98276674-ee82-434d-a2d1-4ef2e726f6e6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: c4219e0b-e130-49d6-8b80-4f7b179fb299] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:57:58.395079 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-98276674-ee82-434d-a2d1-4ef2e726f6e6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:58.395563 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-98276674-ee82-434d-a2d1-4ef2e726f6e6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:58.396324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-98276674-ee82-434d-a2d1-4ef2e726f6e6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:58.396767 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-98276674-ee82-434d-a2d1-4ef2e726f6e6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:58.527720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-98276674-ee82-434d-a2d1-4ef2e726f6e6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:57:58.535280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-98276674-ee82-434d-a2d1-4ef2e726f6e6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299" status: 200 len: 1452 microversion: 2.1 time: 0.151980 Jul 27 20:57:58.535835 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2071/4126] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:57:58 2022] GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 20:57:58.555259 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e8169479-a4e9-44bb-a5ac-18a39f4c5843 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 20:57:58.555873 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e8169479-a4e9-44bb-a5ac-18a39f4c5843 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: c4219e0b-e130-49d6-8b80-4f7b179fb299] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 20:57:58.562433 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e8169479-a4e9-44bb-a5ac-18a39f4c5843 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:58.562884 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e8169479-a4e9-44bb-a5ac-18a39f4c5843 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:58.563649 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e8169479-a4e9-44bb-a5ac-18a39f4c5843 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:57:58.564085 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e8169479-a4e9-44bb-a5ac-18a39f4c5843 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:57:58.696673 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e8169479-a4e9-44bb-a5ac-18a39f4c5843 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 20:57:58.704066 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e8169479-a4e9-44bb-a5ac-18a39f4c5843 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299" status: 200 len: 1452 microversion: 2.1 time: 0.152647 Jul 27 20:57:58.704619 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2056/4127] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 20:57:58 2022] GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 27 20:58:00.316586 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-8fc27d71-187e-4f8f-8994-b5fcbaab7461 req-bf8397f6-54b3-467e-8c5a-16d07fe81471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4219e0b-e130-49d6-8b80-4f7b179fb299", "tag": "05284f9a-fbdb-4b8f-939b-1d6b6a0f1b1e"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 20:58:00.326480 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-8fc27d71-187e-4f8f-8994-b5fcbaab7461 req-bf8397f6-54b3-467e-8c5a-16d07fe81471 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 20:58:00.326933 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-8fc27d71-187e-4f8f-8994-b5fcbaab7461 req-bf8397f6-54b3-467e-8c5a-16d07fe81471 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 20:58:00.338817 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-8fc27d71-187e-4f8f-8994-b5fcbaab7461 req-bf8397f6-54b3-467e-8c5a-16d07fe81471 service nova] Creating event network-changed:05284f9a-fbdb-4b8f-939b-1d6b6a0f1b1e for instance c4219e0b-e130-49d6-8b80-4f7b179fb299 on hv-cinder-79987 Jul 27 20:58:00.343956 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-8fc27d71-187e-4f8f-8994-b5fcbaab7461 req-bf8397f6-54b3-467e-8c5a-16d07fe81471 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031164 Jul 27 20:58:00.344547 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2072/4128] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 20:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 21:00:00.016660 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR oslo.messaging._drivers.impl_rabbit [-] [90651035-8aed-4abb-a7ee-04ffff40ad61] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 27 21:00:00.017488 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 21:00:00.018216 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 21:00:00.022414 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-070b1e00-d275-4c39-806b-807b3543689c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1965077628", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-796992677", "security_groups": [{"name": "tempest-secgroup-smoke-1666106124"}], "block_device_mapping_v2": [{"uuid": "8e6ee343-cbb3-4c76-b023-623c9489d13a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3825a3db-7c3e-4367-8761-ebb2cee02683"}]}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 21:00:00.426353 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-070b1e00-d275-4c39-806b-807b3543689c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] validate_networks() for [('3825a3db-7c3e-4367-8761-ebb2cee02683', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 27 21:00:00.792215 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 21:00:00.792720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 21:00:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 21:00:00.986268 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-070b1e00-d275-4c39-806b-807b3543689c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 27 21:00:00.986702 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-070b1e00-d275-4c39-806b-807b3543689c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 27 21:00:00.987177 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-070b1e00-d275-4c39-806b-807b3543689c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 27 21:00:00.987586 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-070b1e00-d275-4c39-806b-807b3543689c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 27 21:00:00.988003 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-070b1e00-d275-4c39-806b-807b3543689c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 27 21:00:00.997788 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-070b1e00-d275-4c39-806b-807b3543689c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:00.998237 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-070b1e00-d275-4c39-806b-807b3543689c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:00.999067 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-070b1e00-d275-4c39-806b-807b3543689c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:00.999507 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-070b1e00-d275-4c39-806b-807b3543689c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:01.018856 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-070b1e00-d275-4c39-806b-807b3543689c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Getting quotas for project c51423871031456a80da2d9d0c74bc62. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 27 21:00:01.028826 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] [90651035-8aed-4abb-a7ee-04ffff40ad61] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 46314. Jul 27 21:00:01.030911 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-070b1e00-d275-4c39-806b-807b3543689c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Getting quotas for user 060f4e9543a5456897d5217676cb93a6 and project c51423871031456a80da2d9d0c74bc62. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 27 21:00:01.090704 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-070b1e00-d275-4c39-806b-807b3543689c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 27 21:00:01.092941 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-070b1e00-d275-4c39-806b-807b3543689c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8e6ee343-cbb3-4c76-b023-623c9489d13a',volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 27 21:00:01.216582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR oslo.messaging._drivers.impl_rabbit [None req-070b1e00-d275-4c39-806b-807b3543689c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [dfe7407c-6edc-47bb-af3d-ba0764446d05] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 27 21:00:02.223518 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [None req-070b1e00-d275-4c39-806b-807b3543689c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [dfe7407c-6edc-47bb-af3d-ba0764446d05] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 46322. Jul 27 21:00:02.228112 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-070b1e00-d275-4c39-806b-807b3543689c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.213429 Jul 27 21:00:02.228757 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2057/4129] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Jul 27 21:00:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 2215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 27 21:00:02.237577 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ebd3bde3-5295-4d69-bab2-3c6f09163f30] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 27 21:00:02.238200 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=28 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 21:00:02.238930 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=64 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 21:00:02.243984 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-8a72d66c-4cc3-44aa-b6cd-719e5b5f4204 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:00:02.244689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-8a72d66c-4cc3-44aa-b6cd-719e5b5f4204 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:00:02.306501 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-8a72d66c-4cc3-44aa-b6cd-719e5b5f4204 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:00:02.313776 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-8a72d66c-4cc3-44aa-b6cd-719e5b5f4204 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 200 len: 1094 microversion: 2.1 time: 0.077940 Jul 27 21:00:02.314319 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2073/4130] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:00:02 2022] GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:00:03.125571 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 21:00:03.125758 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 21:00:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 21:00:03.335114 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-574e16de-3390-4906-ad58-7b481e052914 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:00:03.335670 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-574e16de-3390-4906-ad58-7b481e052914 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:00:03.389765 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-574e16de-3390-4906-ad58-7b481e052914 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:00:03.399179 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-574e16de-3390-4906-ad58-7b481e052914 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 200 len: 1094 microversion: 2.1 time: 0.068508 Jul 27 21:00:03.399721 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2058/4131] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:00:03 2022] GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:00:04.421260 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-67a0e4b4-0e95-4ef3-ba80-153ff55f47da tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:00:04.421883 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-67a0e4b4-0e95-4ef3-ba80-153ff55f47da tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:00:04.432198 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] [ebd3bde3-5295-4d69-bab2-3c6f09163f30] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 46350. Jul 27 21:00:04.486507 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-67a0e4b4-0e95-4ef3-ba80-153ff55f47da tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:00:04.493518 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-67a0e4b4-0e95-4ef3-ba80-153ff55f47da tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 200 len: 1094 microversion: 2.1 time: 0.077068 Jul 27 21:00:04.494249 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2074/4132] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:00:04 2022] GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:00:05.514515 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-75de7a5e-299c-40a6-9bf5-555cba264c0d tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:00:05.515161 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-75de7a5e-299c-40a6-9bf5-555cba264c0d tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:00:05.566502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-75de7a5e-299c-40a6-9bf5-555cba264c0d tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:00:05.573917 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-75de7a5e-299c-40a6-9bf5-555cba264c0d tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 200 len: 1094 microversion: 2.1 time: 0.063249 Jul 27 21:00:05.574474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2059/4133] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:00:05 2022] GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 1094 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:00:06.595637 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-7627eb7e-8962-4781-b6c6-50587d81d85a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:00:06.596369 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-7627eb7e-8962-4781-b6c6-50587d81d85a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:00:06.606464 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7627eb7e-8962-4781-b6c6-50587d81d85a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:06.606919 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7627eb7e-8962-4781-b6c6-50587d81d85a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:06.607689 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7627eb7e-8962-4781-b6c6-50587d81d85a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:06.608132 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-7627eb7e-8962-4781-b6c6-50587d81d85a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:06.666817 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-7627eb7e-8962-4781-b6c6-50587d81d85a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:00:06.674223 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-7627eb7e-8962-4781-b6c6-50587d81d85a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 200 len: 1144 microversion: 2.1 time: 0.082464 Jul 27 21:00:06.674789 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2075/4134] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:00:06 2022] GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:00:07.000844 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 21:00:07.001044 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 21:00:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 21:00:07.694610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-87799960-d286-47f2-8ba0-e59d2857051a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:00:07.695222 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-87799960-d286-47f2-8ba0-e59d2857051a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:00:07.702336 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87799960-d286-47f2-8ba0-e59d2857051a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:07.702985 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87799960-d286-47f2-8ba0-e59d2857051a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:07.703785 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87799960-d286-47f2-8ba0-e59d2857051a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:07.704222 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87799960-d286-47f2-8ba0-e59d2857051a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:07.781923 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-87799960-d286-47f2-8ba0-e59d2857051a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:00:07.789930 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-87799960-d286-47f2-8ba0-e59d2857051a tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 200 len: 1210 microversion: 2.1 time: 0.099125 Jul 27 21:00:07.790501 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2060/4135] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:00:07 2022] GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:00:08.812154 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-ec4b54cf-9f4e-4d4e-a250-ffd0cbe5f6a8 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:00:08.812692 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-ec4b54cf-9f4e-4d4e-a250-ffd0cbe5f6a8 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:00:08.820663 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec4b54cf-9f4e-4d4e-a250-ffd0cbe5f6a8 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:08.821347 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec4b54cf-9f4e-4d4e-a250-ffd0cbe5f6a8 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:08.822246 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec4b54cf-9f4e-4d4e-a250-ffd0cbe5f6a8 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:08.823061 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-ec4b54cf-9f4e-4d4e-a250-ffd0cbe5f6a8 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:08.966612 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-fe65ee18-4674-47d2-a2e0-fec064f9ab8b req-54584bd5-7f36-4239-b4ea-0996b3570e85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "091f201c-5397-4be4-805e-17c6cabe27ed", "tag": "6b763ee8-789d-4be8-bf6f-56d5b2ace0b7"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 21:00:08.975147 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-ec4b54cf-9f4e-4d4e-a250-ffd0cbe5f6a8 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:00:08.988175 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-ec4b54cf-9f4e-4d4e-a250-ffd0cbe5f6a8 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 200 len: 1266 microversion: 2.1 time: 0.180305 Jul 27 21:00:08.988760 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2076/4136] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:00:08 2022] GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:00:08.989889 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-fe65ee18-4674-47d2-a2e0-fec064f9ab8b req-54584bd5-7f36-4239-b4ea-0996b3570e85 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:08.990339 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-fe65ee18-4674-47d2-a2e0-fec064f9ab8b req-54584bd5-7f36-4239-b4ea-0996b3570e85 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:09.007158 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-fe65ee18-4674-47d2-a2e0-fec064f9ab8b req-54584bd5-7f36-4239-b4ea-0996b3570e85 service nova] Creating event network-changed:6b763ee8-789d-4be8-bf6f-56d5b2ace0b7 for instance 091f201c-5397-4be4-805e-17c6cabe27ed on hv-cinder-79987 Jul 27 21:00:09.013254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-fe65ee18-4674-47d2-a2e0-fec064f9ab8b req-54584bd5-7f36-4239-b4ea-0996b3570e85 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053423 Jul 27 21:00:09.014002 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2061/4137] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 21:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 21:00:10.011258 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-cb64cbb7-ee87-489b-94ee-894e44a019eb tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:00:10.011879 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-cb64cbb7-ee87-489b-94ee-894e44a019eb tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:00:10.018405 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb64cbb7-ee87-489b-94ee-894e44a019eb tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:10.018860 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb64cbb7-ee87-489b-94ee-894e44a019eb tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:10.019625 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb64cbb7-ee87-489b-94ee-894e44a019eb tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:10.020066 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-cb64cbb7-ee87-489b-94ee-894e44a019eb tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:10.151754 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-cb64cbb7-ee87-489b-94ee-894e44a019eb tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:00:10.159248 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-cb64cbb7-ee87-489b-94ee-894e44a019eb tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 200 len: 1266 microversion: 2.1 time: 0.151871 Jul 27 21:00:10.159808 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2077/4138] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:00:10 2022] GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:00:11.181745 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-201bc77b-810d-4b88-b7f6-441144ea0886 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:00:11.182444 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-201bc77b-810d-4b88-b7f6-441144ea0886 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:00:11.184831 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 21:00:11.190509 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-201bc77b-810d-4b88-b7f6-441144ea0886 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:11.190960 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-201bc77b-810d-4b88-b7f6-441144ea0886 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:11.191726 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-201bc77b-810d-4b88-b7f6-441144ea0886 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:11.192163 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-201bc77b-810d-4b88-b7f6-441144ea0886 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:11.323181 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-201bc77b-810d-4b88-b7f6-441144ea0886 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:00:11.330502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-201bc77b-810d-4b88-b7f6-441144ea0886 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 200 len: 1266 microversion: 2.1 time: 0.153800 Jul 27 21:00:11.331090 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2062/4139] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:00:11 2022] GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:00:12.351107 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-b1bb0234-71b4-45ea-bffa-05c0a9acef6f tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:00:12.351678 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-b1bb0234-71b4-45ea-bffa-05c0a9acef6f tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:00:12.358223 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b1bb0234-71b4-45ea-bffa-05c0a9acef6f tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:12.358684 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b1bb0234-71b4-45ea-bffa-05c0a9acef6f tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:12.359451 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b1bb0234-71b4-45ea-bffa-05c0a9acef6f tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:12.359898 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-b1bb0234-71b4-45ea-bffa-05c0a9acef6f tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:12.488923 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-b1bb0234-71b4-45ea-bffa-05c0a9acef6f tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:00:12.497197 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-b1bb0234-71b4-45ea-bffa-05c0a9acef6f tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 200 len: 1266 microversion: 2.1 time: 0.150014 Jul 27 21:00:12.497777 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2078/4140] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:00:12 2022] GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:00:13.518610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cb977723-e170-4817-9740-0086259caf7c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:00:13.519221 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cb977723-e170-4817-9740-0086259caf7c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:00:13.526290 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cb977723-e170-4817-9740-0086259caf7c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:13.526739 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cb977723-e170-4817-9740-0086259caf7c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:13.527502 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cb977723-e170-4817-9740-0086259caf7c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:13.527944 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cb977723-e170-4817-9740-0086259caf7c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:13.657482 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cb977723-e170-4817-9740-0086259caf7c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:00:13.667176 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cb977723-e170-4817-9740-0086259caf7c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 200 len: 1266 microversion: 2.1 time: 0.152444 Jul 27 21:00:13.667740 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2063/4141] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:00:13 2022] GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:00:14.687214 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-35badfa7-ed00-4818-b003-2783f56397dc tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:00:14.687768 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-35badfa7-ed00-4818-b003-2783f56397dc tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:00:14.690092 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell0:SELECT=4 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 21:00:14.696398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-35badfa7-ed00-4818-b003-2783f56397dc tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:14.696854 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-35badfa7-ed00-4818-b003-2783f56397dc tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:14.697730 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-35badfa7-ed00-4818-b003-2783f56397dc tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:14.698103 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-35badfa7-ed00-4818-b003-2783f56397dc tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:14.828456 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-35badfa7-ed00-4818-b003-2783f56397dc tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:00:14.835954 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-35badfa7-ed00-4818-b003-2783f56397dc tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 200 len: 1266 microversion: 2.1 time: 0.152634 Jul 27 21:00:14.836514 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2079/4142] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:00:14 2022] GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:00:15.856601 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f5db87e6-524a-46ef-97cf-f268fbd3d601 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:00:15.857244 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f5db87e6-524a-46ef-97cf-f268fbd3d601 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:00:15.859504 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=10 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 21:00:15.865026 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f5db87e6-524a-46ef-97cf-f268fbd3d601 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:15.865500 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f5db87e6-524a-46ef-97cf-f268fbd3d601 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:15.866245 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f5db87e6-524a-46ef-97cf-f268fbd3d601 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:15.866683 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f5db87e6-524a-46ef-97cf-f268fbd3d601 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:15.997125 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f5db87e6-524a-46ef-97cf-f268fbd3d601 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:00:16.004507 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f5db87e6-524a-46ef-97cf-f268fbd3d601 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 200 len: 1266 microversion: 2.1 time: 0.151723 Jul 27 21:00:16.005093 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2064/4143] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:00:15 2022] GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:00:17.026438 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-5923e282-8eb5-433a-b0e1-7f66f0916ad5 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:00:17.027059 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-5923e282-8eb5-433a-b0e1-7f66f0916ad5 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:00:17.033493 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5923e282-8eb5-433a-b0e1-7f66f0916ad5 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:17.033950 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5923e282-8eb5-433a-b0e1-7f66f0916ad5 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:17.034720 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5923e282-8eb5-433a-b0e1-7f66f0916ad5 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:17.035159 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-5923e282-8eb5-433a-b0e1-7f66f0916ad5 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:17.166894 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-5923e282-8eb5-433a-b0e1-7f66f0916ad5 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:00:17.175045 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-5923e282-8eb5-433a-b0e1-7f66f0916ad5 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 200 len: 1266 microversion: 2.1 time: 0.153362 Jul 27 21:00:17.175614 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2080/4144] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:00:17 2022] GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:00:18.196372 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-614ed36e-bdb4-4f1f-a6f4-41e16a3c4a6c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:00:18.197012 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-614ed36e-bdb4-4f1f-a6f4-41e16a3c4a6c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:00:18.203854 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-614ed36e-bdb4-4f1f-a6f4-41e16a3c4a6c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:18.204308 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-614ed36e-bdb4-4f1f-a6f4-41e16a3c4a6c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:18.205130 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-614ed36e-bdb4-4f1f-a6f4-41e16a3c4a6c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:18.205576 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-614ed36e-bdb4-4f1f-a6f4-41e16a3c4a6c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:18.345929 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-614ed36e-bdb4-4f1f-a6f4-41e16a3c4a6c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:00:18.353479 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-614ed36e-bdb4-4f1f-a6f4-41e16a3c4a6c tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 200 len: 1266 microversion: 2.1 time: 0.161506 Jul 27 21:00:18.354445 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2065/4145] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:00:18 2022] GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:00:19.378759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-11dbe594-051c-40bf-b47d-113e1f978f81 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:00:19.379288 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-11dbe594-051c-40bf-b47d-113e1f978f81 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:00:19.386456 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-11dbe594-051c-40bf-b47d-113e1f978f81 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:19.386903 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-11dbe594-051c-40bf-b47d-113e1f978f81 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:19.387658 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-11dbe594-051c-40bf-b47d-113e1f978f81 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:19.388094 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-11dbe594-051c-40bf-b47d-113e1f978f81 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:19.522746 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-11dbe594-051c-40bf-b47d-113e1f978f81 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:00:19.530640 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-11dbe594-051c-40bf-b47d-113e1f978f81 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 200 len: 1266 microversion: 2.1 time: 0.155828 Jul 27 21:00:19.531428 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2081/4146] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:00:19 2022] GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:00:20.314925 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-ba6efd8f-38e3-4033-8604-769840d99789 req-681150a9-3349-4e1c-9fa2-f5515f66d99c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "091f201c-5397-4be4-805e-17c6cabe27ed", "name": "network-vif-plugged", "status": "completed", "tag": "6b763ee8-789d-4be8-bf6f-56d5b2ace0b7"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 21:00:20.328042 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-ba6efd8f-38e3-4033-8604-769840d99789 req-681150a9-3349-4e1c-9fa2-f5515f66d99c service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:20.328500 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-ba6efd8f-38e3-4033-8604-769840d99789 req-681150a9-3349-4e1c-9fa2-f5515f66d99c service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:20.344712 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-ba6efd8f-38e3-4033-8604-769840d99789 req-681150a9-3349-4e1c-9fa2-f5515f66d99c service nova] Creating event network-vif-plugged:6b763ee8-789d-4be8-bf6f-56d5b2ace0b7 for instance 091f201c-5397-4be4-805e-17c6cabe27ed on hv-cinder-79987 Jul 27 21:00:20.350079 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-ba6efd8f-38e3-4033-8604-769840d99789 req-681150a9-3349-4e1c-9fa2-f5515f66d99c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039493 Jul 27 21:00:20.350952 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2066/4147] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 21:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 21:00:20.551687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-69271714-4181-4eef-88ba-d558765cd0e0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:00:20.552199 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-69271714-4181-4eef-88ba-d558765cd0e0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:00:20.559233 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69271714-4181-4eef-88ba-d558765cd0e0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:20.559712 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69271714-4181-4eef-88ba-d558765cd0e0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:20.560538 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69271714-4181-4eef-88ba-d558765cd0e0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:20.560999 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-69271714-4181-4eef-88ba-d558765cd0e0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:20.692837 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-69271714-4181-4eef-88ba-d558765cd0e0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:00:20.701071 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-69271714-4181-4eef-88ba-d558765cd0e0 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 200 len: 1266 microversion: 2.1 time: 0.153263 Jul 27 21:00:20.701643 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2082/4148] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:00:20 2022] GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:00:21.723474 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-578ed5aa-fef9-4a1d-9fbf-b20bfba6c048 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:00:21.724207 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-578ed5aa-fef9-4a1d-9fbf-b20bfba6c048 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:00:21.730475 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-578ed5aa-fef9-4a1d-9fbf-b20bfba6c048 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:21.730927 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-578ed5aa-fef9-4a1d-9fbf-b20bfba6c048 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:21.731690 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-578ed5aa-fef9-4a1d-9fbf-b20bfba6c048 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:21.732129 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-578ed5aa-fef9-4a1d-9fbf-b20bfba6c048 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:21.862855 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-578ed5aa-fef9-4a1d-9fbf-b20bfba6c048 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:00:21.871077 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-578ed5aa-fef9-4a1d-9fbf-b20bfba6c048 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 200 len: 1266 microversion: 2.1 time: 0.152371 Jul 27 21:00:21.871648 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2067/4149] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:00:21 2022] GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:00:22.891349 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a8bcbb4c-5987-4f1a-b469-7622f785c930 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:00:22.891975 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a8bcbb4c-5987-4f1a-b469-7622f785c930 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:00:22.899091 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a8bcbb4c-5987-4f1a-b469-7622f785c930 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:22.899545 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a8bcbb4c-5987-4f1a-b469-7622f785c930 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:22.900312 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a8bcbb4c-5987-4f1a-b469-7622f785c930 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:22.900759 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a8bcbb4c-5987-4f1a-b469-7622f785c930 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:23.030101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-a8bcbb4c-5987-4f1a-b469-7622f785c930 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:00:23.037624 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a8bcbb4c-5987-4f1a-b469-7622f785c930 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 200 len: 1452 microversion: 2.1 time: 0.150212 Jul 27 21:00:23.038191 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2083/4150] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:00:22 2022] GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:00:23.059364 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-37d58cfc-69fe-48b8-af82-b95eb79ae777 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:00:23.059963 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-37d58cfc-69fe-48b8-af82-b95eb79ae777 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:00:23.066288 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37d58cfc-69fe-48b8-af82-b95eb79ae777 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:23.066732 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37d58cfc-69fe-48b8-af82-b95eb79ae777 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:23.067479 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37d58cfc-69fe-48b8-af82-b95eb79ae777 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:23.067908 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37d58cfc-69fe-48b8-af82-b95eb79ae777 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:23.197406 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-37d58cfc-69fe-48b8-af82-b95eb79ae777 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:00:23.204845 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-37d58cfc-69fe-48b8-af82-b95eb79ae777 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 200 len: 1452 microversion: 2.1 time: 0.149240 Jul 27 21:00:23.205429 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2068/4151] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:00:23 2022] GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:00:25.082687 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-2acee121-1480-4c76-8b8c-b5c17365a897 req-e75bcd99-6ab9-47ed-95cf-cb7191ff9b84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "091f201c-5397-4be4-805e-17c6cabe27ed", "tag": "6b763ee8-789d-4be8-bf6f-56d5b2ace0b7"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 21:00:25.094398 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-2acee121-1480-4c76-8b8c-b5c17365a897 req-e75bcd99-6ab9-47ed-95cf-cb7191ff9b84 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:00:25.094903 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-2acee121-1480-4c76-8b8c-b5c17365a897 req-e75bcd99-6ab9-47ed-95cf-cb7191ff9b84 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:00:25.106995 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-2acee121-1480-4c76-8b8c-b5c17365a897 req-e75bcd99-6ab9-47ed-95cf-cb7191ff9b84 service nova] Creating event network-changed:6b763ee8-789d-4be8-bf6f-56d5b2ace0b7 for instance 091f201c-5397-4be4-805e-17c6cabe27ed on hv-cinder-79987 Jul 27 21:00:25.110757 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR oslo.messaging._drivers.impl_rabbit [req-2acee121-1480-4c76-8b8c-b5c17365a897 req-e75bcd99-6ab9-47ed-95cf-cb7191ff9b84 service nova] [cee1dc85-d8a9-4e52-a9e4-b102c103c541] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 27 21:00:26.118082 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [req-2acee121-1480-4c76-8b8c-b5c17365a897 req-e75bcd99-6ab9-47ed-95cf-cb7191ff9b84 service nova] [cee1dc85-d8a9-4e52-a9e4-b102c103c541] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 46428. Jul 27 21:00:26.123277 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-2acee121-1480-4c76-8b8c-b5c17365a897 req-e75bcd99-6ab9-47ed-95cf-cb7191ff9b84 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.043988 Jul 27 21:00:26.123935 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2084/4152] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 21:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 21:02:14.617277 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 21:02:14.618036 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=48 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 21:02:14.624386 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ebd3bde3-5295-4d69-bab2-3c6f09163f30] AMQP server on 10.222.0.65:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 27 21:02:14.625527 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_api:SELECT=28 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 21:02:14.626326 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG dbcounter [-] [117876] Writing DB stats nova_cell1:SELECT=56 {{(pid=117876) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 21:02:14.630789 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-60a31160-6740-4378-a591-0e18f468a0ac req-0a2f534e-6ab3-46dd-8740-ba37f11c334d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "091f201c-5397-4be4-805e-17c6cabe27ed", "tag": "6b763ee8-789d-4be8-bf6f-56d5b2ace0b7"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 21:02:14.638846 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f8865f8f-dbf6-436b-af28-d30fab818bd3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:02:14.639350 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f8865f8f-dbf6-436b-af28-d30fab818bd3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:02:14.645845 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-60a31160-6740-4378-a591-0e18f468a0ac req-0a2f534e-6ab3-46dd-8740-ba37f11c334d service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:14.646230 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8865f8f-dbf6-436b-af28-d30fab818bd3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:14.646526 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-60a31160-6740-4378-a591-0e18f468a0ac req-0a2f534e-6ab3-46dd-8740-ba37f11c334d service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:14.647047 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8865f8f-dbf6-436b-af28-d30fab818bd3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:14.647836 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8865f8f-dbf6-436b-af28-d30fab818bd3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:14.648290 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8865f8f-dbf6-436b-af28-d30fab818bd3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:14.658586 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-60a31160-6740-4378-a591-0e18f468a0ac req-0a2f534e-6ab3-46dd-8740-ba37f11c334d service nova] Creating event network-changed:6b763ee8-789d-4be8-bf6f-56d5b2ace0b7 for instance 091f201c-5397-4be4-805e-17c6cabe27ed on hv-cinder-79987 Jul 27 21:02:14.664110 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-60a31160-6740-4378-a591-0e18f468a0ac req-0a2f534e-6ab3-46dd-8740-ba37f11c334d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041356 Jul 27 21:02:14.664898 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2085/4153] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 21:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 21:02:14.676521 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f8865f8f-dbf6-436b-af28-d30fab818bd3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 21:02:14.768532 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f8865f8f-dbf6-436b-af28-d30fab818bd3 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "DELETE /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 204 len: 0 microversion: 2.1 time: 0.152803 Jul 27 21:02:14.769586 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2069/4154] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 21:02:14 2022] DELETE /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 21:02:14.778545 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2bd3ff4e-8886-41fb-bd2d-ff54ac59892f tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:02:14.779590 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2bd3ff4e-8886-41fb-bd2d-ff54ac59892f tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:02:14.787811 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2bd3ff4e-8886-41fb-bd2d-ff54ac59892f tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:14.788491 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2bd3ff4e-8886-41fb-bd2d-ff54ac59892f tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:14.789295 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2bd3ff4e-8886-41fb-bd2d-ff54ac59892f tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:14.789962 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2bd3ff4e-8886-41fb-bd2d-ff54ac59892f tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:14.928324 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-2bd3ff4e-8886-41fb-bd2d-ff54ac59892f tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:02:14.936606 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2bd3ff4e-8886-41fb-bd2d-ff54ac59892f tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 200 len: 1576 microversion: 2.1 time: 0.162575 Jul 27 21:02:14.937202 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2086/4155] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:02:14 2022] GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:02:15.959025 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-46e65ee5-fcda-417b-9f50-8f2a82e6ebbf tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:02:15.959779 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-46e65ee5-fcda-417b-9f50-8f2a82e6ebbf tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:02:15.967010 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-46e65ee5-fcda-417b-9f50-8f2a82e6ebbf tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:15.967544 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-46e65ee5-fcda-417b-9f50-8f2a82e6ebbf tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:15.968217 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-46e65ee5-fcda-417b-9f50-8f2a82e6ebbf tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:15.968646 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-46e65ee5-fcda-417b-9f50-8f2a82e6ebbf tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:16.442610 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-46e65ee5-fcda-417b-9f50-8f2a82e6ebbf tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:02:16.450329 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-46e65ee5-fcda-417b-9f50-8f2a82e6ebbf tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 200 len: 1576 microversion: 2.1 time: 0.495453 Jul 27 21:02:16.451254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2070/4156] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:02:15 2022] GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 1576 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:02:17.263895 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-5e0c2c9d-31d8-4407-9a07-2e96651e7b55 req-0bf426c2-df73-47ad-899a-8a7f7ede07e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "091f201c-5397-4be4-805e-17c6cabe27ed", "name": "network-vif-deleted", "tag": "6b763ee8-789d-4be8-bf6f-56d5b2ace0b7"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 21:02:17.275365 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-5e0c2c9d-31d8-4407-9a07-2e96651e7b55 req-0bf426c2-df73-47ad-899a-8a7f7ede07e3 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:17.275810 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-5e0c2c9d-31d8-4407-9a07-2e96651e7b55 req-0bf426c2-df73-47ad-899a-8a7f7ede07e3 service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:17.286757 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] [ebd3bde3-5295-4d69-bab2-3c6f09163f30] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 46484. Jul 27 21:02:17.289012 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-5e0c2c9d-31d8-4407-9a07-2e96651e7b55 req-0bf426c2-df73-47ad-899a-8a7f7ede07e3 service nova] Creating event network-vif-deleted:6b763ee8-789d-4be8-bf6f-56d5b2ace0b7 for instance 091f201c-5397-4be4-805e-17c6cabe27ed on hv-cinder-79987 Jul 27 21:02:17.294884 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-5e0c2c9d-31d8-4407-9a07-2e96651e7b55 req-0bf426c2-df73-47ad-899a-8a7f7ede07e3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034607 Jul 27 21:02:17.295685 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2087/4157] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 21:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 21:02:17.471785 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1c6cf3f2-60b2-4a1c-b8ab-868016569922 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:02:17.472301 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1c6cf3f2-60b2-4a1c-b8ab-868016569922 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:02:17.478777 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c6cf3f2-60b2-4a1c-b8ab-868016569922 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:17.479227 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c6cf3f2-60b2-4a1c-b8ab-868016569922 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:17.480170 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c6cf3f2-60b2-4a1c-b8ab-868016569922 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:17.480657 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c6cf3f2-60b2-4a1c-b8ab-868016569922 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:17.545893 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1c6cf3f2-60b2-4a1c-b8ab-868016569922 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:02:17.553527 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1c6cf3f2-60b2-4a1c-b8ab-868016569922 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 200 len: 1225 microversion: 2.1 time: 0.085688 Jul 27 21:02:17.554293 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2071/4158] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:02:17 2022] GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:02:18.575990 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a39f401b-88f6-4f49-bb79-7d5091f2f060 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:02:18.576694 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-a39f401b-88f6-4f49-bb79-7d5091f2f060 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 091f201c-5397-4be4-805e-17c6cabe27ed] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:02:18.582897 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a39f401b-88f6-4f49-bb79-7d5091f2f060 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:18.583355 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a39f401b-88f6-4f49-bb79-7d5091f2f060 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:18.584118 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a39f401b-88f6-4f49-bb79-7d5091f2f060 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:18.584561 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-a39f401b-88f6-4f49-bb79-7d5091f2f060 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:18.598104 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-a39f401b-88f6-4f49-bb79-7d5091f2f060 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] HTTP exception thrown: Instance 091f201c-5397-4be4-805e-17c6cabe27ed could not be found. Jul 27 21:02:18.599688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a39f401b-88f6-4f49-bb79-7d5091f2f060 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Request method failure captured: Jul 27 21:02:18.599688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed HTTP/1.1 Jul 27 21:02:18.599688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 21:02:18.599688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 21:02:18.599688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 21:02:18.599688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 21:02:18.599688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 21:02:18.599688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 21:02:18.599688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 21:02:18.599688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 21:02:18.599688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4aX-KFD9EgXLURpJbENnJJwOT82xpw2ijhy7cbDTNGRLiN1SgmJTC2Vu4LdOR4OhGek_HWlXJx7Q651nlP8LdO4InzbTmtvMcr0BUDtd62TV7SjCdBx6jVrit9mt4jBjVU6H7feDrBWXaqLoS782HwG9dmHmxAfTZyqTCS8qOOxhGxo Jul 27 21:02:18.599688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 21:02:18.599688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 21:02:18.599688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 21:02:18.599688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 21:02:18.599688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 21:02:18.599688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 21:02:18.599688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: c51423871031456a80da2d9d0c74bc62 Jul 27 21:02:18.599688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-TestVolumeBootPattern-580770462 Jul 27 21:02:18.599688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 21:02:18.599688 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 21:02:18.601140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c51423871031456a80da2d9d0c74bc62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c51423871031456a80da2d9d0c74bc62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c51423871031456a80da2d9d0c74bc62", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c51423871031456a80da2d9d0c74bc62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 21:02:18.601140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-TestVolumeBootPattern-580770462 Jul 27 21:02:18.601140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: c51423871031456a80da2d9d0c74bc62 Jul 27 21:02:18.601140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-TestVolumeBootPattern-580770462 Jul 27 21:02:18.601140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-TestVolumeBootPattern-580770462-project Jul 27 21:02:18.601140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 21:02:18.601140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 21:02:18.601140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: 060f4e9543a5456897d5217676cb93a6 Jul 27 21:02:18.601140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-TestVolumeBootPattern-580770462-project Jul 27 21:02:18.601140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 21:02:18.601140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Instance 091f201c-5397-4be4-805e-17c6cabe27ed could not be found. Jul 27 21:02:18.601140 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'id': '091f201c-5397-4be4-805e-17c6cabe27ed'} Jul 27 21:02:18.602007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 21:02:18.602007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 21:02:18.602007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 21:02:18.602007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 21:02:18.602007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 21:02:18.602007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 21:02:18.602007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 21:02:18.602007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 21:02:18.602007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 21:02:18.602007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 21:02:18.602007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 091f201c-5397-4be4-805e-17c6cabe27ed could not be found. Jul 27 21:02:18.602007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 21:02:18.602007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 21:02:18.602007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 21:02:18.602007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 21:02:18.602007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 21:02:18.602007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 21:02:18.602007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 21:02:18.602007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 21:02:18.602007 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 21:02:18.603448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 21:02:18.603448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 21:02:18.603448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 21:02:18.603448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 21:02:18.603448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 21:02:18.603448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 21:02:18.603448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 21:02:18.603448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 091f201c-5397-4be4-805e-17c6cabe27ed could not be found. Jul 27 21:02:18.603448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 21:02:18.603448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 21:02:18.603448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 21:02:18.603448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 21:02:18.603448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 21:02:18.603448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 21:02:18.603448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 21:02:18.603448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 21:02:18.603448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 091f201c-5397-4be4-805e-17c6cabe27ed could not be found. Jul 27 21:02:18.603448 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 21:02:18.605280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-a39f401b-88f6-4f49-bb79-7d5091f2f060 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Returning 404 to user: Instance 091f201c-5397-4be4-805e-17c6cabe27ed could not be found. {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 21:02:18.605280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-a39f401b-88f6-4f49-bb79-7d5091f2f060 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed" status: 404 len: 111 microversion: 2.1 time: 0.029807 Jul 27 21:02:18.605280 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2088/4159] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:02:18 2022] GET /compute/v2.1/servers/091f201c-5397-4be4-805e-17c6cabe27ed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 21:02:21.663512 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1e6b7b1d-2a0f-4d07-917b-c149c1e3e123 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:02:21.664205 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1e6b7b1d-2a0f-4d07-917b-c149c1e3e123 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: c4219e0b-e130-49d6-8b80-4f7b179fb299] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:02:21.672222 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1e6b7b1d-2a0f-4d07-917b-c149c1e3e123 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:21.672742 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1e6b7b1d-2a0f-4d07-917b-c149c1e3e123 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:21.673540 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1e6b7b1d-2a0f-4d07-917b-c149c1e3e123 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:21.673972 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1e6b7b1d-2a0f-4d07-917b-c149c1e3e123 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:21.703870 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1e6b7b1d-2a0f-4d07-917b-c149c1e3e123 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: c4219e0b-e130-49d6-8b80-4f7b179fb299] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 27 21:02:21.770983 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [req-d558b83e-93d1-4f0d-9ff8-492c6a1376a9 req-e23374c3-8615-4dc9-b1df-08bfe26fd36c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4219e0b-e130-49d6-8b80-4f7b179fb299", "tag": "05284f9a-fbdb-4b8f-939b-1d6b6a0f1b1e"}]} {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 21:02:21.790485 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-d558b83e-93d1-4f0d-9ff8-492c6a1376a9 req-e23374c3-8615-4dc9-b1df-08bfe26fd36c service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:21.790946 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [req-d558b83e-93d1-4f0d-9ff8-492c6a1376a9 req-e23374c3-8615-4dc9-b1df-08bfe26fd36c service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:21.792881 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1e6b7b1d-2a0f-4d07-917b-c149c1e3e123 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299" status: 204 len: 0 microversion: 2.1 time: 0.132917 Jul 27 21:02:21.793580 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2072/4160] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 21:02:21 2022] DELETE /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 27 21:02:21.802790 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2a306f96-8b89-468a-89d3-df20f0c0f9a6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:02:21.803503 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2a306f96-8b89-468a-89d3-df20f0c0f9a6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: c4219e0b-e130-49d6-8b80-4f7b179fb299] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:02:21.809884 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a306f96-8b89-468a-89d3-df20f0c0f9a6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:21.810342 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a306f96-8b89-468a-89d3-df20f0c0f9a6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:21.811119 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a306f96-8b89-468a-89d3-df20f0c0f9a6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:21.811569 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a306f96-8b89-468a-89d3-df20f0c0f9a6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:21.812514 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.compute.server_external_events [req-d558b83e-93d1-4f0d-9ff8-492c6a1376a9 req-e23374c3-8615-4dc9-b1df-08bfe26fd36c service nova] Creating event network-changed:05284f9a-fbdb-4b8f-939b-1d6b6a0f1b1e for instance c4219e0b-e130-49d6-8b80-4f7b179fb299 on hv-cinder-79987 Jul 27 21:02:21.819101 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [req-d558b83e-93d1-4f0d-9ff8-492c6a1376a9 req-e23374c3-8615-4dc9-b1df-08bfe26fd36c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158107 Jul 27 21:02:21.820047 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2089/4161] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 21:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 27 21:02:21.949651 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2a306f96-8b89-468a-89d3-df20f0c0f9a6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:02:21.957367 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2a306f96-8b89-468a-89d3-df20f0c0f9a6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299" status: 200 len: 1577 microversion: 2.1 time: 0.158930 Jul 27 21:02:21.957946 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2073/4162] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:02:21 2022] GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:02:22.981572 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-3f9e76e7-9595-4826-9de3-74e9ffd58785 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:02:22.983388 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-3f9e76e7-9595-4826-9de3-74e9ffd58785 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: c4219e0b-e130-49d6-8b80-4f7b179fb299] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:02:22.992936 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3f9e76e7-9595-4826-9de3-74e9ffd58785 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:22.993727 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3f9e76e7-9595-4826-9de3-74e9ffd58785 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:22.995022 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3f9e76e7-9595-4826-9de3-74e9ffd58785 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:22.996205 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-3f9e76e7-9595-4826-9de3-74e9ffd58785 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:23.150744 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-3f9e76e7-9595-4826-9de3-74e9ffd58785 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:02:23.158580 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-3f9e76e7-9595-4826-9de3-74e9ffd58785 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299" status: 200 len: 1577 microversion: 2.1 time: 0.182709 Jul 27 21:02:23.159157 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2090/4163] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:02:22 2022] GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299 => generated 1577 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:02:24.125613 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-c4fc9a92-35dc-4e83-92a2-15caf7303d6e req-7005b70d-bb2e-45e4-9652-ad2666d0f88e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4219e0b-e130-49d6-8b80-4f7b179fb299", "name": "network-vif-deleted", "tag": "05284f9a-fbdb-4b8f-939b-1d6b6a0f1b1e"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 27 21:02:24.135258 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-c4fc9a92-35dc-4e83-92a2-15caf7303d6e req-7005b70d-bb2e-45e4-9652-ad2666d0f88e service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:24.135692 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-c4fc9a92-35dc-4e83-92a2-15caf7303d6e req-7005b70d-bb2e-45e4-9652-ad2666d0f88e service nova] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:24.147279 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-c4fc9a92-35dc-4e83-92a2-15caf7303d6e req-7005b70d-bb2e-45e4-9652-ad2666d0f88e service nova] Creating event network-vif-deleted:05284f9a-fbdb-4b8f-939b-1d6b6a0f1b1e for instance c4219e0b-e130-49d6-8b80-4f7b179fb299 on hv-cinder-79987 Jul 27 21:02:24.152087 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-c4fc9a92-35dc-4e83-92a2-15caf7303d6e req-7005b70d-bb2e-45e4-9652-ad2666d0f88e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030181 Jul 27 21:02:24.152663 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2074/4164] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Jul 27 21:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 27 21:02:24.183532 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-63139426-0e5b-453b-812a-ba67677a766d tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:02:24.184215 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-63139426-0e5b-453b-812a-ba67677a766d tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: c4219e0b-e130-49d6-8b80-4f7b179fb299] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:02:24.190611 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63139426-0e5b-453b-812a-ba67677a766d tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:24.191058 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63139426-0e5b-453b-812a-ba67677a766d tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:24.191822 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63139426-0e5b-453b-812a-ba67677a766d tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:24.192268 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-63139426-0e5b-453b-812a-ba67677a766d tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:24.253927 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.policy [None req-63139426-0e5b-453b-812a-ba67677a766d tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060f4e9543a5456897d5217676cb93a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51423871031456a80da2d9d0c74bc62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117876) authorize /opt/stack/nova/nova/policy.py:199}} Jul 27 21:02:24.262511 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-63139426-0e5b-453b-812a-ba67677a766d tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299" status: 200 len: 1224 microversion: 2.1 time: 0.083355 Jul 27 21:02:24.263095 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2091/4165] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:02:24 2022] GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 27 21:02:25.284371 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4fa8a981-f002-4ace-a980-d339186ef71b tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:02:25.285102 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4fa8a981-f002-4ace-a980-d339186ef71b tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: c4219e0b-e130-49d6-8b80-4f7b179fb299] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:02:25.291582 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4fa8a981-f002-4ace-a980-d339186ef71b tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:25.292588 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4fa8a981-f002-4ace-a980-d339186ef71b tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:25.293483 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4fa8a981-f002-4ace-a980-d339186ef71b tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:25.293924 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4fa8a981-f002-4ace-a980-d339186ef71b tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:25.307022 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-4fa8a981-f002-4ace-a980-d339186ef71b tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] HTTP exception thrown: Instance c4219e0b-e130-49d6-8b80-4f7b179fb299 could not be found. Jul 27 21:02:25.309447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4fa8a981-f002-4ace-a980-d339186ef71b tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Request method failure captured: Jul 27 21:02:25.309447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299 HTTP/1.1 Jul 27 21:02:25.309447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 21:02:25.309447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 21:02:25.309447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 21:02:25.309447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 21:02:25.309447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 21:02:25.309447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 21:02:25.309447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 21:02:25.309447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 21:02:25.309447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4aX-KFD9EgXLURpJbENnJJwOT82xpw2ijhy7cbDTNGRLiN1SgmJTC2Vu4LdOR4OhGek_HWlXJx7Q651nlP8LdO4InzbTmtvMcr0BUDtd62TV7SjCdBx6jVrit9mt4jBjVU6H7feDrBWXaqLoS782HwG9dmHmxAfTZyqTCS8qOOxhGxo Jul 27 21:02:25.309447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 21:02:25.309447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 21:02:25.309447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 21:02:25.309447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 21:02:25.309447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 21:02:25.309447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 21:02:25.309447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: c51423871031456a80da2d9d0c74bc62 Jul 27 21:02:25.309447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-TestVolumeBootPattern-580770462 Jul 27 21:02:25.309447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 21:02:25.309447 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 21:02:25.310844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c51423871031456a80da2d9d0c74bc62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c51423871031456a80da2d9d0c74bc62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c51423871031456a80da2d9d0c74bc62", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c51423871031456a80da2d9d0c74bc62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 21:02:25.310844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-TestVolumeBootPattern-580770462 Jul 27 21:02:25.310844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: c51423871031456a80da2d9d0c74bc62 Jul 27 21:02:25.310844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-TestVolumeBootPattern-580770462 Jul 27 21:02:25.310844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-TestVolumeBootPattern-580770462-project Jul 27 21:02:25.310844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 21:02:25.310844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 21:02:25.310844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: 060f4e9543a5456897d5217676cb93a6 Jul 27 21:02:25.310844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-TestVolumeBootPattern-580770462-project Jul 27 21:02:25.310844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 21:02:25.310844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Instance c4219e0b-e130-49d6-8b80-4f7b179fb299 could not be found. Jul 27 21:02:25.310844 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'id': 'c4219e0b-e130-49d6-8b80-4f7b179fb299'} Jul 27 21:02:25.311597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 21:02:25.311597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 21:02:25.311597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 21:02:25.311597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 21:02:25.311597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 21:02:25.311597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 21:02:25.311597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 21:02:25.311597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 21:02:25.311597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 21:02:25.311597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 21:02:25.311597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4219e0b-e130-49d6-8b80-4f7b179fb299 could not be found. Jul 27 21:02:25.311597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 21:02:25.311597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 21:02:25.311597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 21:02:25.311597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 21:02:25.311597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 21:02:25.311597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 21:02:25.311597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 21:02:25.311597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 21:02:25.311597 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 21:02:25.312859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 21:02:25.312859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 21:02:25.312859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 21:02:25.312859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 21:02:25.312859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 21:02:25.312859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 21:02:25.312859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 21:02:25.312859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4219e0b-e130-49d6-8b80-4f7b179fb299 could not be found. Jul 27 21:02:25.312859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 21:02:25.312859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 21:02:25.312859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 21:02:25.312859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 21:02:25.312859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 21:02:25.312859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 21:02:25.312859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 21:02:25.312859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 21:02:25.312859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4219e0b-e130-49d6-8b80-4f7b179fb299 could not be found. Jul 27 21:02:25.312859 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 21:02:25.313998 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4fa8a981-f002-4ace-a980-d339186ef71b tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Returning 404 to user: Instance c4219e0b-e130-49d6-8b80-4f7b179fb299 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 21:02:25.313998 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4fa8a981-f002-4ace-a980-d339186ef71b tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299" status: 404 len: 111 microversion: 2.1 time: 0.031304 Jul 27 21:02:25.313998 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2075/4166] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:02:25 2022] GET /compute/v2.1/servers/c4219e0b-e130-49d6-8b80-4f7b179fb299 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 21:02:25.742925 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2438d436-76cd-40c1-8c49-536ababf08ad tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:02:25.743409 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.compute.api [None req-2438d436-76cd-40c1-8c49-536ababf08ad tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117876) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:02:25.750236 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2438d436-76cd-40c1-8c49-536ababf08ad tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:25.750690 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2438d436-76cd-40c1-8c49-536ababf08ad tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:25.751452 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2438d436-76cd-40c1-8c49-536ababf08ad tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:25.751892 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG oslo_concurrency.lockutils [None req-2438d436-76cd-40c1-8c49-536ababf08ad tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117876) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:25.765142 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.wsgi [None req-2438d436-76cd-40c1-8c49-536ababf08ad tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] HTTP exception thrown: Instance 1077c395-be7e-470e-b920-20e6115709bb could not be found. Jul 27 21:02:25.766773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2438d436-76cd-40c1-8c49-536ababf08ad tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Request method failure captured: Jul 27 21:02:25.766773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: request: DELETE /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb HTTP/1.1 Jul 27 21:02:25.766773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept: application/json Jul 27 21:02:25.766773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Accept-Encoding: identity Jul 27 21:02:25.766773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Connection: close Jul 27 21:02:25.766773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Length: 0 Jul 27 21:02:25.766773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Content-Type: application/json Jul 27 21:02:25.766773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Host: 10.222.0.65 Jul 27 21:02:25.766773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Openstack-System-Scope: None Jul 27 21:02:25.766773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: User-Agent: python-urllib3/1.26.10 Jul 27 21:02:25.766773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Auth-Token: gAAAAABi4aX-KFD9EgXLURpJbENnJJwOT82xpw2ijhy7cbDTNGRLiN1SgmJTC2Vu4LdOR4OhGek_HWlXJx7Q651nlP8LdO4InzbTmtvMcr0BUDtd62TV7SjCdBx6jVrit9mt4jBjVU6H7feDrBWXaqLoS782HwG9dmHmxAfTZyqTCS8qOOxhGxo Jul 27 21:02:25.766773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Id: None Jul 27 21:02:25.766773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Domain-Name: None Jul 27 21:02:25.766773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Identity-Status: Confirmed Jul 27 21:02:25.766773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Is-Admin-Project: True Jul 27 21:02:25.766773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Id: default Jul 27 21:02:25.766773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Domain-Name: Default Jul 27 21:02:25.766773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Id: c51423871031456a80da2d9d0c74bc62 Jul 27 21:02:25.766773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Project-Name: tempest-TestVolumeBootPattern-580770462 Jul 27 21:02:25.766773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Role: reader,member Jul 27 21:02:25.766773 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Roles: reader,member Jul 27 21:02:25.768252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c51423871031456a80da2d9d0c74bc62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c51423871031456a80da2d9d0c74bc62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c51423871031456a80da2d9d0c74bc62", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c51423871031456a80da2d9d0c74bc62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 21:02:25.768252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant: tempest-TestVolumeBootPattern-580770462 Jul 27 21:02:25.768252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Id: c51423871031456a80da2d9d0c74bc62 Jul 27 21:02:25.768252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-Tenant-Name: tempest-TestVolumeBootPattern-580770462 Jul 27 21:02:25.768252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User: tempest-TestVolumeBootPattern-580770462-project Jul 27 21:02:25.768252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Id: default Jul 27 21:02:25.768252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Domain-Name: Default Jul 27 21:02:25.768252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Id: 060f4e9543a5456897d5217676cb93a6 Jul 27 21:02:25.768252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: X-User-Name: tempest-TestVolumeBootPattern-580770462-project Jul 27 21:02:25.768252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: method: > Jul 27 21:02:25.768252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: exception: Instance 1077c395-be7e-470e-b920-20e6115709bb could not be found. Jul 27 21:02:25.768252 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: action_args: {'id': '1077c395-be7e-470e-b920-20e6115709bb'} Jul 27 21:02:25.769076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 21:02:25.769076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 21:02:25.769076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 21:02:25.769076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 21:02:25.769076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 21:02:25.769076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 21:02:25.769076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 21:02:25.769076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 21:02:25.769076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 21:02:25.769076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 21:02:25.769076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1077c395-be7e-470e-b920-20e6115709bb could not be found. Jul 27 21:02:25.769076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 21:02:25.769076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 21:02:25.769076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 21:02:25.769076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 21:02:25.769076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 21:02:25.769076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 21:02:25.769076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 21:02:25.769076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 21:02:25.769076 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 21:02:25.770344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 21:02:25.770344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 27 21:02:25.770344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 27 21:02:25.770344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 27 21:02:25.770344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 27 21:02:25.770344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 21:02:25.770344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 21:02:25.770344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 21:02:25.770344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 21:02:25.770344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1077c395-be7e-470e-b920-20e6115709bb could not be found. Jul 27 21:02:25.770344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 21:02:25.770344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 21:02:25.770344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 21:02:25.770344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 21:02:25.770344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 21:02:25.770344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 21:02:25.770344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 21:02:25.770344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 21:02:25.770344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1077c395-be7e-470e-b920-20e6115709bb could not be found. Jul 27 21:02:25.770344 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: ERROR nova.api.openstack.wsgi Jul 27 21:02:25.771601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-2438d436-76cd-40c1-8c49-536ababf08ad tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Returning 404 to user: Instance 1077c395-be7e-470e-b920-20e6115709bb could not be found. {{(pid=117876) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 21:02:25.771601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-2438d436-76cd-40c1-8c49-536ababf08ad tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "DELETE /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 404 len: 111 microversion: 2.1 time: 0.029060 Jul 27 21:02:25.771601 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2092/4167] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Jul 27 21:02:25 2022] DELETE /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 21:02:25.777130 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5d7546b3-aa5e-47cb-802a-7737b8f9d9c6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:02:25.777987 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5d7546b3-aa5e-47cb-802a-7737b8f9d9c6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] [instance: 1077c395-be7e-470e-b920-20e6115709bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 27 21:02:25.784112 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d7546b3-aa5e-47cb-802a-7737b8f9d9c6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:25.784563 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d7546b3-aa5e-47cb-802a-7737b8f9d9c6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:25.785355 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d7546b3-aa5e-47cb-802a-7737b8f9d9c6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 27 21:02:25.785794 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d7546b3-aa5e-47cb-802a-7737b8f9d9c6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Lock "9601e96c-4523-4233-9a0d-7b0bfdd5753a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 27 21:02:25.799416 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-5d7546b3-aa5e-47cb-802a-7737b8f9d9c6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] HTTP exception thrown: Instance 1077c395-be7e-470e-b920-20e6115709bb could not be found. Jul 27 21:02:25.800892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5d7546b3-aa5e-47cb-802a-7737b8f9d9c6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Request method failure captured: Jul 27 21:02:25.800892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb HTTP/1.1 Jul 27 21:02:25.800892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 27 21:02:25.800892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 27 21:02:25.800892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Connection: close Jul 27 21:02:25.800892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 27 21:02:25.800892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 27 21:02:25.800892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jul 27 21:02:25.800892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 27 21:02:25.800892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.10 Jul 27 21:02:25.800892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABi4aX-KFD9EgXLURpJbENnJJwOT82xpw2ijhy7cbDTNGRLiN1SgmJTC2Vu4LdOR4OhGek_HWlXJx7Q651nlP8LdO4InzbTmtvMcr0BUDtd62TV7SjCdBx6jVrit9mt4jBjVU6H7feDrBWXaqLoS782HwG9dmHmxAfTZyqTCS8qOOxhGxo Jul 27 21:02:25.800892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 27 21:02:25.800892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 27 21:02:25.800892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 27 21:02:25.800892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 27 21:02:25.800892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 27 21:02:25.800892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 27 21:02:25.800892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Id: c51423871031456a80da2d9d0c74bc62 Jul 27 21:02:25.800892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-TestVolumeBootPattern-580770462 Jul 27 21:02:25.800892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Role: reader,member Jul 27 21:02:25.800892 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Roles: reader,member Jul 27 21:02:25.802271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c51423871031456a80da2d9d0c74bc62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c51423871031456a80da2d9d0c74bc62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c51423871031456a80da2d9d0c74bc62", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c51423871031456a80da2d9d0c74bc62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jul 27 21:02:25.802271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-TestVolumeBootPattern-580770462 Jul 27 21:02:25.802271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Id: c51423871031456a80da2d9d0c74bc62 Jul 27 21:02:25.802271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-TestVolumeBootPattern-580770462 Jul 27 21:02:25.802271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User: tempest-TestVolumeBootPattern-580770462-project Jul 27 21:02:25.802271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 27 21:02:25.802271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 27 21:02:25.802271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Id: 060f4e9543a5456897d5217676cb93a6 Jul 27 21:02:25.802271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-TestVolumeBootPattern-580770462-project Jul 27 21:02:25.802271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: method: > Jul 27 21:02:25.802271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: exception: Instance 1077c395-be7e-470e-b920-20e6115709bb could not be found. Jul 27 21:02:25.802271 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: action_args: {'id': '1077c395-be7e-470e-b920-20e6115709bb'} Jul 27 21:02:25.803020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 27 21:02:25.803020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 21:02:25.803020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 27 21:02:25.803020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 27 21:02:25.803020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 27 21:02:25.803020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 27 21:02:25.803020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 27 21:02:25.803020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 27 21:02:25.803020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 27 21:02:25.803020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 27 21:02:25.803020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1077c395-be7e-470e-b920-20e6115709bb could not be found. Jul 27 21:02:25.803020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 21:02:25.803020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 21:02:25.803020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 21:02:25.803020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 21:02:25.803020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 21:02:25.803020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 21:02:25.803020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 27 21:02:25.803020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 27 21:02:25.803020 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 27 21:02:25.804234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 27 21:02:25.804234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 27 21:02:25.804234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 27 21:02:25.804234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 27 21:02:25.804234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 27 21:02:25.804234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 27 21:02:25.804234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 27 21:02:25.804234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1077c395-be7e-470e-b920-20e6115709bb could not be found. Jul 27 21:02:25.804234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 21:02:25.804234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 27 21:02:25.804234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 21:02:25.804234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 27 21:02:25.804234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 27 21:02:25.804234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 27 21:02:25.804234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 27 21:02:25.804234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 27 21:02:25.804234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1077c395-be7e-470e-b920-20e6115709bb could not be found. Jul 27 21:02:25.804234 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 27 21:02:25.805395 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5d7546b3-aa5e-47cb-802a-7737b8f9d9c6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Returning 404 to user: Instance 1077c395-be7e-470e-b920-20e6115709bb could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 27 21:02:25.805395 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5d7546b3-aa5e-47cb-802a-7737b8f9d9c6 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb" status: 404 len: 111 microversion: 2.1 time: 0.029489 Jul 27 21:02:25.805395 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2076/4168] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Jul 27 21:02:25 2022] GET /compute/v2.1/servers/1077c395-be7e-470e-b920-20e6115709bb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 27 21:02:27.095716 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: DEBUG nova.api.openstack.wsgi [None req-4de5a917-006a-4821-b558-0f851543b4c2 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] Calling method '.version_select at 0x7fc7eafe2e50>' {{(pid=117876) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 27 21:02:27.120430 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO nova.api.openstack.requestlog [None req-4de5a917-006a-4821-b558-0f851543b4c2 tempest-TestVolumeBootPattern-580770462 tempest-TestVolumeBootPattern-580770462-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-796992677" status: 202 len: 0 microversion: 2.1 time: 0.029287 Jul 27 21:02:27.124168 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: [pid: 117876|app: 0|req: 2093/4169] 10.222.0.65 () {58 vars in 1260 bytes} [Wed Jul 27 21:02:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-796992677 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 27 21:03:23.134254 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 21:03:23.134781 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 21:03:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 21:03:27.009765 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 21:03:27.010346 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 21:03:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 21:05:00.802559 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 21:05:00.803337 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 21:05:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 21:05:07.348353 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 21:05:07.348912 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 21:05:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 21:05:26.186309 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 21:05:26.186825 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 21:05:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 21:05:26.696154 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 21:05:26.696586 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 21:05:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 21:06:43.143837 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 21:06:43.144457 dv-cinder-799871-44-iscsi devstack@n-api.service[117877]: Wed Jul 27 21:06:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 27 21:06:47.018771 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 27 21:06:47.019327 dv-cinder-799871-44-iscsi devstack@n-api.service[117876]: Wed Jul 27 21:06:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!